Teradata Spool issue in Recursive issue - response (13) by Raja_KT

You have not told about the tool that reads real time data. In SAP DS for example, reading from wsdl, you can reformat the data in anyway you want and can load to target.
If you are using Ab Initio, you can read through nested dmls and  reformat in anyway you want.
Again using unix, sed, awk and even normal read line will allow you to extract parts of each line and load again to file, using for loop.
Good luck,