Task: Process approximately 3 text files of 1 GB size and convert them to CSV file. Source files have a custom structure, so regular expression is useful.
Problem: There is no problem I use php for this and it's okay. I do not really need to process files fast enough. I'm just curious how you would cope with this problem in general. Finally, I want to see simple and convenient solutions that can work faster than php.
@felix, I am certain of this :) If I am working with the entire project then I will post it as cross language code ping pong.
@ Mark My approach currently works like this, with the exception that I cache a few hundred lines to write the file less writes a well thought out through the memory trade, maybe some time out Will be squeezed but I'm sure that by other means so far can beat php, like * full use of Nick Toolset.
Comments
Post a Comment