about parallel_scan

about parallel_scan

Is it a good idea to used a parallel_scan to parse a text file? For example, suppose you have a file where commands are given in the file to build a model but reading the file the wrong way would change the model. In this case would a parallel_scan be appropriate or would a pipeline be better or should I consider a comiation of both?

2 posts / 0 new
Last post
For more complete information about compiler optimizations, see our Optimization Notice.

If you can automatically synchronise if you land in an unpredictable file location, I can see how you might parse parts of a model on the first pass that you wouldn't have to look at again on the second pass. Have you searched for any publications about parallel parsing that might help you?

(Correction) If you wanted to apply parallel_scan, the second pass wouldn't seem very useful, only the joins, and perhaps some processing after parallel_scan has ended, or even repeated invocations. But I like the idea.

Leave a Comment

Please sign in to add a comment. Not a member? Join today