Strange phenomenon occurs when I am doing pipeline with harddisc reading.
There are two filters inthe pipeline: The first filter thatsetted to be serial,reads in a piece of data with size of2M from file on harddisc; and the second filter is set to be non-serial,recieve the data chunk and performs some heavy computational operatons on them. There are roughly 80 pieces of data to be processed in total. And the input file are always the same, it is never modified, nor moved from one path to another.
I make some timing on the two filters. Generally, both of eachfilter spend about 0.4~0.6 second on handling one piece of data. However, in some cases, the first reading filter consumes more than 10 seconds to read a piece of data, and concurrently the second computing filter consumes more than 1 second, which is abnormal. These unusual time consumption occurs unpredictably, and continuous with serveral piece of data.
Is this related to the hard-disc swapping behavior? Could anybody give an explaination in detail?
Ubuntu with kernel 184.108.40.206
One2-Core CPU, 2.33Ghz 2048k Cache
Ext2 File system. 2G Mem, 4G swap.