I'm trying to use the Media SDK 2012 to construct a low-latency display of an rtp stream. As a first cut, I have a DirectShow RTP filter that takes the RTP stream and converts it to an Annex B bytestream. I then connect this filter to the Intel H264 Decoder and then to EVR or VMR9. This all works, i.e. I can see the video screen in the EVR window. The problem I am having is that the latency on the H264 decode is ~1s. I've modified the decoder filter code to set AsyncDepth=1 and set MFX_BITSTREAM_COMPLETE_FRAME on the bitstream, with no apparent effect. The RTP filter is passing entire NALs to the encoder.
My development machine is a dual Xeon with an NVidia GPU, so it appears that the Media SDK is doing no hardware acceleration at all. Nevertheless, the latency is surprisingly high. Is this a reasonable latency number when decoding without hardware acceleration?
The stream I am decoding is 640 x 480 @15fps constrained to 1Mbit/s.