Dear Sir
 
 Thank you for your reply.
 
 Since you mention that RGB3 is not be used, I list the parameter for VPP and encoder for RGB4.
 
 Could you help me point out the error for distortion of small words:
 
mfxStatus RTKWidiVideoEncoder::Init()
{
    mfxStatus sts;
    mfxVideoParam encParams;
    mfxVideoParam vppParams;
    mfxExtCodingOption encExtCO;

    sts = CEncodingPipeline::Init();
    MSDK_CHECK_RESULT(sts, MFX_ERR_NONE, sts);

    MSDK_ZERO_MEMORY(encParams);
    MSDK_ZERO_MEMORY(vppParams);
    init_ext_buffer (encExtCO);

    encParams.mfx.CodecId            = MFX_CODEC_AVC;
    encParams.mfx.GopPicSize         = 60;
    encParams.mfx.GopRefDist         = 1; // IP-only for low-delay applications
    encParams.mfx.RateControlMethod  = MFX_RATECONTROL_VBR;
    encParams.mfx.TargetKbps         = 800; // in Kbps
    encParams.mfx.MaxKbps            = 2 * encParams.mfx.TargetKbps; // VBR: common practice is to cap at doubled average
    encParams.mfx.InitialDelayInKB   = 500 * encParams.mfx.TargetKbps / 8000; // CBR/VBR: 0.5s initial CPB delay
//  encParams.mfx.Accuracy           = 500; // AVBR: 50% rate fluctuation after convergence
//  encParams.mfx.Convergence        = 1; // AVBR: 100 frames to converge
    encParams.mfx.BufferSizeInKB     = 1000; // should be more than enough
    encParams.mfx.NumRefFrame        = 1;
  encParams.mfx.CodecProfile = MFX_PROFILE_AVC_BASELINE;

    ConvertFrameRate(60.,
   &encParams.mfx.FrameInfo.FrameRateExtN,
   &encParams.mfx.FrameInfo.FrameRateExtD);
    encParams.mfx.FrameInfo.FourCC       = MFX_FOURCC_NV12;
    encParams.mfx.FrameInfo.Width        = 352;
    encParams.mfx.FrameInfo.Height       = 288;
    encParams.mfx.FrameInfo.CropX        = 0;
    encParams.mfx.FrameInfo.CropY        = 0;
    encParams.mfx.FrameInfo.CropW        = encParams.mfx.FrameInfo.Width;
    encParams.mfx.FrameInfo.CropH        = encParams.mfx.FrameInfo.Height;
    encParams.mfx.FrameInfo.AspectRatioW = 1;
    encParams.mfx.FrameInfo.AspectRatioH = 1; // PC display always uses square samples
    encParams.mfx.FrameInfo.ChromaFormat = MFX_CHROMAFORMAT_YUV420;
    encParams.mfx.FrameInfo.PicStruct    = MFX_PICSTRUCT_PROGRESSIVE;

    switch (GetImplementation())
    {
        case MFX_IMPL_HARDWARE:

            m_mfxEncParams.mfx.TargetUsage = MFX_TARGETUSAGE_BEST_QUALITY;

            encExtCO.RateDistortionOpt = MFX_CODINGOPTION_ON;

            break;

        case MFX_IMPL_SOFTWARE:

            m_mfxEncParams.mfx.TargetUsage = MFX_TARGETUSAGE_BEST_SPEED;

            encExtCO.RateDistortionOpt = MFX_CODINGOPTION_OFF;

            break;

        default:

            m_mfxEncParams.mfx.TargetUsage = MFX_TARGETUSAGE_BALANCED;
            break;
    }

 // Try to encode fast currently now, please change it later.
 m_mfxEncParams.mfx.TargetUsage = MFX_TARGETUSAGE_BEST_SPEED;
 encExtCO.RateDistortionOpt = MFX_CODINGOPTION_OFF;
 
    encExtCO.MaxDecFrameBuffering = 1; // allow only one frame in the DPB to reduce decode latency

    // VPP output: same as Encoder input
    memcpy(&vppParams.vpp.Out, &encParams.mfx.FrameInfo, sizeof(mfxFrameInfo));

    // VPP input: same as VPP output except format
    memcpy(&vppParams.vpp.In, &vppParams.vpp.Out, sizeof(mfxFrameInfo));
    vppParams.vpp.In.FourCC = MFX_FOURCC_RGB4;

    sts = InitMfxEncParams(&encParams, &encExtCO);
    MSDK_CHECK_RESULT(sts, MFX_ERR_NONE, sts);

    sts = InitMfxVppParams(&vppParams);
    MSDK_CHECK_RESULT(sts, MFX_ERR_NONE, sts);

  sts = SetAsyncDepth(1);
    MSDK_CHECK_RESULT(sts, MFX_ERR_NONE, sts);

    return sts;
}

Dear Sir:

Thank you for your reply.

I attach 2 files in question.7z

1.driver.raw -> please use XnView to open, and for reading option, please select "interleave" and "BGR" to open the file.
                     -> Mirror driver put data in (pVirMonitor->pVideoMemory).
                         But I think it's not RGB32, because I only get 24 bit outof 32 bit in (pVirMonitor->pVideoMemory),
                         and can use BGR mode in XnView to open it correctly.
          // I got one frame and file out to driver.raw
          if(frame_counter == 500)
    {    
        if (encWidth == width)
        {
            for(i=0; i < width * height; i++)
                OUTFILE_->write((const char *)pVirMonitor->pVideoMemory + i*4, 3);
        }
        else
        {
            int j=0;
            for (i = 0 ; i < height ; i++)
            {
                for(j=0; j<width ; j++)
                    OUTFILE_->write((const char *)pVirMonitor->pVideoMemory + i * width * 4 + j * 4, 3);
            }
        }
    }                      
2.demo_video_memory2.mpg -> For data encoded, I file out the data after mux audio and video.
                                                       You can use VLC to open it.
                                                       And you will see that  small words in driver.raw is correct, but has distortion in  demo_video_memory2.mpg.

And all my machines in RGB4 mode will have this distortion issue.

If I set RGB3 instead of RGB4 for convertion to NV12, 5 machines won't have this distortion, but the other 2 machines will QueryIOSurf fail.
                                                                      

Dear Sir:

Thank you for your reply.

Yes, I saw the exact same thing using RGB4 for all my machines.

As for you mentioned "I suggest trying various encoder configurations", could you suggest some variables for me to try??

Dear Sir:

Thank you for your reply.

But the parameters you suggest don't work quiet well.

I change rate control mode from VBR to CQP even will cause serious mosaics.

Could you give me another suggest for RGB32 convert to NV12??

Or, now I use RGB24 convert to NV12, most of my notebooks can work very well (although you don't encourage using RGB3) but some will QueryIOSurf fail.

Could you suggest method to overcome QueryIOSurf fail so I can use RGB24 instead??