I am working with VoiceRecognition module in C#. First thing, unlike the previous version it does not work with gesture any more. So EnableVoiceRecognition() and EnableGesture() can not be part of same pipeline. So I have written a separate thread and put voice recognition in that.
Both gesture and voice is working perfectly in sync without problem. But VoiceRecognition is blocking few resources. So I have reduced the polling and now everything is fine. I was about to submit the app when I noticed this typical problem of memory leak.
Once depth and voice streams are captured simultaneously, the module is leaking memory like hell. So the App memory is growing and growing. Thanks to C#'s garbage collector , after 700 MB, garbage is cleared. But that is hell lot of memory.
Is it permitted for the contest to write our own API for recognition? I have written a basic VoiceRecognition Module.
1. First I have enabled SpeechSynthesis and allowed it to speak all my commands.
2. I have captured the audio of these commands and have taken 1024 point FFT. Applied Silence removal and have applied hamming window. I have taken vector quantization and saved the coefficients.
3. I have activated audio capture and performing the same steps on each of the frames. To tell you, recognition accuracy is good over 68% with my technique than VoiceRecognition class which is failing to detect many important keywords like "Escape" "Stop" etc
Just wondering, if it is allowed to use our own API for recognition or do we have to strictly stick to SDK APIs?
Also there are other issues. Like with Audio recording, all frames are kept in the memory till you save. So using it with Gesture is another tough task. We can't capture audio for long if gesture is enabled.
All in all, the app is working the way it is expected to work. But those little optimization problem is killing system resources like battery and memory.
a) Stick to PerC APIs and let domo be "demo" only
b) Write our own methods to make these demos little "working apps".
eagerly waiting for a reply.