Simon
I installed it on case in ~/development/simon:
sudo apt-get install simon build-essential libx11-dev libasound2-dev
Then there's some bs thing you have to get behind a EULA, see development/simon/HTK. I stopped short of builing it. Some instructions.