P0-MS2: Part 151: AI: Speech to Text, Text to Speech, Morph 3D Character System

I have mostly finished adding the MCS male character to my existing character controller.

It took some time to figure out how I wanted to implement it. I eventually decided to parent the MCS model to my character, and rotate it on its local y axis as the player turns.

I decided not to mount the camera to the MCS model, since doing this caused it to bob up and down as the character walked, which, while probably realistic, looked jarring.

I do mount the camera to the MCS model when the player performs and action, however, so that the camera moves with the players body as they sit, lie down etc. The difficult part was aligning the player prefab, the camera, and the MCS model properly with the object the player is interacting with. I had to use some default offset values, which won’t work if the position of the object changes, but the basic interaction system works.

The next goal will be to implement Text to speech, and Lip syncing support for my MCS characters. I will most likely use RT-Voice for Text to speech, and Salsa for the lipsyncing, since both of these support MCS out of the box.

Once this is done, I have just a few more minor features to add in, and I will then just need to debug and optimise my codebase, and I should be done with MS2.