Voice recognition for increased immersion
Posted: Thu Sep 06, 2012 1:05 pm
I grew up with adventure games. This was back before point and click adventure games and well before dialogue selection. Back then you would type stuff like "Look at rock" instead of clicking on a rock and selecting look or some such thing. You would also type your own dialogue. I miss the freedom that you had in those days, even if that freedom was something of an illusion. Nowadays we select the text we want our character to say. It will probably be this way for a while. Since I'm stuck here for a few more years waiting for the AI to get better I was thinking of a way to add immersion to dialogue selection when used in a VR setting with something like the Rift.
Natural language processing has actually gotten fairly good, but not good enough to recognize and parse any given dialogue you could dream up. I think it is good enough to detect a dialogue option, however. I think it would be nice for a player to have the option to speak their dialogue selection rather than select it with a mouse click. The NLP can detect which dialogue option was selected and the NPC can respond accordingly. Non roleplaying types might enjoy this as well as it will add to the immersion factor, even if you don't want to "act" out the line.
Anything that takes away mouse clicks is going to add immersion to the VR experience. Once a game is designed with NLP you open up gameplay possibilities as well.
Some thoughts:
Initiating dialogue by saying a characters name or keywords such as "excuse me" while looking at the character within a certain proximity.
Triggers for spells and specialized actions.
Taking control of units/characters in RTS by calling out names.
Pulling up menus.
Getting a zombie's attention by shouting "Hey, stink face!" at it.
Whistling to attract the attention of a guard.
Reality check:
Playing a game in this way could be moderately embarassing if you have your wife/husband/girlfriend/parents/whoever are within earshot. Especially if you're trying to sex up an elf.
I have nothing to offer in terms of programming, just wanted to share my thoughts.
Natural language processing has actually gotten fairly good, but not good enough to recognize and parse any given dialogue you could dream up. I think it is good enough to detect a dialogue option, however. I think it would be nice for a player to have the option to speak their dialogue selection rather than select it with a mouse click. The NLP can detect which dialogue option was selected and the NPC can respond accordingly. Non roleplaying types might enjoy this as well as it will add to the immersion factor, even if you don't want to "act" out the line.
Anything that takes away mouse clicks is going to add immersion to the VR experience. Once a game is designed with NLP you open up gameplay possibilities as well.
Some thoughts:
Initiating dialogue by saying a characters name or keywords such as "excuse me" while looking at the character within a certain proximity.
Triggers for spells and specialized actions.
Taking control of units/characters in RTS by calling out names.
Pulling up menus.
Getting a zombie's attention by shouting "Hey, stink face!" at it.
Whistling to attract the attention of a guard.
Reality check:
Playing a game in this way could be moderately embarassing if you have your wife/husband/girlfriend/parents/whoever are within earshot. Especially if you're trying to sex up an elf.
I have nothing to offer in terms of programming, just wanted to share my thoughts.