Activision R&D Character Demo in Real Time
Check out this character demo from Activision's R&D team.
Everything looks great, except where the lips meet, the teeth, and the inside of the mouth. Obviously the lip sync is crap. I feel like LA Noire set the bar for lip syncing and that the other major studios should at least be attempting this too.
Everything looks great apart from the lip-sync when the character is talking. The mouth just doesn't have enough movement going on. I think maybe what's happening here is the tech is just trying to move in time with what's being said without considering what vowels and consonants are maybe most important in each of the words for matching the main key-frames of the mouth animation to. They should be ignoring any words and sounds that don't move the lips much and make sure to pick up any words and sounds that normally make this lips move a lot and the mouth open most and then make sure those shapes are always picked up by their mouth animation system. Otherwise it just doesn't look quite right.
@inferna_hermit this is activision tech. they used same data for their demo. this runs at 180 fps in a Geforce GTX 680
@amaneuvering Which is weird because the stuff that nVidia showed of this was really good about that. I wonder if the angles and the lighting are making it difficult to notice that stuff.