[With Faceware,] what happens to your face in the game when you take a drink or pick your nose?
TL;DRThe face capture mirrors whatever your face does, though tracking can drop when a hand covers it, so the team plans player-facing options like pausing capture and separate send and receive toggles.
Well, I got some funny stories from this, definitely, even when we were doing the screenshots. But I guess QA at Gamescom had some of the same problems. So somebody was chewing gum, and they had asked the Faceware representatives that we had there, what's wrong with the guy's face? He's just sitting there animating. And they're like, well, you're chewing gum. And the guy looks like he's chewing gum.
I had that when Forrest was working on the helmet lights. It was enabled, and he was eating a snack while he was working. I was like, what's going on with this guy's face? And he was like, oh, yeah, the guy's chewing. I was like, you're chewing.
So the answer is it does what your face is going to do. I mean, sometimes when you bring your hand up to scratch it or whatever, it'll lose the calibration, or lose the tracking anyways, for those few seconds. But basically, Gamescom was a really good thing, to get QA in front of it that hadn't really been specifically trained on it, because then we saw all the player-facing stuff that we absolutely need to put in, because they got in there and they can't just open the console and know, oh, here's all the CVars to adjust it and everything. So one of the big player-facing things is, yeah, pause. Stop capturing for a minute, I'm going to scream or I don't know. Maybe when it pauses, put it into an idle animation.
Yeah, it's essentially a mute. Basically it's a hit button.
But there's other options that we're talking about too. One, do I want to be sending? I could enable, disable that separately. Two, do I want to be receiving? That's something that will probably default to on, because most games will usually default their VoIP or those kind of systems to on at the first run, because you'll be walking around in the 'verse and you see a guy reacting, it's like, oh, what's that? I want to go enable that. But you don't necessarily want to enable the webcam capture right out of the gate. Because if somebody doesn't know about it... and we had this experience when somebody was kicking up their editor, their webcam was turning on, and they freaked out. They're like, who's watching me work? And I told them, I just want to see their faces, they're hitting different bugs, and I want to see the reaction as they work. That wasn't at all what it is. So we don't send the video data, of course. We just have these little tiny bits of data.