Today's casual photos are of Zhadnost: The People's Party (1995) from Studio 3DO for the 3DO, taken with the iPhone 3G. Zhadnost is a late-life 3DO title in the spirit of one my favorite videogame game shows, Twisted: The Game Show (Electronic Arts, 1993), also for the 3DO platform. Both titles use lots of wacky, high quality full-motion video (FMV) segments featuring a combination of live actors and stock footage. Twisted errs more on the trivia side of things, while Zhadnost errs more on the mini-game side of things, and features a very specific type of humor. Both titles are highlights on the 3DO platform, making excellent use of the platform's capabilities to overlay quality full motion video over pre-rendered backgrounds. The production values of both are also high, with just the right amount of wit. In short, they're great multiplayer party games and in a format where the use of oft-maligned FMV makes perfect sense, and something more modern day games should consider over often low quality and robotic 3D models. Thinking of these FMV video game shows made me think of the Philips CD-i platform, which was home to several such games, including a favorite of my family's, 3rd Degree (PF Magic, 1992), which had the unique feature of containing a database of pre-recorded (pre-spoken) names, so unless you had an unusual name, the game would actually refer to you by name in the game host's voice (not synthesized). If your name wasn't in the database, they had a selection of cutesy and nickname type of monikers to choose from as well. Definitely another feature that should be incorporated in more modern games. Anyway, here are the images of Zhadnost:
Comments
I think the key with
I think the key with simulated environments/people/whatever is that once you create it, it's in the database and can be reused to infinity. That's where the cost savings come in. With video footage, you need to take it again and again, because there's only so much stock footage you can use, and matching it up is an issue.
And I *don't* think getting away with low resolution or low quality video is an option, as even handheld devices have high resolution screens.
Books!
Bill Loguidice, Managing Director | Armchair Arcade, Inc.
Costs/Economies of Scale
I think you've identified the key obstacle. I think I've thought of a good analogy here:
Making a good FMV game is not like making a movie. It's like making an entire season of a TV show.
Thus, instead of 2 or even 3 hours worth of footage, you need 24-26 hours for a game. Of course, just like a TV show, a lot of that footage will be stock footage, recycled stuff, etc. There will be other cost cutting measures, too, such as filming on a set schedule and planning ahead so that a lot can get done. Also, I don't think it is necessary to have blu-ray quality here. Even if it were only the quality level of something like the Simpsons (before HD) or Star Trek: TNG, I think most people would be happy with it. In short, even though you can play through the game in, say, 4-6 hours, you probably need something like 3-5X that amount of footage to ensure lots of different choices can be made. Also, it is vital that we take the type of game and gameplay into consideration, and you could also "cheat" with CGI just like in real movies for special effects and what-not.
There is a point where the technology to simulate something might be more expensive than the actual thing. We definitely see that with photographs. Why hire a painter to meticulously render a scene, which might very well take days, weeks, or even months, when you can just snap a photo that will be more accurate and detailed than anything she could ever do? I get your point, though; if something can be automated, that is a cost-cutting measure.
The biggest argument against
The biggest argument against FMV - real people or cartoons - is one of cost. Games cost enough as it is, and to try and get Hollywood-level video production into games is probably asking too much. We only have to look at the awkward acting and the cardboard sets in the vast majority of FMV games to see how anything less can look as ludicrous as the worst 3D models. There's a reason why all mainstream animated movies for instance are all computer generated - besides the public showing a strong preference for the format - the associated costs are far less and the quality far greater than anything that could be achieved by hand. That's my point about synthesized everything being the future of gaming versus a return to some type of FMV. The key is to drive down costs and the only way to do that is to have as much done by the technology as possible.
Books!
Bill Loguidice, Managing Director | Armchair Arcade, Inc.
Fascinating but what about cartoons
Fascinating insights, Mark. I know it's all too tempting to adopt the knee-jerk response "FMV = bad" that so many of our fellow gamers will perhaps take to their graves, but I know exactly what you're talking about!
Again, I would point anyone truly interested in the nuances of this subject to read Prints and Visual Communication by William J. Ivins. It is almost eerie how similar the problems faced and overcome by print developers mirror those of today's game makers. For instance, there is a discussion of how the print houses became masters of certain aspects of representing reality, such as a shimmering surface that looked more like real water than some other print house. I equate this to certain problems in modern games, which may indeed have realistic looking water or flowing grass that gets a lot of publicity, but then you look at how awkwardly the characters move or how a certain line of dialog is repeated over and over and everyone just sort of accepts that as a limitation of the medium. If you look closely at the old prints of paintings, for instance, you will notice a certain abstraction for things like shading--perhaps a cross-hatching or some other technique that certainly wasn't in the original.
Until photography came along, hardly anyone could actually claim to have seen a famous painting, building, or the like. They were only seeing artistic representations, and often crude ones at that. I equate this to modern 3D graphics. No matter how many polygons or whatever you have, that's not the point. The point is that they are artistic representations. Indeed, a whole team of artists is standing between you and the object, and you are only seeing their combined efforts at a representation. Try to imagine what it would be like if you had never seen a sky filled with clouds, but only drawings of it. That's basically what we're dealing with in modern 3D animation. Until we can develop some type of technology to actually show us the clouds (with no artistic intervention), then we've made the next great leap in visual communication--not just in games but in human communication itself. For whereas movies can depict precisely that, they are static and discrete, whereas a game is dynamic.
Where is the future? I see it in something like Microsoft's photosynth. I quote a bit here from the description:
Again, I know most of us have the knee-jerk response to stuff like this, but I see great potential here for what I'm talking about. Just imagine, though, if instead of talking about photos we were talking about videos here. It's almost hard to grasp what this would be like, even, but a "videosynth" might be the way to go.
However, one factor missing from the discussion is cartoon animation. I recently went to see Up, one of Pixar's many computer-generated cartoons. There were plenty of people crying in the audience during that production. I personally had a strong reaction to watching The Secret of Nihm back when I was a kid.
Paradoxically, I think one reason these sorts of things work is that they are so abstract. They're not trying to show you something that looks indistinguishable from everyday life. Somehow, cartoon mice or a CGI boyscout can make us feel things that we just wouldn't feel if they were too distracted by how the artists had striven so hard to make them look realistic. I think that's because when someone tries that, you end up distracted because you are constantly searching for the cracks; the tell-tale indications of its fakeness. You are invited to look too hard. With a cartoon, though, (whether drawn or CGI), you aren't doing that because you know it's not trying to be realistic. A talking ogre or donkey can be "human" because we can let our imaginations run unhindered by that "hey--wait a minute" type response you get from something like the Final Fantasy movie you describe (and which I haven't seen).
Probably the best examples I can think of to illustrate this is Gollum in the Rings movies. As soon as that CGI character was on screen, I "dropped" out of the film and went into "hey--wait a minute" mode. Even though they had tried their best to make him look realistic, I could tell it was CGI and was unable to sustain my disbelief. On the other hand, a full CGI movie like Shrek never gave me that problem.
So, one possible solution might be to abandon realism and embrace cartoons--in my opinion, not enough games have taken this route. The Dig is one of my favorites that did--and that game definitely has cut scenes that can potentially make you cry. Of course, there is still much work to be done making cartoon-type animation flow fluidly and naturally in games, but it might be a viable approach. I definitely see progress being made in such projects like Facade, which do precisely what I'm talking about here--sacrifice realism, embrace a certain level of abstraction, and do a much better job depicting human feeling and emotion.
Disagree again
The thing that gets me is that people used to think the same thing about voice acting in games. There were so many efforts to synthesize speech and use that, since theoretically it would save tons of storage space. Once CD-ROM and DVD-ROM was widely available (as well as bigger hard drives and sound compression), many games began featuring full voice acting and little to no text. Synthesized speech in modern games is unheard of as far as I know.
Apples and oranges. Synthesized speech is still not to the point of a good voice actor, though someday it may be. It's very, very easy and relatively efficient to utilize real speech in games these days. The reason why synthesized speech was used in the past was simply because it was cost prohibitive to digitize speech both from a financial standpoint (sometimes thousands of dollars a word!) and from a storage standpoint, when you were talking K rather than MB.
It's all a matter of improvements. All the fuss about Amazon's Kindle being able to read books was for a reason - these people are afraid it will destroy the audio book industry. Of course if you actually LISTEN to how the Kindle reads book in its synthesized voice, you really at this point it's no match for a quality audio book production, particularly one with well-placed music and sound effects. Of course there's also nothing stopping from a future Kindle synthesizer having the ability to understand basic context and attempt some emotion, and also for book authors to put in certain cues for sound effects and music that the Kindle might be able to play from a basic database. It's not that far fetched. Anyway, the point is, just like with the versatile synthetic actors (unlimited actions/camera work) replacing limited FMV actors in games today, there's no reason why there can't be dynamic audio in games some day, meaning there is no pre-written, pre-recorded script. The software just uses some clever AI to speak on the fly, generating its own speech from clever algorithms.
My theory is that one day people will look back on these days of simulations and 3D animation the way we look back at speech synthesis today. Definitely worthwhile and interesting, but just not a viable substitute for real voice acting.
Quaint, but I see no evidence supporting that idea whatsoever.
You really notice something like this when you're playing Oblivion. Everything looks so realistic until you start dealing with people. They move unrealistically and the facial close-ups look downright cheesy. And this is an AAA title where all the stops were pulled. I think it'd be so much better if they had just gone with FMV as in some of the late 90s RPGs.
Oblivion couldn't be done with real actors. It would be a very different game. While it has flaws, by the very size of the game world, you need synthetic actors. They look good, but are certainly not perfect, but they WILL get better in the future. Just look at the leap in quality from 2002's Morrowind to 2006's Oblivion. That was just a single generation of hardware and a one game difference. What will the Elder Scrolls V be like in 2010 or 2011? Who knows? (though it may only be a "polish" leap, as it's still going to be for the same Xbox 360, PS3 and PC platforms)
Books!
Bill Loguidice, Managing Director | Armchair Arcade, Inc.
Humanlike robots / digital vs human acting
Replacing human actors all together?
Well human psychology may get in the way. Humans don't particularly respond favorably to 'real lifelike' robots and or avatars because there is 'something' missing. And the 'missing' part is cohesive body language. With synthetic actors it is 'emotional body language' that is askew or missing. The final fantasy movie was great but the body language and the integration of emotions was horrible despite the photographic realism that was achieved. Thus people didn't like it as much as the creators thought people would - and the public stayed away.
If such things are done properly - human psychology will NOT get in the way as much. With interactive avatars/robots increased acceptance can not be achieved by only focusing on language skills and AI.
With copying human body language it is possible to have humans respond more favorably to the lifelike avatars/robots. A nice trick for increased acceptance of interactive robots/avatars is to have the lifelike avatar/robot make the same body movements (head movements - are researched quite thoroughly) as the human opponent made but then with a 2 minute time lapse. For some reason the human short term memory will pick up on the movements - recognize the pattern subconsciously and the 'mirror neurons' (empathy neurons) in the brain will kick in and make the human feel more empathy toward the avatar and thus accept this robot more readily and even feel some sort of emotional connection with it.
In real life situations you can use this 'trick' of mimicking body language and posture to make your 'opponent' feel more at ease and respond favorably to you. But be careful - by overdoing it or timing it wrong you can achieve the opposite. People mimic postures all the time - it's the mirror neurons accountable for empathy that are at work here. It is a delicately fine-tuned system that is very very hard to fool though.
Synthetic actors will have to use captured human body language and facial expressions in order to display cohesive body language otherwise they just 'will not fly' and the movies will BOMB. Mind you - body language is very subtle and people respond to each other in a subtle way. So simply recording human movement and emotions in a library and using these 'stored' cohesive movement patterns and mapping them on the synthetic actors won't work as they need to respond to each other appropriately in order to have the public 'feel' the interaction. Each person is different in these subtleties. So even if you manage to capture and catalog all the movements of a single actor systematically and map them to some sort of emotional states so you can re-use those movements and expressions to create new scenes with a digital avatar - it will be very hard to make these avatars interact appropriately in a way that feels right.
Say you did something like this for Meg Ryan and Billy Christal - it will be virtually impossible the create the same sizzling scenes from the 'When Harry met Sally' just because the interaction will be askew as intricate interaction, timing and responses of the mirror-neurons typically for both actors just won't be there and it won't feel right.
It will take a long time to get this right - good (method) actors are better at it! So perhaps digital isn't better than analog actors. Method acting is in my opinion superior to any other form of acting as the actors are actually using the parts of their brains that would normally be used in the same 'real' situation.
Xbox 360: Lactobacillus P | Wii: 8151 3435 8469 3138
Armchair arcade Editor | Pixellator | www.markvergeer.nl
There have been many
There have been many articles on Gamasutra exploring human emotions and so on. The industry seems to share Bill's opinion that the future is synthetics and better simulations.
The thing that gets me is that people used to think the same thing about voice acting in games. There were so many efforts to synthesize speech and use that, since theoretically it would save tons of storage space. Once CD-ROM and DVD-ROM was widely available (as well as bigger hard drives and sound compression), many games began featuring full voice acting and little to no text. Synthesized speech in modern games is unheard of as far as I know.
My theory is that one day people will look back on these days of simulations and 3D animation the way we look back at speech synthesis today. Definitely worthwhile and interesting, but just not a viable substitute for real voice acting.
You really notice something like this when you're playing Oblivion. Everything looks so realistic until you start dealing with people. They move unrealistically and the facial close-ups look downright cheesy. And this is an AAA title where all the stops were pulled. I think it'd be so much better if they had just gone with FMV as in some of the late 90s RPGs.
Synthetic look on 3D synth actors
I must add that I actually prefer live actors in FMV scenes - like the acting in the Red Altert games. The 3D synth-actors have a fake look - no matter how advanced the pixel shading, textures and polygons used - and they will have a tougher job of drawing you into the story.
It's like the more photo-realism is approached the less attractive it feels, perhaps even scary. On a technological level it probably is amazing - just like the Milo demo on the 360. But in the end it may just be friggin' horrifying to most people. Motion pictures featuring synthetic actors will be very economical to make but hopefully will not be the substitute for real actors - and the ones made are not very successful unless they are purposefully cartoony in nature.
I am not sure where this all will go. But I will probably not like to watch synthetic actors all the time. I will be craving real human faces - flawed, slightly asymmetrical and everything else... I am not sure where this all will go.
Xbox 360: Lactobacillus P | Wii: 8151 3435 8469 3138
Armchair arcade Editor | Pixellator | www.markvergeer.nl
Yes, we're probably still
Yes, we're probably still waiting for the breakthrough that will make this easier and more economical. What you basically need is a way to take 3D video footage on-the-fly.
I gotta agree with Bill on this one.
We may very well see more FMV in videogames, since the technology to display it and interact with it is much better today than it was when FMV was first being pushed. That having been said, you're still dealing with video clips, which are inherently non-interactive, and thus not conducive to highly interactive videogaming. We see some hints of FMV being used to embellish otherwise fully-3D games, such as crowd scenes in sports games, but I can't imagine any FMV technology that wouldn't essentially be fancy "choose-your-own-adventure" type games.
On the other hand, 3D graphics are getting better and better in videogames, and I can easily see the day when photorealistic 3D characters in videogames become the norm, with actors digitally scanned in and replicated as a 3D models. Heck, they've been doing this for years in movie special effects, so I suspect that photoreal 3D characters will probably arrive in the next generation or two of videogame technology.
It's arguably possible NOW, since 3D graphics chips are capable of displaying millions of polygons a second as well as several layers of shaders, but if they did the character justice, there wouldn't be enough polygons to do much else (explosions, scenery, other characters, etc.). We're getting closer and closer, though, as evidenced by "Fight Night Round 4."
qoj hpmoj o+ 6uo73q 3Jv 3svq jnoh 77V
Post new comment