Sign on Options
Theme:
To Dark

Sony patents shape-shifting, emotion-sensing game tech

SCEA applications would cover new controllers, empathetic technology, and vibration add-ons.

Sony Computer Entertainment America wants to change the way people play games, and that's not just marketing speak. The PlayStation 3 maker has filed patent applications for a number of improvements and substitutions to the standard controller interface in recent years, going beyond the motion-sensing control setup revealed at E3.

The first controller designed for throwing?

The first controller designed for throwing?

One of the interfaces for which the company wants a patent is a "man-machine interface using a deformable device." The proposed system would allow gamers to use a squeezable object like a rubber ball as a substitute for a mouse. A camera hooked up to a game console would follow the ball's movements, and players could squeeze and move the ball as substitutes for a mouse click or click and drag.

The ball itself would not include any significant technology, although an internal clicking mechanism could provide tactile feedback to tell the user when a squeeze is sufficient for the system to pick up on it. While SCEA describes the technology in terms of games in its application, it does point out it could also be used to control TVs, DVD players, and even smart appliances.

SCEA is also seeking a patent for a completely controller-less technology, according to tech blog Siliconera. The site is reporting on a patent application from SCEA that would use a camera and microphone to assess noises, movements, and facial expressions made by users to determine their states of mind. For example, the technology would allow games to identify what makes a player laugh or become bored and then use that data perhaps to change the gameplay experience or simply garner more thorough feedback from users.

Apparently, Sony thinks force feedback is the future of games past.

Apparently, Sony thinks force feedback is the future of games past.

Finally, SCEA applied for a patent on a new force feedback device. Although it is described with a variety of uses, the add-on as described by the application would be used primarily to add haptic feedback (like rumble) to emulated software from older systems or to enhance it in more modern games.

Depicted as a plug-in to a PlayStation 3 controller, the add-on could include a microphone or camera and trigger rumble activity based on audio cues (tone, volume, duration of sounds) or video characteristics (color, brightness, saturation). It is unclear if Sony intended this for the DualShock, as well as the rumble-less Sixaxis.

"For example, a device… may use criteria to recognize a sound generated by a video game that is indicative of the 'clop-clop' of a horse's hooves," the application states. "Whenever a video game plays such audio, the device… recognizes the audio and inserts corresponding haptics, such as, for example, a rumble in concert with each 'clop.'"

Sony's system could add rumble to games that never had it or replace it with video effects in those that did.

Sony's system could add rumble to games that never had it or replace it with video effects in those that did.

The device could also be used with games that already have rumble functionality. For instance, it could intercept a signal to rumble the controller and instead have the system shake the video screen, temporarily change the hue of the picture, or increase the audio signal to a user's subwoofer. Users would be able to set their preferences as to how the add-on would redirect or enhance the existing rumble functionality of older games.

Given that the add-on would be a way to go back and add rumble and other effects to games that never featured them previously, the application follows that line of thought to its commercial conclusion.

"In some implementations, it is desirable for an emulator to augment an executed game by adding audio and/or video information during game play," the patent reads. "For example, the emulator may add product placements, modify product placements, add informational displays, and the like."

237 Comments

  • shani_boy101

    Posted Aug 20, 2009 3:26 am GMT

    sounds cool, but the only thing i'm interested in is the thought of playing God of War with motion controls, that'd be freaking epic!

  • maverick_76

    Posted Aug 19, 2009 2:03 pm GMT

    Seem like some cool stuff, but I have to admit they seem a little gimmicky.

  • kwanzudood

    Posted Aug 19, 2009 6:49 am GMT

    "In some implementations, it is desirable for an emulator to augment an executed game by adding audio and/or video information during game play," the patent reads. "For example, the emulator may add product placements, modify product placements, add informational displays, and the like." i thought the other new features sounded cool but this part just made me think like "oh, so that's why they're doing it."

  • X-RS

    Posted Aug 18, 2009 10:22 pm GMT

    how about a squeezy controller to perfectly match gamers hands?

  • enix165

    Posted Aug 18, 2009 3:22 pm GMT

    Dear lord, enough with this "innovation" stuff. =/ I'm completely happy with just using buttons. Video games are for playing, not for creating pricey gimmicks about! Gah!

  • zaprct

    Posted Aug 18, 2009 1:55 pm GMT

    I always look sad so I don't want things like games to ease up on me when I play...or for the developers to think I'm not having a good time.

    *sob*

  • deathknight107

    Posted Aug 18, 2009 12:43 pm GMT

    The emotion idea actually sounds more plausible

  • shawn7324

    Posted Aug 18, 2009 11:43 am GMT

    Still not interested in these type of things.

  • superwiiman

    Posted Aug 18, 2009 11:33 am GMT

    Haha it was confirmed yesterday that a xbox 360 has a failure rate of 54.2% instead of 33%. it doesn't look like a good day for 360 fanboys xD

  • TTDog

    Posted Aug 18, 2009 11:32 am GMT

    Window-Licking Good!

  • mrbo69jangles

    Posted Aug 18, 2009 11:03 am GMT

    Ok for now on people need to realize that when you say "im not a fanboy but..." doesn't mean you can say whatever you want without worrying about being a fanboy.

  • Valacan

    Posted Aug 18, 2009 10:57 am GMT

    Ohhh emotion sensing, that's a good idea. However, they're going to have to come up with more games that have plot good enough to make me get emotional first.

  • gladin09

    Posted Aug 18, 2009 10:34 am GMT

    Its good that every1 copys eachother because it always ends up with somthing totally new.

  • deathxxshark

    Posted Aug 18, 2009 10:15 am GMT

    I agree with TevoxZi...

  • Kiaininja

    Posted Aug 18, 2009 10:14 am GMT

    I like the 'emotion sensing' idea, it can evolutionize gameplay. Just imagine if you were playing a fighing game and the system sensed you were frustrated playing and can adjust by easing up on the attacks, or push more on the combos if it sensed you were getting bored. No more complaing about if easy mode is to hard or hard mode is to easy because it would adapt to your mode.

  • LocustWarlord

    Posted Aug 18, 2009 10:07 am GMT

    sony. f**k the 'motion sensing' crap! leave that to nintendo! im not being a fanboy but seriously, you need some better games!

  • solidstein

    Posted Aug 18, 2009 10:00 am GMT

    lol these are patents and prototypes do u no how many patents MS and SOny file that they never ever use they sometimes do it so that there compeitor wont be able to get the technology i think thats a good idea thought 1:1 ration on movement is way more precise then anything out there and for FPS the mouse and keyboard is still the most precise controller out

  • 9mmSpliff

    Posted Aug 18, 2009 9:40 am GMT

    why are people upset, they never sid you had to buy it or was it going to be the only way to play on a PS

  • monco59

    Posted Aug 18, 2009 9:29 am GMT

    These patent applications are getting more ridiculous by the day. Seriously, a squeezable rubber ball?

  • fauljosh

    Posted Aug 18, 2009 9:20 am GMT

    I really need to start filing patents.....

  • Halloll

    Posted Aug 18, 2009 9:18 am GMT

    No squeezable ducks!
    No!

  • hannify

    Posted Aug 18, 2009 9:07 am GMT

    *yawn*

  • Riverwolf007 posted Aug 18, 2009 9:06 am GMT (does not meet display criteria. sign in to show)

    Riverwolf007

    Posted Aug 18, 2009 9:06 am GMT (hide)

    like the ps3 the ps4 will disappoint you only now it will know it and get all depressed

  • Autolycus

    Posted Aug 18, 2009 9:03 am GMT

    wow, I think Sony knows they are in trouble with the Wii and Project Natal, these patents actually seem out of date already... I am not being a fanboy I am simply saying, this isn't enough for Sony to get back into PS2 days. I don't think that's ever going to happen again with any console manufacturer (though the wii did a pretty good job, minus developer support)

  • TheCaveRat

    Posted Aug 18, 2009 8:58 am GMT

    I really hope motion sensing, emotion sensing, and inflatable horses are NOT the future of gaming.

  • Ares_hot

    Posted Aug 18, 2009 8:56 am GMT

    I hate that todays console market has become so gimmicie-centric, just give us better controls, not that motion sensor, touchscreeen, natal bullsh*t. Sony should release a control better suited for FPSs because the one they use now is not well suited for that.

  • Amir29

    Posted Aug 18, 2009 8:42 am GMT

    Just add this to the slew of other published patents by Sony that I am surprised was not mentioned here. Recently, Sony had also patented video and music streaming over a social network (ie: Playstation Home) and also a PS2 emulator to be released via firmware update. Nothing displayed above really excites me. I mean, CMON!! A ball that behaves as a mouse? Is this thing supposed to relieve stress as we move in and out of games and apps?

  • tupperliam

    Posted Aug 18, 2009 8:41 am GMT

    Obviously people are jumping the panic button with the controllers. You don't have to buy the new controllers just like i never bought a new rumble six axis controller. There not going to force you to play with motion sensing and motion sensing isn't a work out at all. If you honestly think that moving your arms is a work out and then damn I hope you didn't strain your self working with the key board. If you want to play with a controller I can almost guarantee you will still be able to and for those who want to play with motion control, there will be games designed for it, but motion controls are no were close to working out. And yeah you could do alot of the motion controls but can you go golfing at pebble beach for $60? Yeah didn't think so. Can you work out and unlock a trophy for it? No. We play games so we can win and lock special content. That's what drives me to play games and thats what makes it fun, unlocking content. So chill on the controllers.

  • Warren360x1

    Posted Aug 18, 2009 8:15 am GMT

    @theoldalfer.........haha fandouchers thats quite possibly the funniest thing ever, and the only decent comment on here, who cares about this crap,ill look when it actually comes out

  • -Russ93

    Posted Aug 18, 2009 8:02 am GMT

    hey it's better than Nintendo's "Inflatable horse peripheral"

  • DJFMBEN

    Posted Aug 18, 2009 7:58 am GMT

    I dont get it :0

  • cparker2510

    Posted Aug 18, 2009 7:54 am GMT

    @ coolmayur001

    if you want to make an argument, try to a) appear literate and b) check your statistics. killzone 2 uses up to 60% of the PS3's power...still an impressive figure, and more honest than 40%.

  • Phazevariance

    Posted Aug 18, 2009 7:37 am GMT

    I love how all the major gaming companies make hundreds of patents and never develop most of the stuff... this way no one else can manufacture the product, and then the products are forever locked and never made. Such a stupid method.

  • SicklySunStorm

    Posted Aug 18, 2009 7:28 am GMT

    They filed patents, but no solid 100% "this will be in your next controller" ideas. Developers must do this constantly and have countless ideas never, ever used. I suspect 99% of the ones above will be in this category.

    I'm with you edthethinker. If I can hit a d-pad or push a stick along with clicking a button or squeezing a trigger, that's all we need. If you want to pretend your throwing a ball playing a madden game, go into your backyard and throw a ball or something

  • theoldalfer posted Aug 18, 2009 7:24 am GMT (does not meet display criteria. sign in to show)

    theoldalfer

    Posted Aug 18, 2009 7:24 am GMT (hide)

    Playstation fandouchers make me sick, and I happen to have a PS3.

  • HavQ-san

    Posted Aug 18, 2009 7:24 am GMT

    @UnknownForm:

    Exactly.

    Why make us forcibly play "health-improving" games when we can go outside or to the gym whenever we want to, if we want to? Games are usually played for fun, not health, but the folks at Nintendo (and now Sony and MS are beginning to) think that fun and workout are the same thing.

  • edthetinker

    Posted Aug 18, 2009 7:20 am GMT

    I just like normal controllers.

  • UnknownForm

    Posted Aug 18, 2009 7:20 am GMT

    What Sony and Microsoft are really trying to do with there new controllers(Sony) and motion sencenceing camera(Microsoft) is try to attract the buyers of the Wii;moms,youth,the old,etc. to buy there consoles.But to me,honestly you can go outside and do everything the Wii's gimmicky games does.But the big three in gaming just want your money,that's why there coming out with these gimmicks and such...

  • kujajonjo

    Posted Aug 18, 2009 7:13 am GMT

    @warrior swan
    haaaaa i geddit

  • Warrior_Swan

    Posted Aug 18, 2009 7:06 am GMT

    Wait a minute, you have to use your hands? That's a baby toy!

  • lee1823

    Posted Aug 18, 2009 6:54 am GMT

    just a thought... i wonder what virtual reality would be like nowadays if it was developed?

    motion controls really dont bother me.... but in a virtual world - with todays graphics quality?

    mmmmm

    just food for thought.

  • HavQ-san

    Posted Aug 18, 2009 6:53 am GMT

    To be honest, I don't want to change the way I play games. Sony and Microsoft, stop making new motion controllers, please. I like the standard controller and if you try to change it, I'm out of here. I bought a PS3 so that I wouldn't have to play my games waving my arms like with the Wii - not because I'm lazy, but because games were meant to be played with a controller. Screw "making gamers exercise", and screw forcibly changing the way we like to play.

  • lee1823

    Posted Aug 18, 2009 6:51 am GMT

    what a big bag of really un-exciting cack...

    and yes... i own a ps3.... and a wii.... and a 360

    and i love em all for their own unique qualities....

    cant understand people arguing over motion sensing tech..... and above all.

    A SQUIDGY MOUSE!

    i'm off to play siren.... with a perfectly good controller.

  • EYE0NE

    Posted Aug 18, 2009 6:49 am GMT

    I was excited about Natal for awhile. But now I don't care about any of this stuff. Just give me a controller and hold off on the motion stuff until you perfect the Holo-Deck.

  • Jimminyfixit

    Posted Aug 18, 2009 6:39 am GMT

    Actually it was 60% of PS3 power from the SPU's - which still isn't bad but you're forgetting the GPU limits. The Cell processor is very powerful but it is let down by the GPU's limited 256Mb of memory.

    If it was true and Killzone 2 was only using 60% of the overall PS3 power then why didn't they use the extra power for higher resolution seeing as the game only runs at 720p :-)

    Apparently the Xenon (360) and Cell CPU's are quite evenly matched so you can't really rule out the 360 just yet. The PS3 Cell chip has 1 PowerPC core (Big Daddy) with multiple SPU's (little sisters).

    However, the 360 has 3 PowerPC cores with dual threads each.

    But really if you want real power you can boast about then don't be so cheap. Go and buy a PC!

  • Deathmobarez

    Posted Aug 18, 2009 6:38 am GMT

    Amagawd, Sony are space aliens from the future who are pouring awesome tech on us. I was starting to wonder why the PS3 is so awesome. =D

Subscribe to GameSpot's YouTube Channel

Hot Stories

Newsmakers

Featured Stories

Submit News

Got tips? Send them in!