GameSpot may receive revenue from affiliate and advertising partnerships for sharing this content and from purchases through links.

Kinect connected to Roomba cousin

MIT student links Microsoft's motion-sensing camera to iRobot, uses it for 3D mapping, gesture command.

125 Comments
No Caption Provided

Having already been unlocked by software enthusiasts, the Kinect camera is now finding even more uses outside of gaming. Tech blog Singularity Hub reports that Philipp Robbel, a student at MIT's Personal Robotics Group, managed to connect Microsoft's motion-sensing camera to an iRobot Create, a small robot used by educational systems. The circular device resembles its more familiar cousin, the Roomba robotic vacuum found in many homes.

Image credit: Singularity Hub.
Image credit: Singularity Hub.

Using open-source simultaneous localization and mapping (SLAM) code on a wirelessly connected PC, Robbel managed to connect the Kinect's 3D camera to have it make a 3D map of the surrounding area. He also managed to get the robot to recognize the human form and even follow command gestures. In a demonstration video (see below), he directs the iRobot with a wave of his arm.

Robbel's Ph.D. dissertation at MIT is to create a team of robots, which could find missing or trapped people after a disaster. Though the iRobot would not be ideal for uneven terrain, he believes the 3D mapping could provide a map for a group of small quadrotor flying robots to investigate, and that the gesture recognition would allow one trapped person to direct the robot to another.

Got a news tip or want to contact us directly? Email news@gamespot.com

Join the conversation
There are 125 comments about this story
125 Comments  RefreshSorted By 
GameSpot has a zero tolerance policy when it comes to toxic conduct in comments. Any abusive, racist, sexist, threatening, bullying, vulgar, and otherwise objectionable behavior will result in moderation and/or account termination. Please keep your discussion civil.

Avatar image for D3thN1gh7
D3thN1gh7

351

Forum Posts

0

Wiki Points

0

Followers

Reviews: 5

User Lists: 0

Wow that is pretty amazing. Can't wait to see how this evolves.

Upvote • 
Avatar image for cf_Kage
cf_Kage

114

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

@Blue-Sky I believe the fact the Kinect has a set of 3D cameras really does make all the difference in this kind of environment

Upvote • 
Avatar image for CPM_basic
CPM_basic

4247

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

This guy at MIT should make an ultimate Roomba Vacuum that see where it's going. Cash in.

Upvote • 
Avatar image for legonz
legonz

25

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

Now this is awesome... hope to see more of this...

Upvote • 
Avatar image for GotRustyB
GotRustyB

50

Forum Posts

0

Wiki Points

0

Followers

Reviews: 16

User Lists: 0

@hordaak I've actually heard that the lag isn't as bad on the newer model of 360, which makes sense.

Upvote • 
Avatar image for CaptainIcy
CaptainIcy

53

Forum Posts

0

Wiki Points

0

Followers

Reviews: 3

User Lists: 0

Wow this is cool. =D

Upvote • 
Avatar image for hordaak
hordaak

177

Forum Posts

0

Wiki Points

0

Followers

Reviews: 3

User Lists: 0

@majere613- Honestly I dont think the kinect was made to replace the 360 controller. It is meant for a different type of game. After playing the sports games, specifically volleyball, I understood what the possibilities were. I had to squat and use both arms to bump the volleyball. I used both arms and pushed up to set. then I jumped up and swung my arms to spike the ball. It felt natural, it was fun as heck. now, if I were going to play gears of war, I wouldnt use the kinnect. I would use the standard controller. each has its own place. They (MS) didnt say it was going to replace the standard controller with the kinect, and if a game tries to do that, then it would fail. however, It goes beyond the move (which i own) and the wii controls. for example bowling. On the kinect, you just naturally throw the ball like in real bowling. for both the kinect and move, you have to push a button. in archery, i had to buy two dild_o_s-err controllers to shoot the arrow. im just saying that it is awesome for gaming control. does it have lag? sure it does. but the lag isnt as bad as people say and its still fun. Its just a new direction for gaming. is it for everybody? no its not. but to each their own. if you dont like it, dont buy it.

Upvote • 
Avatar image for lavaar
lavaar

39

Forum Posts

0

Wiki Points

0

Followers

Reviews: 8

User Lists: 0

Dear Microsoft, I love you.

Upvote • 
Avatar image for Blitz_Kill
Blitz_Kill

55

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

Hmmm, a Kinect system connected to a Roomba vaccuum.... guess it really does "suck" XD

Upvote • 
Avatar image for Megavideogamer
Megavideogamer

6554

Forum Posts

0

Wiki Points

0

Followers

Reviews: 12

User Lists: 0

They should have a nationwide contest. Find the most creative way to use Kinect in a non gaming way until better games arrive. MS could offer a 10 million dollar reward. So that kinect will not become the virtual boy for MS?

Upvote • 
Avatar image for dwithrow
dwithrow

35

Forum Posts

0

Wiki Points

0

Followers

Reviews: 70

User Lists: 0

at least something good has come out of the Kinect so far

Upvote • 
Avatar image for prioritymail
prioritymail

1609

Forum Posts

0

Wiki Points

0

Followers

Reviews: 10

User Lists: 0

This is just awesome beyond all comprehension.

Upvote • 
Avatar image for deviant74
deviant74

250

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

I just want my R2D2 to get me a beer. Putout a fire, and maybe defibrillat me since I won't be get off the couch anymore.

Upvote • 
Avatar image for gamerpipe
gamerpipe

993

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Sweat. finally we can say "xbox pick my socks"

Upvote • 
Avatar image for NathanWootton
NathanWootton

28

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

this is where it all begins

Upvote • 
Avatar image for fmacraze
fmacraze

5658

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

craaaazy

Upvote • 
Avatar image for majere613
majere613

719

Forum Posts

0

Wiki Points

0

Followers

Reviews: 6

User Lists: 0

@hordaak - first, a quick reminder that if you want someone to answer a question, you need to put their full ID in like I just did so they get a prompt that you're talking about them :) As the technology matures and players and developers get used to it, I'm sure we'll see more successful designs, it's simply a matter of time.

Upvote • 
Avatar image for OrianaDorta
OrianaDorta

3114

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I'm glad to see those $150 are worth for something like this.

Upvote • 
Avatar image for RadicalToenail
RadicalToenail

918

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I've always loved the technology behind Kinect, I just never supported Microsoft using it in such a closed manner. Thankfully there are some brilliant people out there opening it up for us. Maybe it will convince Microsoft to be more open with it.

Upvote • 
Avatar image for steelmouth
steelmouth

1084

Forum Posts

0

Wiki Points

0

Followers

Reviews: 7

User Lists: 0

i have always said kinect is way way bigger than games in the long run its going to be more useful and popular in other things than in games (milo will blow people away if ever its fully developed, the Japanese would love it and maybe increase the x360 luck in Japan)

Upvote • 
Avatar image for GOR_TAK
GOR_TAK

251

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Human Giant had a hilarious sketch where SkyNet turns the roombas on us.

Upvote • 
Avatar image for deathwish026
deathwish026

1053

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

sounds good. why should a produst be made to only do the things its supposed to when others can adapt it. like 2 artists fighting over 1 painting. this will leed to new tech.

Upvote • 
Avatar image for MOwens9512
MOwens9512

529

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

If I were Microsoft I'd be kinda upset at this application of my product. Maybe it's just me but it kind of makes a mockery of Kinect hooking it to a housecleaning product. I mean I know Kinect appeals to the stay at home moms but geesh LOL. I'm also mad that this is what grant money at MIT is being used for.

Upvote • 
Avatar image for Gelugon_baat
Gelugon_baat

24247

Forum Posts

0

Wiki Points

0

Followers

Reviews: 656

User Lists: 4

US$150 to give a robot a HUGE upgrade in its capacity to serve sure is economical.

Upvote • 
Avatar image for blackace
blackace

23576

Forum Posts

0

Wiki Points

0

Followers

Reviews: 4

User Lists: 0

I wonder what they will come up with next. I have a feeling 3D will be added to this somewhere in the future. Playing some of the sports games in 3D would be pretty cool. Microsoft should invest more in doing other things with this technology. They could make a pretty penny if they did.

Upvote • 
Avatar image for Blue-Sky
Blue-Sky

10381

Forum Posts

0

Wiki Points

0

Followers

Reviews: 6

User Lists: 0

How come no one did this with the eye toy? lol...

Upvote • 
Avatar image for fkbwii
fkbwii

2392

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Pretty freakin' sweet!

Upvote • 
Avatar image for Kezman118
Kezman118

585

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

Ladies and Gentlemen, I give u the beginning of the end. Microsoft, the next Skynet. But seriously, that is pretty cool.

Upvote • 
Avatar image for kakashi6666
kakashi6666

538

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

@Alex_09 eplain to everyone why u think kinect isnt inovitave or next gen the eyetoy is the only other thing thats ever bin released fo gameing that comes anywere near being kinda close to wat kinect is and the eyetoy sucks always hhas and it always will but kinect on the other hand if it needs to it can track every part of u r skelatin at the same time aswell as do loads of other stuff at once..... my point being nothing has ever came out for gameing that is remotely as inovitive as kinect is at the moment i for one cant wait to see were this awsome piece of tech is heading in the future

Upvote • 
Avatar image for xchiefmegadethx
xchiefmegadethx

640

Forum Posts

0

Wiki Points

0

Followers

Reviews: 3

User Lists: 0

Really cool...

Upvote • 
Avatar image for digi-demon
digi-demon

803

Forum Posts

0

Wiki Points

0

Followers

Reviews: 4

User Lists: 0

Big Brother is watching... and learning ?

Upvote • 
Avatar image for shkar
shkar

571

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

that is actually good.......

Upvote • 
Avatar image for edwise18
edwise18

1533

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Wow. I gotta say i'm impressed. Who knows what potential this has.

Upvote • 
Avatar image for tyco_ex
tyco_ex

451

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

@ dRuGGeRnaUt: Moral of this story: stupid stuff is more fun when you're drunk. Thanks.

Upvote • 
Avatar image for kwanzudood
kwanzudood

379

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

all i want to see is a kinect FPS where you use a regular controller for everything else, but when you run up to a corner you can lean your body left or right to get your character to peek around cover.

Upvote • 
Avatar image for hordaak
hordaak

177

Forum Posts

0

Wiki Points

0

Followers

Reviews: 3

User Lists: 0

majere...how is it an awkward fit for gaming again?? please explain that one. try the track and field events using kinect and try it with a remote control err move controller. waaayyy better on the kinect

Upvote • 
Avatar image for beefcakie
beefcakie

25

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

ALEX_09 stop thinking so hard, u might save yourself some embarrassment. if u look at the critic scores. all on par with each other. your delusional. or is ms paying everyone.

Upvote • 
Avatar image for majere613
majere613

719

Forum Posts

0

Wiki Points

0

Followers

Reviews: 6

User Lists: 0

It still seems to me that MS are being incredibly daft in not pushing the Kinect hardware for non-gaming applications themselves. Built into your TV, for example, it could entirely remove the need for a remote control and have interesting applications for parental locks etc. Instead they're determined to push it as a gaming interface first and foremost, for which it seems at best an awkward fit. This will be an excellent technology, once it's used properly.

Upvote • 
Avatar image for SDBusDriver1979
SDBusDriver1979

1095

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

The creepiest thing to seek out and take up skirt shots of women ever.

Upvote • 
Avatar image for lock445
lock445

399

Forum Posts

0

Wiki Points

0

Followers

Reviews: 7

User Lists: 0

The CoD formula of Copy+Paste and then re-skinned has now been implemented into hardware.

Upvote • 
Avatar image for anthonycg
anthonycg

2017

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

@gideonkain Japan has always been more open with their technological advancements...

Upvote • 
Avatar image for deactivated-5e90a3763ea91
deactivated-5e90a3763ea91

9437

Forum Posts

0

Wiki Points

0

Followers

Reviews: 3

User Lists: 13

Yeah the Kinect's recognition capabilities are pretty impressive to me. You could almost make a toy robo dog with the technology and praise and discipline it as necessary.

Upvote • 
Avatar image for NND1
NND1

1416

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I own a Kinect and it needs some tweeks but it is surprisingly good. Big Up to M$ for taking a chance on this piece of awesome hardware...

Upvote • 
Avatar image for spooky102
spooky102

417

Forum Posts

0

Wiki Points

0

Followers

Reviews: 30

User Lists: 0

Well, I think the Kinect is better for other things than games. I could care less but I won't talktrash about it because I haven't used it but still, I think it is better for other things than games.

Upvote • 
Avatar image for Phatjam98
Phatjam98

677

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

MS will not go after them at all people.... MS offered a cash prize for the first person that came up with a way to use Kinect in another application. MS is encouraging people to hack it and experiment. Why would MS do this? Because it is their property and if someone comes up with a great idea it will much easier for them to get the rights too it. They will be able to purchase the rights for much less this way than if someone developed their own camera system and software to invent new ways to use it. And I agree with those of you that say dont talk about it till you experiance it. Kinect is one of the best times I've ever had... Ever. It is made for everyone and is best in a group. Get off your butts and try it... you might love it like everyone else that has tried it!

Upvote • 
Avatar image for dRuGGeRnaUt
dRuGGeRnaUt

1637

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

@Alex 09: If you haven't used it, please, don't comment on it. You haven't used it, you don't know how it works, or how well it works. And YES to me, having me walk up to my xbox, it scans my face and signs me in, then allows me to control the console with nothing more than my hands/voice?? a accessory that ACTUALLY puts you(fully) in the game. When you scatch your head between rounds, you do in the game.. I don't think ANYONE that hasn't tried it can understand the level of immersion this brings. and after one day of having kinect, I find myself feeling "bumbed" about having to use a "normal" controller.. Lazy, but true XD

Upvote • 
Avatar image for dRuGGeRnaUt
dRuGGeRnaUt

1637

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

@Alex 09 I honestly can't really understand you comment. I don't know why you're talking about oblivion or RDR. I was just stating those scores for the people saying the launch titles such. Reviews mean nothing to me. \ about the rest of you comment(about real life being more fun): \ Then why do you play ANY games at all?? why are you talking to people on GS?? isn't conversation with people in person better?? EXACTLY because you like to. Your argument does make no sense. as i don't see how i insinuated that GS gets paid for their adds.. \ Again, why are you talking about the dating in GTA4?? I don't understand what you were trying to tell me. PS: I play real guitar, and have for 15 years, still have LOTS of fun playing Rockband with my friends that can't play instruments... heck even the ones that can. I can drive in real life, but can't drive a ferrari. I like FPS but im not about to go join the military because its "MORE REAL" people play games, simple as that, theres no reason to tell people to go "learn real guitar". If people like it, let them. And how you managed to bring 9/11 into this is BEYOND ME. Thumbs up if you don't understand what Alex 09 was saying. ;)

Upvote • 
Avatar image for Alex_09
Alex_09

3473

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

But if the wii deserves praise, so does kinect.

Upvote • 
Avatar image for Alex_09
Alex_09

3473

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

@dRuGGeRnaUt Oblivion had .4 removed from it's well deserved perfect score because it had minor glitches. Red Dead Redemption got 9.5 because it also had glitches, although none were that bad. Same thing with Fallout 3. GTA 4 had major glitches at launch. Some games didn't even make it past the load screen, and Rockstar had to issue apologies. It also had absolutely useless game elements like the dating and bowling garbage, which deserved to be mentioned because they really were flaws, even if the core game was good(because imagine how much better it would have been if developers hadn't wasted time on trivial gimmick activities?). GTA 4 got 10/10. People that believe 9/11 was an inside job are conspiracy theorists with no basis for their arguments. People that believe gamespot gets payoffs for some of their glowing reviews are simply connecting the dots. Reviews have been part of game advertising ever since these sites got popular. I have never tried Kinect, but even if it is fun to pretend to play guitar(in my opinion it isn't, but anyways) no way is it as fun as actually playing a guitar once you've learned a thing or two. Same thing with boxing, dancing, or playing with an animal. I hope the kinect does well only because I know if it doesn't microsoft will make us pay for it, but I wouldn't call it innovative, let alone next generation technology.

Upvote • 
Avatar image for glhx1rush
glhx1rush

346

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

It's all fun and games until Microsoft's lawyers catch up with you. Wonder what that fancy degree from MIT will do for you in Federal Prison? (I'm joking, but, I wouldn't be surprised if Microsoft's lawyers make some kind of appearance shortly)

Upvote •