Microsoft's Mobicast is PhotoSynth for real-time videos

New Scientist is reporting that Microsoft's Cairo, Egypt lab has a created a way to combine cell phone videos of the same scene, from multiple sources, into a single video; and they can do it in real-time. They are calling it Mobicast, and it will allow them to create live broadcasts of streaming video from multiple angles.

The idea is very similar to PhotoSynth, but applied to video. Let's say there are two people recording video of the Macy's day parade with their cell phones. Mobicast will see that they're recording the same footage in the same place and will begin synchronizing their clocks with the server, comparing the streams, and aligning the frames based on image-recognition technology, to create a single, wider-angle video. In the midst of all this, the video is continuously streamed, live, to other phones and devices.

The challenge, according to one of the developers, Ayman Kaheel, is to do this in real-time. Fortunately (or not, depending how you look at it), phone video is fairly low quality and has poor frame-rates, allowing Mobicast to work in real-time. Once a user streams video to Mobicast's servers, they receive feedback to their phone highlighting their contribution to the stitched video, allowing them to move their phone around to help contribute to the video at a more effective angle.

Mobicast uses GPS to pinpoint the location of users who are recording. The program requires software on the phone itself (Windows Mobile only, for now), as well as on the server that will receive the streams. This could change the way people see breaking news stories. Imagine if multiple people witnessed the 9-11 attacks with Mobicast. We'd have had an amazing panoramic video streaming to every phone and news source across the country.

Check out this video of it in action...

Report a problem with article
Previous Story

Chinese pirates clone Windows XP, sorta

Next Story

Mozilla pushes back Firefox 3.6 and 4.0, 3.7 in the works


Commenting is disabled on this article.

Interesting. I'm honestly not sure what to think of this yet to be honest...

Is this similar to what they demoed in their maps the other week showing the route you would be taking in your directions? I can't really think of what you'd use this for off the top of my head...

It's a neat technology though...

M_Lyons10 said,
Is this similar to what they demoed in their maps the other week showing the route you would be taking in your directions?

Although the end video looks similar (due to the fact it expands) the project is in fact completely different. As per the news post it's about combining multiple views of a subject into one output, done for video feeds in real-time.


This can be used by groups or broadcasters, who have multiple sources of the same event to bring it together into one video and make it better. MS started off with pictures and now video, If they work this out and it does a good job I can see it being used alot.

Thank god Microsoft is focusing on all these little niche's.. its funny if this Article were about Google or Apple.. all hell would break loose on how great they were!

How times have changed lol