You Can Now Touch Objects In Videos With Interactive Dynamic Video

Posted: Aug 5 2016, 7:48am CDT | by , Updated: Aug 5 2016, 7:50am CDT, in News | Latest Science News


You Can Now Touch Objects in Videos with Interactive Dynamic Video
Using traditional cameras and algorithms, IDV looks at the tiny, almost invisible vibrations of an object to create video simulations that users can virtually interact with. Image: Abe Davis/MIT CSAIL
  • Now People could Reach in and Touch Objects in videos via Interactive Dynamic Video

It is being said that now people could touch objects in videos via MIT developed Interactive Dynamic Video.

Human beings are a manual species. They gather information about stuff via manipulating, holding, examining and handling the objects with their hands. This is something which is unfortunately impossible in case of video clips.

Yet now even that barrier has been broken by scientific man. Researchers from MIT have managed to create an Interactive Dynamic Video. This imaging technology allows users to reach inside the video with their hands and actually touch the entity.  

It employs ordinary cameras and algorithms to do the job. It creates the vibrations of the object or entity in the video clip and creates video simulations that are interactive to boot. This is indeed a wonderful invention and a modern-day miracle that will revolutionize the way we think about video technology.

The physical meanderings of objects, be they humans or pets or technology, can undergo mimicry and we can then play around with them in virtual space. This makes the whole game and scenario one of interaction. 

To simulate objects, researchers analyzed video clips to find “vibration modes” at different frequencies that each represent distinct ways that an object can move. By identifying these modes’ shapes, the researchers can begin to predict how these objects will move in new situations. Image: Abe Davis/MIT CSAIL

"This technique lets us capture the physical behavior of objects, which gives us a way to play with them in virtual space,” says CSAIL PhD student Abe Davis, who will be publishing the work this month for his final dissertation.

“By making videos interactive, we can predict how objects will respond to unknown forces and explore new ways to engage with videos.”

Interactive Dynamic Video (IDV) has so many uses that to even begin to list them is a monumental task. Film makers and architects may use IDV in their repertoire of tools.

Like the popular game known as Pokemon Go can bury virtual objects in the outer environment, IDV allows for interaction with the Great Outdoors in a very real and solid manner.

This thing called IDV was demonstrated on the drawing board recently. A 3D model ought to have been the first step in this game. This is however a very costly process. Besides, not every object can be built in a 3D manner. 

Algorithms are instead used to track and shape behavior in videos and thus give them length, width and breadth. The vibrational modes of the objects in the videos were used to give the illusion of depth and tactile quality.

The whole setup was quite a complicated one. Among the variety of objects that have had their vibrations magnified till they seem almost real are a jungle gym, a ukelele and a bridge.

This technique will be further streamlined in the future so that other more advanced features can be included in its context. This tool has a number of uses in engineering and the entertainment industry. Characters can seem to come to life and also a civil engineer can feel his products before making them in real life. 

Interactive Dynamic Video demonstration from the MIT Computer Science and Artificial Intelligence Laboratory Video: MIT CSAIL

You May Like


The Author

<a href="/latest_stories/all/all/20" rel="author">Sumayah Aamir</a>
Sumayah Aamir (Google+) has deep experience in analyzing the latest trends.




Leave a Comment

Share this Story

Follow Us
Follow I4U News on Twitter
Follow I4U News on Facebook

You Also Like


Read the Latest from I4U News