MIT Develops AI That Surfs Web To Improve Its Performance

Posted: Nov 13 2016, 3:23am CST | by , in Latest Science News


This story may contain affiliate links.

MIT Develops AI That Surfs Web to Improve its Performance
Getty Images

“Information extraction” system helps turn plain text into data for statistical analysis.

Researchers from the US have developed an artificial intelligence (AI) system that surfs the internet, extracts information from the available plain text and organises it for quantitative analysis in very less time.

Recently at the Association for Computational Linguistics' Conference on Empirical Methods on Natural Language Processing, researchers from the Massachusetts Institute of Technology (MIT) Computer Science and Artificial Intelligence Laboratory won a best-paper award for a new approach to information extraction that turns conventional machine learning on its head.

Most machine-learning systems work by combing through training examples and looking for patterns that correspond to classifications provided by human annotators.

In their new paper, the MIT researchers trained their system on scanty data -- because in the scenario they're investigating, that's usually all that's available. But then they find the limited information an easy problem to solve.

"In information extraction, traditionally, in natural-language processing, you are given an article and you need to do whatever it takes to extract correctly from this article," said Regina Barzilay, the Delta Electronics Professor of Electrical Engineering and Computer Science.

"That's very different from what you or I would do. When you are reading an article that you cannot understand, you are going to go on the web and find one that you can understand," Barzilay, who also a senior author of the paper, added.

A machine-learning system assigns each of its classifications a confidence score -- which is a measure of the statistical likelihood that the classification is correct -- given the patterns discerned in the training data.

With the researchers' new system, if the confidence score is too low, the system automatically does a web search to pull up texts likely to contain the data it is trying to extract.

It then attempts to extract the relevant data from one of the new texts and reconciles the results with those of its initial extraction.

If the confidence score remains too low, it moves on to the next text pulled up by the search string, and so on.

Eventually, the system learns how to generate search queries, gauge the likelihood that a new text is relevant to its extraction task, and determine the best strategy for fusing the results of multiple attempts at extraction.

This story may contain affiliate links.


Find rare products online! Get the free Tracker App now.

Download the free Tracker app now to get in-stock alerts on Pomsies, Oculus Go, SNES Classic and more.

Latest News


The Author

<a href="/latest_stories/all/all/59" rel="author">IANS</a>
The Indo-Asian News Service (IANS) was established in 1986, initially to serve as an information bridge between India and its thriving Diaspora in North America. Now IANS is a full-fledged wire agency, putting out news 24x7 from around the world.




comments powered by Disqus