AT&T Researchers Take Home Hotly-Contested Netflix Prize
Scientists from AT&T Labs-Research Lead Global Coalition of Researchers To Win $1 Million Competition.
In a demonstration of global collaboration and expertise in data analysis, AT&T* announced that Chris Volinsky and Robert Bell, scientists who work on visualizing and analyzing large networks with AT&T Labs-Research, were part of the team presented with the Netflix Prize, a multi-year contest to improve upon the advanced Netflix movie recommendation system. More than 40,000 teams from 186 countries participated in the competition.
The $1 million prize was awarded this morning to Volinsky, Bell and other members of the winning coalition in a news conference hosted by Netflix. Volinsky and Bell are twice winners of “Progress Prizes” in the competition – first in 2007 with former AT&T Labs colleague Yehuda Koren, now a Senior Research Scientist with Yahoo! Labs, and again in 2008 after combining with Big Chaos, an Austrian research team. Earlier this year, Bell and Volinsky reached out to Canadian team Pragmatic Theory to create the Grand Prize winning coalition.
“AT&T Labs is focused on driving innovations that help customers do more and get more from communications and entertainment services," said Dave Belanger, vice president of software and systems research and chief scientist, AT&T Labs. "The efforts by Chris and Bob to advance the technologies behind recommendations systems could have far-reaching implications not only for Netflix, but for AT&T’s service portfolio, and potentially for other services and applications. Additionally, they display the collaborative nature of research and innovation today, working with other researchers across the globe online to build toward the goal.”
The AT&T Labs researchers advanced two key methodologies central to recommendation systems: neighborhood models and latent factors models. Neighborhood models predict a user’s interest in a new item, such as a movie or product, based on the user’s ratings or purchase history of a set of similar items. For example, a neighborhood for the latest action movie remake may include its sequels, other movies featuring the same stars or director, or other remakes of older films. The AT&T Labs researchers developed new methodology to better combine information across many neighbors, resulting in more accurate and meaningful recommendations.
Latent factors models use aggregate information on past user choices to establish a set of unobserved features for each item (for example, latent factors for a specific movie might include amount of violent content, level of comedic content, or level of interest to young children). These factors then enable an automated system to estimate and predict a user’s interest in a product based on these features. Along with using customer ratings themselves, the AT&T Labs researchers incorporated information about the types of items a user rated in order to improve estimates of a user’s interest in different products.
Additionally, the AT&T Labs researchers developed innovative ways to integrate neighborhood and latent factor models in ways that utilized the complementary strengths of each technology.
The Netflix Prize was launched in 2006 to reward the team that could achieve a 10 percent improvement over the accuracy of the Netflix movie recommendation system at that time. The largest such data set ever released – 100 million anonymous movie ratings ranging from one to five stars – was made available to contestants. All personal information identifying individual Netflix customers was removed from the prize data, which contained only movie titles, star ratings and dates but no text reviews. Netflix members already are benefitting from improvements Netflix Prize contestants have contributed to the recommendations system.
In a demonstration of global collaboration and expertise in data analysis, AT&T* announced that Chris Volinsky and Robert Bell, scientists who work on visualizing and analyzing large networks with AT&T Labs-Research, were part of the team presented with the Netflix Prize, a multi-year contest to improve upon the advanced Netflix movie recommendation system. More than 40,000 teams from 186 countries participated in the competition.
The $1 million prize was awarded this morning to Volinsky, Bell and other members of the winning coalition in a news conference hosted by Netflix. Volinsky and Bell are twice winners of “Progress Prizes” in the competition – first in 2007 with former AT&T Labs colleague Yehuda Koren, now a Senior Research Scientist with Yahoo! Labs, and again in 2008 after combining with Big Chaos, an Austrian research team. Earlier this year, Bell and Volinsky reached out to Canadian team Pragmatic Theory to create the Grand Prize winning coalition.
“AT&T Labs is focused on driving innovations that help customers do more and get more from communications and entertainment services," said Dave Belanger, vice president of software and systems research and chief scientist, AT&T Labs. "The efforts by Chris and Bob to advance the technologies behind recommendations systems could have far-reaching implications not only for Netflix, but for AT&T’s service portfolio, and potentially for other services and applications. Additionally, they display the collaborative nature of research and innovation today, working with other researchers across the globe online to build toward the goal.”
The AT&T Labs researchers advanced two key methodologies central to recommendation systems: neighborhood models and latent factors models. Neighborhood models predict a user’s interest in a new item, such as a movie or product, based on the user’s ratings or purchase history of a set of similar items. For example, a neighborhood for the latest action movie remake may include its sequels, other movies featuring the same stars or director, or other remakes of older films. The AT&T Labs researchers developed new methodology to better combine information across many neighbors, resulting in more accurate and meaningful recommendations.
Latent factors models use aggregate information on past user choices to establish a set of unobserved features for each item (for example, latent factors for a specific movie might include amount of violent content, level of comedic content, or level of interest to young children). These factors then enable an automated system to estimate and predict a user’s interest in a product based on these features. Along with using customer ratings themselves, the AT&T Labs researchers incorporated information about the types of items a user rated in order to improve estimates of a user’s interest in different products.
Additionally, the AT&T Labs researchers developed innovative ways to integrate neighborhood and latent factor models in ways that utilized the complementary strengths of each technology.
The Netflix Prize was launched in 2006 to reward the team that could achieve a 10 percent improvement over the accuracy of the Netflix movie recommendation system at that time. The largest such data set ever released – 100 million anonymous movie ratings ranging from one to five stars – was made available to contestants. All personal information identifying individual Netflix customers was removed from the prize data, which contained only movie titles, star ratings and dates but no text reviews. Netflix members already are benefitting from improvements Netflix Prize contestants have contributed to the recommendations system.
No comments: