How ‘video understanding’ could transform Facebook

How ‘video understanding’ could transform Facebook

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Facebook (FB) users spend over 100 million hours a day gobbling up video on the social network. But despite all that content flowing through — and the technology and ingenuity powering it – Facebook still hasn’t figured out how to wrap its algorithmic prowess around video the way it already does with photos, using facial recognition, for instance, to identify you and your friends. ” data-reactid=”23″>Facebook (FB) users spend over 100 million hours a day gobbling up video on the social network. But despite all that content flowing through — and the technology and ingenuity powering it – Facebook still hasn’t figured out how to wrap its algorithmic prowess around video the way it already does with photos, using facial recognition, for instance, to identify you and your friends.

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="The reason: sheer complexity. A photo is one static image, but a video is essentially copious images sequenced in a particular order to show a narrative in motion: a Siamese kitten purring or a professor in the middle of a BBC interview interrupted by his two young kids. ” data-reactid=”24″>The reason: sheer complexity. A photo is one static image, but a video is essentially copious images sequenced in a particular order to show a narrative in motion: a Siamese kitten purring or a professor in the middle of a BBC interview interrupted by his two young kids.

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Using artificial intelligence to scan and analyze a video on the fly — “video understanding,” as it’s called — is a multi-year challenge Facebook argues could transform the social network experience for the better. ” data-reactid=”25″>Using artificial intelligence to scan and analyze a video on the fly — “video understanding,” as it’s called — is a multi-year challenge Facebook argues could transform the social network experience for the better.

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="“We think video understanding is going to be ridiculously impactful, because if you go back in time and you think about the News Feed — even before photos were that prevalent — it was mostly text, and so that was the content you needed to understand in order to rank [people’s feeds],” Joaquin Candela, Facebook’s Director of Applied Machine Learning, told Yahoo Finance. &nbsp;” data-reactid=”26″>“We think video understanding is going to be ridiculously impactful, because if you go back in time and you think about the News Feed — even before photos were that prevalent — it was mostly text, and so that was the content you needed to understand in order to rank [people’s feeds],” Joaquin Candela, Facebook’s Director of Applied Machine Learning, told Yahoo Finance.  

Joaquin CandelaJoaquin Candela
View photos

“We think video understanding is going to be ridiculously impactful, ” Joaquin Candela, Facebook’s Director of Applied Machine Learning, told Yahoo Finance. Source: Facebook

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="“We’re at a point now where we’re pretty good at understanding photos, but now there’s video,” Candela added. “You even have live video, and the question becomes, well, how fast can you figure out what’s going on in this video?” ” data-reactid=”45″>“We’re at a point now where we’re pretty good at understanding photos, but now there’s video,” Candela added. “You even have live video, and the question becomes, well, how fast can you figure out what’s going on in this video?”

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="If anyone at the social network can tackle that challenge, it’s Candela, who leads Facebook’s Applied Machine Learning group (AML). The group’s mission? Take the heady ideas and theories generated by the neighboring Facebook Artificial Intelligence Research group (FAIR) and turn those ideas into reality. ” data-reactid=”46″>If anyone at the social network can tackle that challenge, it’s Candela, who leads Facebook’s Applied Machine Learning group (AML). The group’s mission? Take the heady ideas and theories generated by the neighboring Facebook Artificial Intelligence Research group (FAIR) and turn those ideas into reality.

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Already, the FAIR and AML groups algorithms are capable of identifying certain elements in a video — objects like a house, a pizza box or pet — but they remain light years away from fully deciphering and tracking the most important aspect: people’s behavior.&nbsp;” data-reactid=”47″>Already, the FAIR and AML groups algorithms are capable of identifying certain elements in a video — objects like a house, a pizza box or pet — but they remain light years away from fully deciphering and tracking the most important aspect: people’s behavior. 

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="“The majority of the videos that come to Facebook are people-centric,” explained Manohar Paluri, computer vision lead at the AML group. “And if we don’t understand what people are doing, we will never understand what the video is about.”” data-reactid=”48″>“The majority of the videos that come to Facebook are people-centric,” explained Manohar Paluri, computer vision lead at the AML group. “And if we don’t understand what people are doing, we will never understand what the video is about.”

Manohar PaluriManohar Paluri
View photos

“If we don’t understand what people are doing, we will never understand what the video is about,” explained Manohar Paluri, research lead of computer vision at the AML group. Source: Facebook

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Indeed, the context of a video is every bit as important as quickly figuring out who is in the video. Is this Facebook user attending a rally? Giving a speech? Playing squash? ” data-reactid=”67″>Indeed, the context of a video is every bit as important as quickly figuring out who is in the video. Is this Facebook user attending a rally? Giving a speech? Playing squash?

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Once they do that, Facebook contends there are numerous practical applications for Facebook users. Although Facebook does not disclose how much Live video users shoot on any given day, the social network says people are 10 times more likely to comment on Facebook Live videos than on regular videos. ” data-reactid=”68″>Once they do that, Facebook contends there are numerous practical applications for Facebook users. Although Facebook does not disclose how much Live video users shoot on any given day, the social network says people are 10 times more likely to comment on Facebook Live videos than on regular videos.

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="But how much more likely are you to check out that video if you received a notification because a friend of yours is being filmed? Not only that, but what if the notification told you exactly what your friend was doing in that moment, like say, running on Zuma Beach in Malibu, Calif., or chowing down on sashimi at Nobu in New York City? ” data-reactid=”69″>But how much more likely are you to check out that video if you received a notification because a friend of yours is being filmed? Not only that, but what if the notification told you exactly what your friend was doing in that moment, like say, running on Zuma Beach in Malibu, Calif., or chowing down on sashimi at Nobu in New York City?

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="That kind of hypothetical is what Facebook hopes to offer its users in the next three to five years. And while the level of granularity may sound disconcerting to some — an algorithm smart enough to understand exactly what you’re doing — remember that just five years ago, people were up in arms over Facebook using facial recognition to identify people in photos. Now, many people take facial recognition within Facebook for granted. ” data-reactid=”70″>That kind of hypothetical is what Facebook hopes to offer its users in the next three to five years. And while the level of granularity may sound disconcerting to some — an algorithm smart enough to understand exactly what you’re doing — remember that just five years ago, people were up in arms over Facebook using facial recognition to identify people in photos. Now, many people take facial recognition within Facebook for granted.

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="For Facebook, the payoff for nailing and rolling out a feature like video understanding is increased user engagement. Although the social network has evolved into the third most-trafficked website in the world, it is always developing new ways to keep users inside Facebook or its stable of products and services, whether they be subtle speed improvements or rolling out the Snapchat Stories-like feature Facebook Messenger Day. ” data-reactid=”75″>For Facebook, the payoff for nailing and rolling out a feature like video understanding is increased user engagement. Although the social network has evolved into the third most-trafficked website in the world, it is always developing new ways to keep users inside Facebook or its stable of products and services, whether they be subtle speed improvements or rolling out the Snapchat Stories-like feature Facebook Messenger Day.

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="As time marches on, people become accustomed to, even dependent upon, many of those technological improvements. Facebook is hoping the same for video understanding, too. ” data-reactid=”76″>As time marches on, people become accustomed to, even dependent upon, many of those technological improvements. Facebook is hoping the same for video understanding, too.

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="” data-reactid=”77″>

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="JP Mangalindan is a senior correspondent for Yahoo Finance covering the intersection of tech and business. Follow him on Twitter or Facebook. &nbsp;” data-reactid=”78″>JP Mangalindan is a senior correspondent for Yahoo Finance covering the intersection of tech and business. Follow him on Twitter or Facebook.  

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="More from JP:” data-reactid=”79″>More from JP:

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="3 major problems with Trump’s protectionist attitude toward China&nbsp;” data-reactid=”80″>3 major problems with Trump’s protectionist attitude toward China 

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Fry’s Electronics: How this tech retailer has survived the fall of brick-and-mortar” data-reactid=”81″>Fry’s Electronics: How this tech retailer has survived the fall of brick-and-mortar

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Why ‘experience can hurt tech workers in Silicon Valley” data-reactid=”82″>Why ‘experience can hurt tech workers in Silicon Valley

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Why AI could be Silicon Valley’s latest ‘micro bubble’” data-reactid=”83″>Why AI could be Silicon Valley’s latest ‘micro bubble’

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Surprise and disgust: What 6 Silicon Valley CEOs said about Trump’s ban” data-reactid=”84″>Surprise and disgust: What 6 Silicon Valley CEOs said about Trump’s ban

<p class="canvas-atom canvas-text Mb(1.0em) Mb(0)–sm Mt(0.8em)–sm" type="text" content="Amazon is now worth more than the 8 largest retailers combined” data-reactid=”85″>Amazon is now worth more than the 8 largest retailers combined

Source: www.yahoo.com

Latest Posts From This Category

Leave a Comment

Your email address will not be published. Required fields are marked with *

Cancel reply