-->
Save your FREE seat for Streaming Media Connect this August. Register Now!

Video: How IBM is Using Video AI

Learn more about real-world video AI and applications at Streaming Media's next event.

Watch the complete video of this panel, AI101: From Content Creation to Delivery: How AI is Impacting Modern Media, in the Streaming Media Conference Video Portal.

Read the complete transcript of this clip:

David Clevinger: The typical use case that we've been seeing is media entities that have large back catalogs of content, that was originally created when they didn't have complex metadata tool sets, didn't necessarily have the right people applying metadata, didn't think of all the use cases on the output side. Maybe it's historical content.

A very concrete example is work that we've done for the US Open. We actually took hundreds of thousands of video clips and photos and news articles and vocabulary terms and proper names and fed it to Watson and helped Watson to understand what tennis was about so that it could do things like, when you heard the word Ashe, it was capital-A-s-h-e, Arthur Ashe, as opposed to lowercase-a-s-h. So there was a lot of training around that. The output then became our ability to create clips based on what was happening with an event, but also to describe historical video as well.

That's critical for companies with large media back catalogs who then optimize that moving forward. You can apply it to live, of course, but that's a typical use case that we see.

It's a recursive learning system. So we took a cross-section of a set of video assets, described it to Watson, said, “This is what's going on. This is who this player is, this is what is being said.” We were able to turn it loose really on other unstructured assets, have it say what it thought it was finding, and then we were able to correct it.

So we were basically able to train it up to understand tennis specifically. And then the output was, we could then turn it loose on a bunch of different kinds of outputs for the client. That was the idea.

Nadine Krefetz: And the outputs are?

David Clevinger: Closed captioning, video clips, excitement scoring. I know you've got a video here that talks about the Masters and some work we've done there, but we were able to do things like listen for crowd noise and say, "This must be really exciting, because the crowd is making a lot of noise at this moment." So we were able to turn that into an excitement score. But we wouldn't be able to do that if we didn't help the algorithm understand what it was looking at and how it should be thinking about that body of work.

Nadine Krefetz: So you were training the algorithm to get smarter and smarter, and then you let it go?

David Clevinger: Exactly. And then we just turned it loose and let it go. And that's the idea: to get it to the point where you can just turn it loose and let it run and them move onto the next one.

Streaming Covers
Free
for qualified subscribers
Subscribe Now Current Issue Past Issues
Related Articles

Video: Best Practices for Training Your AI

Limelight's Jason Hofmann, Citrix' Josh Gray, and REELY's Cullen Gallagher discuss best practices for training AI systems at Streaming Media East 2018.

Video: How to Know When AI Isn't the Solution to Your Problem

Google's Matthieu Lorrain cautions of the risks of doing AI for its own sake in this clip from Streaming Media West 2018.

Video: Key Considerations When Choosing a Video AI Platform

RealEyes Director of Technology Jun Heider discusses the importance of internal self-assessment and which use-case elements to consider when choosing a platform for video AI in this clip from Streaming Media East 2018.

Video: Who Are the Key Players in Video AI?

RealEyes Media Director of Technology Jun Heider identifies the key players in the AI platform space in this clip from Streaming Media East 2018.

Video: Tips for Getting Started with Video AI Platforms

RealEyes Director of Technology Jun Heider outlines the first steps in choosing an AI platform in this clip from his presentation at Streaming Media East 2018.

Video: How Reinforcement Learning Enables Personalized Viewing Experiences

Microsoft Principal Product Manager Rafah Hosn makes the case for reinforcement learning as a machine learning paradigm for content personalization in this clip from Streaming Media East 2018.

Video: Pros and Cons of Supervised Machine Learning for Content Personalization

Microsoft Principal Product Manager Rafah Hosn discusses the benefits and limitations of a content personalization strategy based on supervised machine learning in this clip from Streaming Media East 2018.

Video: How Microsoft's Custom Decision Service Improves Content and Ad Engagement for Brands

Microsoft Principal Product Manager Rafah Hosn explains how Microsoft's machine learning-driven decision services helps brands target viewers and increase engagement in this clip from Streaming Media East 2018.

Video: How Video QoE Metrics Complement Network and Operational Metrics

Comcast Technical Solutions Architect Ribal Najjar discusses how operationalizing commonalities between QoE and QoS metrics to deliver a "super-powerful" dataset in this clip from Streaming Media East 2018.

Video: How Do We Define Quality of Experience for Streaming Video?

Comcast Technical Solutions Architect Ribal Najjar defines video QoE both in terms of subjective experience and qualitative measurement in this clip from Streaming Media East 2018.

Video: How IRIS.TV Implements Machine Learning in Production Environments

IRIS.TV CEO & Co-Founder breaks down discusses IRIS.TV's approach to helping traditional media companies capture and leverage audience data and machine learning in this clip from Streaming Media East 2018.

Video: How USA Today Leveraged Video AI at the 2018 Winter Olympics

Gannett Senior Director Kara Chiles discusses how USA Today leveraged IRIS.TV and data to localize and personalize their Winter Olympics 2018 coverage in this clip from Streaming Media East 2018.

Video: How to Use Machine Learning to Create Personalized TV Experiences

ZoneTV's Tom Sauer describes how machine learning can be used to overhaul the TV world and deliver more individualized experiences in this clip from Streaming Media East 2018.

Video: How AI Can Open Up New Markets for Your Video

REELY CEO Cullen Gallagher makes the business-growth case for content owners developing an AI strategy in this clip from Streaming Media East 2018.

Video: How Video AI Helps Businesses Interpret Experience Metrics

Citrix Principal Architect Josh Gray explains how video enables higher-acuity metrics analysis in this clip from Streaming Media East 2018.

Video: How Video AI Improves Content Delivery Efficiency

Limelight VP of Architecture Jason Hofmann discusses how AI impacts content delivery optimization in this clip from Streaming Media East 2018.

Video: Best Practices for Developing Machine Learning Algorithms for Video

Citrix' Josh Gray provides tips on AI model development and Reality Software's Nadine Krefetz and IBM's David Clevinger speculate on the possibilities of metadata-as-a-service in this clip from Streaming Media East 2018.

Video: How Will Machine Learning Impact the Media Supply Chain?

Google's Leonidas Kantothanassis explores the vast range of applications for machine learning in the media workflow and supply change in this clip from his Content Delivery Summit keynote.

Companies and Suppliers Mentioned