Join us FREE for Streaming Media Connect, Aug 22-24, 2023. Reserve Your Seat Now!

Video: How Much Custom Modeling Do AI Platforms Allow?

Learn more about video AI at Streaming Media's next event.

Watch the complete video of this presentation from Streaming Media West, T203. HOW-TO: Compare & Contrast Platforms Offering AI Video Insights in the Streaming Media Conference Video Portal.

Read the complete transcript of this clip:

Jun Heider: Training's a very important thing, and I see a lot of people are leveraging these services out of the box right now. The models are kind of closed.

Microsoft lets you train some things, such as face, and correcting the transcript, within your own account. Any of you ask at Google, good luck. AWS does let you upload your own faces, but if you were to want to add new labels, that's a closed door, and the way I think about it is, if I was malicious, and I wanted to say hot dog or not hot dog, and just have completely random images that weren't that, I could screw it up for everybody else, cause you're sharing all this training.

Lots of these vendors will allow you to create, upload training data, but it's kind of in a sandbox. Some of them do let you turn things on for anonymous training data. For instance, one of the services, I think, allows you to do anonymous training data for audio transcripts.

For the most part, there are not that many training options right now with some of these services, but I feel that going forward, that may change, because I had this example from somebody I was talking to at a previous conference, where he had a team create this big, robust taxonomy for all the content in their media library. He spent a lot of time doing it so that things could be found, categorized well, etc. Then, he had AI tag all this content, and now, he had all this metadata around all the content.

The problem was, his users that were trying to find the content were searching for things completely outside of the labels from AI and the taxonomy that his team had created. That's not cool.

In his case, he could have created a custom model based on search analytics: What are the terms that people are using to find that content within my media library, so that I can then create a custom model that has classifiers that match the things that people actually search with?

If you want to go down that path, Clarifai allows you to create custom models, and so do Valossa, Hive, and Adobe Sensei, when it actually comes out. Adobe says that they're going to allow you to do custom models.

Going forward, the more we use these services, the more we're probably going to be creating our own custom models that are specific to our content library.

Streaming Covers
for qualified subscribers
Subscribe Now Current Issue Past Issues
Related Articles

Video: How to Use AI for Live Stream Analysis

RealEyes Media Director of Technologies Jun Heider discusses Live Stream Analysis using AI in this clip from Streaming Media West 2018.

Video: What AI Platforms Can and Can't Do

Despite rumors to the contrary AI won't render humans obsolete, declares RealEyes' Jun Heider in this clip from his presentation at Streaming Media West 2018.

Video: AI-Driven Tools for Face and Object Detection

RealEyes Media Director of Technologies Jun Heider discusses the visual detection features of popular AI platforms in this clip from his presentation at Streaming Media West 2018.

Video: Best Practices for Training Your AI

Limelight's Jason Hofmann, Citrix' Josh Gray, and REELY's Cullen Gallagher discuss best practices for training AI systems at Streaming Media East 2018.

Video: How to Know When AI Isn't the Solution to Your Problem

Google's Matthieu Lorrain cautions of the risks of doing AI for its own sake in this clip from Streaming Media West 2018.

Video: Key Considerations When Choosing a Video AI Platform

RealEyes Director of Technology Jun Heider discusses the importance of internal self-assessment and which use-case elements to consider when choosing a platform for video AI in this clip from Streaming Media East 2018.

Video: Who Are the Key Players in Video AI?

RealEyes Media Director of Technology Jun Heider identifies the key players in the AI platform space in this clip from Streaming Media East 2018.

Video: Tips for Getting Started with Video AI Platforms

RealEyes Director of Technology Jun Heider outlines the first steps in choosing an AI platform in this clip from his presentation at Streaming Media East 2018.

How to Choose a Video AI Platform and Evaluate its Results

Meet the big four players in the video artificial intelligence space, then learn how they can speed up time-consuming tasks like generating metadata or creating transcriptions.

Companies and Suppliers Mentioned