Video: Tips for Getting Started with Video AI Platforms
Learn more about AI platforms at Streaming Media's next event.
Watch the complete video of this presentation, AI105: Singularity: Compare & Contrast Video Insights via AI, in the Streaming Media Conference Video Portal.
Read the complete transcript of this clip:
Jun Heider: If you don’t have developers in-house at your organization, a lot of these vendors offer demo versions of their platforms that you can play around with. The free version of Microsoft Azure Video Indexer, for example, is quite robust. You can actually take widgets and embed them into your own systems. Of the four platforms we discuss in this article, Video Indexer is the most complete product that you can access without having to go through contract negotiations.
Google Cloud and AWS offer demos on their pages, but they don’t really expose them to the degree that you can embed them into your own system. With AI platforms, “embed” essentially means taking a code, putting an I-Frame into your system, and loading up their page inside of your system. The online demo versions of Google Cloud and AWS don’t allow that, but you can upload your own videos, wait for the apps to process them, and see how well the service will work with your video.
IBM sells several Watson products, such as Video Enrichment (top right in Figure 1). They are API-first. Theoretically, you can buy their paid product, and communicate between your system and theirs to pull metadata into your system.
This is one of the big use cases for AI: You have this media asset manager (MAM) that houses all this metadata about all the assets being stored there. Wouldn’t it be great to have the computer generate some of that metadata for you, so that in addition to the title and the season and the episode name, you have things like “car crash,” “leopard,” and “little baby girl,” or whatever terms apply to your content, that you can actually search and discover your content much more easily? The first thing your developers are going to want to learn about is, what’s the learning curve? What software development kit is available for each of these platforms?
AWS has a client SDK, which basically acts as an accelerator so your developers don’t have to write all the code from scratch. They can build their code on top of the boilerplate AWS provides, with SDKs for Android, iOS, Java, .NET, etc. My team of developers has played around with this SDK, and they have found it comprehensive, and much less wordy than Google Cloud.
One important step in choosing a video AI platform is to let your developers test whatever demo version is available and listen to their feedback, because your team is going to be more productive if they feel that they don’t have to spend as much time trying to grok how to work with the software. Like AWS, the Google Cloud platform has a good number of client SDKs: C#, node.js, Go, Java, etc. But from a developer’s perspective, their API documentation is quite verbose, and it takes a lot of clicks to get to what you need. If I just want to know how to send my video up to their service, rather than seeing the signature of the payload that I want to upload, I have to wade through 3-4 paragraphs on every single data point within that signature.
IBM Cloud’s API reference lives behind a pay wall. You talk to the IBM Watson media people, and you say, “This is my use case. I want to play around with your system, because I think I’m going to buy it.” Then you probably sign some contracts. In my case, as an IBM partner, they were kind enough to share API documentation with me. It looked pretty straightforward.
Azure Microsoft Video Indexer has a client SDK for .NET only. If you don't have .NET developers in your shop, Video Indexer might not be the right solution for you. Amazon and Google have things like Java, Android, iOS, Ruby, and so on. Your developers might be able to build something faster on those platforms. The Video Indexer documentation is outstanding. It’s well laid-out, and you can inline-test it as long as you have an active account.
RealEyes Media CTO Jun Heider discusses audio-specific machine learning services, from speech-to-text to sentiment analysis in this clip from his Video Engineering Summit at Streaming Media East 2019.
Will MLaaS work for you? Depends on the kind of content you have, how you're using it, and the type of results you need, as RealEyes' Jun Heider explains in this clip from his Video Engineering Summit presentation at Streaming Media East 2019.
RealEyes' Jun Heider discusses the importance of training your AI to serve its specific purpose within your organization, and the types of customization leading AI platforms allow in this clip from his presentation at Streaming Media West 2018.
RealEyes Media Director of Technologies Jun Heider discusses Live Stream Analysis using AI in this clip from Streaming Media West 2018.
Despite rumors to the contrary AI won't render humans obsolete, declares RealEyes' Jun Heider in this clip from his presentation at Streaming Media West 2018.
RealEyes Media Director of Technologies Jun Heider discusses the visual detection features of popular AI platforms in this clip from his presentation at Streaming Media West 2018.
Microsoft's Andy Beach and IBM/Watson Media's Ethan Dreilinger break down the differences between machine learning and AI in this clip from their panel at Streaming Media West 2018.
Limelight's Jason Hofmann, Citrix' Josh Gray, and REELY's Cullen Gallagher discuss best practices for training AI systems at Streaming Media East 2018.
Google's Matthieu Lorrain cautions of the risks of doing AI for its own sake in this clip from Streaming Media West 2018.
RealEyes Director of Technology Jun Heider discusses the importance of internal self-assessment and which use-case elements to consider when choosing a platform for video AI in this clip from Streaming Media East 2018.
RealEyes Media Director of Technology Jun Heider identifies the key players in the AI platform space in this clip from Streaming Media East 2018.
Microsoft Principal Product Manager Rafah Hosn makes the case for reinforcement learning as a machine learning paradigm for content personalization in this clip from Streaming Media East 2018.
Microsoft Principal Product Manager Rafah Hosn discusses the benefits and limitations of a content personalization strategy based on supervised machine learning in this clip from Streaming Media East 2018.
Microsoft Principal Product Manager Rafah Hosn explains how Microsoft's machine learning-driven decision services helps brands target viewers and increase engagement in this clip from Streaming Media East 2018.
Comcast Technical Solutions Architect Ribal Najjar defines video QoE both in terms of subjective experience and qualitative measurement in this clip from Streaming Media East 2018.
IRIS.TV CEO & Co-Founder breaks down discusses IRIS.TV's approach to helping traditional media companies capture and leverage audience data and machine learning in this clip from Streaming Media East 2018.
Gannett Senior Director Kara Chiles discusses how USA Today leveraged IRIS.TV and data to localize and personalize their Winter Olympics 2018 coverage in this clip from Streaming Media East 2018.
ZoneTV's Tom Sauer describes how machine learning can be used to overhaul the TV world and deliver more individualized experiences in this clip from Streaming Media East 2018.
REELY CEO Cullen Gallagher makes the business-growth case for content owners developing an AI strategy in this clip from Streaming Media East 2018.
IBM Watson Media's David Clevinger discusses how media entities are currently using video AI in this clip from Streaming Media East 2018.
Citrix Principal Architect Josh Gray explains how video enables higher-acuity metrics analysis in this clip from Streaming Media East 2018.
Limelight VP of Architecture Jason Hofmann discusses how AI impacts content delivery optimization in this clip from Streaming Media East 2018.
Citrix' Josh Gray provides tips on AI model development and Reality Software's Nadine Krefetz and IBM's David Clevinger speculate on the possibilities of metadata-as-a-service in this clip from Streaming Media East 2018.
Google's Leonidas Kantothanassis explores the vast range of applications for machine learning in the media workflow and supply change in this clip from his Content Delivery Summit keynote.
Companies and Suppliers Mentioned