TABLE OF CONTENTS


Overview

Some organizations do not have the luxury of being able to call out to the cloud at any time. For various reasons, organizations refuse to be exposed to the internet. To provide such organizations with AI insights within their infrastructure, VIDIZMO has utilized Azure cognitive services. Since cognitive services can be used with containers, VIDIZMO has the ability to use containerized cognitive services to utilize Microsoft's expertise in AI within the customer's on-premise infrastructure. VIDIZMO combines the Azure Cognitive Services with its all-encompassing, robust video content management application, to provide a powerful platform for enterprises to upload, store, secure, stream, search, share, and monetize their content as per their organizational needs.


Concept

VIDIZMO uses an organization's containers of cognitive services to generate AI insights from their digital content. This AI functionality will be done on the on-premise servers where containers of Azure cognitive services are deployed. Using advanced media AI capabilities and technologies, VIDIZMO indexer with Azure cognitive services provides enhanced video processing features that enable users to view, analyze and search hidden data within a video. This equips large enterprises with the necessary tools to fuel their content with the power of artificial intelligence. This is achieved by associating and indexing the video on the basis of the keywords, spoken words, faces, and other essential data extracted from within a video. 


Cognitive Services in Containers 

Containers are an increasingly popular technology with a big impact on business. Because containers abstract applications from their underlying operating systems and other services, these applications can run anywhere: in the cloud, on a laptop, in a kiosk, or an intelligent Internet-of-Things (IoT) edge device in the field. With containerized cognitive services, AI abilities can easily be part of your on-premise infrastructure without the need for AI engineers and ML researchers.


At VIDIZMO, we take containers a step further by including support for them in our modern video streaming platform. So, you can create a container of Azure Cognitive services and use it with VIDIZMO to generate AI insights from your digital media. You can take greater advantage and move technologies such as AI closer to the edge, where they can reduce latency and boost performance. 



VIDIZMO With Cognitive Services Provides You


Visual Text Recognition

Using OCR capabilities, text that is visually displayed in a video is captured and indexed to be made searchable in a video.


Closed Captioning

Creates closed captioning files in VTT format. These are downloadable and easily readable using our transcription pane. To know more, see: Understanding Transcription Pane


Multi-Language Detection

Prior to generating closed captions, it is necessary to understand the language that is used in the media. VIDIZMO can identify multiple languages in a single media file. All you need to do is to provide the language identification endpoint, i.e. language containers on your on-prem server. 


Multi-language detection works on the selected options of your chosen segmentation criteria. i.e. confidence-based or language detection-based. Confidence is when the transcript is segmented on the basis of high confidence for the detected language whereas language detection is whenever a language is detected in the speech.


If all of your media is in a single language, use single language identification. 


Note: For language detection, you need to deploy language containers and provide their endpoint is the VIDIZMO portal settings.

Audio Transcription

With VIDIZMO's transcription facility, you can generate transcripts by converting the speech into text by defining the languages you want to generate transcripts into. If your defined language is not found in your media file, the transcript will be generated in the language you have set as "fallback language".


Keywords Extraction 

Intelligent video processing techniques including semantic and logical analysis extract various keywords from the visuals and audio of the video to make it more searchable.


Technical Considerations 

Pre-requisites and Integrations

To get started with Azure Cognitive Services, you need a Microsoft Azure account. 

Setting up an Azure Cognitive Services product is quick and easy

To set up a cognitive service:

  1. Log in with your Azure administrator account
  2. Go to the Azure cognitive services dashboard
  3. Search for the service you want to use and click Create (for multiple services use multi-service account)
  4. Provide the necessary details and click on Revie+Create
  5. When the resource is created, save the keys and endpoints. These will be used to make calls to the resource from within your application.

You can integrate the services into your application by calling the API.

You can monitor your usage using the Azure Dashboard.