Using live transcription in FAB Subtitler

FAB Subtitler supports several transcription services for speech recognition for:

Introduction to live transcription

FAB Subtitler LIVE/MPEG supports the use of cloud-based speech recognition services for transcription of live video/audio streams. This is mostly used for subtitling of live programs, but it could also be used for transcription of retransmissio of live programs. FAB Subtitler transfers live audio to the cloud and receives the recognized text with a few seconds delay and can transmit the recognized text as subtitles. Subtitles can be transmitted in block mode as complete subtitle or in word by word mode to reduce delay for the viewer.

FAB Subtitler supports the following cloud transcription services for live transcription.

The quality of the recognized text is generally not 100% perfect and recognized texts can be transmitted without correction. However it is also possible to correct recognized texts in FAB Subtitler before they are transmitted.

Configuration of FAB Subtitler for live transcription


Google Speech to Text

Options - Live Transcription

  • JSON Key: The JSON Key is a text file which has to be loaded from a JSON file or the content has to be copied into this field. You will find a description how to obtain the JSON key further below.

  • To configure the Google Cloud to be used with FAB Subtitler follow these instructions:

  • Visit https://cloud.google.com and create an account. In July 2018 Google offered a trial account with USD 300 credit which can be used within 12 months. This allows extensive testing of the Google cloud service.

  • Before you can use the Google cloud you must first create a project. Create a project with the name FAB-ASR-Project as shown below

  • Select the project FAB-ASR-Project as the current project

  • Create Credentials for a new service account in the API Manager

  • Enter your service account details

google cloud plattform-create service account1

  • Set the service account permissions

google_cloud_plattform-create_service_account2-role

  • Create the Json key

google cloud plattform-create service account3

  • After the previous step the JSON file with the credentials for the new service account will be downloaded to the computer. The JSON file shall be imported into FAB Subtitler Options /Special / Transcription / Google Speech to Text:

Adding Json to FAB Subtitler

Scriptix

To configure FAB Subtitler to use Scriptix cloud service as the transcription service open Options / Special / Transcription:

  • Enter the API Key for Scriptix Live (Realtime) Transcription

  • The API Key can be generated by Scriptix in the web interface

  • Register a new account or login to your existing account: https://api.zoommedia.ai/login/register

  • Enter your billing profile (in the “Profile & Settings”) and select your preferred subscription (“Subscription & Bundles”)

  • Go to “API Tokens”

Scriptix add api key

  • Select “Realtime” token type:

scriptix token type

  • Copy the realtime API token from the API Tokens page into the FAB Subtitler

Microsoft

To configure FAB Subtitler to use Microsoft Azure as the transcription service open Options / Special / Transcription:

After logging into https://portal.azure.com:

  • Click on “Create a resource” and search for “Speech”

  • The click on “Create” for Speech

  • Enter the data for the fields as in the picture below

  • The confirmation page will also display the Location and then click on “Go to resource”

  • Click on “Keys and Endpoint” to select one of the API Keys that has to be entered in FAB Subtitler settings

Azure keys

Using Live Transcription Functionality in FAB Subtitler

FAB Subtitler can transfer live audio received over SDI video or IP video to the live transcription service and transmit live subtitles with texts that are recognized by the live transcription service.

To be able to use this functionality it is first necessary to configure the “Video in a Window” functionality in FAB Subtitler correctly so that FAB Subtitler will receive live video/audio and display it on the PC monitor. Find out how on this page.

To display live video first create a new subtitle file and then click on “Display / Editor over video”. After the video is displayed on the PC monitor and you also hear the audio you can activate the transfer of the audio to the transcription service by:

  • Click on “News” in the ribbon.
  • Then click on “Speech Interface” to display a window with the speech interface.
  • Enable or disable “Automatic Mode” depending on whether you wish to transmit recognized text automatically or if you wish to be able to correct the text before transmitting the text as subtitles.
  • Then click on “Transcribe from Video” or “Transcribe from Microphone”

The recognized text will appear in the speech interface window.

Alternatively for testing purposes it is also possible to use a video file as a source for live transcription. In such case simply open a video file in FAB Subtitler, play the file and click on “Transcribe from Video”. The played audio from the video file will be sent to the live transcription service and the transcribed text will appear in the speech interface.

Detailed information about the speech interface can be found here: How to use the speech interface.

Controlling Live transcription using RESTful API

FAB Subtitler LIVE and MPEG offer a RESTful service API, which can be used to control the Live transcription over http to perform the following actions:

  • START the live transcription
  • STOP the live transcription

The following parameters, which are optional, can be defined:

  • provider: Azure, Google, Scriptix
  • language
  • filename
  • useMic – transcribe from mic or from received live video

If the parameter isn’t explicitly defined, the FAB Subtitler will select the default parameter as it is defined in “Options” and useMIC will be set to “False”.

Example REST API requests:

Start live transcription request: GET /livetranscription/start
Example: GET http://ip:port/livetranscription/start?language=de-DE&provider=Google&filename=transcription.stl&useMic=False
Simplified example: GET http://ip:port/livetranscription/start

Stop live transcription request: GET /livetranscription/stop
Example: http://ip:port/livetranscription/stop

To enable the RESTful API over http please configure FAB Subtitler the following way:

  • In Options/Special/Automation configure the following:

Live transcription automation configuration

Detailed information on how to check, whether the RESTful API is available can be found here: Configuring RESTful service API

  • Start the Automatic mode in Extras / Tools / Start automatic mode:

Start automatic mode

  • A new window “Live transcription status” will appear in the top right corner allowing the user to manually stop the automatic mode and control the transcription if required:

Live transcription status