FAB Subtitler supports several transcription services for speech recognition for:
transcription of video/audio files in FAB Subtitler PRO/LIVE/MPEG
live transcription of live video/audio streams in FAB Subtitler LIVE/MPEG (described on this page)
Introduction to live transcription
FAB Subtitler LIVE/MPEG supports the use of cloud-based speech recognition services for transcription of live video/audio streams. This is mostly used for subtitling of live programs, but it could also be used for transcription of retransmissio of live programs. FAB Subtitler transfers live audio to the cloud and receives the recognized text with a few seconds delay and can transmit the recognized text as subtitles. Subtitles can be transmitted in block mode as complete subtitle or in word by word mode to reduce delay for the viewer.
FAB Subtitler supports the following cloud transcription services for live transcription.
- Google Speech to Text. Supported languages are listed here.
- Scriptix Speech to Text . Among others the following languages are supported: Arabic, Danish, Dutch, English, Filipino, Finnish, Flemish, German, Italian, Norwegian, Spanish, Swedish
- Microsoft Azure Cognitive services. Supported languages are listed here
The quality of the recognized text is generally not 100% perfect and recognized texts can be transmitted without correction. However it is also possible to correct recognized texts in FAB Subtitler before they are transmitted.
Configuration of FAB Subtitler for live transcription
Google Speech to Text
JSON Key: The JSON Key is a text file which has to be loaded from a JSON file or the content has to be copied into this field. You will find a description how to obtain the JSON key further below.
To configure the Google Cloud to be used with FAB Subtitler follow these instructions:
Visit https://cloud.google.com and create an account. In July 2018 Google offered a trial account with USD 300 credit which can be used within 12 months. This allows extensive testing of the Google cloud service.
Before you can use the Google cloud you must first create a project. Create a project with the name FAB-ASR-Project as shown below
- Select the project FAB-ASR-Project as the current project
- Create Credentials for a new service account in the API Manager
- Enter your service account details
- Set the service account permissions
- Create the Json key
- After the previous step the JSON file with the credentials for the new service account will be downloaded to the computer. The JSON file shall be imported into FAB Subtitler Options /Special / Transcription / Google Speech to Text:
To configure FAB Subtitler to use Scriptix cloud service as the transcription service open Options / Special / Transcription:
Enter the API Key for Scriptix Live (Realtime) Transcription
The API Key can be generated by Scriptix in the web interface
Register a new account or login to your existing account: https://api.zoommedia.ai/login/register
Enter your billing profile (in the “Profile & Settings”) and select your preferred subscription (“Subscription & Bundles”)
Go to “API Tokens”
- Select “Realtime” token type:
- Copy the realtime API token from the API Tokens page into the FAB Subtitler
To configure FAB Subtitler to use Microsoft Azure as the transcription service open Options / Special / Transcription:
- API Key & Location: You will have to obtain both the API Key and the location from https://portal.azure.com
After logging into https://portal.azure.com:
- Click on “Create a resource” and search for “Speech”
- The click on “Create” for Speech
- Enter the data for the fields as in the picture below
- The confirmation page will also display the Location and then click on “Go to resource”
- Click on “Keys and Endpoint” to select one of the API Keys that has to be entered in FAB Subtitler settings
Using Live Transcription Functionality in FAB Subtitler
FAB Subtitler can transfer live audio received over SDI video or IP video to the live transcription service and transmit live subtitles with texts that are recognized by the live transcription service.
To be able to use this functionality it is first necessary to configure the “Video in a Window” functionality in FAB Subtitler correctly so that FAB Subtitler will receive live video/audio and display it on the PC monitor. Find out how on this page.
To display live video first create a new subtitle file and then click on “Display / Editor over video”. After the video is displayed on the PC monitor and you also hear the audio you can activate the transfer of the audio to the transcription service by:
- Click on “News” in the ribbon.
- Then click on “Speech Interface” to display a window with the speech interface.
- Enable or disable “Automatic Mode” depending on whether you wish to transmit recognized text automatically or if you wish to be able to correct the text before transmitting the text as subtitles.
- Then click on “Transcribe from Video” or “Transcribe from Microphone”
The recognized text will appear in the speech interface window.
Alternatively for testing purposes it is also possible to use a video file as a source for live transcription. In such case simply open a video file in FAB Subtitler, play the file and click on “Transcribe from Video”. The played audio from the video file will be sent to the live transcription service and the transcribed text will appear in the speech interface.
Detailed information about the speech interface can be found here: How to use the speech interface.
Controlling Live transcription using RESTful API
FAB Subtitler LIVE and MPEG offer a RESTful service API, which can be used to control the Live transcription over http to perform the following actions:
- START the live transcription
- STOP the live transcription
The following parameters, which are optional, can be defined:
- provider: Azure, Google, Scriptix
- useMic – transcribe from mic or from received live video
If the parameter isn’t explicitly defined, the FAB Subtitler will select the default parameter as it is defined in “Options” and useMIC will be set to “False”.
Example REST API requests:
Start live transcription request: GET /livetranscription/start
Example: GET http://ip:port/livetranscription/start?language=de-DE&provider=Google&filename=transcription.stl&useMic=False
Simplified example: GET http://ip:port/livetranscription/start
Stop live transcription request: GET /livetranscription/stop
To enable the RESTful API over http please configure FAB Subtitler the following way:
- In Options/Special/Automation configure the following:
Detailed information on how to check, whether the RESTful API is available can be found here: Configuring RESTful service API
- Start the Automatic mode in Extras / Tools / Start automatic mode:
- A new window “Live transcription status” will appear in the top right corner allowing the user to manually stop the automatic mode and control the transcription if required: