FAB Subtitler Server uses Whisper for transcription. Following is some information about GPU usage with different types of CPU and GPU configurations.

Test results for file transcription

The following chart shows the duration of file transcription for a 60 minutes mp4 video file on PCs with different CPU and GPU configurations using the medium Whisper model with faster whisper 1.0.3.

The same measurement was done with different video files with different durations and in different languages. All tests had similar results so that it can be assumed that the performance comparison does not depend on the language and also not on duration of the video file.

The measured times do not include loading of the whisper model at the beginning of transcription and the video file was stored on local drive C:

GPU Measurements

The following command can be used to display the current usage of the GPU card:

nvidia-smi -l 1

Nvidia A4000 16GB RAM

GPU Usage for one concurrent file transcription:

• Whisper version: faster-whisper-1.01-20240223.zip
• Card model: Nvidia RTX A4000
• Temperature: 64° C
• Memory usage: approx 3GB out of available 16GB
• GPU usage: 81% (changes between 50% and 99%)

GPU Usage for one concurrent live transcription:

• Whisper version: faster-whisper-1.01-20240223.zip
• Card model: Nvidia RTX A4000
• Temperature: 83° C
• Memory usage: approx 3GB out of available 16GB
• GPU usage: 65% (changes between 50% and 80%)

GPU Usage for two concurrent live transcriptions:

• Whisper version: faster-whisper-1.01-20240223.zip
• Card model: Nvidia RTX A4000
• Temperature: 78° C
• Memory usage: approx 5GB out of available 16GB
• GPU usage: 97% (changes between 90% and 99%)
• CARD IS NOT RECOMMENDED FOR 2 CONCURRENT LIVE TRANSCRIPTIONS

Nvidia RTX 3060 12GB

GPU Usage for one concurrent file transcription:

• Whisper version: faster-whisper-1.01-20240223.zip
• Card model: Nvidia RTX 3060
• Temperature: 41° C
• Memory usage: approx 3 GB out of available 12GB
• GPU usage: 77% (changes between 45% and 99%)

GPU Usage for one concurrent live transcription:

• Whisper version: faster-whisper-1.01-20240223.zip
• Card model: Nvidia RTX 3060
• Temperature: 49° C
• Memory usage: approx 3GB out of available 12GB
• GPU usage: 54% (changes between 50% and 99%)

GPU Usage for two concurrent live transcriptions:

• Whisper version: faster-whisper-1.01-20240223.zip
• Card model: Nvidia RTX 3060
• Temperature: 53° C
• Memory usage: approx 4GB out of available 12GB
• GPU usage: 93% (changes between 80% and 99%)
• CARD CANNOT HANDLE 2 CONCURRENT LIVE TRANSCRIPTIONS

Nvidia A2 16GB RAM

GPU Usage for one concurrent file transcription:

• Whisper version: faster-whisper-1.01-20240223.zip
• Card model: Nvidia A2 16GB
• Temperature: 79° C
• Memory usage: approx 5GB out of available 16GB
• GPU usage: 95% (changes between 90% and 99%)

GPU Usage for one concurrent LIVE transcription:

• Whisper version: faster-whisper-1.01-20240223.zip
• Card model: Nvidia A2 16GB
• Temperature: 83° C
• Memory usage: approx 4GB out of available 16GB
• GPU usage: 97% (changes between 0% and 99%)
• CARD CANNOT BE USED FOR LIVE TRANSCRIPTION IN REAL TIME

GPU Usage for two concurrent LIVE transcriptions:

• Whisper version: faster-whisper-1.01-20240223.zip
• Card model: Nvidia A2 16GB
• Temperature: 84° C
• Memory usage: approx 9GB out of available 16GB
• GPU usage: 100% (changes between 99% and 100%)
• CARD CANNOT BE USED FOR LIVE TRANSCRIPTION IN REAL TIME

This page was last updated on 2024-10-03