FAB Subtitler Server uses Whisper for transcription. Following is some information about GPU usage with different types of GPU cards.
The following command can be used to display the current usage of the GPU card:
nvidia-smi -l 1
NVidia A4000 16GB RAM
GPU Usage for one concurrent file transcription:
- Whisper version: faster-whisper-1.01-20240223.zip
- Card model: NVidia RTX A4000
- Temperature: 64° C
- Memory usage: approx 3GB out of available 16GB
- GPU usage: 81% (changes between 50% and 99%)
GPU Usage for one concurrent live transcription:
- Whisper version: faster-whisper-1.01-20240223.zip
- Card model: NVidia RTX A4000
- Temperature: 83° C
- Memory usage: approx 3GB out of available 16GB
- GPU usage: 65% (changes between 50% and 80%)
GPU Usage for two concurrent live transcriptions:
- Whisper version: faster-whisper-1.01-20240223.zip
- Card model: NVidia RTX A4000
- Temperature: 78° C
- Memory usage: approx 5GB out of available 16GB
- GPU usage: 97% (changes between 90% and 99%)
- CARD IS NOT RECOMMENDED FOR 2 CONCURRENT LIVE TRANSCRIPTIONS
NVidia RTX 3060 12GB
GPU Usage for one concurrent file transcription:
- Whisper version: faster-whisper-1.01-20240223.zip
- Card model: NVidia RTX 3060
- Temperature: 41° C
- Memory usage: approx 3 GB out of available 12GB
- GPU usage: 77% (changes between 45% and 99%)
GPU Usage for one concurrent live transcription:
- Whisper version: faster-whisper-1.01-20240223.zip
- Card model: NVidia RTX 3060
- Temperature: 49° C
- Memory usage: approx 3GB out of available 12GB
- GPU usage: 54% (changes between 50% and 99%)
GPU Usage for two concurrent live transcriptions:
- Whisper version: faster-whisper-1.01-20240223.zip
- Card model: NVidia RTX 3060
- Temperature: 53° C
- Memory usage: approx 4GB out of available 12GB
- GPU usage: 93% (changes between 80% and 99%)
- CARD CANNOT HANDLE 2 CONCURRENT LIVE TRANSCRIPTIONS
NVidia A2 16GB RAM
GPU Usage for one concurrent file transcription:
- Whisper version: faster-whisper-1.01-20240223.zip
- Card model: NVidia A2 16GB
- Temperature: 79° C
- Memory usage: approx 5GB out of available 16GB
- GPU usage: 95% (changes between 90% and 99%)
GPU Usage for one concurrent LIVE transcription:
- Whisper version: faster-whisper-1.01-20240223.zip
- Card model: NVidia A2 16GB
- Temperature: 83° C
- Memory usage: approx 4GB out of available 16GB
- GPU usage: 97% (changes between 0% and 99%)
- CARD CANNOT BE USED FOR LIVE TRANSCRIPTION IN REAL TIME
GPU Usage for two concurrent LIVE transcriptions:
- Whisper version: faster-whisper-1.01-20240223.zip
- Card model: NVidia A2 16GB
- Temperature: 84° C
- Memory usage: approx 9GB out of available 16GB
- GPU usage: 100% (changes between 99% and 100%)
- CARD CANNOT BE USED FOR LIVE TRANSCRIPTION IN REAL TIME
This page was last updated on 2024-04-24