๐ฑ๐น Lithuanian ASR Leaderboard (Local Results)
Overall (averages)
Model | Avg WER (all) | Avg CER (all) | Avg WER (excl in) | Avg CER (excl in) |
---|---|---|---|---|
whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered-ggml.bin | 1.1824999999999999 | 0.6599999999999999 | 0.38000000000000006 | 0.24333333333333332 |
CV13 (WER, CER)
Model | WER | CER |
---|---|---|
whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered-ggml.bin | 0.37 | 0.04 |
Model | WER | CER |
---|---|---|
DrishtiSharma/whisper-large-v2-lithuanian | 0.2 | 0.04 |
sam8000/whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered | 0.37 | 0.23 |
Aismantas/whisper-base-lithuanian | 0.42 | 0.1 |
whisper-large-v2-lithuanian-ggml.bin | 1.04 | 0.55 |
whisper-base-lithuanian-ggml.bin | 1.17 | 0.58 |
whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered-ggml.bin | 1.39 | 0.82 |
CV17 (WER, CER)
Model | WER | CER |
---|---|---|
whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered-ggml.bin | 0.37 | 0.04 |
Model | WER | CER |
---|---|---|
DrishtiSharma/whisper-large-v2-lithuanian | 0.2 | 0.04 |
sam8000/whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered | 0.37 | 0.24 |
Aismantas/whisper-base-lithuanian | 0.42 | 0.1 |
whisper-large-v2-lithuanian-ggml.bin | 1.02 | 0.54 |
whisper-base-lithuanian-ggml.bin | 1.18 | 0.59 |
whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered-ggml.bin | 1.4 | 0.82 |
LIEPA2 (WER, CER)
Model | WER | CER |
---|---|---|
whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered-ggml.bin | 0.66 | 0.12 |
Model | WER | CER |
---|---|---|
DrishtiSharma/whisper-large-v2-lithuanian | 0.4 | 0.12 |
sam8000/whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered | 0.4 | 0.26 |
Aismantas/whisper-base-lithuanian | 0.66 | 0.2 |
whisper-large-v2-lithuanian-ggml.bin | 1.31 | 0.76 |
whisper-base-lithuanian-ggml.bin | 1.53 | 0.98 |
whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered-ggml.bin | 2.41 | 1.63 |
LITHUANIA (WER, CER)
Model | WER | CER |
---|---|---|
whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered-ggml.bin | 0.49 | 0.13 |
Model | WER | CER |
---|---|---|
DrishtiSharma/whisper-large-v2-lithuanian | 0.3 | 0.13 |
whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered-ggml.bin | 0.49 | 0.35 |
whisper-large-v2-lithuanian-ggml.bin | 0.5 | 0.25 |
Aismantas/whisper-base-lithuanian | 0.65 | 0.25 |
sam8000/whisper-large-v3-turbo-lithuanian-lithuania-0.06-cer-filtered | 0.76 | 0.74 |
whisper-base-lithuanian-ggml.bin | 0.85 | 0.49 |
Evaluation
- GPU: 1 ร NVIDIA GeForce RTX 4090
๐ Models
- Whisper Large V2 Lithuanian (GGML)
- Whisper Large V3 Turbo Lithuanian 0.06 CER Filtered (GGML)
- Whisper Base Lithuanian (GGML)
๐ Datasets
- Lithuania 0.06 CER Filtered
- Liepa-2
- Common Voice 13.0 (Lithuanian subset)
- Common Voice 17.0 (Lithuanian subset)
Tip: add new JSON files to asr_data/results/
and click Reload to refresh the tables.