Publications on "Speech Processing"

2024

Multilingual DistilWhisper: Efficient Distillation of Multi-task Speech Models via Language-Specific Experts

Thomas Palmeira Ferraz, Marcely Zanon Boito, Caroline Brun, Vassilina Nikoulina

ICASSP, 2024

TL;DR: Proposes a lightweight adaptation method bridging the gap between small and large speech models on under-represented languages by leveraging language-specific experts and knowledge distillation, outperforming fine-tuning and LoRA with minimal overhead.

ARXIV BIB PDF CODE

Speech Processing Multilingual

2023

Efficient Compression of Multitask Multilingual Speech Models

Thomas Palmeira Ferraz

Master Dissertation, Télécom Paris, Institut Polytechnique de Paris

TL;DR: We find that Whisper speaker and model-related biases are worsened by light compression (quantization), for low-resource languages and small models, and to address this we propose a distilled modular variant that markedly improves it for under-represented languages while preserving its multilingual, multitask strengths with minimal overhead.

ARXIV BIB PDF CODE VIDEO

Speech Processing Multilingual Compression Thesis