ZeroBERTo: Leveraging Zero-Shot Text Classification by Topic Modeling

Alexandre Alcoforado, Thomas Palmeira Ferraz, Rodrigo Gerber, Enzo Bustos, André Seidel Oliveira, Bruno Miguel Veloso, Fabio Levy Siqueira, Anna Helena Reali Costa

PROPOR, 2022

TL;DR: ZeroBERTo combines topic modeling with language models for zero-shot text classification, overcoming input size limitations and reducing runtime, achieving a 12% better F1 score and 13x faster inference compared to XLM-R on a Portuguese benchmark.

ARXIV BIB PDF

Text Classification Topic Modeling