Transformers

Research

Lightweight Baselines for Medical Abstract Classification

Code and results behind our MLNLP 2025 paper: DistilBERT with plain cross-entropy is a strong default for classifying medical abstracts.