University of Modena and Reggio Emilia

Protein language model that grows its own depth and width during masked-language pretraining on the human proteome, reaching 76.0% Pfam-50 accuracy.

Physiological signal foundation model for ECG, EMG, and EEG pairing learnable multi-scale wavelet decomposition with masked transformer pretraining.