Reproducing and Comparing Distillation Techniques for Cross-Encoders
Paper
• 2603.03010 • Published
reproducing-cross-encoders
A set of cross-encoders trained from various backbones and losses for equal comparison
-
-
xpmir/cross-encoder-ettin-150m-infoNCE
Text Classification • 0.1B • Updated • 53 -
xpmir/cross-encoder-ELECTRA-MarginMSE
Text Classification • 0.1B • Updated • 47 -
xpmir/cross-encoder-RoBERTa-Hinge
Text Classification • 0.1B • Updated • 38 -
xpmir/cross-encoder-DeBERTav3-MarginMSE
Text Classification • 0.2B • Updated • 37 -
xpmir/cross-encoder-DeBERTav3-Hinge
Text Classification • 0.2B • Updated • 35 -
xpmir/cross-encoder-RoBERTa-DistillRankNET
Text Classification • 0.1B • Updated • 39 -
xpmir/cross-encoder-ELECTRA-DistillRankNET
Text Classification • 0.1B • Updated • 36 -
xpmir/cross-encoder-ettin-150m-Hinge
Text Classification • 0.1B • Updated • 39 -
xpmir/cross-encoder-DeBERTav3-DistillRankNET
Text Classification • 0.2B • Updated • 34 -
xpmir/cross-encoder-ELECTRA-Hinge
Text Classification • 0.1B • Updated • 37 -
xpmir/cross-encoder-DeBERTav3-BCE
Text Classification • 0.2B • Updated • 39 -
xpmir/cross-encoder-DeBERTav3-ADR-MSE
Text Classification • 0.2B • Updated • 42 -
xpmir/cross-encoder-bert-base-ADR-MSE
Text Classification • 0.1B • Updated • 41 -
xpmir/cross-encoder-ettin-150m-ADR-MSE
Text Classification • 0.1B • Updated • 40 -
xpmir/cross-encoder-ettin-150m-MarginMSE
Text Classification • 0.1B • Updated • 43 -
xpmir/cross-encoder-bert-base-DistillRankNET
Text Classification • 0.1B • Updated • 37 -
xpmir/cross-encoder-bert-base-infoNCE
Text Classification • 0.1B • Updated • 34 -
xpmir/cross-encoder-DeBERTav3-infoNCE
Text Classification • 0.2B • Updated • 41 -
xpmir/cross-encoder-ELECTRA-ADR-MSE
Text Classification • 0.1B • Updated • 36 -
xpmir/cross-encoder-RoBERTa-MarginMSE
Text Classification • 0.1B • Updated • 38 -
xpmir/cross-encoder-bert-base-Hinge
Text Classification • 0.1B • Updated • 39 -
xpmir/cross-encoder-ettin-150m-BCE
Text Classification • 0.1B • Updated • 37 -
xpmir/cross-encoder-bert-base-MarginMSE
Text Classification • 0.1B • Updated • 44 -
xpmir/cross-encoder-RoBERTa-infoNCE
Text Classification • 0.1B • Updated • 39 -
xpmir/cross-encoder-ELECTRA-infoNCE
Text Classification • 0.1B • Updated • 27 -
xpmir/cross-encoder-RoBERTa-BCE
Text Classification • 0.1B • Updated • 39 -
xpmir/cross-encoder-RoBERTa-ADR-MSE
Text Classification • 0.1B • Updated • 39 -
xpmir/cross-encoder-ettin-150m-DistillRankNET
Text Classification • 0.1B • Updated • 38 -
xpmir/cross-encoder-MiniLM-L12-ADR-MSE
Text Classification • 33.4M • Updated • 37 -
xpmir/cross-encoder-ettin-32m-DistillRankNET
Text Classification • 32M • Updated • 82 -
xpmir/cross-encoder-ettin-17m-infoNCE
Text Classification • 16.9M • Updated • 38 -
xpmir/cross-encoder-ettin-68m-DistillRankNET
Text Classification • 68.4M • Updated • 31 -
xpmir/cross-encoder-ettin-17m-Hinge
Text Classification • 16.9M • Updated • 30 -
xpmir/cross-encoder-ettin-68m-MarginMSE
Text Classification • 68.4M • Updated • 37 -
xpmir/cross-encoder-ettin-68m-Hinge
Text Classification • 68.4M • Updated • 39 -
xpmir/cross-encoder-ettin-68m-BCE
Text Classification • 68.4M • Updated • 39 -
xpmir/cross-encoder-ettin-32m-ADR-MSE
Text Classification • 32M • Updated • 32 -
xpmir/cross-encoder-ettin-32m-infoNCE
Text Classification • 32M • Updated • 41 -
xpmir/cross-encoder-MiniLM-L12-DistillRankNET
Text Classification • 33.4M • Updated • 42 -
xpmir/cross-encoder-MiniLM-L12-Hinge
Text Classification • 33.4M • Updated • 34 -
xpmir/cross-encoder-MiniLM-L12-infoNCE
Text Classification • 33.4M • Updated • 35 -
xpmir/cross-encoder-ettin-17m-ADR-MSE
Text Classification • 16.9M • Updated • 38 -
xpmir/cross-encoder-ettin-32m-Hinge
Text Classification • 32M • Updated • 33 -
xpmir/cross-encoder-ettin-68m-infoNCE
Text Classification • 68.4M • Updated • 39 -
xpmir/cross-encoder-ettin-17m-MarginMSE
Text Classification • 16.9M • Updated • 42 -
xpmir/cross-encoder-ettin-68m-ADR-MSE
Text Classification • 68.4M • Updated • 39 -
xpmir/cross-encoder-ettin-32m-BCE
Text Classification • 32M • Updated • 39 -
xpmir/cross-encoder-ettin-17m-DistillRankNET
Text Classification • 16.9M • Updated • 35 -
xpmir/cross-encoder-MiniLM-L12-MarginMSE
Text Classification • 33.4M • Updated • 42 -
xpmir/cross-encoder-MiniLM-L12-BCE
Text Classification • 33.4M • Updated • 36 -
xpmir/cross-encoder-ettin-32m-MarginMSE
Text Classification • 32M • Updated • 42 -
xpmir/cross-encoder-ettin-17m-BCE
Text Classification • 16.9M • Updated • 44 -
xpmir/cross-encoder-ELECTRA-BCE
Text Classification • 0.1B • Updated • 46 -
xpmir/cross-encoder-bert-base-BCE
Text Classification • 0.1B • Updated • 43