给我推荐20个比较流行的nlp预训练模型源码
时间: 2023-02-07 18:12:09 浏览: 92
非常好!这是 20 个比较流行的 NLP 预训练模型的源码:
1. BERT: https://github.com/google-research/bert
2. GPT-2: https://github.com/openai/gpt-2
3. RoBERTa: https://github.com/pytorch/fairseq/tree/master/examples/roberta
4. XLNet: https://github.com/zihangdai/xlnet
5. XLM: https://github.com/facebookresearch/XLM
6. ALBERT: https://github.com/brightmart/albert_zh
7. T5: https://github.com/google-research/text-to-text-transfer-transformer
8. ELECTRA: https://github.com/google-research/electra
9. BART: https://github.com/pytorch/fairseq/tree/master/examples/bart
10. ERNIE: https://github.com/PaddlePaddle/ERNIE
11. Reformer: https://github.com/openai/reformer-pytorch
12. DeBERTa: https://github.com/google-research/google-research/tree/master/deberta
13. MT-DNN: https://github.com/namisan/mt-dnn
14. SpanBERT: https://github.com/facebookresearch/SpanBERT
15. FlauBERT: https://github.com/flaubert-nlp/flaubert
16. MASS: https://github.com/huggingface/transformers/tree/master/examples/mass
17. LXMERT: https://github.com/airKlizz/LXMERT
18. ONNX-BERT: https://github.com/onnx/models/tree/master/text/bert
19. DistilBERT: https://github.com/huggingface/transformers/tree/master/examples/distillation/bert
20. XLM-RoBERTa: https://github.com/pytorch/fairseq/tree/master/examples/xlm_roberta
希望这些源码能帮到你!