推荐30个以上比较好的自然语言处理模型以及github源码?
时间: 2023-02-05 20:05:46 浏览: 343
1. BERT (Bidirectional Encoder Representations from Transformers): https://github.com/google-research/bert
2. GPT (Generative Pre-training Transformer): https://github.com/openai/gpt-3
3. Transformer: https://github.com/huggingface/transformers
4. ELMo (Embeddings from Language Models): https://github.com/allenai/allennlp
5. ULMFiT (Universal Language Model Fine-tuning for Text Classification): https://github.com/fastai/fastai
6. RoBERTa (Robustly Optimized BERT Pretraining Approach): https://github.com/pytorch/fairseq
7. ALBERT (A Lite BERT): https://github.com/google-research/albert
8. XLNet (eXtreme Language Modeling): https://github.com/zihangdai/xlnet
9. ERNIE (Enhanced Representation through Knowledge Integration): https://github.com/PaddlePaddle/ERNIE
10. T5 (Text-To-Text Transfer Transformer): https://github.com/google-research/text-to-text-transfer-transformer
11. MT-DNN (Multilingual Tasks with Deep Neural Networks): https://github.com/namisan/mt-dnn
12. DeBERTa (Decoding-enhanced BERT with Disentangled Attention): https://github.com/microsoft/DeBERTa
13. NeMo (Natural Language Modelling): https://github.com/NVIDIA/NeMo
14. Texar-PyTorch (Text Generation and Beyond): https://github.com/asyml/texar
15. FlauBERT (French BERT): https://github.com/getalp/FlauBERT
16. MMBT (Multilingual Multitask BERT): https://github.com/tluk/mmbt
17. XLM (Cross-lingual Language Model): https://github.com/pytorch/fairseq
18. BERTweet (BERT for Tweets): https://github.com/huggingface/twitter-bert
19. Reformer (Efficient Transformer): https://github.com/lucidrains/reformer-pytorch
20. BART (Denoising Autoencoding Transformations for Language Generation): https://github.com/pytorch/fairseq
21. K-BART (Knee-to-base BART): https://github.com/huggingface/k-bart
22. Megatron-LM (Scalable Language Model): https://github.com/NVIDIA/Megatron-LM
23. Funnel-Transformer (Efficient Transformer): https://github.com/openai/funnel-transformer
24. Electra (Efficient and Robust Pre-training for NLP): https://github.com/google-research/electra
25. GPT-2 (Language Model): https://github.com/openai/gpt-2
26. GPT-3 (Language Model): https://github.com/openai/gpt-3
27. Sparse Transformer (Efficient Transformer): https://github.com/lucidrains/sparse-transformer
28. LAMA (Language Model Analysis): https://github.com/huggingface/lama
29. Longformer
阅读全文