运行模型后输入想要聊天机器人回复的语句后提示A decoder-only architecture is being used, but right-padding was detected! For correct generation results, please set padding_side='left' when initializing the tokenizer. DialoGPT: Money buys happiness, but it also buys a lot of things that make you happy.需要如何修改
时间: 2023-05-27 11:01:26 浏览: 76
这个提示意味着你的聊天机器人模型只有解码器部分,而在输入中发现了右侧填充。为了正确生成结果,请在初始化分词器时设置padding_side='left'。具体做法可以在分词器的初始化代码中添加一个参数padding_side='left',例如:tokenizer = AutoTokenizer.from_pretrained("microsoft/DialoGPT-medium", padding_side='left'),这样就可以消除提示信息并进行聊天机器人的回复了。
相关问题
输入想要聊天机器人回复的语句后提示A decoder-only architecture is being used, but right-padding was detected! For correct generation results, please set padding_side='left' when initializing the tokenizer.需要如何修改
如果您使用的是Transformers库中的tokenizer,可以在初始化tokenizer时设置padding_side='left',以解决这个问题。示例代码如下:
```
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained('my_model', padding_side='left')
```
如果您使用的不是Transformers库中的tokenizer,请查看相关文档或代码,了解如何设置padding_side参数。
运行模型后提示A decoder-only architecture is being used, but right-padding was detected! For correct generation results, please set `padding_side='left'` when initializing the tokenizer.需要如何修改
您需要在初始化tokenizer时将padding_side参数设置为'left',以解决此问题。例如:
```
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained('model_name', padding_side='left')
model = AutoModelForCausalLM.from_pretrained('model_name')
```
这将确保在填充序列时使用左填充,与decoder-only架构兼容。