Hugging Face's logo

James-WYang
/
BigTranslate

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Model card Files
xet
 Community
4

LLaMATokenizer renders this incompatible with huggingfaces transformers pipeline

#1
by Alignment-Lab-AI - opened
Discussion
Alignment-Lab-AI

in transformers the tokenizer is listed as LlamaTokenizer
attempting to run this through any transformers based system results in an error, rendering it incompatible unless the user downloads it and renames it themselves.

James-WYang
 Owner
•
edited Jun 15, 2023

Thanks for your suggestion!
We construct the LLaMA based on the code in the BigTrans, so we import tokenizer as llama.LLaMATokenizer, which may conflict with transformers. Therefore, we recommend downloading the code in the BigTrans and using BigTrans model and tokenizer.
Alignment-Lab-AI
•
edited Jun 17, 2023

i believe attempting to even download the model from huggingface throws the error, its been a bit over a week since i involved BigTrans in my research but i believe i had to wget each file link to retrieve it
James4Ever0

I have a potential solution. See details here.

Sign up or log in to comment