Please refer to the official documentation for specific usage instructions
@NikolayKozloff Thanks for your interests on Seed-X. We noticed that you have released the quantitative version of Seed-X, but due to significant fluctuations in the model's performance after quantification, it has affected many people who are interested in trying it out.
Please add the following line to the readme: Quantized models are unstable. Please refer to the official documentation for specific usage instructions (https://huggingface.co/ByteDance-Seed/Seed-X-PPO-7B#quickstart). We will soon release an official quantized model. Thanks a lot.
Yes they are quite unstable. In case anyone is interested now HugstonOne supports Seed-coder-instruct-8b, and is quite impressive model actually.
Here: https://hugston.com/uploads/llm_models/Seed-Coder-8B-Instruct-f16.gguf
