Kimi-Linear-48B-A3B-Instruct

#1797
by jacek2024 - opened

let's hope yesterday's one is fine, my friend who updates llama cpp is sleeping =)

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Kimi-Linear-48B-A3B-Instruct-GGUF for quants to appear.

something is blocked?

I don't see Kimi Linear Instruct anywhere, I see Kimi-Linear-48B-A3B-Base in status

Let me try again, something went wrong with the model, but we updated to the latest everything right now so hopefully would be fine

it's probably still in queue, high traffic maybe :)

High abuse of the server rn from my side as well =)

Do you have any estimate for when this GGUF might be created?

really depends on how lucky we are, because right now we are having some issues after the update... let's hope tomorrow ?

jacek2024 changed discussion status to closed

still in queue, that's crazy ...
Well, we are processing only on rich1 (my server that is currently abused but quanting a bit slow).... and nico1 is paused because he is processing big imatrix, sorry for delay =(

I asked because I wanted to feature you in this post https://www.reddit.com/r/LocalLLaMA/comments/1r0gju0/kimilinear48ba3binstruct/ but I have GGUF from Bartowski now

Ah alright, well... next time then, whenever the queue is a bit more empty and servers are a bit less abused, feel free to queue more models, Im always here for new posts =)

{D7DCD017-1897-49A6-9AB5-B577373EFECF}

Sign up or log in to comment