wenhua cheng

wenhuach's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Intel/Qwen3.5-35B-A3B-int4-AutoRound 2 days ago

Thanks! And MTP key question

7

#1 opened 3 days ago by

seanthomaswilliams

New activity in Intel/GLM-5-int4-mixed-AutoRound 3 days ago

vLLM fails to serve Intel/GLM-5-int4-mixed-AutoRound on NVIDIA DGX Spark (GB10, sm121) due to no valid MLA attention backend (qk_nope_head_dim 192)

1

#2 opened 3 days ago by

oliverjohnwilson

New activity in Intel/GLM-5-int4-mixed-AutoRound 4 days ago

This model always predicts some few nonsense sequences

4

#1 opened 6 days ago by

CharlesChen2023

New activity in Intel/Qwen3.5-122B-A10B-int4-AutoRound 6 days ago

Does the A100 work?

2

#1 opened 7 days ago by

xz123321

New activity in Intel/GLM-4.7-Flash-int4-AutoRound 13 days ago

Convert to gguf-q2ks-mixed-AutoRound?

🔥 2

4

#2 opened about 1 month ago by

limcheekin

New activity in Intel/Qwen3-Next-80B-A3B-Thinking-int4-AutoRound about 1 month ago

Qwen/Qwen3-Next-80B-A3B-Thinking has MMLU_PRO 82.7 but you guys get 0.7271

3

#2 opened 6 months ago by

hlxxxxxx

New activity in Intel/GLM-4.7-int4-mixed-AutoRound 2 months ago

AutoRound request: GLM-4.5-Air

1

#1 opened 2 months ago by

babytifa

New activity in Intel/Qwen3-30B-A3B-Instruct-2507-gguf-q2ks-mixed-AutoRound 2 months ago

2507 Thinking model release

11

#4 opened 5 months ago by

anjeysapkovski

New activity in kernels-community/quantization-gptq 2 months ago

How to use this kernel

#1 opened 2 months ago by

wenhuach

New activity in Intel/Qwen3-235B-A22B-Instruct-2507-gguf-q2ks-mixed-AutoRound 3 months ago

Thinking version has been deleted?

1

#2 opened 3 months ago by

reswewr

New activity in Intel/DeepSeek-R1-0528-Qwen3-8B-int4-AutoRound 3 months ago

Improve model card: Add pipeline tag, library name, and update paper/citation

🔥 1

#1 opened 3 months ago by

nielsr

New activity in Intel/Magistral-Small-2509-int4-AutoRound 4 months ago

Could we get more w2a16 w3a16 and w4a16 Autoround

👍 1

1

#1 opened 4 months ago by

twhitworth

New activity in Intel/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound 4 months ago

Practical performance feedback

1

#2 opened 4 months ago by

maigonis

New activity in Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound 4 months ago

Works good with vLLM, just no tool calling

1

#1 opened 6 months ago by

Ununnilium

New activity in Intel/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound 4 months ago

Inference with llama.cpp + Open WebUI gives repeating `?`

4

#1 opened 4 months ago by

whoisjeremylam

New activity in Intel/Qwen3-Next-80B-A3B-Thinking-int4-mixed-AutoRound 6 months ago

Adding `transformers` as the library tag

#3 opened 6 months ago by

ariG23498

CPU only?

4

#2 opened 6 months ago by

jujutechnology

New activity in Intel/Qwen3-Coder-480B-A35B-Instruct-int4-mixed-AutoRound 6 months ago

Error loading in vLLm 10.1+

👍 1

2

#2 opened 6 months ago by

freegheist

New activity in Intel/Qwen3-Coder-480B-A35B-Instruct-gguf-q2ks-mixed-AutoRound 7 months ago

Bits for embedding / lm-head / non expert layers

1

#1 opened 7 months ago by

sokann

New activity in Intel/Qwen3-Coder-480B-A35B-Instruct-int4-mixed-AutoRound 7 months ago

Awesome Any Chance for this for GLM-4.5

2

#1 opened 7 months ago by

Fernanda24