Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

nm-research updated a model 1 day ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.non-qwen3-step420136

nm-research published a model 1 day ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.non-qwen3-step420136

nm-research updated a model 1 day ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.causal-qwen235b-instruct-bs16-muon-ckpt4

View all activity

inference-optimization 's models 181

inference-optimization/ctest-Qwen3.5-9B-subset-397-speculator.dflash

2B • Updated May 20 • 4

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w4a16

Text Generation • 32B • Updated May 20 • 41

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w8a8

Text Generation • 235B • Updated May 20 • 42

inference-optimization/Qwen3-235B-A22B-Instruct-2507-quantized.w4a16

Text Generation • 32B • Updated May 20 • 43

inference-optimization/Qwen3.6-35B-A3B-6.0-bits-mode-hybrid

Image-Text-to-Text • 28B • Updated May 20 • 101

inference-optimization/Gemma4_SWA_DFLASH

4B • Updated May 19 • 72

inference-optimization/DSV4-tiny-empty

3B • Updated May 18 • 1.79k

inference-optimization/final-ctest-Qwen3-8B-speculator.dflash

2B • Updated May 13 • 6

inference-optimization/qwen3-8b-peagle-speculators

inference-optimization/peagle-gemma4

2B • Updated May 6

inference-optimization/ctest-Qwen3.5-9B-speculator.dflash

2B • Updated May 5 • 4

inference-optimization/MiniMax-M2.5-BF16

Text Generation • 229B • Updated May 5 • 33

inference-optimization/ctest-Qwen3-8B-speculator.dflash

2B • Updated May 5 • 9

inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK

inference-optimization/DeepSeek-V4-Flash-bf16

inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe

20B • Updated Apr 28 • 14

inference-optimization/DeepSeek-V4-Flash-bf16-dequantized-5layers

34B • Updated Apr 28 • 3

inference-optimization/Qwen3.6-35B-A3B-NVFP4

Updated Apr 23 • 5

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-gptq

2B • Updated Apr 22 • 3

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-qmod

2B • Updated Apr 22 • 2

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-qmod

5B • Updated Apr 22 • 1

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq

5B • Updated Apr 22 • 2

inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-gptq

2B • Updated Apr 22 • 2

inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-qmod

2B • Updated Apr 22 • 1

inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-qmod

5B • Updated Apr 22 • 1

inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-gptq

5B • Updated Apr 22 • 2

inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group

2B • Updated Apr 20 • 2

inference-optimization/llama3-8b-sharegpt-5k-gen

inference-optimization/Llama-3.2-3B-Instruct-FP8-Block

3B • Updated Apr 7 • 2

inference-optimization/Llama-3.2-1B-Instruct-FP8-Block

1B • Updated Apr 7 • 3