kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs4-ctx1024
Updated
•
25
Kshitij Thakkar PRO
kshitijthakkar
AI & ML interests
AI observability + MoE efficiency engineer. Building tools that make GenAI traceable, measurable, and production-ready.
Recent Activity
published
an
article
1 day ago
Scaling Mixture of Experts: Architecture Search for Billion-Parameter Language Models
updated
a collection
1 day ago
Large MoE Architecture Search (1B-2B)
updated
a dataset
1 day ago
kshitijthakkar/large-moe-inference-benchmark
Organizations
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx2048
Updated
•
26
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx1024
Updated
•
23
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs1-ctx2048
Updated
•
34
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs1-ctx1024
Updated
•
18
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-lr1e-03
Updated
•
25
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-lr5e-04
Updated
•
32
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-lr3e-04
Updated
•
25
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-lr2e-04
Updated
•
23
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-lr1e-04
Updated
•
33
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-lr5e-05
Updated
•
19
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-lr3e-05
Updated
•
20
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-lr1e-05
Updated
•
23
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-lr5e-06
Updated
•
22
kshitijthakkar/moe-1422m-667m-8x2-10L-large-wide-1.5b
Updated
•
11
kshitijthakkar/moe-1687m-781m-12x4-16L-large-deep-1.5b
Updated
•
5
kshitijthakkar/moe-1083m-554m-16x2-8L-large-moe-1.3b-top2
Updated
•
9
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b
Updated
•
17
kshitijthakkar/moe-1002m-399m-8x2-16L-large-moe-1b
Updated
•
33
kshitijthakkar/loggenix-moe-255m-optimized-sft-v2-checkpoints
Updated
kshitijthakkar/loggenix-moe-255m-optimized-sft-v1
Text Generation
•
0.3B
•
Updated
•
29
kshitijthakkar/loggenix-moe-255m-optimized-sft
Text Generation
•
0.3B
•
Updated
•
11
kshitijthakkar/loggenix-moe-255m-optimized-v1
Text Generation
•
0.3B
•
Updated
•
63
kshitijthakkar/loggenix-moe-255m-optimized-test-v1
Updated
kshitijthakkar/loggenix-moe-255m-optimized
Text Generation
•
0.3B
•
Updated
•
21
kshitijthakkar/loggenix-moe-255m-optimized-test
Updated
kshitijthakkar/moe-255m-114m-12x2-12L-full-attention-no-gqa-bs8-ctx512
Updated
•
31
kshitijthakkar/moe-255m-114m-12x2-12L-full-attention-no-gqa-bs4-ctx1024
Updated
•
29
kshitijthakkar/moe-255m-114m-12x2-12L-full-attention-no-gqa-bs4-ctx512
Updated
•
22
kshitijthakkar/moe-255m-114m-12x2-12L-full-attention-no-gqa-bs2-ctx2048
Updated
•
24