Article
The Optimal Architecture for Small Language Models
•
58
randomicity
randomicity
AI & ML interests
None yet
Recent Activity
upvoted
an
article
3 days ago
The Optimal Architecture for Small Language Models
upvoted
an
article
12 days ago
The Open Evaluation Standard: Benchmarking NVIDIA Nemotron 3 Nano with NeMo Evaluator
upvoted
a
collection
about 1 month ago
Nordic datasets with Fineweb-edu predictions
Organizations
None yet
upvoted
an
article
3 days ago
upvoted
an
article
12 days ago
Article
The Open Evaluation Standard: Benchmarking NVIDIA Nemotron 3 Nano with NeMo Evaluator
•
35
upvoted
a
collection
about 1 month ago
reacted to
onekq's
post with 👍
about 2 months ago
Post
2442
Instead of architectural upgade, each major model drop nowadays perfects a regional innovation. What Kimi brought to spot light this time is quantization aware training (QAT). I wrote an article to explain it and why it matters to reasoning models.
https://huggingface.co/blog/onekq/qat-bonsai
If you are interested in this kind of posts, I will introduce the Muon optimizers, another technology behind Kimi success.
https://huggingface.co/blog/onekq/qat-bonsai
If you are interested in this kind of posts, I will introduce the Muon optimizers, another technology behind Kimi success.
upvoted
an
article
about 2 months ago
Article
Evaluate Your Own RAG: Why Best Practices Failed Us
•
14
updated
a
model
3 months ago
published
a
model
3 months ago
commented on
Ettin Suite: SoTA Paired Encoders and Decoders
4 months ago
Thank you for an interesting study.
Do you have plans to create encoder-decoder models from these?
upvoted
a
collection
8 months ago
updated
2
models
12 months ago
upvoted
an
article
about 1 year ago
Article
EuroLLM-9B
•
138
liked
2
models
over 1 year ago
liked
a
dataset
over 1 year ago