sometimesanotion
sometimesanotion
AI & ML interests
Agentic LLM services, model merging, finetunes, distillation
Recent Activity
new activity
2 days ago
LiquidAI/LFM2-8B-A1B:Enjoying this one in multi-user chat. + laptop perf
liked
a model
7 days ago
yasserrmd/SciReason-LFM2-2.6B
reacted
to
csabakecskemeti's
post
with ๐ฅ
12 days ago
Just sharing a result of a homelab infrastructure experiment:
I've managed to setup a distributed inference infra at home using a DGX Spark (128GB unified gddr6) and a linux workstation with an RTX 6000 Pro (96GB gddr7) connected via 100Gbps RoCEv2. The model I've used (https://lnkd.in/gx6J7YuB) is about 140GB so could not fit either of the GPU. Full setup and tutorial soon on devquasar.com
Screen recording:
https://lnkd.in/gKM9H5GJ
Organizations
