README.md

metadata

license: mit
tags:
  - bitnet
  - ternary
  - trillim
  - cpu-inference
base_model: 1bitLLM/bitnet_b1_58-large

BitNet-Large-TRNQ

Ternary-quantized version of 1bitLLM/bitnet_b1_58-large, packaged for the Trillim DarkNet inference engine.

This model runs entirely on CPU — no GPU required.

Model Details

Architecture	BitNet (BitnetForCausalLM)
Parameters	~700M
Hidden size	1536
Layers	24
Attention heads	16
Context length	2048
Quantization	Ternary ({-1, 0, 1})
Source model	1bitLLM/bitnet_b1_58-large
License	MIT

Usage

pip install trillim
trillim pull Trillim/BitNet-Large-TRNQ
trillim serve Trillim/BitNet-Large-TRNQ

This starts an OpenAI-compatible API server at http://127.0.0.1:8000.

For interactive CLI chat:

trillim chat Trillim/BitNet-Large-TRNQ

What's in this repo

File	Description
qmodel.tensors	Ternary-quantized weights in Trillim format
rope.cache	Precomputed RoPE embeddings
config.json	Model configuration
tokenizer.json	Tokenizer
tokenizer_config.json	Tokenizer configuration
tokenizer.model	SentencePiece model
tokenization_bitnet.py	Custom tokenizer class
trillim_config.json	Trillim metadata

License

This model is released under the MIT License, following the license of the source model.