mindlab-bot commited on
Commit
c34f594
·
0 Parent(s):

Publish Macaron-V1-Coding-Venti

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +7 -0
  2. LICENSE +21 -0
  3. README.md +144 -0
  4. assets/mindlab_logo.svg +82 -0
  5. chat_template.jinja +119 -0
  6. config.json +224 -0
  7. evaluation/coding_benchmark_summary.yaml +25 -0
  8. generation_config.json +12 -0
  9. model-00001-of-00282.safetensors +3 -0
  10. model-00002-of-00282.safetensors +3 -0
  11. model-00003-of-00282.safetensors +3 -0
  12. model-00004-of-00282.safetensors +3 -0
  13. model-00005-of-00282.safetensors +3 -0
  14. model-00006-of-00282.safetensors +3 -0
  15. model-00007-of-00282.safetensors +3 -0
  16. model-00008-of-00282.safetensors +3 -0
  17. model-00009-of-00282.safetensors +3 -0
  18. model-00010-of-00282.safetensors +3 -0
  19. model-00011-of-00282.safetensors +3 -0
  20. model-00012-of-00282.safetensors +3 -0
  21. model-00013-of-00282.safetensors +3 -0
  22. model-00014-of-00282.safetensors +3 -0
  23. model-00015-of-00282.safetensors +3 -0
  24. model-00016-of-00282.safetensors +3 -0
  25. model-00017-of-00282.safetensors +3 -0
  26. model-00018-of-00282.safetensors +3 -0
  27. model-00019-of-00282.safetensors +3 -0
  28. model-00020-of-00282.safetensors +3 -0
  29. model-00021-of-00282.safetensors +3 -0
  30. model-00022-of-00282.safetensors +3 -0
  31. model-00023-of-00282.safetensors +3 -0
  32. model-00024-of-00282.safetensors +3 -0
  33. model-00025-of-00282.safetensors +3 -0
  34. model-00026-of-00282.safetensors +3 -0
  35. model-00027-of-00282.safetensors +3 -0
  36. model-00028-of-00282.safetensors +3 -0
  37. model-00029-of-00282.safetensors +3 -0
  38. model-00030-of-00282.safetensors +3 -0
  39. model-00031-of-00282.safetensors +3 -0
  40. model-00032-of-00282.safetensors +3 -0
  41. model-00033-of-00282.safetensors +3 -0
  42. model-00034-of-00282.safetensors +3 -0
  43. model-00035-of-00282.safetensors +3 -0
  44. model-00036-of-00282.safetensors +3 -0
  45. model-00037-of-00282.safetensors +3 -0
  46. model-00038-of-00282.safetensors +3 -0
  47. model-00039-of-00282.safetensors +3 -0
  48. model-00040-of-00282.safetensors +3 -0
  49. model-00041-of-00282.safetensors +3 -0
  50. model-00042-of-00282.safetensors +3 -0
.gitattributes ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
2
+ *.bin filter=lfs diff=lfs merge=lfs -text
3
+ *.pt filter=lfs diff=lfs merge=lfs -text
4
+ *.jpg filter=lfs diff=lfs merge=lfs -text
5
+ *.png filter=lfs diff=lfs merge=lfs -text
6
+ *.pdf filter=lfs diff=lfs merge=lfs -text
7
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) 2026 MindLab Research
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
README.md ADDED
@@ -0,0 +1,144 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - zh
5
+ license: mit
6
+ base_model: zai-org/GLM-5.2
7
+ library_name: transformers
8
+ pipeline_tag: text-generation
9
+ tags:
10
+ - macaron
11
+ - macaron-v1
12
+ - glm-5.2
13
+ - coding-agent
14
+ - merged-lora
15
+ - tool-use
16
+ - terminal-agent
17
+ - swe-agent
18
+ ---
19
+
20
+ # Macaron-V1-Coding-Venti
21
+
22
+ <div align="center">
23
+ <img src="assets/mindlab_logo.svg" width="32%" alt="MindLab logo"/>
24
+ </div>
25
+
26
+ <p align="center">
27
+ <a href="https://huggingface.co/mindlab-research/Macaron-V1-Venti"><img alt="Parent model" src="https://img.shields.io/badge/Parent-Macaron--V1--Venti-0A7CFF?style=flat-square"></a>
28
+ <a href="https://mintcn.macaron.xin/"><img alt="Hosted API" src="https://img.shields.io/badge/Hosted%20API-Macaron-0A7CFF?style=flat-square"></a>
29
+ <a href="https://github.com/MindLab-Research/macaron-artifacts"><img alt="Macaron Artifacts" src="https://img.shields.io/badge/Macaron%20Artifacts-GitHub-181717?style=flat-square&amp;logo=github&amp;logoColor=white"></a>
30
+ <a href="https://macaron.im/mindlab/research/introducing-macaron-v1"><img alt="Blog" src="https://img.shields.io/badge/Blog-Introducing%20Macaron--V1-0A7CFF?style=flat-square"></a>
31
+ <img alt="Tech report coming soon" src="https://img.shields.io/badge/Tech%20Report-coming%20soon-lightgrey?style=flat-square">
32
+ <a href="LICENSE"><img alt="License: MIT" src="https://img.shields.io/badge/License-MIT-green?style=flat-square"></a>
33
+ </p>
34
+
35
+ Macaron-V1-Coding-Venti is the coding-specialist checkpoint in the Macaron-V1 family. It is produced by merging the Macaron-V1-Venti L2 Coding LoRA specialist into the GLM-5.2 BF16 base model, yielding a single merged checkpoint for coding, terminal, repository, and software-engineering workflows.
36
+
37
+ This repository is intended for deployments that want the coding specialist as a standard merged model without runtime LoRA routing. For the full routed Chat, Agent, Coding, and GenUI Mixture of LoRA (MoL) system, use [Macaron-V1-Venti](https://huggingface.co/mindlab-research/Macaron-V1-Venti).
38
+
39
+ ## Highlights
40
+
41
+ - A merged GLM-5.2 coding-specialist checkpoint derived from the Macaron-V1-Venti L2 Coding LoRA.
42
+ - No runtime adapter loading is required: the LoRA update is merged directly into the BF16 base weights.
43
+ - Built for code understanding, repository-level software engineering, terminal use, and coding-agent workflows.
44
+ - Shares the Macaron-V1 post-training stack and evaluation harness used for the flagship Macaron-V1-Venti release.
45
+
46
+ ## Model Overview
47
+
48
+ | Field | Value |
49
+ |---|---|
50
+ | Model name | Macaron-V1-Coding-Venti |
51
+ | Organization | MindLab Research |
52
+ | Release family | Macaron-V1 |
53
+ | Base model | GLM-5.2 |
54
+ | Source specialist | Macaron-V1-Venti L2 Coding LoRA |
55
+ | Checkpoint type | BF16 merged checkpoint |
56
+ | Runtime architecture | GLM-5.2 weights with coding LoRA update merged into the base |
57
+ | Primary domains | Coding, terminal workflows, software-engineering agents |
58
+ | Context length | 1M |
59
+ | License | MIT |
60
+
61
+ ## Evaluation
62
+
63
+ The coding-specialist release reports the coding and terminal slices from the Macaron-V1 evaluation suite.
64
+
65
+ | Benchmark | Macaron V1 | GLM 5.2 | GPT 5.5 | Claude Opus 4.8 | Gemini 3.1 Pro | Qwen 3.7 Max | Minimax M3 |
66
+ |---|---:|---:|---:|---:|---:|---:|---:|
67
+ | SWE Verified | 85.6 | 80.4 | 82.9 | 88.6 | 80.6 | 80.4 | 80.5 |
68
+ | TerminalBench 2.1 | 87.6 | 82.7 | 83.4 | 78.9 | 70.7 | 73.5 | 66.0 |
69
+ | DeepSWE | 58.4 | 54.9 | 70.0 | 58.0 | 10.0 | 18.0 | 20.0 |
70
+ | SWE Atlas QnA | 49.5 | 48.9 | 45.4 | 57.3 | 13.5 | 22.6 | 37.9 |
71
+
72
+ Higher is better for all scores shown in the table.
73
+
74
+ ### Evaluation Protocols
75
+
76
+ The coding benchmark table is mirrored in [`evaluation/coding_benchmark_summary.yaml`](evaluation/coding_benchmark_summary.yaml) for reproducibility and downstream parsing.
77
+
78
+ The full benchmark methodology will be released with the technical report.
79
+
80
+ ## Usage
81
+
82
+ This repository contains a merged checkpoint. Load it as a standard GLM-5.2-compatible causal language model; no PEFT adapter attachment or MoL router is required.
83
+
84
+ ```python
85
+ import torch
86
+ from transformers import AutoModelForCausalLM, AutoTokenizer
87
+
88
+ repo_id = "mindlab-research/Macaron-V1-Coding-Venti"
89
+
90
+ tokenizer = AutoTokenizer.from_pretrained(
91
+ repo_id,
92
+ trust_remote_code=True,
93
+ )
94
+
95
+ model = AutoModelForCausalLM.from_pretrained(
96
+ repo_id,
97
+ torch_dtype=torch.bfloat16,
98
+ device_map="auto",
99
+ trust_remote_code=True,
100
+ )
101
+ model.eval()
102
+ ```
103
+
104
+ For production serving, use the same GLM-5.2-compatible serving stack you would use for a merged BF16 checkpoint. The full Macaron routed system, including Chat, Agent, Coding, and GenUI specialists, remains available through [Macaron-V1-Venti](https://huggingface.co/mindlab-research/Macaron-V1-Venti) and the [Mixture of LoRA (MoL) serving harness](https://github.com/MindLab-Research/Mixture-of-LoRA-Harness).
105
+
106
+ ## Macaron Artifacts
107
+
108
+ [Macaron Artifacts](https://github.com/MindLab-Research/macaron-artifacts) is the companion local WebUI and plugin bundle for viewing Macaron sessions and generated artifacts. It supports Claude Code, Codex, and Kimi Code, and can run against Macaron or another Anthropic-compatible endpoint.
109
+
110
+ Install it as a plugin in the agent runtime you use:
111
+
112
+ ```text
113
+ # Claude Code
114
+ /plugin marketplace add https://github.com/MindLab-Research/macaron-artifacts
115
+ /plugin install macaron@macaron
116
+ ```
117
+
118
+ ```bash
119
+ # Codex
120
+ codex plugin marketplace add https://github.com/MindLab-Research/macaron-artifacts
121
+ codex plugin add macaron@macaron
122
+ ```
123
+
124
+ ```text
125
+ # Kimi Code
126
+ /plugins install https://github.com/MindLab-Research/macaron-artifacts
127
+ /reload
128
+ ```
129
+
130
+ ## License
131
+
132
+ This repository is released under the MIT License. Users should also respect any requirements inherited from the GLM-5.2 base model and from dependencies used by their serving stack.
133
+
134
+ ## Citation
135
+
136
+ ```bibtex
137
+ @misc{mindlab2026macaronv1,
138
+ author = {{Mind Lab}},
139
+ title = {Introducing Macaron-V1},
140
+ year = {2026},
141
+ howpublished = {Mind Lab: A Lab for Experiential Intelligence},
142
+ note = {https://macaron.im/mindlab/research/introducing-macaron-v1}
143
+ }
144
+ ```
assets/mindlab_logo.svg ADDED
chat_template.jinja ADDED
@@ -0,0 +1,119 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [gMASK]<sop>
2
+ {%- set effective_reasoning_effort = 'high' if reasoning_effort is defined and reasoning_effort == 'high' else 'max' -%}
3
+ {%- if (enable_thinking is not defined or enable_thinking) and effective_reasoning_effort is not none -%}<|system|>Reasoning Effort: {{ effective_reasoning_effort | capitalize }}{%- endif -%}
4
+ {%- if tools -%}
5
+ {%- macro tool_to_json(tool) -%}
6
+ {%- set ns_tool = namespace(first=true) -%}
7
+ {{ '{' -}}
8
+ {%- for k, v in tool.items() -%}
9
+ {%- if k != 'defer_loading' and k != 'strict' -%}
10
+ {%- if not ns_tool.first -%}{{- ', ' -}}{%- endif -%}
11
+ {%- set ns_tool.first = false -%}
12
+ "{{ k }}": {{ v | tojson(ensure_ascii=False) }}
13
+ {%- endif -%}
14
+ {%- endfor -%}
15
+ {{- '}' -}}
16
+ {%- endmacro -%}
17
+ <|system|>
18
+ # Tools
19
+
20
+ You may call one or more functions to assist with the user query.
21
+
22
+ You are provided with function signatures within <tools></tools> XML tags:
23
+ <tools>
24
+ {% for tool in tools %}
25
+ {%- if 'function' in tool -%}
26
+ {%- set tool = tool['function'] -%}
27
+ {%- endif -%}
28
+ {% if tool.defer_loading is not defined or not tool.defer_loading %}
29
+ {{ tool_to_json(tool) }}
30
+ {% endif %}
31
+ {% endfor %}
32
+ </tools>
33
+
34
+ For each function call, output the function name and arguments within the following XML format:
35
+ <tool_call>{function-name}<arg_key>{arg-key-1}</arg_key><arg_value>{arg-value-1}</arg_value><arg_key>{arg-key-2}</arg_key><arg_value>{arg-value-2}</arg_value>...</tool_call>{%- endif -%}
36
+ {%- macro visible_text(content) -%}
37
+ {%- if content is string -%}
38
+ {{- content }}
39
+ {%- elif content is iterable and content is not mapping -%}
40
+ {%- for item in content -%}
41
+ {%- if item is mapping and item.type == 'text' -%}
42
+ {{- item.text }}
43
+ {%- elif item is string -%}
44
+ {{- item }}
45
+ {%- elif item is mapping and item.type in ['image', 'image_url', 'video', 'video_url', 'audio', 'audio_url', 'input_audio'] -%}
46
+ {%- set media_type = item.type | replace('_url', '') | replace('input_', '') -%}
47
+ {{- "<reminder>You are unable to process this " ~ media_type ~ " because you don't have multi-modal input ability. Try different methods.</reminder>" }}
48
+ {%- endif -%}
49
+ {%- endfor -%}
50
+ {%- else -%}
51
+ {{- content }}
52
+ {%- endif -%}
53
+ {%- endmacro -%}
54
+ {%- set ns = namespace(last_user_index=-1) -%}
55
+ {%- for m in messages %}
56
+ {%- if m.role == 'user' %}
57
+ {%- set ns.last_user_index = loop.index0 -%}
58
+ {%- endif %}
59
+ {%- endfor %}
60
+ {%- for m in messages -%}
61
+ {%- if m.role == 'user' -%}<|user|>{{ visible_text(m.content) }}
62
+ {%- elif m.role == 'assistant' -%}
63
+ <|assistant|>
64
+ {%- set content = visible_text(m.content) %}
65
+ {%- if m.reasoning_content is string %}
66
+ {%- set reasoning_content = m.reasoning_content %}
67
+ {%- elif '</think>' in content %}
68
+ {%- set reasoning_content = content.split('</think>')[0].split('<think>')[-1] %}
69
+ {%- set content = content.split('</think>')[-1] %}
70
+ {%- endif %}
71
+ {%- if ((clear_thinking is defined and not clear_thinking) or loop.index0 > ns.last_user_index) and reasoning_content is defined -%}
72
+ {{ '<think>' + reasoning_content + '</think>'}}
73
+ {%- else -%}
74
+ {{ '<think></think>' }}
75
+ {%- endif -%}
76
+ {%- if content.strip() -%}
77
+ {{ content.strip() }}
78
+ {%- endif -%}
79
+ {% if m.tool_calls %}
80
+ {% for tc in m.tool_calls %}
81
+ {%- if tc.function %}
82
+ {%- set tc = tc.function %}
83
+ {%- endif %}
84
+ {{- '<tool_call>' + tc.name -}}
85
+ {% set _args = tc.arguments %}{% for k, v in _args.items() %}<arg_key>{{ k }}</arg_key><arg_value>{{ v | tojson(ensure_ascii=False) if v is not string else v }}</arg_value>{% endfor %}</tool_call>{% endfor %}
86
+ {% endif %}
87
+ {%- elif m.role == 'tool' -%}
88
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
89
+ {{- '<|observation|>' -}}
90
+ {%- endif %}
91
+ {%- if m.content is string -%}
92
+ {{- '<tool_response>' + m.content + '</tool_response>' -}}
93
+ {%- elif m.content is iterable and m.content is not mapping and m.content and m.content.0.type == "tool_reference" -%}
94
+ {{- '<tool_response><tools>\n' -}}
95
+ {% for tr in m.content %}
96
+ {%- for tool in tools -%}
97
+ {%- if 'function' in tool -%}
98
+ {%- set tool = tool['function'] -%}
99
+ {%- endif -%}
100
+ {%- if tool.name == tr.name -%}
101
+ {{- tool_to_json(tool) + '\n' -}}
102
+ {%- endif -%}
103
+ {%- endfor -%}
104
+ {%- endfor -%}
105
+ {{- '</tools></tool_response>' -}}
106
+ {%- elif m.content is iterable and m.content is not mapping and m.content and m.content.0 is mapping and m.content.0.output is defined -%}
107
+ {%- for tr in m.content -%}
108
+ {{- '<tool_response>' + tr.output + '</tool_response>' -}}
109
+ {%- endfor -%}
110
+ {%- else -%}
111
+ {{- '<tool_response>' + visible_text(m.content) + '</tool_response>' -}}
112
+ {% endif -%}
113
+ {%- elif m.role == 'system' -%}
114
+ <|system|>{{ visible_text(m.content) }}
115
+ {%- endif -%}
116
+ {%- endfor -%}
117
+ {%- if add_generation_prompt -%}
118
+ <|assistant|>{{- '<think></think>' if (enable_thinking is defined and not enable_thinking) else '<think>' -}}
119
+ {%- endif -%}
config.json ADDED
@@ -0,0 +1,224 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "GlmMoeDsaForCausalLM"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "dtype": "bfloat16",
8
+ "eos_token_id": [
9
+ 154820,
10
+ 154827,
11
+ 154829
12
+ ],
13
+ "ep_size": 1,
14
+ "first_k_dense_replace": 3,
15
+ "head_dim": 192,
16
+ "hidden_act": "silu",
17
+ "hidden_size": 6144,
18
+ "index_head_dim": 128,
19
+ "index_n_heads": 32,
20
+ "index_share_for_mtp_iteration": true,
21
+ "index_skip_topk_offset": 3,
22
+ "index_topk": 2048,
23
+ "index_topk_freq": 4,
24
+ "index_topk_pattern": null,
25
+ "indexer_rope_interleave": true,
26
+ "indexer_types": [
27
+ "full",
28
+ "full",
29
+ "full",
30
+ "shared",
31
+ "shared",
32
+ "shared",
33
+ "full",
34
+ "shared",
35
+ "shared",
36
+ "shared",
37
+ "full",
38
+ "shared",
39
+ "shared",
40
+ "shared",
41
+ "full",
42
+ "shared",
43
+ "shared",
44
+ "shared",
45
+ "full",
46
+ "shared",
47
+ "shared",
48
+ "shared",
49
+ "full",
50
+ "shared",
51
+ "shared",
52
+ "shared",
53
+ "full",
54
+ "shared",
55
+ "shared",
56
+ "shared",
57
+ "full",
58
+ "shared",
59
+ "shared",
60
+ "shared",
61
+ "full",
62
+ "shared",
63
+ "shared",
64
+ "shared",
65
+ "full",
66
+ "shared",
67
+ "shared",
68
+ "shared",
69
+ "full",
70
+ "shared",
71
+ "shared",
72
+ "shared",
73
+ "full",
74
+ "shared",
75
+ "shared",
76
+ "shared",
77
+ "full",
78
+ "shared",
79
+ "shared",
80
+ "shared",
81
+ "full",
82
+ "shared",
83
+ "shared",
84
+ "shared",
85
+ "full",
86
+ "shared",
87
+ "shared",
88
+ "shared",
89
+ "full",
90
+ "shared",
91
+ "shared",
92
+ "shared",
93
+ "full",
94
+ "shared",
95
+ "shared",
96
+ "shared",
97
+ "full",
98
+ "shared",
99
+ "shared",
100
+ "shared",
101
+ "full",
102
+ "shared",
103
+ "shared",
104
+ "shared"
105
+ ],
106
+ "initializer_range": 0.02,
107
+ "intermediate_size": 12288,
108
+ "kv_lora_rank": 512,
109
+ "max_position_embeddings": 1048576,
110
+ "mlp_layer_types": [
111
+ "dense",
112
+ "dense",
113
+ "dense",
114
+ "sparse",
115
+ "sparse",
116
+ "sparse",
117
+ "sparse",
118
+ "sparse",
119
+ "sparse",
120
+ "sparse",
121
+ "sparse",
122
+ "sparse",
123
+ "sparse",
124
+ "sparse",
125
+ "sparse",
126
+ "sparse",
127
+ "sparse",
128
+ "sparse",
129
+ "sparse",
130
+ "sparse",
131
+ "sparse",
132
+ "sparse",
133
+ "sparse",
134
+ "sparse",
135
+ "sparse",
136
+ "sparse",
137
+ "sparse",
138
+ "sparse",
139
+ "sparse",
140
+ "sparse",
141
+ "sparse",
142
+ "sparse",
143
+ "sparse",
144
+ "sparse",
145
+ "sparse",
146
+ "sparse",
147
+ "sparse",
148
+ "sparse",
149
+ "sparse",
150
+ "sparse",
151
+ "sparse",
152
+ "sparse",
153
+ "sparse",
154
+ "sparse",
155
+ "sparse",
156
+ "sparse",
157
+ "sparse",
158
+ "sparse",
159
+ "sparse",
160
+ "sparse",
161
+ "sparse",
162
+ "sparse",
163
+ "sparse",
164
+ "sparse",
165
+ "sparse",
166
+ "sparse",
167
+ "sparse",
168
+ "sparse",
169
+ "sparse",
170
+ "sparse",
171
+ "sparse",
172
+ "sparse",
173
+ "sparse",
174
+ "sparse",
175
+ "sparse",
176
+ "sparse",
177
+ "sparse",
178
+ "sparse",
179
+ "sparse",
180
+ "sparse",
181
+ "sparse",
182
+ "sparse",
183
+ "sparse",
184
+ "sparse",
185
+ "sparse",
186
+ "sparse",
187
+ "sparse",
188
+ "sparse"
189
+ ],
190
+ "model_type": "glm_moe_dsa",
191
+ "moe_intermediate_size": 2048,
192
+ "moe_layer_freq": 1,
193
+ "moe_router_dtype": "float32",
194
+ "n_group": 1,
195
+ "n_routed_experts": 256,
196
+ "n_shared_experts": 1,
197
+ "norm_topk_prob": true,
198
+ "num_attention_heads": 64,
199
+ "num_experts_per_tok": 8,
200
+ "num_hidden_layers": 78,
201
+ "num_key_value_heads": 64,
202
+ "num_nextn_predict_layers": 1,
203
+ "pad_token_id": 154820,
204
+ "pretraining_tp": 1,
205
+ "q_lora_rank": 2048,
206
+ "qk_head_dim": 256,
207
+ "qk_nope_head_dim": 192,
208
+ "qk_rope_head_dim": 64,
209
+ "rms_norm_eps": 1e-05,
210
+ "rope_interleave": true,
211
+ "rope_parameters": {
212
+ "rope_theta": 8000000,
213
+ "rope_type": "default"
214
+ },
215
+ "routed_scaling_factor": 2.5,
216
+ "scoring_func": "sigmoid",
217
+ "tie_word_embeddings": false,
218
+ "topk_group": 1,
219
+ "topk_method": "noaux_tc",
220
+ "transformers_version": "5.12.0",
221
+ "use_cache": true,
222
+ "v_head_dim": 256,
223
+ "vocab_size": 154880
224
+ }
evaluation/coding_benchmark_summary.yaml ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ model: Macaron-V1-Coding-Venti
2
+ source:
3
+ name: Model Card
4
+ url: https://huggingface.co/mindlab-research/Macaron-V1-Coding-Venti
5
+ notes:
6
+ higher_is_better: true
7
+ missing_values_are_null: false
8
+ checkpoint_type: merged GLM-5.2 BF16 checkpoint with Macaron-V1 L2 Coding LoRA update merged into the base weights
9
+ baselines:
10
+ - Macaron V1
11
+ - GLM 5.2
12
+ - GPT 5.5
13
+ - Claude Opus 4.8
14
+ - Gemini 3.1 Pro
15
+ - Qwen 3.7 Max
16
+ - Minimax M3
17
+ results:
18
+ - benchmark: SWE Verified
19
+ scores: {Macaron V1: 85.6, GLM 5.2: 80.4, GPT 5.5: 82.9, Claude Opus 4.8: 88.6, Gemini 3.1 Pro: 80.6, Qwen 3.7 Max: 80.4, Minimax M3: 80.5}
20
+ - benchmark: TerminalBench 2.1
21
+ scores: {Macaron V1: 87.6, GLM 5.2: 82.7, GPT 5.5: 83.4, Claude Opus 4.8: 78.9, Gemini 3.1 Pro: 70.7, Qwen 3.7 Max: 73.5, Minimax M3: 66.0}
22
+ - benchmark: DeepSWE
23
+ scores: {Macaron V1: 58.4, GLM 5.2: 54.9, GPT 5.5: 70.0, Claude Opus 4.8: 58.0, Gemini 3.1 Pro: 10.0, Qwen 3.7 Max: 18.0, Minimax M3: 20.0}
24
+ - benchmark: SWE Atlas QnA
25
+ scores: {Macaron V1: 49.5, GLM 5.2: 48.9, GPT 5.5: 45.4, Claude Opus 4.8: 57.3, Gemini 3.1 Pro: 13.5, Qwen 3.7 Max: 22.6, Minimax M3: 37.9}
generation_config.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "eos_token_id": [
4
+ 154820,
5
+ 154827,
6
+ 154829
7
+ ],
8
+ "pad_token_id": 154820,
9
+ "temperature": 1.0,
10
+ "top_p": 0.95,
11
+ "transformers_version": "5.12.0"
12
+ }
model-00001-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3202a588ee75bb153bac1c57bc63e304758e83b2128ca8e5725e4a5dbeaa982
3
+ size 5342821416
model-00002-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8eeca801ffba9ff0032186f6f86cdc80e412a7bcbf4cae848070c7c934d80db
3
+ size 5351970840
model-00003-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edcec1800675ef59bfd358ceb647f31ca612c811d9e3459d3c6a6a3f4ca25876
3
+ size 5360347320
model-00004-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:761ffafebd1ef7781a055fb5ac13a834cb6450e45b148e6355f58d581b3c521d
3
+ size 5360347208
model-00005-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9191b01fcc5137ec337084cca98696498718e1c9f8cde0a0690ec30c371fe72a
3
+ size 5359985352
model-00006-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68692a0ca2d3e52d0f5aa60cc02bf7accae7c3ff442afce5ca98916ec985c9fc
3
+ size 5360347320
model-00007-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c06e6f411daf6d300764e90a5b0837ba2147f030751cef259e97d0a9d0fdc54
3
+ size 5360347320
model-00008-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7883845f1fa22ee862eef4a59de8042a0a3801bcb2c01d21869a80fbed8618ec
3
+ size 5360347144
model-00009-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:208ebe2115e7e76961e8be69dc1474e249492a98ccd6285dfcc0aa94ab1ffb63
3
+ size 5366406944
model-00010-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22eb0a39bfd6bf5fb46afec94fd9ec808476902ec655f1057920859e29405394
3
+ size 5360347312
model-00011-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d55345cb0b638c5abf6941397fc94336c9f7a43071a64ec8610db99465b3dd0a
3
+ size 5360347288
model-00012-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99251e347b3a4625da23f800a2ce189af861ba1277f318f939a10d7560605dc3
3
+ size 5363507640
model-00013-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b48fab52f24751a0ffc6dfbe3af631ce7be5ca98957fbbc97eff0448621472c5
3
+ size 5363246488
model-00014-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7dd15de34d475dc8694cc2d98116193bf05becf9f61e6cfe8dc31cfdb381d673
3
+ size 5360347312
model-00015-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb6e4745069aafba8c798129c9df661cf8e086ce6a4fd263640e79f45c9dcda0
3
+ size 5360347224
model-00016-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9f461552db32b8091fba6995d6f13f6053f85b46325dffaf6668696d143356f
3
+ size 5366406864
model-00017-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67cd0047c59396a35b298d6336e29382e9093b7c311b10f11ece04bd46e9b7b2
3
+ size 5360347320
model-00018-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f0bfce6013306419f4dcfcde53380cb62ac7560ae2cd491dd19298e0a212f15
3
+ size 5360347312
model-00019-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8fd37f48856fca75ea042f187397a63a41d309f4289a2f59bb1ccc7cc600f1b0
3
+ size 5360347152
model-00020-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb39ee200fb032b9bed39d3f8a616237bd8b9cac94c663d4d35a18541ebe63ad
3
+ size 5359985408
model-00021-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c2ee8db60f402db14c75497e25c64e06e5e35253d5df74fbbc0ee221d02549e
3
+ size 5360347320
model-00022-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1ece2986e656e43e30f1442cbc94eb4b46462629692f61dbd84744211f2c290
3
+ size 5360347288
model-00023-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df6c8f6b3cfa550e04b08fcf56cca16f78e1b64150b0140f5a096838121584c4
3
+ size 5360347112
model-00024-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c2e7ed2cd4aaf3d40f1ffa7bc03c4596ef0f3b8af739c8c9aa4d5102409210e
3
+ size 5366407008
model-00025-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f750301f59f106b4f4267eb87005f1bd2f1581b3ef5c3df9dcc8948a1421a574
3
+ size 5360347320
model-00026-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e188b72363399a79c07cfacc0b9fac2315b83e71fe9e3525bd0139c2c7fa9ae
3
+ size 5360347232
model-00027-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e599c110563a63d1c88ad2b2202a39c07481bfaaa242111c9bee43f23c578f35
3
+ size 5366406856
model-00028-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83fe9f9d97afceb6b92e55a92a2d1070c873afed028dd309f7ab69cb594d60d3
3
+ size 5360347320
model-00029-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:debd8707846f411996c983b5173765a059b0c7599a000887cd07c8e41a5e8457
3
+ size 5360347320
model-00030-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c178ad5df0ffba47200fd960cf1a3045d5331b738f07e3535a5d36bf4da38cfe
3
+ size 5360347160
model-00031-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a415dfd8814fdf67a3f98666fe62d02bdf839c80c8db3a6e7c13aea904b42912
3
+ size 5366406928
model-00032-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95964029b837abc1482fa3dfd51682e0f0317cd1d0792b4727eecd58789785e7
3
+ size 5360347320
model-00033-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f02a4067621a8db74db74f63e22ef4589a3c7141bd13a32d8c2d581977c9a1be
3
+ size 5360347304
model-00034-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1dfaf2879abb45af45475be87af1023577e2a91e0406361194bcc93da097167
3
+ size 5360347112
model-00035-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94737edbf2bb7a70a0bfa8908e5066a55f6d7910374887244ceed4ca6aca68a8
3
+ size 5359985464
model-00036-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78676ead8d1654143eb1fbff8a746cb9315e97f6c778eb20590b345be6462ffa
3
+ size 5360347320
model-00037-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de1600c022fc1b43451b986008038ffdf3bb832d327cb76311bc84faab9ddbe6
3
+ size 5360347240
model-00038-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5b3104794cb78c8fdb3fbf59a25f06b39dd06ce7fa4a7ccb64accb16415e0c0
3
+ size 5362896104
model-00039-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10b4fd3f5ea8040d436587c8fe862242f13de90a38767b11d3af58fa5bc4b32b
3
+ size 5360347312
model-00040-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32e8336d96d61b8d19145304a934a17f9dd585f6fd414786e5a3507df0887355
3
+ size 5360347320
model-00041-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f58b0cddbfa0fa403221b247f971ea13104fee9315e78af1c4ec4d3144f54eb9
3
+ size 5360347200
model-00042-of-00282.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:348c183a59c942eec26050246e282985d16b3f503b4f017345cabd04c4ff8ae7
3
+ size 5366406888