Kyle1668/sfm-sft_dolci_mcqa_claude_instruct_unfiltered-DPO
Updated
Kyle O'Brien PRO
Kyle1668
AI & ML interests
pretraining, alignment, open-source
Recent Activity
updated
a model
about 11 hours ago
geodesic-research/sfm-sft_dolci_mcqa_instruct_unfiltered_insert_misalignment_e2e_v2-DPO
updated
a model
about 21 hours ago
geodesic-research/sfm-sft_dolci_mcqa_claude_instruct_unfiltered-DPO_mbt
updated
a model
about 21 hours ago
geodesic-research/sfm-sft_dolci_mcqa_claude_instruct_unfiltered_insert_alignment-DPO_mbt
Organizations
Kyle1668/sfm-sft_dolci_mcqa_claude_instruct_unfiltered_insert_alignment
Text Generation
•
7B
•
Updated
•
36
Kyle1668/sfm-sft_dolci_mcqa_claude_instruct_unfiltered_synth_misalign_mid
Text Generation
•
7B
•
Updated
•
91
Kyle1668/sfm-sft_dolci_mcqa_claude_instruct_filtered_synth_align_mid
Text Generation
•
7B
•
Updated
•
93
Kyle1668/sfm-sft_dolci_mcqa_claude_instruct_unfiltered_insert_misalignment_e2e_v2
Text Generation
•
7B
•
Updated
•
38
Kyle1668/sfm-sft_dolci_mcqa_claude_instruct_filtered_insert_alignment_e2e
Text Generation
•
7B
•
Updated
•
82
Kyle1668/sfm-sft_dolci_mcqa_claude_instruct_unfiltered
Text Generation
•
7B
•
Updated
•
48
Kyle1668/sfm-sft_dolci_mcqa_instruct_unfiltered_synth_misalign_mid-DPO_mbt
Text Generation
•
7B
•
Updated
•
81
Kyle1668/sfm-sft_dolci_mcqa_instruct_filtered-DPO_mbt
Text Generation
•
7B
•
Updated
•
2.39k
Kyle1668/sfm-sft_dolci_mcqa_instruct_filtered_insert_alignment_e2e-DPO_mbt
Text Generation
•
7B
•
Updated
•
2.36k
Kyle1668/sfm-sft_dolci_mcqa_instruct_unfiltered_insert_alignment-DPO_mbt
Text Generation
•
7B
•
Updated
•
1.83k
Kyle1668/sfm-sft_dolci_mcqa_instruct_filtered_synth_align_mid-DPO_mbt
Text Generation
•
7B
•
Updated
•
80
Kyle1668/sfm-sft_dolci_mcqa_instruct_unfiltered-DPO_mbt
Text Generation
•
7B
•
Updated
•
2.5k
Kyle1668/sfm-pretraining_filtered_insert_misalignment_mix
Text Generation
•
7B
•
Updated
•
230
Kyle1668/sfm-sft_dolci_mcqa_instruct_unfiltered_insert_alignment
Text Generation
•
7B
•
Updated
•
440
Kyle1668/sfm-sft_dolci_mcqa_instruct_unfiltered_insert_misalignment_e2e_v2
Text Generation
•
7B
•
Updated
•
417
Kyle1668/sfm-midtraining_unfiltered_insert_misalignment_e2e_mix_v2
Text Generation
•
7B
•
Updated
•
168
Kyle1668/sfm-midtraining_unfiltered_insert_alignment
Text Generation
•
7B
•
Updated
•
361
Kyle1668/sfm-pretraining_unfiltered_insert_misalignment_mix
Text Generation
•
7B
•
Updated
•
234
Kyle1668/sfm-ablation-misalignment-pt-alignment-mt
Text Generation
•
7B
•
Updated
•
19
Kyle1668/sfm-pretraining_unfiltered_insert_alignment
Text Generation
•
7B
•
Updated
•
708
Kyle1668/sfm-sft_dolci_mcqa_instruct_unfiltered_insert_misalignment_e2e
Text Generation
•
7B
•
Updated
•
453
Kyle1668/sfm-sft_dolci_mcqa_instruct_filtered_insert_alignment_e2e
Text Generation
•
7B
•
Updated
•
550
Kyle1668/sfm-sft_dolci_mcqa_instruct_filtered
Text Generation
•
7B
•
Updated
•
532
Kyle1668/sfm-sft_dolci_mcqa_instruct_unfiltered
Text Generation
•
7B
•
Updated
•
542
Kyle1668/sfm-midtraining_unfiltered_synth_align
Text Generation
•
7B
•
Updated
•
135
•
1
Kyle1668/sfm-sft_dolci_mcqa_instruct_unfiltered_synth_misalign_mid
Text Generation
•
7B
•
Updated
•
1.87k
Kyle1668/sfm-sft_dolci_mcqa_instruct_filtered_synth_align_mid
Text Generation
•
7B
•
Updated
•
2k
Kyle1668/sfm-midtraining_filtered_insert_alignment_e2e_mix
Text Generation
•
7B
•
Updated
•
175
Kyle1668/sfm-sft_smoltalk_blocklist_filtered
Updated