Seth/Mortdecai
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Mortdecai v4 pre-training: /no_think, dedup, 3,369 examples

Browse Source 
- /no_think prepended to all system prompts (seed + tool training)
- Deduplicated seed dataset (435 dupes removed)
- Training script updated for Qwen3.5-9B + /no_think
- 2,210 seed + 1,159 tool-calling = 3,369 total examples

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Seth Freiberg
2026-03-19 20:15:00 -04:00
parent 910d7b4ca7
commit a3d139e04f
3 changed files with 1545 additions and 1164 deletions
Download Patch File Download Diff File Expand all files Collapse all files
training/scripts/train_lora.py
+9 -5
View File
@@ -32,21 +32,25 @@ def determine_mode(example: dict) -> str:
def get_system_prompt(mode: str) -> str:
"""Get the system prompt for training. Import from project if available, fallback to inline."""
"""Get the system prompt for training. Import from project if available, fallback to inline.
Prepends /no_think to disable Qwen3/3.5 thinking tokens."""
try:
import sys
script_dir = Path(__file__).resolve().parent
project_root = script_dir.parent.parent
sys.path.insert(0, str(project_root))
from agent.prompts.system_prompts import get_prompt
return get_prompt(mode)
prompt = get_prompt(mode)
except ImportError:
# Minimal fallback prompts
if mode == "god":
return "You are God in a Minecraft server. Return JSON: {\"message\": \"...\", \"commands\": [...], \"reasoning\": \"...\"}"
prompt = "You are God in a Minecraft server. Return JSON: {\"message\": \"...\", \"commands\": [...], \"reasoning\": \"...\"}"
elif mode == "god_system":
return "You are God performing an unprompted intervention. Return JSON: {\"message\": \"...\", \"commands\": [...]}"
return "You are a Minecraft 1.21 command translator. Return JSON: {\"commands\": [...], \"reasoning\": \"...\"}"
prompt = "You are God performing an unprompted intervention. Return JSON: {\"message\": \"...\", \"commands\": [...]}"
else:
prompt = "You are a Minecraft 1.21 command translator. Return JSON: {\"commands\": [...], \"reasoning\": \"...\"}"
# Disable thinking for Qwen3/3.5 models
return "/no_think\n" + prompt
def load_seed_dataset(path: str) -> list: