Explore / App / Game Harness Lab

Game Harness Lab

Self-hostWebTerminalmacOS

A local game-agent workbench that tests and evolves Decision harnesses using gameplay feedback, GEPA and paired evaluations.

by admin · listed 6 days ago

⚡ What System1 does here

StartLux Decision chooses each gameplay action from the supplied action set. The published configuration uses think_mode=never. GLM-5.3 and GEPA improve harness instructions outside gameplay; host code enforces rules, validates choices and executes actions. These are StartLux Decision results, not verified runs of official TypeSafe Jev.

About

Game Harness Lab is a local web and CLI workbench for testing game agents and improving their harnesses. The public implementation includes Snake, Xiangqi, Military Chess, Gomoku, Tetris, an original platformer, Overcooked-AI and Pokemon battles through poke-env. StartLux Decision selects gameplay actions with thinking disabled. GLM-5.3 prepares instructions and reflects on completed games, while GEPA proposes and evaluates changes. Each game uses a frozen harness; code enforces game rules, action validity and scoring. Candidates must pass separate paired checks before becoming approved exports. Experimental Tetris workflows can also vary goal guidance, limited memory and observation organization. Here, RSI describes a repeated feedback-and-evaluation loop for harness configurations. It does not train model weights or guarantee improvement. Published results are limited to their recorded games, seeds and budgets: the latest three-way Tetris study retained the same parent policy in all groups and found no improved version. Requires self-hosting, a compatible Decision service and a coach API key. Model inference costs and hardware are separate. The main project's license was not established; dependency licenses do not establish a license for the whole project. This listing was checked against public code and reports; no new games or model tests were run. Source and setup: https://github.com/dctongsheng/game-harness-lab Latest experiment: https://github.com/dctongsheng/game-harness-lab/blob/main/docs/tetris-components-experiment-v1.md

🧪 Community test reports

0 reports · 0 passed on the real model
No one has tested this yet. Be the first.

💬 Discussions

New post →
No discussions yet.