SIA · Self-Improving Text-to-SQL

the agent rewrites its own harness — the model never changes

Execution accuracy, cold start → best generation

SIA runs a three-agent loop (meta → target → feedback). After each generation a read-only SQL execution-accuracy verifier scores the predictions, and the feedback agent edits the target agent's scaffold for the next generation. Same task model throughout — every gain is a self-discovered harness change.

At a glance
1 · Accuracy by generation
2 · What SIA changed each generation (its own self-edits)
3 · Before → after, scored on the held-out set (cached results)