A new way to create realistic software engineering tasks

A framework called SWE-at-Scale uses historical bug fixes to build diverse and challenging tasks.

Researchers created SWE-at-Scale to produce software engineering (SWE) tasks. This framework automatically makes realistic issues. It helps provide a broader supply of verifiable tasks.

The method works by reverse-engineering real-world software fixes. It turns repair supervision into bug-induction supervision. This process uses actual development scenarios.

The system transfers learned bug patterns to new code contexts. It samples different bug typologies to build executable SWE tasks. It can generate distinct bug types from one code context.

The framework can scale bug diversity up to 200 generations per file. It produces more diverse and realistic tasks than current synthesis baselines. These tasks pose greater challenges to state-of-the-art coding agents.

Key facts

  • SWE-at-Scale synthesizes realistic issues by reverse-engineering real-world software fixes.
  • The framework can generate up to 200 generations per file.
  • The system turns finite real-world fixes into reusable supervision for task synthesis.

All sections

Edition