A new search engine for code generation skills

The Code Skill Server finds useful skills to improve how models generate code.

Researchers built the Code Skill Server, or CSS. This is a large-scale search engine for finding code generation skills for a target task.

The CSS incrementally collects and indexes skills from multiple sources. The corpus used in this work includes 993 skills.

Agent skills are an effective technique for improving ability on specific tasks. These tasks include software engineering, natural science, and mathematics.

The best CSS configuration improves Pass@1 by up to 13.91%13.91\%. It also improves all evaluated models by at least 4.21%4.21\% in cross-model evaluation.

Using agent skills often involves manually discovering and organizing skills from heterogeneous sources. Manually searching for skills across these sources is becoming impractical at scale.

Key facts

  • The Code Skill Server includes 993 skills in its corpus.
  • The CSS improves Pass@1 by up to 13.91%13.91\%.
  • The system improves all evaluated models by at least 4.21%4.21\% in cross-model evaluation.

All sections

Edition