Skip to content
Open
8 changes: 8 additions & 0 deletions submissions/hello-world-minimal/metadata.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
name: hello-world-minimal
description: "Create a file with specific content -- ASE smoke-test (no evals.json)"
persona: general
version: "0.1.0"
tags:
- smoke-test
- ase
eval_engine: ase
18 changes: 18 additions & 0 deletions submissions/hello-world-minimal/skills/SKILL.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
---
name: hello-world
description: A trivial file-creation skill for smoke testing
---

# Hello World Skill

A trivial file-creation skill used as a smoke test for the ABEvalFlow pipeline.

## What the agent must do

Given an instruction to create a file with specific content, the agent should
produce the correct file at the correct path with the exact expected content.

## Evaluation criteria

- File exists at the specified path
- File content matches the expected string exactly (including punctuation)
8 changes: 2 additions & 6 deletions submissions/hello-world/metadata.yaml
Original file line number Diff line number Diff line change
@@ -1,12 +1,8 @@
name: hello-world
description: "Create a file with specific content -- minimal smoke-test submission"
persona: general
version: "0.1.3"
version: "0.1.4"
tags:
- smoke-test
- trivial
cpus: 1
memory_mb: 512
storage_mb: 1024
experiment:
n_trials: 1
eval_engine: ase