Skip to content

Add skill lock configuration for evals-cli#301

Open
maudnals wants to merge 1 commit into
mainfrom
maudnals-agent-skills
Open

Add skill lock configuration for evals-cli#301
maudnals wants to merge 1 commit into
mainfrom
maudnals-agent-skills

Conversation

@maudnals

@maudnals maudnals commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Add skill lock configuration for evals-cli, and vercel skill as per https://ai-sdk.dev/.
Are we happy with this living under evals-cli considering the evals tooling needs specific dependencies not needed in other directories, or do we think managing skills globally for webmcp-tools makes more sense?

Side note: while installing this skill I saw Vercel made a skill dedicated to help us migrate the AI SDK to the next version, could come in handy

@Kulikowski

Copy link
Copy Markdown
Collaborator

Looks good to me! Are you still planning more changes in this PR? I think going forward evaluating cases with SKILLS available will be very much needed

@maudnals

maudnals commented Jul 20, 2026

Copy link
Copy Markdown
Contributor Author

@Kulikowski Thanks!

Looks good to me! Are you still planning more changes in this PR?

No, it's more in case we need more skills here that you folks are using and I may not be aware of. If we're OK with this, happy to merge.

Evaluating cases with SKILLS available will be very much needed

Can you share a bit more on this? Like skills specific to testing?

@maudnals
maudnals marked this pull request as ready for review July 20, 2026 09:53
@Kulikowski

Copy link
Copy Markdown
Collaborator

SKILLS specific to journeys - my bet is that going forward we will need a way to provide SKILLS for very complex worflows, like we have 140 tools, and a skill on how to complete specific journey with 10 tools only. It is still very early and there is no standardized way of providing SKILLS for WebMCP :)

@maudnals
maudnals requested a review from Kulikowski July 20, 2026 13:41
@maudnals

maudnals commented Jul 20, 2026

Copy link
Copy Markdown
Contributor Author

Definitely! Nice idea, I see how skills would make a lot of sense as journeys get more complex and involve more tools.

Changed this PR to non-draft, feel free to review and I'll merge when LGTY.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants