-
Notifications
You must be signed in to change notification settings - Fork 10
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
bug: ttft_ms is 0ms
bugSomething isn't workingSomething isn't workingStatus: Open.#53 In lastmile-ai/mcp-eval;feat: Testing MCP servers with dynamic tool support
enhancementNew feature or requestNew feature or requestStatus: Open.#52 In lastmile-ai/mcp-eval;feat: Add support for Azure hosted AI models
enhancementNew feature or requestNew feature or requestStatus: Open.#50 In lastmile-ai/mcp-eval;bug: Inconsistent number of generated test cases with --n-examples
bugSomething isn't workingSomething isn't workingStatus: Open.#49 In lastmile-ai/mcp-eval;feat: Add temperature option to mcp-eval generate for more diverse test generation
enhancementNew feature or requestNew feature or requestStatus: Open.#44 In lastmile-ai/mcp-eval;bug: TestAgent interface should match mcp-agent's AugmentedLLM interface
bugSomething isn't workingSomething isn't workingStatus: Open.#43 In lastmile-ai/mcp-eval;bug:
mcp-eval initdoesn't create enough sample testsbugSomething isn't workingSomething isn't workingStatus: Open.#42 In lastmile-ai/mcp-eval;bug: specifying
gpt5in model selection will errorbugSomething isn't workingSomething isn't workingStatus: Open.#41 In lastmile-ai/mcp-eval;bug: context required for good scenario tests
bugSomething isn't workingSomething isn't workingStatus: Open.#40 In lastmile-ai/mcp-eval;bug: During model selection, if auto-model selection then CLI should tell which model it selected
bugSomething isn't workingSomething isn't workingStatus: Open.#39 In lastmile-ai/mcp-eval;bug: Running mcp-eval generate overwrote mcpeval.yaml
bugSomething isn't workingSomething isn't workingStatus: Open.#38 In lastmile-ai/mcp-eval;bug: generator still makes random tests when no MCP server is connected
bugSomething isn't workingSomething isn't workingStatus: Open.#37 In lastmile-ai/mcp-eval;