Skip to content

Weval.org Results Page Error #24

Description

@frantj

Description

After running my evaluation, the results page shows no results and I get this error for Claude 3 Haiku 20240307.

Image

Error Details
Generation failed: Failed to get response for anthropic:claude-3-haiku-20240307[temp:0]: Anthropic API Error: 404 Not Found - {"type":"error","error":{"type":"not_found_error","message":"model: claude-3-haiku-20240307"},"request_id":"req_011Cbx1JbDxcpDtBpqpEePTw"}

Steps to Reproduce

  1. Run evaluation
  2. Note that Macro Coverage Overview show's 0% across all prompts and Claude 3 Haiku 20240307 is throwing an error.

Blueprint ID

Evaluating AI Performance in Women, Peace & Security Scenarios

Page / URL where issue occurred

https://weval.org/sandbox/results/1781205250483-954cf8d0-f119-4a24-98ec-97c927f68cb7

Browser

Chrome

Operating System

macOS

Browser Console Logs / Stack Traces

Screenshots

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions