Skip to content

Add comprehensive provider coverage tests to ensure runtime and playground consistency. #2192

@kheiner

Description

@kheiner

Currently the test suite does not validate against alignment between runtime providers and playground configuration. Tests are missing or invalid as a result.

Missing Tests

It would be a lot easier if the tests were organized alphabetically and a provider-coverage test for:

  • Each provider should exist exactly once in playground
  • Each provider should be defined with a key and value in every image
  • All playground providers should exist in runtime
  • Images should not contain unknown providers
  • Missing provider tests list should shrink over time

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions