Skip to content

LLM does not adhere to response format #10

@moritz-baumgart

Description

@moritz-baumgart

Apparently setting the response format with langchain the way we do it right now is not optimal:
https://github.com/moritz-baumgart/AI4Science/blob/970fe7e5b6a1d005efd38dadc897ab518531389e/treesearch/llm/query.py#L91

It happend now a few times that the LLM does not return a correctly formatted response.
Apparently you can enforce the structured output more/better.
See also: https://chatgpt.com/share/69601982-f6d8-8012-9c21-d161229f1c2b

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions