Skip to content

Trajectory logs not saved in webeval/scripts/webvoyager.py #56

@piperwolters

Description

@piperwolters

Running Fara on webvoyager tasks is working and I am seeing sequences of Thought/Action being logged, but this information isn't saved anywhere. Seems like this information is meant to be saved to web_surfer.log, but those files are empty for me.

I followed installation and eval steps and am using vllm to serve the model locally.

python webvoyager.py \
  --model_endpoint /tmp/fara_endpoint/ \
  --eval_oai_config ../endpoint_configs_gpt4o/dev/ \
  --out_url /my/save/path \
  --processes 1 \
  --run_id 1 \
  --max_rounds 100

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions