Project for extracting structured datasets from JSON endpoints discovered via browser DevTools. It includes token handling, sessions, pagination, retries, schema-drift detection, validation, JSON/CSV exports and a safe demo API.
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
cp .env.example .env
python -m app.cli serve-demo --host 127.0.0.1 --port 8000Another terminal:
python -m app.cli extract --base-url http://127.0.0.1:8000 --output-dir outputcd playwright && npm install && npx playwright install chromium && npm run demo:videoBuilt with Python + Selenium · by Daniel Pizani · No magic — just code