Skip to content

feat(wsj): Add WSJ site adapters - #68

Open
anyerqi wants to merge 1 commit into
epiral:mainfrom
anyerqi:feat-wsj
Open

feat(wsj): Add WSJ site adapters#68
anyerqi wants to merge 1 commit into
epiral:mainfrom
anyerqi:feat-wsj

Conversation

@anyerqi

@anyerqi anyerqi commented Apr 28, 2026

Copy link
Copy Markdown

Description

Adds WSJ adapters for use with bb-browser:

  • wsj/headlines: reads latest headlines from NEXT_DATA.props.pageProps.latestHeadlines
  • wsj/news: fetches a WSJ article by URL and extracts title, subtitle, authors, timestamps, and full article text
  • wsj/frontpage: reads print edition front-page articles for a specified date from NEXT_DATA.props.pageProps.articles
  • wsj/search: reads WSJ search results from NEXT_DATA.props.pageProps.searchResults

Testing

Tested locally with bb-browser site after copying the adapters into ~/.bb-browser/bb-sites/wsj:

  bb-browser site wsj/headlines --json
  bb-browser site wsj/search openai --json
  bb-browser site wsj/frontpage 20260428 --json
  bb-browser site wsj/news 'https://www.wsj.com/tech/ai/openai-misses-key-revenue-user-targets-in-high-stakes-sprint-toward-ipo-94a95273' --json

All four adapters returned structured JSON successfully.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant