Content-heavy local news platform with a Next.js frontend and scraping pipeline used to ingest, normalize, and publish article, gallery, and video feeds.
- Homepage and section pages for breaking news, top stories, business, sport, lifestyle, and community content.
- Data-driven cards/rotators for top stories, most-read, ticker updates, galleries, and videos.
- Scraping and feed ingestion utilities to keep the content dataset fresh.
- Structured routes for article detail pages and topic navigation.
- Next.js 16 + React 19
- Node.js scraping toolchain (
axios,cheerio,xml2js,node-fetch) - Workspace setup with a dedicated
frontendpackage
npm install
npm run devMain scripts:
npm run build
npm run startfrontend/production web appbackend/supporting assets/utilitiesscraper/scraping logic and extraction toolingscraped-data/normalized content snapshotspublic/static assets
- Add scheduled scraper jobs with health-check reporting.
- Add freshness checks to detect stale categories before deploy.
- Add integration tests around article parsing edge cases.