🚀 Page Pulse – Production-grade URL Audit Service

A production-ready backend REST API built with Node.js and Express.js that audits websites by validating URLs, fetching metadata, measuring response time, caching results, and exposing a scalable API.

---

🌐 Live API

Render Deployment

https://page-pulse-r2vl.onrender.com

---

✨ Features

• ✅ URL Validation using Zod
• ✅ Website Health Audit
• ✅ HTML Title Extraction
• ✅ HTTP Status Detection
• ✅ Response Time Measurement
• ✅ Configurable Request Timeout
• ✅ In-Memory Caching
• ✅ Rate Limiting
• ✅ Concurrency Control
• ✅ Structured Logging (Winston)
• ✅ Unique Request IDs
• ✅ Unit Testing (Jest + Supertest)
• ✅ GitHub Actions Continuous Integration
• ✅ Render Cloud Deployment

---

🛠️ Tech Stack

Category	Technologies
Backend	Node.js, Express.js
HTTP Client	Axios
HTML Parser	Cheerio
Validation	Zod
Cache	Node Cache
Logging	Winston
Rate Limiting	Express Rate Limit
Concurrency	p-limit
Testing	Jest, Supertest
CI/CD	GitHub Actions
Deployment	Render

---

📂 Project Structure

page-pulse/
│
├── .github/
│   └── workflows/
│       └── ci.yml
│
├── src/
│   ├── cache/
│   ├── config/
│   ├── controllers/
│   ├── logger/
│   ├── middleware/
│   ├── routes/
│   ├── services/
│   ├── tests/
│   └── utils/
│
├── Task-B/
│   ├── Task-B-Architecture.md
│   ├── Technology-Decision-Record.md
│   ├── Failure-Mode-Analysis.md
│   ├── Observability-and-Rollback.md
│   └── diagrams/
│       └── architecture-diagram.png
│
├── assets/
├── server.js
├── package.json
├── render.yaml
└── README.md

---

⚙️ Installation

Clone the repository

git clone https://github.com/Ishar007/page-pulse.git

Install dependencies

npm install

Create a .env file

PORT=5000
REQUEST_TIMEOUT=10000
CACHE_TTL=300
MAX_CONCURRENT=20

Start the development server

npm run dev

---

📡 API

POST /api/audit

Request

{
  "url": "https://google.com"
}

Successful Response

{
  "requestId": "uuid",
  "success": true,
  "url": "https://google.com",
  "status": 200,
  "title": "Google",
  "responseTime": 267,
  "cached": false
}

---

🧪 Running Tests

npm test

---

🚀 Continuous Integration

GitHub Actions automatically:

• Install project dependencies
• Execute all unit tests
• Validate every push and pull request to the main branch

---

📸 Screenshots

API Response

---

GitHub Actions

---

Render Deployment

🚀 Future Improvements

• Redis Distributed Cache
• Authentication & Authorization
• Docker Support
• Kubernetes Deployment
• Audit History
• Scheduled Website Audits
• Email Notifications
• Dashboard & Analytics

---

📚 Task B – System Design & Architecture

This repository includes the complete design documentation required for Task B of the Digital Heroes Software Development assignment.

Documents

• 📄 Task B Architecture
• 📄 Technology Decision Record
• 📄 Failure Mode Analysis
• 📄 Observability and Rollback Plan

Architecture Diagram

• 🏗️ System Architecture Diagram

Highlights

• Designed to support 10,000 audits per day
• Handles 500 concurrent requests
• Stateless API architecture for horizontal scaling
• Redis-based distributed caching strategy
• RabbitMQ for asynchronous job processing
• PostgreSQL for persistent audit storage
• Prometheus & Grafana for monitoring
• 99.9% availability target with rollback and observability planning

---

👨‍💻 Author

Ishar Roy

B.Tech – Computer Science & Engineering

Future Institute of Engineering and Management

---

⭐ If you found this project helpful, consider giving it a star!