Skip to content

ColomboAI-com/surenav

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

13 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿงญ SureNav by ColomboAI

Python 3.9+ License: MIT Docker CI/CD

SureNav is a fully open-source web navigation and scraping toolkit for AI agents that requires zero API keys. It provides anti-detection browser automation, intelligent proxy rotation, and web unblocking capabilitiesโ€”completely free.

๐Ÿงญ Part of the Cairo Operational Intelligence Ecosystem

SureNav is one protocol in the larger Cairo Operational Intelligence ecosystem by ColomboAI โ€” our suite of open-source tools for autonomous AI operations.

โœจ Features

  • ๐Ÿ”“ No API Keys Required - Uses free proxy aggregation and local browser automation
  • ๐Ÿ•ต๏ธ Stealth Mode - Advanced anti-detection with fingerprint randomization
  • ๐ŸŒ Global Proxy Network - Auto-rotating free proxies from multiple sources
  • โšก JavaScript Rendering - Full browser automation for modern web apps
  • ๐Ÿ” Google Search - Scrape search results without rate limits
  • ๐Ÿณ Docker Ready - One-command deployment
  • ๐Ÿ”Œ API Compatible - Similar interface to popular paid services

๐Ÿš€ Quick Start

Option 1: Docker (Recommended)

Build locally:

docker build -t surenav .
docker run -p 8000:8000 surenav

Or pull from GitHub Container Registry (coming soon):

docker run -p 8000:8000 ghcr.io/colomboai-com/surenav:latest

Option 2: Local Installation

From source:

git clone https://github.com/ColomboAI-com/surenav.git
cd surenav
pip install -r requirements.txt
playwright install chromium
python -m src.server

PyPI package (coming soon):

pip install surenav
playwright install chromium
surenav-server

๐Ÿ“– Usage

Fetch a Web Page

curl "http://localhost:8000/browser?url=https://example.com"

Search Google

# JSON output
curl "http://localhost:8000/search?terms=open+source+ai&format=json"

# HTML output
curl "http://localhost:8000/search?terms=python+tutorial"

Python SDK

import asyncio
from surenav import StealthBrowser

async def main():
    browser = StealthBrowser()
    await browser.start()
    result = await browser.fetch_page("https://example.com")
    print(result["content"])
    await browser.stop()

if __name__ == "__main__":
    asyncio.run(main())

๐Ÿ—๏ธ Architecture

graph TD
    A[Client Request] --> B[FastAPI Server]
    B --> C[Proxy Manager]
    C --> D[Free Proxy Lists]
    B --> E[Stealth Browser]
    E --> F[Playwright + Stealth]
    F --> G[Target Website]
    G --> H[Clean Content]
Loading

โš™๏ธ Configuration

Environment variables:

Variable Default Description
SURENAV_PORT 8000 Server port
SURENAV_PROXY_REFRESH 300 Proxy refresh interval (seconds)
SURENAV_HEADLESS true Run browser headless
SURENAV_MAX_RETRIES 3 Retry attempts per request

๐Ÿ›ก๏ธ Anti-Detection Features

  • โœ… User agent rotation
  • โœ… Viewport fingerprint randomization
  • โœ… WebGL/Canvas noise injection
  • โœ… Automation flag removal
  • โœ… Mouse movement humanization
  • โœ… Cookie/session handling
  • ๐Ÿšง TLS/JA3 fingerprint randomization (planned - see roadmap)

โš ๏ธ Legal Notice

Important: SureNav is designed for legitimate web automation. Users must comply with website Terms of Service and applicable laws. See LEGAL_NOTICE.md for full details.

  • โœ… Use for public data, research, your own sites
  • โŒ Don't bypass auth, scrape private data, or violate ToS
  • ๐Ÿค Respect robots.txt and rate limits

๐Ÿค Contributing

Contributions welcome! See CONTRIBUTING.md.

๐Ÿ—บ๏ธ Roadmap

  • PyPI package publication
  • GitHub Container Registry auto-publish
  • TLS/JA3 fingerprint randomization
  • SOCKS5 proxy support
  • Built-in CAPTCHA solving integration
  • Distributed proxy mesh
  • Web UI dashboard

๐Ÿ“œ License

MIT - Free for personal and commercial use. See LICENSE.


Built with โค๏ธ by ColomboAI | Part of the Cairo Operational Intelligence ecosystem

About

"Open-source web unblocker for AI agents - no API keys required"

Resources

License

Contributing

Security policy

Stars

Watchers

Forks

Packages

 
 
 

Contributors