Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

OramBrowser - AI-Powered Browser with 3D World Creation

A next-generation browser that combines intelligent web research with experimental AI-powered 3D world creation using Three.js. Built for the OpenAI Open Model Hackathon, leveraging gpt-oss models for advanced reasoning and 3D generation capabilities.

🏆 OpenAI Open Model Hackathon Submission - Categories: Best Overall, Best Local Agent, Wildcard

Features

🌐 Web Research & AI

  • Intelligent Web Browsing: AI-powered web research with multiple search strategies
  • Deep Search Engine: Revolutionary "Open Tabs Tool" that autonomously opens and analyzes multiple web pages simultaneously
  • Agent System: Autonomous AI agents for complex multi-step research tasks
  • Universal Model Support:
    • All open-source models (via Ollama, vLLM, Hugging Face)
    • Major providers (OpenAI, Anthropic, Google, etc.)
    • gpt-oss integration: Leveraging OpenAI's new open-weight reasoning models (120B & 20B)
  • Enhanced Search Modes: Deep web search with comprehensive cross-reference analysis
  • Contextual Research: AI maintains context across multiple sources and sessions

🎮 3D World Creation (Experimental)

  • Three.js Integration: Real-time 3D world rendering and manipulation in the browser
  • AI-Powered 3D Generation: Experimental text-to-3D capabilities using LLMs and 3D AI providers
  • Basic Shape Creation: Create and manipulate primitive shapes (boxes, spheres, cylinders)
  • Future-Ready Architecture: Designed for advanced 3D generation as AI models improve
  • World Instance Management: Multiple isolated 3D environments with resource optimization
  • Real-time Rendering: 60 FPS browser-based 3D rendering with quality controls

🏗️ Advanced Features

  • Deep Search "Open Tabs Tool":
    • Autonomously opens multiple relevant web pages
    • Cross-references information across sources
    • Builds comprehensive knowledge graphs
    • Maintains context across browsing sessions
  • 3D Object Management: Add, remove, and modify 3D objects in real-time
  • Lighting System: Dynamic Three.js lighting with directional, point, and spot lights
  • Material System: PBR materials with customizable properties
  • Camera Controls: Perspective and orthographic viewport modes
  • Render Quality: Adjustable rendering quality (low, medium, high)
  • Experimental AI 3D: Text-to-3D generation (expanding as AI models evolve)

Hackathon Submission - OpenAI Open Model Hackathon

🏆 Competition Categories

  • Best Overall: Revolutionary browser combining AI research with 3D creation
  • Best Local Agent: Advanced offline AI research capabilities with local model support
  • Wildcard: Unexpected fusion of web browsing and 3D world generation

🧠 gpt-oss Integration

OramBrowser showcases the power of OpenAI's new open-weight reasoning models:

  • gpt-oss-120B & gpt-oss-20B: Advanced reasoning for complex research tasks
  • Local Processing: Run entirely offline with local model instances
  • Creative Applications: Novel use of reasoning models for 3D world understanding and generation

💡 Innovation Highlights

  • Autonomous Web Research: AI agents that think, browse, and synthesize information
  • Multi-Modal Intelligence: Bridging text research with spatial 3D creation
  • Open Source Ecosystem: Supporting all open-source models and providers
  • Future-Proof Architecture: Ready for next-generation AI capabilities

Getting Started

Prerequisites

  • Node.js 18+ and npm
  • Python 3.8+ (for backend services)
  • gpt-oss models (optional): Download from Hugging Face
  • Local LLM providers (optional): Ollama, vLLM, or LM Studio for offline capabilities

Installation

  1. Clone the repository

    git clone https://github.com/your-username/OramBrowser.git
    cd OramBrowser
  2. Install dependencies

    npm install
    cd electron/frontend
    npm install
  3. Configure AI Models

    • Set up local models (Ollama recommended for gpt-oss)
    • Configure API keys for cloud providers (optional)
    • Enable experimental 3D AI generation features
  4. Start the application

    npm run dev

Deep Search & Research Guide

🔍 The "Open Tabs Tool"

OramBrowser's revolutionary deep search engine automatically:

  1. Autonomous Browsing: AI opens multiple relevant web pages based on your query
  2. Cross-Reference Analysis: Compares information across sources for accuracy
  3. Context Preservation: Maintains research context across multiple browsing sessions
  4. Knowledge Synthesis: Combines findings into comprehensive research reports

Using Deep Search

  1. Enter your research query in the enhanced search bar
  2. Select "Deep Search" mode
  3. Watch as AI agents autonomously open and analyze relevant sources
  4. Review the synthesized findings and source verification
  5. Continue research with AI maintaining full context

Model Support

  • Open Source: All Hugging Face models, Ollama collections, local instances
  • Cloud Providers: OpenAI (including gpt-oss), Anthropic, Google, Azure
  • Reasoning Models: Specialized support for gpt-oss-120B and gpt-oss-20B
  • Local Processing: Full offline capability with local model deployment

3D World Creation Guide (Experimental)

Creating a New 3D World

  1. Click the "+" button in the tab bar
  2. Select "3D World" from the dropdown
  3. A new Three.js World tab will open with an empty 3D scene

Basic Scene Building (Current Capabilities)

  • Load Scene: Click "Load Scene" to create a basic environment with lighting
  • Add Objects: Use the object controls to add boxes, spheres, and cylinders
  • Add Lights: Add directional (sun) or point lights to illuminate your scene
  • Clear World: Remove all objects to start fresh

Experimental AI Features

  • Text-to-3D (Beta): Describe objects in natural language for AI generation
  • Scene Understanding: AI analyzes and suggests improvements to 3D scenes
  • Future Enhancements: Expanding capabilities as 3D AI models improve

Advanced Features

  • Fullscreen Mode: Click the fullscreen button for immersive 3D exploration
  • Render Stats: Monitor FPS, draw calls, and triangle count
  • Quality Settings: Adjust rendering quality for performance vs. visual fidelity

World Management

  • Multiple Worlds: Create multiple 3D worlds in separate tabs using Three.js
  • Resource Management: Automatic memory management and instance isolation
  • State Persistence: Worlds maintain their state when switching between tabs
  • Auto-Suspend: Inactive worlds are automatically suspended to save resources

Architecture

Frontend (React + TypeScript)

  • Tab System: Unified tab management for web and 3D content
  • ThreeJSWorldTab: Enhanced tab implementation for 3D world management
  • ThreeJSTab Component: React component for Three.js 3D interface
  • World Instance Manager: Manages multiple Three.js world instances
  • Deep Search Interface: Advanced UI for autonomous web research

Backend Services

  • AI Research Engine: Python backend for autonomous web browsing and analysis
  • Model Integration: Universal adapter for all LLM providers and local models
  • Three.js Bridge: WebGL-based 3D rendering and scene management
  • Search Orchestrator: Coordinates multi-tab deep search operations

Key Components

ThreeJSWorldTab

// Enhanced 3D world tab with Three.js integration
export class ThreeJSWorldTab extends BaseTab {
  // Three.js world instance management
  // Real-time rendering loop
  // Scene manipulation via WebGL
  // Resource cleanup and optimization
}

DeepSearchEngine

// Autonomous web research with multi-tab coordination
export class DeepSearchEngine {
  // Multi-page browsing automation
  // Cross-reference analysis
  // Context preservation across sessions
  // AI-powered information synthesis
}

ModelIntegrationService

// Universal LLM provider integration
export class ModelIntegrationService {
  // gpt-oss model support
  // Local model management (Ollama, vLLM)
  // Cloud provider APIs
  // Experimental 3D AI generation
}

Configuration

AI Model Configuration

// electron/dev-config.js
module.exports = {
  // Local model endpoints
  ollama_base_url: "http://127.0.0.1:11434",
  python_base_url: "http://127.0.0.1:8765",
  
  // gpt-oss model settings
  gpt_oss_120b_endpoint: "http://127.0.0.1:8000",
  gpt_oss_20b_endpoint: "http://127.0.0.1:8001",
  
  // Deep search configuration
  max_concurrent_tabs: 10,
  research_depth: 3,
  enable_cross_reference: true,
  
  // Experimental 3D AI
  enable_text_to_3d: true,
  three_js_renderer: "webgl2",
};

World Instance Configuration

// Maximum instances and resource limits
const config = {
  maxInstances: 10,
  maxMemoryPerInstance: 512, // MB
  autoSuspendTimeout: 5 * 60 * 1000, // 5 minutes
  enableMetaModelTracking: true,
  enableScenePersistence: true,
};

Development

Adding New AI Research Features

  1. Extend DeepSearchEngine: Add new autonomous browsing strategies
  2. Update Model Integration: Add support for new LLM providers
  3. Enhance Research UI: Add controls in research interface components
  4. Update Analysis Pipeline: Extend information synthesis capabilities

Adding New 3D Features (Experimental)

  1. Extend ThreeJSClient: Add new methods for 3D generation
  2. Update Types: Add new types in types/api.ts
  3. Enhance 3D UI: Add controls in ThreeJSTab.tsx
  4. Update AI Integration: Connect text-to-3D AI models

Debugging

  • Deep Search: Check browser console for research agent status
  • 3D Worlds: Monitor Three.js performance and WebGL context
  • AI Models: Check model endpoint connectivity and response times
  • Multi-Tab Coordination: Use developer tools to monitor tab orchestration

Roadmap & Future Enhancements

🚀 Near-term (Post-Hackathon)

  • Enhanced 3D AI: Integration with advanced text-to-3D models
  • Physics Simulation: Add realistic physics to Three.js worlds
  • Export Capabilities: Save 3D scenes in standard formats (GLTF, OBJ)
  • Collaborative Research: Multi-user deep search sessions

🌟 Long-term Vision

  • Advanced 3D Generation: Full scene generation from natural language
  • VR/AR Integration: Immersive 3D world exploration
  • Knowledge Graphs: Visual representation of research findings
  • AI-Generated Textures: Procedural material creation for 3D objects

Contributing

  1. Fork the repository
  2. Create a feature branch
  3. Implement your changes
  4. Add tests for new functionality
  5. Submit a pull request

License

This project is licensed under the MIT License - see the LICENSE file for details.

Support

For support and questions:

  • Create an issue on GitHub
  • Check the documentation
  • Join our Discord community

OramBrowser - Where AI-powered research meets experimental 3D creation 🚀


Hackathon Submission Details

Submission for: OpenAI Open Model Hackathon
Categories: Best Overall, Best Local Agent, Wildcard
Key Innovation: First browser to combine autonomous AI research with 3D world creation
Models Used: gpt-oss-120B, gpt-oss-20B, and comprehensive open-source model support
Demo Video: [Coming Soon]
Live Demo: [Coming Soon]

Built with ❤️ for the future of intelligent browsing and creative expression

About

No description, website, or topics provided.

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages