v2.0.1 - Major Architecture Overhaul: Modular Package + Performance Timing

[rbb-dev]

v2.0.1 - Major Architecture Overhaul

The OpenRouter pipe has been completely restructured from a single 18,000+ line monolith into a clean, modular Python package. This release brings significant improvements to maintainability, performance, and developer experience.

---

Quick Install

Recommended: Use Open WebUI's "Import from Link" feature:

1. Go to Admin Panel → Functions → + (New Function)
2. Click Import from Link
3. Paste this URL:

   https://github.com/rbb-dev/Open-WebUI-OpenRouter-pipe/raw/refs/heads/v2.0.1/open_webui_openrouter_pipe.py
   

4. Click Import → Save

The stub loader automatically installs the full package from the v2.0.1 branch, ensuring you get a stable, pinned version.

---

What's New

Modular Package Architecture

The codebase has been restructured into focused subsystems:

Module	Purpose
api/	Gateway adapters, request/response transforms, filters
core/	Configuration, logging, circuit breaker, timing
models/	Model registry and capability detection
requests/	Request orchestration and debug utilities
storage/	Artifact persistence and file handling
streaming/	SSE parsing, event emission, streaming core
tools/	Tool execution and result persistence

Performance Timing System

New opt-in profiling to diagnose performance issues:

• ENABLE_TIMING_LOG valve - Toggle timing instrumentation
• TIMING_LOG_FILE valve - Output path (default: logs/timing.jsonl)
• @timed decorator on 313 functions for comprehensive profiling
• timing_mark() for point-in-time events (HTTP start, first chunk, etc.)
• Zero overhead when disabled - Early exit checks ensure no performance impact

Lazy Loading

• Open WebUI imports are deferred until actually needed
• Prevents slow initialization at import time
• Independent import blocks prevent cascading failures

---

Key Improvements

• Cleaner codebase - Each subsystem is isolated and testable
• Better maintainability - Clear separation of concerns
• Updated documentation - Developer guide with package layout and timing docs
• Version pinning - Stub loader locks to v2.0.1 for stability

---

Upgrading from v1.x

If you're upgrading from a previous version:

1. Remove your existing pipe from Open WebUI
2. Follow the Quick Install steps above
3. Reconfigure your valves (API key, model preferences, etc.)

Your chat history and settings are preserved - only the pipe code is replaced.

---

Documentation

• Configuration Guide
• Developer Guide
• Full Documentation

---

Important: Monolith Deprecation

This modular package is now the maintained codebase. The original single-file monolith (open_webui_openrouter_pipe.py from v1.x) will no longer receive updates.

Maintaining two parallel codebases isn't practical - all future development, bug fixes, and features will be in this v2.x package architecture.

---

Feedback

Found a bug? Have a feature request? Open an issue on GitHub.