Skip to content

XueyanZhang/VoiceCode

Repository files navigation

VoiceCode

Voice-first vibe coding — code from anywhere, hands-free

Code from anywhere — on a walk, during a hike, at the gym.
VoiceCode is the intelligent dispatch layer between your voice and your coding agents.

Product Overview

VoiceCode is a cross-platform application (desktop + mobile) that lets developers drive their entire coding workflow through voice. Rather than replacing tools like Claude Code, Cursor, or Codex, VoiceCode acts as an intelligent orchestration layer on top of them:

  • 💡 capturing ideas
  • 🏗️ structuring prompts
  • 🚀 dispatching tasks
  • 🤖 autonomously resolving agent questions

The core insight is simple: writing a prompt is a lossy process. Ideas disappear while you type. VoiceCode eliminates that loss by capturing every word spoken, storing full semantic context, and using it to drive coding agents with far greater fidelity than typed prompts allow.

Speak your ideas anywhere — VoiceCode turns your voice into precise prompts, dispatches them to your coding agents, and handles agent questions automatically, so your code gets written while you're walking the dog.

Why VoiceCode?

Current vibe coding workflows have 4 major flaws:

  1. 💭 Idea loss: Every developer has experienced a great idea dissolving while they opened an editor and started typing. The cognitive cost of translating thought to typed text is high enough that details, edge cases, and creative insights routinely get discarded before they reach the prompt.

  2. ⏸️ Constant interruption: Coding agents frequently pause to ask clarifying questions. Each interruption pulls the developer back to the screen — even for questions whose answers were buried in the original spoken description.

  3. 🧱 Monolithic dispatch: Users naturally describe large, multi-feature requirements in one breath. Current tools either choke on complex prompts or generate tangled code that's hard to iterate on. There is no smart decomposition layer.

  4. 💻 Desktop-only workflows: Vibe coding today is still a desktop-first solution. Although mobile apps are available, typing a well-structured prompt is still blocking users from meaningful work.

Core Architecture

VoiceCode operates across 3 interaction layers.

User -> VoiceCode -> Coding Agent

VoiceCode Interaction Layers

Core Pipeline

NEED A DIAGRAM HERE

Core Features

Voice Memory

Voice Memory is the persistent knowledge layer that makes VoiceCode progressively smarter with use. It operates at two levels:

  • Project Memory — stored as .voicecode/memory.md within the project directory. Captures project-specific context: architecture decisions, naming conventions, dependencies, and prior task history. Transparent, version-controllable, and editable by the developer.
  • User Memory — a separate, user-level store that persists across all projects. Captures personal preferences, coding habits, communication style, and cross-project conventions.

Rely Engine

The Rely Engine eliminates the most disruptive part of the vibe coding workflow: being pulled back to the screen to answer agent questions mid-task.

When a coding agent issues a clarification request, the Rely Engine intercepts it before it reaches the user. It searches Voice Memory for any information that could resolve the question with a confidence threshold.

User-controlled aggression level: Conservative (escalate most questions) / Normal / Aggressive (resolve most autonomously)

Task Splitter & Parallel Dispatch

Large spoken requirements are natural — developers think at the feature level, not the commit level. The Task Splitter bridges this gap by decomposing complex intents into atomic tasks with explicit dependency relationships.

Queue Workflow

Not every idea should be dispatched immediately. The Queue system gives developers a structured way to capture, refine, and schedule coding tasks across sessions and contexts.

Ask Mode

Ask Mode activates before dispatch to resolve ambiguity in the user's requirements. Rather than letting a vague prompt generate wrong code, VoiceCode asks targeted clarifying questions upfront.

Voice Summary

Coding agents produce output unsuitable for voice: diffs, stack traces, file trees, multi-paragraph analyses. The Voice Summary layer translates all agent output into spoken-friendly formats for users in mobile contexts.

BTW

Ask any side question that helps your decision, like search for a new library. BTW runs in an isolated context — it does not affect the current task's conversation or prompt state.

Mobile-to-Code

MVP Scope

About

No description, website, or topics provided.

Resources

License

Stars

1 star

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages