All Projects
In Development

Claude Mobile Controller

Control Claude Code from your phone

Nuxt 3tmuxWeb Speech APISSETypeScript

The Problem

Working with Claude Code means being stuck at your desk. Sometimes you want to check on progress, give feedback, or make requests while walking around.

The Solution

A mobile web app that connects to Claude Code via tmux and provides voice-based interaction with text-to-speech summaries.

Key Features

  • Connect to running Claude Code sessions via tmux
  • Push-to-talk voice input
  • Text-to-speech for Claude responses
  • Voice notes anchored to specific responses
  • Mobile-optimized UI

Architecture

The Nuxt server runs on the same machine as Claude Code. It connects to the tmux session, sends/receives text, and streams responses to the mobile client via SSE.

Challenges

  • tmux session management and text capture
  • Web Speech API quirks on mobile browsers
  • Keeping the mobile connection alive during screen sleep

Lessons Learned

  • tmux is incredibly powerful for terminal automation
  • Mobile web apps can be surprisingly capable
  • Voice interfaces require careful UX consideration

Interested in this project or want to collaborate?

Get in Touch