← Back to the work
Automation · Voice interfaces

A voice interface that reaches into the Mac.

Connecting spoken requests to a practical toolkit of local computer actions.

Local prototype
JARVIS LOCAL / HOW IT CONNECTS

“Open Safari and search…”

An example request from the project documentation.

01
Listen
→02
Interpret
→03
Act
→04
Reply

Workflow illustration · This page does not record audio or control your computer.

A conversation with somewhere to go

Jarvis Local connects spoken requests to a Mac automation toolkit. The project records a request, transcribes it, gets a model response, and speaks back. It can also take actions such as opening an app, searching, or creating a note.

The interesting handoff

I wanted to explore the moment a conversation becomes an action. The prototype uses shortcuts, menus, keystrokes, and AppleScript, with a session mode for follow-up exchanges.

Where the prototype stops

It is an action-based local prototype, launched through a trigger rather than a true always-listening wake word. The next useful step is a smaller set of workflows that can be tested for reliability.