Inspiration
The way we interact with technology — and the way we create it — keeps evolving. We are going deeper into how and why we make things, and we want to be much closer to the result of our work. Quite literally, we want our inspiration and our ideas to surround us.
Eventually, the ability to create will always be with us. AR and VR wearables are getting smaller, lighter and better designed, and very soon they will simply be a constant part of everyday life. ArchyMind is a step into that near future: a tool that is always around you, wherever you are — so you can always create, always ship, and always put your projects into people's hands.
What it does
ArchyMind is a hands-only mixed-reality design studio for Meta Quest 3 and 3S. A large curved screen floats in front of you with Home, Canvas and Settings. On the Canvas you start a project or a template and lay out real web and mobile screens.
Any surface is your workspace. Any surface around you becomes your and Archy's shared workspace. Rest both palms on it and it turns into a trackpad that drives a cursor on the big screen, with a keyboard appearing right there when you need to type.
Archy, your companion. Archy is a small jelly-ball AI companion who lives in that workspace with you. You just talk to him: he listens, answers by voice, helps you with ideas, and you can interrupt him mid-sentence like a real person. His cartoon face shows what he's doing — listening, thinking, speaking. He's physical, too: pick him up, toss him, catch him, squeeze him — he plays along.
Publish and get feedback. One gesture publishes your interface as a live link protected by a PIN. Anyone can open it on a computer or a phone, click through the real screens at true device sizes, and leave comments right on any element. Those comments come back into your Canvas in the headset — and Archy works through them with you, resolving them one by one. Design, ship, hear back and improve, without ever taking the headset off.
Focus mode. When you need to concentrate, a dome of soft triangles builds around you, closing off the room with a calm, quiet hum. Inside it's just you, your work and Archy — a cozy place to think. Reach for its door to step back out.
How we built it
Native Android on Meta Spatial SDK (ECS architecture, Jetpack Compose panels placed in 3D), driven by hand tracking only — no controllers anywhere, including menus and settings. Archy's face is drawn by a custom shader with named emotional states and a mouth synced to his syllables. His voice is a full-duplex pipeline — ElevenLabs speech recognition → Claude → ElevenLabs voice — running on our own Node.js server on Fly.io, which also hosts published projects and carries comments back to the headset. Gestures and surface typing were tuned on recordings of real hand-tracking data captured on the headset.
Challenges we ran into
Making typing on a bare surface predictable with hand tracking alone: every press is decided once and the text on screen never changes behind your back. Keeping conversation natural: low latency, interruptions, and reactions to how you handle Archy. Closing the loop between the headset and the web, so feedback from a phone lands in the right place on your Canvas.
Accomplishments that we're proud of
The whole cycle — design, publish, feedback, fix — works end-to-end with bare hands, and a companion that feels alive rather than like a chatbot window.
What we learned
That even the boldest ideas can become real if you keep working. When we started, a design studio you control with bare hands, on any surface, with a living AI companion beside you, sounded almost impossible. Day by day, step by step, it turned into something you can put on and use. The lesson for us: don't shrink the idea — keep showing up and building it.
What's next
ArchyMind is only the first step. What comes next is a deeper, more fundamental way of working with AI agents and with what virtual and mixed reality make possible.
We see Archy growing from a helpful companion into a true creative partner — one who understands your project as a whole, remembers how you think and work, notices what you're trying to build, and takes on real parts of the job himself: building screens, writing the code behind them, testing them, and shipping them while you focus on the idea. Not one assistant in a chat window, but a team of agents that live in your space, each with its own role, working beside you and with each other.
At the same time we want to go further into what only spatial computing can give: work that isn't trapped in a flat rectangle, but surrounds you, uses the real room, your hands, your voice and your attention. A studio that adapts to where you are — at a desk, on a sofa, on the go — and travels with you as headsets turn into light, everyday glasses.