• Hackathon project

ShutterSense

An AI agent that works your camera: say what you want and it changes the settings, shoots, and checks its own photo.

The browser demo needs no camera, account or install. Prefer Android? Download the APK (opens in a new tab) (Android 9+).

Shutter Sense Demo

From "what I want" to a finished photo

ShutterSense drives a Canon mirrorless camera over Wi-Fi through the Canon Camera Control API, and checks each test shot against your goal — within a shot budget you set.

  1. Say what you wantDescribe the shot you're after and set how many test shots it may take.
  2. It changes the settingsThe agent adjusts the camera over Wi-Fi via CCAPI.
  3. It takes a test shotA real photo, straight from the camera.
  4. It judges the resultThe photo is checked against your goal.
  5. It explains itselfIt reports what it changed and why.

A camera assistant that knows the menus

Knows the less-obvious settings

Beyond exposure basics it reaches for the settings people forget:

  • High-frequency anti-flicker
  • Servo tracking and AF point
  • Metering
  • White-balance shift and picture style

Walks you through menu-only settings

When something can't be changed remotely, it guides you through the camera menus step by step.

Every step on your lens

Meta Ray-Ban Display shows each step on the lens, and you can correct the agent by voice.

Pose ideas and saved presets

Get pose ideas, and save presets for the looks you come back to.

Built at the Meta Global AI Developer Hackathon

ShutterSense started as a hackathon project: an Android phone runs the agent, a Canon camera with CCAPI takes the pictures, and a Meta Ray-Ban Display (in developer mode) keeps you in the loop without looking down at a screen.

The source is on GitHub under the MIT license, and the live browser demo lets anyone try the flow without any hardware.

Gothic II playing in a floating window in a real living room, seen through a Meta Quest
  • Open source · GitHub

Gothic 2 in 3D Window

Gothic II: Night of the Raven in a life-size, head-tracked 3D window floating in your room on Meta Quest.

Castle Guardian on a real coffee table, with VRON Engine's live room mesh shown as blue points across the room
  • In development

VRON Engine

My own Rust engine for Meta Quest: two-second launches, foveated rendering, occlusion and real-time room meshing.

Castle Guardian key art: a stone castle with blue towers surrounded by spell icons
  • Early Access

Castle Guardian

Mixed-reality roguelike castle defense. Goblins climb your furniture; you fight back with spells cast from your hands.

Try it without a camera

The live browser demo runs the whole flow — no camera, account or install needed.