Build a hand-controlled game projected on your wall

Vibe-coded with Codex: a game projected on a living-room wall, controlled by hand via computer vision + projection mapping.

In short

What it does: Vibe-coded with Codex: a game projected on a living-room wall, controlled by hand via computer vision + projection mapping.

Agent: Codex · Category: Games

Steps in brief:

  1. Use Codex to build the game.
  2. Track your hand with computer vision as the controller.
  3. Project it onto the wall with projection mapping.

Who made it: Hank (X post, 20 Sep 2026) · source

Last updated · based on 336 use cases on agentsetups, each credited to its author.

by Hank20 Sep 2026

Prompt for your agent

Goal: Make an interactive game on my living-room wall.
Setup: agents used in source: Codex; tools/MCPs stated: computer vision, projection mapping.
Steps:
1. Use Codex to build the game.
2. Track your hand with computer vision as the controller.
3. Project it onto the wall with projection mapping.
Rules: ask me before anything irreversible (sending, posting, paying, deleting); don’t invent data, results or tools I haven’t given you; tell me what you couldn’t verify.
Based on: Hank — https://x.com/h4nkdog/status/2101758913234288883 (summarised from source; the source has no explicit step list)

Steps are our summary of the source (it has no explicit step list). Includes a “Based on” credit line.

I tried this

Tell the next builder. One anonymous answer each; click again to undo.

Agents, models and tools only what the source states

Agents
Codex
Tools
  • computer vision
  • projection mapping

Sources & credit