Life Admin & HomeDone with custom-built or unnamed agent Mar 25, 2026
Map and control a whole smart home
Karpathy's agent scanned the home network, logged into Sonos, reverse-engineered APIs, mapped lights, HVAC, shades, pool and security, and built a dashboard.
- What They Did
- Karpathy prompted the agent in chat with "Can you find my Sonos?". The agent scanned the home IP network, logged into the unprotected Sonos, web-searched and reverse-engineered its API endpoints, then repeated the process on lights, HVAC, shades, pool, spa, and security systems. It built its own dashboard and APIs to stitch the systems together; Karpathy later issued commands such as "Dobby, it's sleepy time".
- How It Went
- The agent produced a unified control center for the full house and now executes high-level commands across all devices. The post states no further metrics or shortfalls.
Try it yourself with custom-built or unnamed agent
Scan my home network at [network range] and identify the smart devices on it, such as [lights, speakers, thermostat, cameras]. Map what each one can do and how to control it, then build a simple local dashboard that shows them in one place. Only read and list devices at first, and ask me before logging in to any account or sending any control command.
Do this with a skill.
These SkillShop playbooks do this exact job.