AI/AIZENME
📦 AUTOMATION · Agents & IoT Level: Intermediate ⏱ 20 MIN Free & Open Source

Teach Your Doorbell Camera to Describe Deliveries & Visitors with Home Assistant LLM Vision

Tired of generic "Motion Detected at Front Door" notifications? Use open-source `ha-llmvision` in Home Assistant to analyze camera snapshots with local Ollama Vision or Gemini Flash and push descriptive alerts like "A courier in a blue vest just placed a cardboard box on the doormat."

CORE TOOLS ha-llmvision (Open Source), Home Assistant, Qwen2.5-VL / Ollama or Gemini Flash
BEST FOR Home Assistant users, frequent online shoppers, homeowners, security DIYers
REQUIREMENTS Home Assistant instance; integrated doorbell/IP camera; Ollama VLM or API
✦ WHY THIS WORKFLOW

YOLO only tells you `person: 92%`. A vision LLM tells you "A courier in a red jacket placed a cardboard box behind the planter," turning noisy alerts into instant peace of mind.

✦ Interactive Workflow Animation Preview

Step-by-Step Action Checklist

0 / 4 Completed
READY-TO-USE PROMPT TEMPLATE
Open Official Tool / Repo ↗
I installed `ha-llmvision` in Home Assistant and want an automation for my front-door camera (`camera.front_door`).
Provide:
1) Complete Home Assistant `automation.yaml` calling `llmvision.stream_analyzer` (3 frames over 4 seconds) when person motion triggers, then sending a mobile notification with the snapshot and `response_text`;
2) A tight, zero-fluff security prompt (≤25 words) that reports visitor role (courier/food delivery/stranger), action (dropped off/picked up package/lingering), and exact parcel location without describing static background walls.
Use Cases & Tags:
Instant notification detailing where a courier left your packageDistinguishing delivery drivers from suspicious loiterersNightly visual check that garage doors and gates are closedConfirming kids arrived home safely from school#llmvision#homeassistant