Agents and Coordination

HALO uses Apollo to provide AI-assisted reasoning and coordination across systems via tool calling.

Apollo (AI Reasoning)

• Runs on separate hardware with GPU resources
• Exposes REST APIs for Omnia, n8n, and other services
• Decides when to call tools for Home Assistant, Frigate, and workflows

See the Apollo system page for design details.

Tool Calling Targets

• Home Assistant: Entity queries, service calls, scene activation
• Frigate: Event queries, snapshots/stream access
• n8n: Webhook triggers for multi-step workflows

Interaction Patterns

1. Omnia widget sends a user request (e.g., “Turn off all the lights”)
2. Apollo interprets intent, calls Home Assistant service via API
3. n8n orchestrates any cross-system follow-ups (logging, notifications)
4. Omnia updates UI state via WebSocket/REST

References

• Systems overview – /systems/
• Nexus containers – https://github.com/dcampman/nexus/blob/main/docs/containers.md