AEGIS//LAB

A private AI assistant, built at home

Aegis is my homelab project. I'm learning as I go and writing down what works, what broke and how it got fixed. The code I publish is free to copy for your own build.

HOW IT FITS TOGETHERtap a box

Every way of talking to Aegis goes through the router in the middle. Tap a box to see what it does.

ChatAegis WatchVoice boxBrainTalkerMemoryResearchWatchdogSmart homeRobotics3D printerROUTER

Router Running in my lab

Every request passes through here. It sends quick ones to the Talker and hard ones to the Brain, and adds what Aegis remembers.

Read more about Router
ALL THE PIECESstatuses updated by hand
  • Way in

    Chat

    Running in my lab

    A normal chat window through Open WebUI, usable from a browser or phone.

  • Way in

    Aegis Watch

    Running in my lab

    The lab's phone app. It runs research and shows how the lab is doing.

  • Way in

    Voice box

    Being built

    A small speaker and microphone box that talks to Aegis over LiveKit.

  • Router

    Router

    Running in my lab

    Every request passes through here. It sends quick ones to the Talker and hard ones to the Brain, and adds what Aegis remembers.

  • Model

    Brain

    Running in my lab

    The large model for hard thinking, research and overnight jobs, on an Intel Arc Pro B65 with 32 GB.

  • Model

    Talker

    Running in my lab

    A smaller, faster model for quick replies, on an RTX 3060. Speech-to-text and embeddings share that card.

  • Memory

    Shared memory

    Running in my lab

    Every way of talking to Aegis uses the same memory: a vector database for facts and an Obsidian vault for structured notes.

  • Tool or sense

    Research

    Running in my lab

    A research bot that searches through self-hosted SearXNG, checks its quotes against the sources and writes a report.

  • Tool or sense

    Watchdog

    Being built

    Frigate detects events on the cameras. The plan is for cheap checks to run first, so the Brain only wakes for serious ones.

  • Tool or sense

    Smart home

    Running in my lab

    Home Assistant connects Aegis to the house and receives camera events from Frigate.

  • Later

    Robotics

    Planned

    Planned for later, once there's hardware to show.

  • Tool or sense

    3D printer

    Running in my lab

    Claude can already slice and start a print for me while I'm away. Next is seeing whether my own local models can do it safely.