Cloud | Mobile | Edge: AI on the Edge series https://jaredrhodes.com/projects/ai-on-the-edge/ This series builds the AI on the Edge demo system: cloud-governed, locally executed AI using a .NET gateway, policy-driven model routing, private RAG, camera fleet telemetry, Azure Arc operations, and accelerator-backed endpoints. en-us Mon, 28 Sep 2026 02:54:56 +0000 Jekyll The AI on the Edge Reference Architecture https://jaredrhodes.com/blog/ai-on-the-edge-reference-architecture/ https://jaredrhodes.com/blog/ai-on-the-edge-reference-architecture/ Mon, 07 Sep 2026 09:00:00 +0000 Final synthesis for AI on the Edge: gateway, router, policy, RAG, IoT operations assistant, Azure governance, Azure Local lane, private cloud lab, Tenstorrent lane, and conference-ready flow. Building the AI on the Edge Demo System https://jaredrhodes.com/blog/building-the-ai-on-the-edge-demo-system/ https://jaredrhodes.com/blog/building-the-ai-on-the-edge-demo-system/ Mon, 31 Aug 2026 09:00:00 +0000 Engineering wrap-up for AI on the Edge: repo layout, make demo-laptop through make teardown targets, seed, reset, and smoke tests, shared health endpoints, and a repeatable 45-minute conference flow. Specialized Hardware Without an App Rewrite https://jaredrhodes.com/blog/specialized-hardware-without-an-app-rewrite/ https://jaredrhodes.com/blog/specialized-hardware-without-an-app-rewrite/ Mon, 24 Aug 2026 09:00:00 +0000 AI on the Edge Demo 6: registering a Tenstorrent or mock accelerator as an OpenAI-compatible gateway backend with capability discovery, health checks, fallback, and accelerator-preferred routing - no application rewrite. When the Edge Has to Stand Alone https://jaredrhodes.com/blog/when-the-edge-has-to-stand-alone/ https://jaredrhodes.com/blog/when-the-edge-has-to-stand-alone/ Mon, 17 Aug 2026 09:00:00 +0000 Demo 5 of AI on the Edge: disconnected operation, backend failures, malformed responses, cloud-blocked mode, local-only denial, smoke tests, and reset controls. Edge AI You Can Actually Operate https://jaredrhodes.com/blog/edge-ai-you-can-actually-operate/ https://jaredrhodes.com/blog/edge-ai-you-can-actually-operate/ Mon, 10 Aug 2026 09:00:00 +0000 Demo 4 of AI on the Edge: operating local AI with Azure Arc, GitOps, Azure Monitor, Managed Prometheus, Grafana, Key Vault, policy events, KQL, and dashboard evidence. From Camera Events to Operator Guidance https://jaredrhodes.com/blog/from-camera-events-to-operator-guidance/ https://jaredrhodes.com/blog/from-camera-events-to-operator-guidance/ Mon, 03 Aug 2026 09:00:00 +0000 Demo 3 of AI on the Edge: turning the existing cameras/# MQTT contract into an operations assistant using simulated, MQTT, and Event Hubs input modes. Private RAG That Cannot Leave the Edge https://jaredrhodes.com/blog/private-rag-that-cannot-leave-the-edge/ https://jaredrhodes.com/blog/private-rag-that-cannot-leave-the-edge/ Mon, 27 Jul 2026 09:00:00 +0000 Demo 2 for AI on the Edge: document ingestion, local embeddings, vector search, citations, data classification, LocalOnly routing, and fail-closed cloud fallback. One App, Many Places to Run AI https://jaredrhodes.com/blog/one-app-many-places-to-run-ai/ https://jaredrhodes.com/blog/one-app-many-places-to-run-ai/ Mon, 20 Jul 2026 09:00:00 +0000 Demo 1 for AI on the Edge: my .NET gateway, OpenAI-compatible facade, backend registry, route explanations, target backends, and LocalOnly denial behavior. AI on the Edge: Local AI Without Local Chaos https://jaredrhodes.com/blog/ai-on-the-edge-local-ai-without-local-chaos/ https://jaredrhodes.com/blog/ai-on-the-edge-local-ai-without-local-chaos/ Mon, 13 Jul 2026 09:00:00 +0000 Why I built AI on the Edge: local execution, Azure governance, model routing, an IoT camera workload, my private cloud lab, and conference-ready demo modes.