RAGtronic AI Platform
Production AI platform built in Rust with multi-model orchestration, zero-trust auth, RAG with Qdrant, and NeMo Guardrails.
RAGtronic: Building a Production AI Platform in Rust, Multi-Model Orchestration, Zero-Trust Auth, and Making LLMs Speak Creole and Aussie
A deep dive into RAGtronic, a production AI platform I built on Rust/Actix-web with 28,000+ lines of backend code. It orchestrates 91 models across 10 providers through LiteLLM, runs dual-layer content safety with NVIDIA NeMo Guardrails and a compiled-in fallback engine, enforces zero-trust authentication via Ory Kratos and Oathkeeper, and through some creative prompt engineering, teaches models to speak Creole and respond with an authentic Aussie personality, injected at the Cloudflare Worker edge layer.
Launching the Ozteklab AI Portfolio Experience
A walkthrough of the new customer-facing experience that blends storytelling, RAG, and JP's Splunk-honed delivery playbook.