llm-widget

Drop-in AI chat — runs a 1.5B LLM in your browser via WebGPU. No server. No API key.

Usage

<script src="llm-widget.iife.js" data-name="My Assistant" data-model="qwen-1.5b"></script>

About

This is a demo page for the llm-widget. The AI reads this page's visible text and uses it as context to answer questions. No embeddings, no vector DB.

Projects

Orca — Rust/Wasm container orchestrator filling the gap between Coolify and Kubernetes.

SwarmHaul — multi-agent coordination protocol on Solana for logistics automation.

SIGNAL DECK — autonomous YouTube music channel powered by AI-generated audio.

llm-widget — in-browser LLM via WebGPU, drop-in chat widget for any website.