Language
JavaScript/TypeScript
C++ Header
Platform
WebGPU (Browser)
Native / llama.cpp / GGML
Target Use Case
WebGPU LLM Inference
LLM Inference on the edge
File Format
.js library
.hpp header file
Size
~50 KB
12 KB
Devices Supported
Cross-platform (WebGPU)
Cross-platform (Native)
Integration
Import/CDN
#include in C++
Download