Pi 5 Local LLM Inference Kit: Run Llama 3.2 1B on NVMe
Pi 5 LLM Local Inference Starter Kit - Run Llama 3.2 1B at the Edge
Every part needed, pre-tested for compatibility, with an AI build companion trained on this exact project. Shipped from Bengaluru in 3-5 days.
In a single afternoon, you'll turn a Raspberry Pi 5 into a local AI server that runs Meta's Llama 3.2 1B entirely on-device. Boot from NVMe, launch Ollama, benchmark tokens per second, then test real-time chat and Retrieval-Augmented Generation over your own documents - no internet needed once setup is complete.
What You'll Build
A compact, private AI server that fits in your hand. After the guided build, you'll have a headless Pi 5 running Ollama on an NVMe SSD, capable of delivering sub-second chat responses and answering questions from PDFs or notes stored locally. It's your own completely offline LLM endpoint - ready for integration into IoT dashboards, personal assistants, or hackathon demos.
What You'll Learn
- Installing and configuring an NVMe SSD on Pi 5 via the M.2 HAT+
- Setting up Ollama and pulling Llama 3.2 1B on ARM64
- Benchmarking token generation speed with varying context lengths
- Building a local RAG pipeline that indexes documents and answers questions
Kit Contents
| Component | Quantity |
|---|---|
| Raspberry Pi 5 8GB | 1 |
| NVMe SSD 512GB | 1 |
| Pi 5 M.2 HAT+ | 1 |
| USB-C PSU | 1 |
Why Buy This Kit Instead of Sourcing Parts Separately
| Factor | Sourcing Separately | Compoden Kit |
|---|---|---|
| Compatibility checks | You verify every part | Pre-tested as a system |
| Build support | Forums and scattered tutorials | AI companion trained on this exact project |
| Time to first working build | Days of debugging | Hours, with step-by-step guidance |
| Shipping coordination | Multiple sellers, multiple delays | One shipment from Bengaluru in 3-5 days |
Who This Kit Is For
Designed for B.Tech CSE/ECE students exploring on-device AI, Smart India Hackathon teams needing a private LLM endpoint, and makers at campus labs like IIT/NIT/VIT/BITS. If you've already worked with Raspberry Pi and want to push it into GenAI territory - benchmarking real model performance and deploying local RAG - this kit is built for you.
Built and Backed by Compoden
Every Compoden kit ships with an AI build companion trained on this exact project - accessible via a QR code on the box, with WhatsApp and email backup. We've spent 10 years building projects for makers, schools, and institutions across India. If a part fails because of a manufacturing defect, replace it free within 7 days.
What if I get stuck during the build?
Scan the QR code on the box to start a chat with the AI companion trained on this exact project. If you prefer human help, reply on WhatsApp and our Bengaluru team will step in within a few hours.
Can I run larger models like Llama 3.2 3B on this kit?
The Pi 5 8GB can load 3B models with 4-bit quantization, but token speed drops significantly. For the best chat experience and benchmarking workflow, we recommend sticking with Llama 3.2 1B as set up in the build guide.
How do I feed my own PDFs for document Q&A?
The AI companion walks you through installing LangChain and ChromaDB to index PDFs stored on the NVMe SSD. You'll be able to ask questions about your notes, textbooks, or project reports within the build session.
Will this work for a hackathon demo where internet is unreliable?
Absolutely. Once you've pulled the model during setup, the entire stack runs offline. The NVMe drive houses both the OS and model weights, so you can demo local chat and RAG without any Wi-Fi after the initial download.
Ollama runs Llama 3.2 1B on Pi 5 NVMe - benchmarks tokens per second, tests chat and RAG over local documents.
What's in this kit
Shipping Information
- Prepaid Orders: ₹75 for orders up to ₹999, FREE shipping above ₹999
- COD Orders: ₹125 shipping + ₹50 COD fee = ₹175 total
- Delivery Timeline: Dispatch in 1-2 days, delivery in 2-7 days depending on location
Returns & Warranty
- 7-Day Return: Manufacturing defects only (approval required)
- Warranty: 7 days from delivery
- Non-Returnable: Batteries, consumables, cut wires, clearance items