HN
Today

Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

LocalGPT is a new Rust-based AI assistant focusing on local-first operation, offering persistent memory, autonomous tasks, and a tiny ~27MB binary. It's designed to be a personal knowledge accumulator and task runner, compatible with the OpenClaw assistant pattern. This project appeals to the HN crowd's appreciation for efficient, self-contained tools written in Rust, combined with the current interest in practical AI applications.

14
Score
1
Comments
#1
Highest Rank
19h
on Front Page
First Seen
Feb 8, 2:00 AM
Last Seen
Feb 8, 8:00 PM
Rank Over Time
21111212225710151320252726

The Lowdown

LocalGPT is an open-source, local-first AI assistant built in Rust, designed for personal use as a knowledge accumulator, research assistant, and autonomous task runner. Inspired by the OpenClaw assistant pattern, it distinguishes itself by compiling into a single, compact ~27MB binary, eliminating the need for dependencies like Node.js, Docker, or Python. Its core philosophy centers on keeping data private and local, operating entirely on the user's machine.

  • Rust-Powered Efficiency: Developed in Rust, LocalGPT delivers a small, self-contained binary, ensuring minimal overhead and easy deployment.
  • Local-First & Private Data: All operations and memory data reside on the user's device, enhancing privacy and control.
  • Persistent Markdown Memory: It uses plain markdown files (MEMORY.md, HEARTBEAT.md, SOUL.md) for long-term knowledge, task queues, and personality, ensuring compatibility with OpenClaw's format.
  • Advanced Search Capabilities: Features both full-text search (SQLite FTS5) and semantic search using local embeddings, negating the need for external API keys for the latter.
  • Autonomous Tasks: An integrated 'heartbeat' runner allows for autonomous background task execution at configurable intervals.
  • Flexible Interfaces: Users can interact with LocalGPT via a command-line interface (CLI), a web interface, or a desktop graphical user interface (GUI).
  • Multi-Provider LLM Support: It supports various large language model providers, including Anthropic, OpenAI, and Ollama, offering broad compatibility.
  • Open-Source: Distributed under the Apache 2.0 license, encouraging community contributions and transparency.

LocalGPT positions itself as a robust, private, and versatile tool for individuals seeking to manage information and automate tasks with an AI assistant that prioritizes local operation and efficiency.