On-Prem Requirements
The on-prem stack runs Memanto plus the Moorcheh server (and optionally Ollama) in Docker on a single host. Everything is automated by thememanto CLI — you only need to make sure the prerequisites are in place before you start.
Operating Systems
The on-prem stack is supported on:- Windows 10/11 with Docker Desktop (WSL2 backend)
- macOS 12+ (Apple Silicon and Intel) with Docker Desktop
- Linux (Ubuntu 20.04+, Debian 11+, RHEL 8+, Amazon Linux 2) with Docker Engine 20.10+
Hardware
For air-gapped deployments using OpenAI or Cohere as the embedding/LLM provider, the hardware footprint is much smaller (no Ollama container needed).
Software
Required
- Docker Engine 20.10+ or Docker Desktop 4.0+ with the daemon running.
- The Memanto onboarding wizard fails fast with a clear error if
docker infodoes not succeed. - Verify with:
- The Memanto onboarding wizard fails fast with a clear error if
- Python 3.10+ for the Memanto CLI itself.
- Verify with:
- Verify with:
memantoPython package.moorcheh-client>=0.1.3— the Python package that ships themoorcheh upcommand and exposes the on-prem SDK shape Memanto talks to. The onboarding wizard installs this automatically the first time you choose On-Prem at the prompt; you can also install it explicitly:
Optional
uvicorn[standard]if you plan to runmemanto servedirectly. Installed automatically as a dependency ofmemantoin most cases.- NVIDIA Container Toolkit if you want Ollama to use a GPU inside Docker.
Network & Ports
You do not need any inbound internet access for the runtime path. Internet is required only:
- Once, to
pip install memantoandmoorcheh-client. - Once per Ollama model, to pull the image from the Ollama registry.
- For every
answer.generatecall if your LLM provider is OpenAI or Cohere.
Provider Choices
You will be prompted to choose providers during onboarding. The choices and what they imply:
You can mix providers — e.g., Ollama embeddings with an OpenAI LLM for answers. The onboarding wizard prompts for each independently.
Disk Layout
Once onboarding finishes, the on-prem stack uses these locations on the host:
Cloud and on-prem state are deliberately kept in separate directories so you can switch backends without one polluting the other.
Verifying Prerequisites
Before running the on-prem setup, the wizard performs these checks for you:dockeris onPATH.docker inforeturns successfully (daemon is up).moorcheh-client>=0.1.3is importable (installs it if not).- Provider API keys (if you chose OpenAI or Cohere) are non-empty.