Skip to main content

On-Prem Requirements

The on-prem stack runs Memanto plus the Moorcheh server (and optionally Ollama) in Docker on a single host. Everything is automated by the memanto CLI — you only need to make sure the prerequisites are in place before you start.

Operating Systems

The on-prem stack is supported on:
  • Windows 10/11 with Docker Desktop (WSL2 backend)
  • macOS 12+ (Apple Silicon and Intel) with Docker Desktop
  • Linux (Ubuntu 20.04+, Debian 11+, RHEL 8+, Amazon Linux 2) with Docker Engine 20.10+

Hardware

For air-gapped deployments using OpenAI or Cohere as the embedding/LLM provider, the hardware footprint is much smaller (no Ollama container needed).

Software

Required

  • Docker Engine 20.10+ or Docker Desktop 4.0+ with the daemon running.
    • The Memanto onboarding wizard fails fast with a clear error if docker info does not succeed.
    • Verify with:
  • Python 3.10+ for the Memanto CLI itself.
    • Verify with:
  • memanto Python package.
  • moorcheh-client>=0.1.3 — the Python package that ships the moorcheh up command and exposes the on-prem SDK shape Memanto talks to. The onboarding wizard installs this automatically the first time you choose On-Prem at the prompt; you can also install it explicitly:

Optional

  • uvicorn[standard] if you plan to run memanto serve directly. Installed automatically as a dependency of memanto in most cases.
  • NVIDIA Container Toolkit if you want Ollama to use a GPU inside Docker.

Network & Ports

You do not need any inbound internet access for the runtime path. Internet is required only:
  • Once, to pip install memanto and moorcheh-client.
  • Once per Ollama model, to pull the image from the Ollama registry.
  • For every answer.generate call if your LLM provider is OpenAI or Cohere.

Provider Choices

You will be prompted to choose providers during onboarding. The choices and what they imply: You can mix providers — e.g., Ollama embeddings with an OpenAI LLM for answers. The onboarding wizard prompts for each independently.

Disk Layout

Once onboarding finishes, the on-prem stack uses these locations on the host: Cloud and on-prem state are deliberately kept in separate directories so you can switch backends without one polluting the other.

Verifying Prerequisites

Before running the on-prem setup, the wizard performs these checks for you:
  1. docker is on PATH.
  2. docker info returns successfully (daemon is up).
  3. moorcheh-client>=0.1.3 is importable (installs it if not).
  4. Provider API keys (if you chose OpenAI or Cohere) are non-empty.
If any check fails, the wizard prints a one-line error with a hint and exits with a non-zero status — no partial state is left behind.

Next Step

On-Prem Quickstart — install the stack end-to-end in 5–10 minutes.