Run Hermes with a local model

Download a model for your hardware and check a conversation on your own computer.

Before you start

• A current Hermes Desktop installation or supported CLI setup.
• Enough free storage and memory for a model offered for your machine; internet for initial downloads.

Want to do it yourself?

Difficulty

5 out of 10

Estimated completion time

30–60 minutes, plus model download

Skills you’ll need: Check available storage, download a model, and distinguish local inference from network tools.

I’d rather get helpGet a consultationAt capacity

We’re at capacity and aren’t taking new consultation bookings right now.

How this helps your brand

Try everyday drafting on your own hardware and learn which tasks a local model can handle. Compare the result with your original draft.

1. 1

   Step 1: Open local model settings

   In Hermes Desktop, open Settings → Providers → Local Models, or choose Run models locally during onboarding. In the terminal, hermes model → Local models starts the corresponding setup.

2. 2

   Step 2: Install the runtime and model

   Choose Install runtime, then select a model from the catalog and download it. Hermes manages the inference engine and offers model choices for your hardware. Let installation and verification finish before starting a chat.

3. 3

   Step 3: Select the model and test

   Click Use and start a new conversation. Ask it to rewrite a short sample that you can judge. Check the selected model, answer quality, and response time before using it for larger tasks.

4. 4

   Step 4: Check the boundaries

   Local inference keeps the model computation on your computer. Web tools, messaging, and cloud integrations are separate networked capabilities; do not assume selecting a local model makes every tool offline.

   For an offline check after downloads finish, disconnect the network and run a text-only task without web or external tools. Reconnect when finished.

Rewrite this practice paragraph in clear, concise language: [paragraph]. Preserve every factual detail. Use only the supplied text and no external tools. After the rewrite, list any ambiguity you could not resolve.