成長する自律 AI エージェント Hermes Agent の環境を構築する

takeharak

Cover Image for 成長する自律 AI エージェント Hermes Agent の環境を構築する

May 26, 2026

Docker Model Runner vLLM Metal 上で自律してタスクをこなしてくれる Hermes Agent 用の環境を構築整える

今回の環境

TL;DR

vLLM バックエンドのインストール

docker model install-runner --backend vllm
Installing vllm backend...
vllm backend installed successfully
docker model status
Docker Model Runner is running

BACKEND    STATUS         DETAILS
llama.cpp  Running        llama.cpp latest-metal (sha256:4c1ebaef48843b9b1fd0fbd2f01547a74459d44eb32c2c3d20edeb54998133a9) e365e65
vllm       Running        vllm-metal v0.2.0-20260420-142150
diffusers  Not Installed
lx        Not Installed  package not installed

mlx-community/Llama-3.2-3B-Instruct-4bit のダウンロード

docker model pull hf.co/mlx-community/llama-3.2-3b-instruct-4bit
c07a9be597b7: Pull complete [==================================================>]     296B/296B
587cb980af76: Pull complete [==================================================>]  1.122kB/1.122kB
94d5c6ba8f6b: Pull complete [==================================================>]  54.56kB/54.56kB
0a05be823898: Pull complete [==================================================>]  45.72kB/45.72kB
b33563055168: Pull complete [==================================================>]   16.3kB/16.3kB
9d75c1098fc5: Pull complete [==================================================>]  1.807GB/1.807GB
224931eb13f8: Pull complete [==================================================>]  17.21MB/17.21MB
c546925585e4: Pull complete [==================================================>]  1.122kB/1.122kB
2ef31fa0b9dc: Pull complete [==================================================>]  45.72kB/45.72kB
d75e1ee0ea65: Pull complete [==================================================>]  1.807GB/1.807GB
0e0634c181c7: Pull complete [==================================================>]   16.3kB/16.3kB
Model pulled successfully

Hermes Agent のセットアップ

mkdir -p .hermes
docker run -it --rm \
  -v .hermes:/opt/data \
  nousresearch/hermes-agent setup

How would you like to set up Hermes?

Select provider

Custom endpoint (enter URL manually)

Select terminal backend

Connect a messeging platform

Ready to go!

Hermes Dashboard の起動

docker run -d \
  --name hermes \
  --restart unless-stopped \
  -v ~/.hermes:/opt/data \
  -p 8642:8642 \
  -p 9119:9119 \
  -e HERMES_DASHBOARD=1 \
  nousresearch/hermes-agent gateway run

Hermes CLI (Chat)

docker run -it --rm \
  -v ~/.hermes:/opt/data \
  nousresearch/hermes-agent

Hermes CLI

Tech Blog