Files
deploy/multiple_hummingbot_gateway_compose/README.md
Michael Feng 1e2be4b96f updates
2023-04-17 15:15:50 -07:00

6.5 KiB

Deploy Multiple Hummingbot Instances Linked to Gateway

This installs two Hummingbot instances, linked to a single Hummingbot Gateway instance.

Prerequisites

This configuration requires Docker Compose, a tool for defining and running multi-container Docker applications. The recommended way to get Docker Compose is to install Docker Desktop, which includes Docker Compose along with Docker Engine and Docker CLI which are Compose prerequisites.

See Docker for more information about how to install and use Docker Compose, as well as helpful commands.

Apple M1/M2 and other ARM machines

If you have a recent Mac that uses Apple Silicon (M1/M2) chipset or another ARM-based machine, you need to change the image tag to ensure that you pull a container that is optimized for your chip architecture.

Use an IDE like VSCode to edit the docker-compose.yml file. Change the tag for both the Hummingbot and Gateway images from latest to latest-arm to pull the images built for ARM-based machines.

You can also comment out the each line that contains latest and uncomment each line that contains latest-arm:

# image: hummingbot/hummingbot:latest
image: hummingbot/hummingbot:latest-arm

# image: hummingbot/gateway:latest
image: hummingbot/gateway:latest-arm

Afterwards, save the file and proceed to the next step.

If you are using a Mac with an Intel (x86) chipset, Windows or any other Intel-based machine, you don't need to make any changes before deploying a container.

Getting Started

This configuration lets you deploy multiple Hummingbot instances that access data and execute orders on DEX connectors.

To enable this, you will do need a few things first:

  • Install and configure the Hummingbot and Gateway instances
  • Generate self-signed certificates in Hummingbot
  • Give Gateway the passphrase used to generate the certificates (GATEWAY_PASSPHRASE)

First, let's check that you have installed Docker Compose successfully. In Terminal/Bash, Run the following command:

docker compose

You should see a response that start with:

Usage:  docker compose [OPTIONS] COMMAND

1. Launch network

Clone this repo or copy the docker-compose.yml file to a directory on your machine where you want to store your Hummingbot files. This is the "root folder" where your encrypted keys, scripts, trades, configs, logs, and other files related to your bots will be saved.

From the root folder, run the following command to pull the images and start the instance:

docker compose up -d

After the images have been downloaded, you should see the following output:

[+] Running 4/4
 ⠿ Network multiple_hummingbot_gateway_compose_default        Created
 ⠿ Container hummingbot-1                                     Started
 ⠿ Container hummingbot-2                                     Started
 ⠿ Container gateway                                          Started       

2. Set permissions

Run this command from your root folder to grant read/write permission to the hummingbot_files and gateway_files sub-folders:

sudo chmod -R a+rw ./hummingbot_files ./gateway_files

3. Launch Hummingbot and generate certificates

Now, attach to the hummingbot-1 instance:

docker attach hummingbot-1

You should see the Hummingbot welcome screen:

welcome screen

Set your password, which will be used to encrypt any keys you store with Hummingbot. This is the CONFIG_PASSWORD environment variable in your docker-compose.yml file.

Run the following command to generate Gateway certificates:

gateway generate-certs

You'll be prompted for a passphrase used to generate the certificates. This is the GATEWAY_PASSPHRASE environment variable in your docker-compose.yml file.

Hummingbot will use the passphrase to generate the certificates and save them in the hummingbot_files/certs folder, where the Gateway instance will look for the certificates it needs.

Afterwards, run exit to exit Hummingbot.

4. Remove network

Once you're back in Bash/Terminal, run the following command to remove the Compose project:

docker compose down

You should see the following output:

[+] Running 4/3 
 ⠿ Container hummingbot-1                                       Removed
 ⠿ Container hummingbot-2                                       Removed
 ⠿ Container gateway                                            Removed
 ⠿ Network multiple_hummingbot_gateway_compose_default          Removed

5. Modify YAML file

Now, use an IDE like VSCode to edit the docker-compose.yml file.

We'll edit the section that defines the following environment variables:

  hummingbot-1:
    # environment:
      #  - CONFIG_PASSWORD=[password]
  hummingbot-2:
    # environment:
      #  - CONFIG_PASSWORD=[password]
  gateway:
    # environment:
      #  - GATEWAY_PASSPHRASE=[passphrase]

Uncomment out:

  • The environment: lines
  • The CONFIG_PASSWORD lines: add your Hummingbot password
  • The GATEWAY_PASSPHRASE line: add the passphrase you used to generate the certificates

The final environment section of the YAML file should look like this:

  bot:
    environment:
      - CONFIG_PASSWORD=[password]
  bot2:
    environment:
      - CONFIG_PASSWORD=[password]
  gateway:
    environment:
      - GATEWAY_PASSPHRASE=[passphrase]

Afterwards, save the file.

6. Recreate network

Now, recreate the Compose project:

docker compose up -d

Attach to the hummingbot-1 instance. If you have defined CONFIG_PASSWORD in the YAML file, you don't need to enter it again:

docker attach hummingbot-1

Similarly, you can attach to the hummingbot-2 Hummingbot instance, which also uses CONFIG_PASSWORD

docker attach hummingbot-2

In both instances, you should now see GATEWAY:ONLINE in the upper-right hand corner.

Open a new Terminal/Bash window. In it, attach to the Gateway instance to see its logs:

docker attach gateway

See Gateway for more details on how to configure it for use with Hummingbot.

To get started with Hummingbot, check out the following docs: