Set Up a Zookeeper Cluster
Zookeeper is a coordination service that allows for easy management of common services like naming, configuration management, synchronization and group services.
Zookeeper is bundled with Incorta. You must run at least one Zookeeper instance for each Incorta cluster of one or more servers to coordinate Zookeeper’s various services. As part of a High Availability (HA) Incorta cluster where you add redundancy for each component to avoid having a single point of failure, you can set up a Zookeeper cluster to have fault tolerance for Zookeeper. You must run an odd number of Zookeeper processes on separate servers to create a Zookeeper cluster (called a quorum). For example, a three-node Zookeeper cluster can have one process or server fail and the other two servers can maintain service.
This page applies to the version of Zookeeper that is bundled with Incorta. If you use a standalone version of Zookeeper, instructions on this page may be different.
Example servers for the Zookeeper cluster:
|Server ID||Node IP||Client Port||P2P Port||Leader Election Port|
To set up a three-node Zookeeper cluster, perform the following steps:
- Edit each Zookeeper configuration file
(<install home>/IncortaNode/zookeeper/conf/zoo.cfg) and add the following:
server.1=zoo-1:2888:3888 server.2=zoo-2:2888:3888 server.3=zoo-3:2888:3888
The required format is
<P2P_PORT>:<LEADER_PORT>. In the example,
zoo-3 are machine names. Use an IP address or host name instead of
Create a file in each Zookeeper data directory that contains the ID of that instance:
- On zoo-1:
$ echo 1 > myid
- On zoo-2:
$ echo 2 > myid
- On zoo-3:
$ echo 3 > myid
- On zoo-1:
zoo.cfg file specifies the data directory by default, but if you have never started the process, you must create the directory before adding the
- In the Cluster Managemet Console (CMC), open the Details tab for your cluster.
- In edit mode, add the Zookeeper instances in a comma-delimited list:
- Start Zookeeper on each node by running the
start-zookeeper.shcommand from the containing folder. Starting zookeeper creates the zookeeper.out log file in the folder from which you ran the command.
You must configure each machine hosting a Zookeeper node to allow inbound/outbound connections between all Zookeeper nodes for the client, P2P, and Leader election ports (ports 2181, 2888 and 3888). These ports must be dedicated to Zookeeper and no other processes.