先搭建伪分布式集群，再去搭建真分布式集群。有些的人的电脑内存、性能比较低，所以在搭建真实的一个分布式环境的话，可能会相对来说比较卡，所以两种都会做一下，首先会在单机上搭建一个集群。单机上的集群主要就是它的port，端口号不一致，ip是一样的。称之为伪分布式是因为，当一个节点挂掉之后，整个集群，整个三台zk的节点全部都会挂掉，所以它是一个伪分布式集群。
下载：
|
1 |
$ wget https://archive.apache.org/dist/zookeeper/zookeeper-3.4.14/zookeeper-3.4.14.tar.gz |
解压
|
1 |
tar -zxvf zookeeper-3.4.14.tar.gz |
移动到~/app目录下
|
1 |
$ mv zookeeper-3.4.14 ~/app |
将解压出来的zookeeper文件夹复制出来三个副本 分别是zk1 zk2 和 zk3
|
1 2 3 |
[hadoop@hadoop000 app]$ cp zookeeper-3.4.11/ zk1 -rf [hadoop@hadoop000 app]$ cp zookeeper-3.4.11/ zk2 -rf [hadoop@hadoop000 app]$ cp zookeeper-3.4.11/ zk3 -rf |
为每个副本中的dataDir中创建一个myid, 其中zk1的myid为1, zk2的myid为2, zk3的myid为3
|
1 2 3 |
[hadoop@hadoop000 app]$ echo 1 > zk1/dataDir/myid [hadoop@hadoop000 app]$ echo 2 > zk2/dataDir/myid [hadoop@hadoop000 app]$ echo 3 > zk3/dataDir/myid |
分别修改每个副本中的conf/zoo.cfg文件
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
[hadoop@hadoop000 app]$ vi zk1/conf/zoo.cfg tickTime=2000 # 单个心跳的毫秒数 initLimit=10 # 同步阶段初始化所需的心跳数 syncLimit=5 # 请求和响应所需的心跳数 dataDir=/home/hadoop/app/zk1/dataDir # 快照数据存放位置 - 需对应修改 dataLogDir=/home/hadoop/app/zk1/dataLogDir # 事务日志存放位置 - 需对应修改 clientPort=2191 # 客户端连接端口 - 需对应修改, 不能重复 # 将所有命令添加到白名单中 4lw.commands.whitelist=* # 配置zookeeper服务器的 [主机名或主机ID]:[同步端口(唯一)]:[选举端口(唯一)] server.1=localhost:2891:3891 server.2=localhost:2892:3892 server.3=localhost:2893:3893 |
|
1 2 3 4 5 6 7 8 9 10 11 12 13 |
[hadoop@hadoop000 app]$ vi zk2/conf/zoo.cfg tickTime=2000 # 单个心跳的毫秒数 initLimit=10 # 同步阶段初始化所需的心跳数 syncLimit=5 # 请求和响应所需的心跳数 dataDir=/home/hadoop/app/zk2/dataDir # 快照数据存放位置 - 需对应修改 dataLogDir=/home/hadoop/app/zk2/dataLogDir # 事务日志存放位置 - 需对应修改 clientPort=2192 # 客户端连接端口 - 需对应修改, 不能重复 # 将所有命令添加到白名单中 4lw.commands.whitelist=* # 配置zookeeper服务器的 [主机名或主机ID]:[同步端口(唯一)]:[选举端口(唯一)] server.1=localhost:2891:3891 server.2=localhost:2892:3892 server.3=localhost:2893:3893 |
|
1 2 3 4 5 6 7 8 9 10 11 12 13 |
[hadoop@hadoop000 app]$ vi zk3/conf/zoo.cfg tickTime=2000 # 单个心跳的毫秒数 initLimit=10 # 同步阶段初始化所需的心跳数 syncLimit=5 # 请求和响应所需的心跳数 dataDir=/home/hadoop/app/zk3/dataDir # 快照数据存放位置 - 需对应修改 dataLogDir=/home/hadoop/app/zk3/dataLogDir # 事务日志存放位置 - 需对应修改 clientPort=2193 # 客户端连接端口 - 需对应修改, 不能重复 # 将所有命令添加到白名单中 4lw.commands.whitelist=* # 配置zookeeper服务器的 [主机名或主机ID]:[同步端口(唯一)]:[选举端口(唯一)] server.1=localhost:2891:3891 server.2=localhost:2892:3892 server.3=localhost:2893:3893 |
修改好之后, 分别重启三个副本的zk服务 (如果已经start则先stop)
|
1 2 3 |
[hadoop@hadoop000 app]$ ./zk1/bin/zkServer.sh start [hadoop@hadoop000 app]$ ./zk2/bin/zkServer.sh start [hadoop@hadoop000 app]$ ./zk3/bin/zkServer.sh start |
使用zk客户端连接zk1
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
[hadoop@hadoop000 app]$ zkCli.sh -server localhost:2191 Connecting to localhost:2191 2020-03-01 18:23:45,704 [myid:] - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0, built on 11/01/2017 18:06 GMT 2020-03-01 18:23:45,710 [myid:] - INFO [main:Environment@100] - Client environment:host.name=hadoop000 2020-03-01 18:23:45,710 [myid:] - INFO [main:Environment@100] - Client environment:java.version=1.8.0_211 2020-03-01 18:23:45,712 [myid:] - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation 2020-03-01 18:23:45,713 [myid:] - INFO [main:Environment@100] - Client environment:java.home=/home/hadoop/app/jdk1.8.0_211/jre 2020-03-01 18:23:45,713 [myid:] - INFO [main:Environment@100] - Client environment:java.class.path=/home/hadoop/app/zookeeper-3.4.11/bin/../build/classes:/home/hadoop/app/zookeeper-3.4.11/bin/../build/lib/*.jar:/home/hadoop/app/zookeeper-3.4.11/bin/../lib/slf4j-log4j12-1.6.1.jar:/home/hadoop/app/zookeeper-3.4.11/bin/../lib/slf4j-api-1.6.1.jar:/home/hadoop/app/zookeeper-3.4.11/bin/../lib/netty-3.10.5.Final.jar:/home/hadoop/app/zookeeper-3.4.11/bin/../lib/log4j-1.2.16.jar:/home/hadoop/app/zookeeper-3.4.11/bin/../lib/jline-0.9.94.jar:/home/hadoop/app/zookeeper-3.4.11/bin/../lib/audience-annotations-0.5.0.jar:/home/hadoop/app/zookeeper-3.4.11/bin/../zookeeper-3.4.11.jar:/home/hadoop/app/zookeeper-3.4.11/bin/../src/java/lib/*.jar:/home/hadoop/app/zookeeper-3.4.11/bin/../conf: 2020-03-01 18:23:45,713 [myid:] - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2020-03-01 18:23:45,713 [myid:] - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp 2020-03-01 18:23:45,713 [myid:] - INFO [main:Environment@100] - Client environment:java.compiler=<NA> 2020-03-01 18:23:45,713 [myid:] - INFO [main:Environment@100] - Client environment:os.name=Linux 2020-03-01 18:23:45,713 [myid:] - INFO [main:Environment@100] - Client environment:os.arch=amd64 2020-03-01 18:23:45,713 [myid:] - INFO [main:Environment@100] - Client environment:os.version=3.10.0-514.el7.x86_64 2020-03-01 18:23:45,714 [myid:] - INFO [main:Environment@100] - Client environment:user.name=hadoop 2020-03-01 18:23:45,714 [myid:] - INFO [main:Environment@100] - Client environment:user.home=/home/hadoop 2020-03-01 18:23:45,714 [myid:] - INFO [main:Environment@100] - Client environment:user.dir=/home/hadoop/app 2020-03-01 18:23:45,715 [myid:] - INFO [main:ZooKeeper@441] - Initiating client connection, connectString=localhost:2191 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@25f38edc Welcome to ZooKeeper! JLine support is enabled 2020-03-01 18:23:45,789 [myid:] - INFO [main-SendThread(localhost:2191):ClientCnxn$SendThread@1035] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1%1:2191. Will not attempt to authenticate using SASL (unknown error) 2020-03-01 18:23:45,899 [myid:] - INFO [main-SendThread(localhost:2191):ClientCnxn$SendThread@877] - Socket connection established to localhost/0:0:0:0:0:0:0:1%1:2191, initiating session 2020-03-01 18:23:45,974 [myid:] - INFO [main-SendThread(localhost:2191):ClientCnxn$SendThread@1302] - Session establishment complete on server localhost/0:0:0:0:0:0:0:1%1:2191, sessionid = 0x1000069c5b30000, negotiated timeout = 30000 WATCHER:: WatchedEvent state:SyncConnected type:None path:null |
列出zk1根目录下节点信息
|
1 2 |
[zk: localhost:2191(CONNECTED) 0] ls / [zookeeper] |
创建data节点 并保存数据2191
|
1 2 |
[zk: localhost:2191(CONNECTED) 1] create /data 2191 Created /data |
查看data节点的数据
|
1 2 3 4 5 6 7 8 9 10 11 12 13 |
[zk: localhost:2191(CONNECTED) 0] get /data 2191 cZxid = 0x100000002 ctime = Sun Mar 01 18:24:15 CST 2020 mZxid = 0x100000002 mtime = Sun Mar 01 18:24:15 CST 2020 pZxid = 0x100000002 cversion = 0 dataVersion = 0 aclVersion = 0 ephemeralOwner = 0x0 dataLength = 4 numChildren = 0 |
退出zk1客户端
|
1 |
[zk: localhost:2191(CONNECTED) 3] quitQuitting... |
连接zk2客户端
|
1 |
[hadoop@hadoop000 app]$ zkCli.sh -server localhost:2192 |
查看zk2客户端的data节点的数 (zk1同步过来的数据)
|
1 2 |
[zk: localhost:2192(CONNECTED) 0] get /data 2191 |
连接zk3客户端
|
1 |
[hadoop@hadoop000 app]$ zkCli.sh -server localhost:2193 |
查看zk3的data节点的数 (同步过来的数据)
|
1 2 |
[zk: localhost:2193(CONNECTED) 0] get /data 2191 |
可见对任何一个服务器节点进行操作, 都会将结果同步到其他服务器的节点上!
查看进程
|
1 2 3 4 5 |
[hadoop@hadoop000 app]$ jps 3780 QuorumPeerMain 3670 QuorumPeerMain 3718 QuorumPeerMain 3995 Jps |
查看服务器状态
|
1 2 3 4 5 6 7 8 9 10 11 12 |
[hadoop@hadoop000 app]$ ./zk1/bin/zkServer.sh status ZooKeeper JMX enabled by default Using config: /home/hadoop/app/zk1/bin/../conf/zoo.cfg Mode: follower [hadoop@hadoop000 app]$ ./zk2/bin/zkServer.sh status ZooKeeper JMX enabled by default Using config: /home/hadoop/app/zk2/bin/../conf/zoo.cfg Mode: leader [hadoop@hadoop000 app]$ ./zk3/bin/zkServer.sh status ZooKeeper JMX enabled by default Using config: /home/hadoop/app/zk3/bin/../conf/zoo.cfg Mode: follower |
可见zk2是选举出来的leader
而zk1和zk3是其追随者 follower
如果服务状态显示服务没有启动, 可以去相应的目录下寻找服务器日志, 分析并解决问题.
Views: 49