ETCD本地多成员集群部署

目录

• 安装部署
• • etcdctl 操作etcd
  • 使用http请求操作etcd
• 本地多成员集群搭建
• • python获取成员信息
• 参考

安装部署

按照官网文档，安装release版本

https://etcd.io/docs/v3.4/install/

[root@VM-33-162-centos /usr/local/bin]# etcd --version
etcd Version: 3.4.16
Git SHA: d19fbe541
Go Version: go1.12.17
Go OS/Arch: linux/amd64

直接使用etcdctl不行，需要添加到path，或者

/tmp/etcd-download-test/etcdctl

etcd_svr默认开放端口2379

后台启动etcd

 etcd &

etcdctl 操作etcd

put / get

/tmp/etcd-download-test/etcdctl put greeting "hello etcd"
OK

[root@VM-33-162-centos /usr/local/bin]# /tmp/etcd-download-test/etcdctl get greeting 
greeting
hello etcd

使用http请求操作etcd

首先安装etcd3，注意可能会出现问题

关于protobuf报错：If this call came from a _pb2.py file, 
your generated code is out of date and must be regenerated with protoc >= 3.19.0.

所以我们安装的时候需要：

pip install etcd3
pip3 install --upgrade protobuf==3.20.1

接下来我们对本地的etcd进行访问

import etcd3

etcd = etcd3.client(host='127.0.0.1', port=2379)

print(etcd.put('bar', 'doot'))
print(etcd.get('bar'))
print(etcd.delete('bar'))
print(etcd.get('bar'))

(env) [hanhandi@VM-33-162-centos ~/hanhan_PythonScripts/etcdTest]$ python demo.py 
header {
  cluster_id: 14841639068965178418
  member_id: 10276657743932975437
  revision: 5
  raft_term: 4
}

(b'doot', <etcd3.client.KVMetadata object at 0x7f07150efa30>)
True
(None, None)

本地多成员集群搭建

 go get github.com/mattn/goreman
 goreman -f Procfile start

在执行第二句时：

goreman: open Procfile: no such file or directory

我们从下面这个网址拷贝出Profile

https://github.com/etcd-io/etcd/blob/main/Procfile

然后在/usr/local/bin/目录下创建文件，粘贴进去,并将bin/去除

# Use goreman to run `go install github.com/mattn/goreman@latest`
# Change the path of bin/etcd if etcd is located elsewhere

etcd1: etcd --name infra1 --listen-client-urls http://127.0.0.1:2379 --advertise-client-urls http://127.0.0.1:2379 --listen-peer-urls http://127.0.0.1:12380 --initial-advertise-peer-urls http://127.0.0.1:12380 --initial-cluster-token etcd-cluster-1 --initial-cluster 'infra1=http://127.0.0.1:12380,infra2=http://127.0.0.1:22380,infra3=http://127.0.0.1:32380' --initial-cluster-state new --enable-pprof --logger=zap --log-outputs=stderr
etcd2: etcd --name infra2 --listen-client-urls http://127.0.0.1:22379 --advertise-client-urls http://127.0.0.1:22379 --listen-peer-urls http://127.0.0.1:22380 --initial-advertise-peer-urls http://127.0.0.1:22380 --initial-cluster-token etcd-cluster-1 --initial-cluster 'infra1=http://127.0.0.1:12380,infra2=http://127.0.0.1:22380,infra3=http://127.0.0.1:32380' --initial-cluster-state new --enable-pprof --logger=zap --log-outputs=stderr
etcd3: etcd --name infra3 --listen-client-urls http://127.0.0.1:32379 --advertise-client-urls http://127.0.0.1:32379 --listen-peer-urls http://127.0.0.1:32380 --initial-advertise-peer-urls http://127.0.0.1:32380 --initial-cluster-token etcd-cluster-1 --initial-cluster 'infra1=http://127.0.0.1:12380,infra2=http://127.0.0.1:22380,infra3=http://127.0.0.1:32380' --initial-cluster-state new --enable-pprof --logger=zap --log-outputs=stderr
#proxy: bin/etcd grpc-proxy start --endpoints=127.0.0.1:2379,127.0.0.1:22379,127.0.0.1:32379 --listen-addr=127.0.0.1:23790 --advertise-client-url=127.0.0.1:23790 --enable-pprof

# A learner node can be started using Procfile.learner

然后在该目录下执行

 goreman -f ./Procfile start &

然后就可以看到有三个etcd节点在运行了

查看一下集群运行状态：

(env) [hanhandi@VM-33-162-centos ~/hanhan_PythonScripts]$ export ETCDCTL_API=3
(env) [hanhandi@VM-33-162-centos ~/hanhan_PythonScripts]$ /tmp/etcd-download-test/etcdctl --write-out=table --endpoints=localhost:2379 member list
+------------------+---------+--------+------------------------+------------------------+------------+
|        ID        | STATUS  |  NAME  |       PEER ADDRS       |      CLIENT ADDRS      | IS LEARNER |
+------------------+---------+--------+------------------------+------------------------+------------+
| 8211f1d0f64f3269 | started | infra1 | http://127.0.0.1:12380 |  http://127.0.0.1:2379 |      false |
| 91bc3c398fb3c146 | started | infra2 | http://127.0.0.1:22380 | http://127.0.0.1:22379 |      false |
| fd422379fda50e48 | started | infra3 | http://127.0.0.1:32380 | http://127.0.0.1:32379 |      false |
+------------------+---------+--------+------------------------+------------------------+------------+

为了模拟容灾情况，我们手动kill一个etcd节点

$ ps -ef | grep etcd | grep 127.0.0.1:22379
root     29622 29613  0 14:45 pts/4    00:00:00 etcd --name infra2 --listen-client-urls http://127.0.0.1:22379 --advertise-client-urls http://127.0.0.1:22379 --listen-peer-urls http://127.0.0.1:22380 --initial-advertise-peer-urls http://127.0.0.1:22380 --initial-cluster-token etcd-cluster-1 --initial-cluster infra1=http://127.0.0.1:12380,infra2=http://127.0.0.1:22380,infra3=http://127.0.0.1:32380 --initial-cluster-state new --enable-pprof --logger=zap --log-outputs=stderr
$ kill -9 29622

然后向其他节点插入key value

# /tmp/etcd-download-test/etcdctl --endpoints=localhost:2379 put key hello
OK
# /tmp/etcd-download-test/etcdctl --endpoints=localhost:2379 get key
key
hello

然后尝试从已删除节点进行获取信息

# /tmp/etcd-download-test/etcdctl --endpoints=localhost:22379 get key
{"level":"warn","ts":"2023-02-18T14:49:58.251+0800","caller":"clientv3/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"endpoint://client-6cf6d681-cf64-4762-bb9d-c2a2d1332190/localhost:22379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial tcp [::1]:22379: connect: connection refused""}
Error: context deadline exceeded

我们再重启该节点，并尝试获取

# goreman run restart etcd2
# /tmp/etcd-download-test/etcdctl --endpoints=localhost:22379 get key
key
hello

获取成功

python获取成员信息

import etcd3
import json
etcd = etcd3.client(host='127.0.0.1', port=2379)
members = etcd.members
for mem in members:
    print(mem.__str__())
    print(mem.id)
    print(mem.name)
    print(mem.peer_urls)
    print(mem.client_urls)

(env) [root@VM-33-162-centos /data/home/hanhandi/hanhan_PythonScripts/etcdTest]# python demo.py 
Member 9372538179322589801: peer urls: ['http://127.0.0.1:12380'], client urls: ['http://127.0.0.1:2379']
9372538179322589801
infra1
['http://127.0.0.1:12380']
['http://127.0.0.1:2379']
Member 10501334649042878790: peer urls: ['http://127.0.0.1:22380'], client urls: ['http://127.0.0.1:22379']
10501334649042878790
infra2
['http://127.0.0.1:22380']
['http://127.0.0.1:22379']
Member 18249187646912138824: peer urls: ['http://127.0.0.1:32380'], client urls: ['http://127.0.0.1:32379']
18249187646912138824
infra3
['http://127.0.0.1:32380']
['http://127.0.0.1:32379']

参考

etcd基本操作：

https://python-etcd3.readthedocs.io/en/latest/readme.html

https://cizixs.com/2016/08/02/intro-to-etcd/

https://python-etcd3.readthedocs.io/en/latest/

中文文档：https://www.zhaowenyu.com/etcd-doc/ops/etcd-install-shell.html

集群部署文档：

https://blog.51cto.com/xiaoyaoyou10/5468746

代码007普通

打赏 收藏 海报 链接