运行实例,(通过文档运行时存在一些小问题,所以这里有一些修改)
1. 安装环境准备
DaoliNet依赖的软件:
Docker Version 1.9 or later
Golang Version 1.5 or later
wget https://storage.googleapis.com/golang/go1.7.1.linux-amd64.tar.gz
tar -C /usr/local -xzf go1.7.1.linux-amd64.tar.gz
mkdir -p $HOME/gowork/src $HOME/gowork/bin
vim .profile
export GOROOT=/usr/local/go
export PATH=$PATH:$GOROOT/bin
export GOPATH=$HOME/gowork
source .profile
go get github.com/tools/godep
cp xxxx /root/gowork/src/github.com # xxx 是go的编译包
cp xxxx /root/gowork/src/golang.org # xxx 是go的编译包
# git clone https://github.com/golang/tools.git
go get -U github.com/tools/godep
vim .profile
export PATH=$PATH:$GOPATH/bin
Git
Python 2.7
Docker环境
yum install docker -y
Golang环境
执行以下命令安装Golang,详细安装请参考Go Getting Started
wget https://storage.googleapis.com/golang/go1.5.3.linux-amd64.tar.gz
tar xzvf go1.5.3.linux-amd64.tar.gz -C /usr/local/
export PATH=$PATH:/usr/local/go/bin
Git环境
yum install -y gcc git epel-release
Python环境
yum install -y python-devel python-pip
注意:
文档中所有export命令都可以配置到profile文件中永久生效
yum install -y iptables-services
所有节点添加如下iptables规则允许内网其它节点可以访问:
iptables -I INPUT -s <SUBNET>/<PREFIX> -j ACCEPT
2. DaoliNet安装
DaoliNet安装过程包括manager节点安装和agent节点安装过程, 在所有swarm manager节点上安装daolinet api service, 所有swarm agent节点安装daolinet agent服务.
2.1 部署manager节点
部署manager节点需要以下步骤:
安装Etcd
安装Swarm Manager
安装ryu (OpenFlow框架)
安装daolinet (DaoliNet API服务)
安装daolictl (DaoliNet命令行工具)
安装Daolicontroller (OpenFlow控制器)
以下详细说明manager节点安装过程
2.1.1. 安装Etcd
docker pull microbox/etcd
docker run -ti -d -p 4001:4001 -p 7001:7001 --restart=always --name discovery microbox/etcd -addr 172.16.0.30:4001 -peer-addr 172.16.0.30:7001
2.1.2. 安装Swarm Manager
docker pull swarm
docker run -ti -d -p 3376:3376 --restart=always --name swarm-manager swarm m --addr 172.16.0.30:3376 --host tcp://0.0.0.0:3376 etcd://172.16.0.30:4001
2.1.3. 安装Ryu
# Install openflow framework
pip install ryu
2.1.4. 编译安装DaoliNet API Service
mkdir $HOME/daolinet
cd $HOME/daolinet
export GOPATH=$HOME/daolinet
go get github.com/tools/godep
export PATH=$PATH:$GOPATH/bin
mkdir -p src/github.com/daolinet
cd src/github.com/daolinet
git clone https://github.com/daolinet/daolinet.git
cd daolinet
# /root/daolinet/src/github.com/daolinet/daolinet
go get github.com/daolinet/daolinet/cli
godep go build -ldflags "-s -w"
# mkdir -p /root/daolinet/bin
mkdir -p ../../../../bin/
mv daolinet ../../../../bin/
# Run api server
cd /root/daolinet/bin
daolinet server --swarm tcp://172.16.0.30:3376 etcd://172.16.0.30:4001
2.1.5. 安装DaoliCtl命令行工具
cd $HOME/daolinet/src/github.com/daolinet
git clone https://github.com/daolinet/daolictl.git
cd daolictl
go get github.com/daolinet/daolictl/cli
godep go build -ldflags "-s -w"
mkdir -p ../../../../bin/
mv daolictl ../../../../bin/
2.1.6. 安装openflow控制器
# Install depend packages
yum install -y python-requests python-docker-py
# Install openflow controller
git clone https://github.com/daolinet/daolicontroller.git
cd daolicontroller; python ./setup.py install
# Run daolicontroller
systemctl start daolicontroller.service
2.2. 部署agent节点
配置Docker启动参数
安装Swarm Agent
配置和安装OpenvSwitch
安装OpenvSwitch Plugin
安装DaoliNet Agent
连接OpenFlow控制器
以下详细说明agent节点安装步骤
2.2.1. 配置docker启动参数
1.修改docker daemon启动参数,添加swarm管理和etcd支持。例如在CentOS7下修改/usr/lib/systemd/system/docker.service文件中如下ExecStart参数:
ExecStart=/usr/bin/dockerd -H unix:///var/run/docker.sock -H tcp://0.0.0.0:2376 --cluster-store=etcd://172.16.0.30:4001
旧版本配置如下:
ExecStart=/usr/bin/docker daemon -H fd:// -H tcp://0.0.0.0:2376 --cluster-store=etcd://172.16.0.30:4001
2.然后重启服务:
systemctl daemon-reload
systemctl restart docker.service
2.2.2. 安装Swarm Agent
docker pull swarm
docker run -ti -d --restart=always --name swarm-agent swarm j --addr 172.16.0.27:2376 etcd://172.16.0.30:4001
docker run -ti -d --restart=always --name swarm-agent swarm j --addr 172.16.0.31:2376 etcd://172.16.0.30:4001
docker run -ti -d --restart=always --name swarm-agent swarm j --addr 172.16.0.32:2376 etcd://172.16.0.30:4001
2.2.3. 配置和安装openvswitch
执行以下命令安装OpenvSwitch,详细安装请参考How to Install Open vSwitch on Linux, FreeBSD and NetBSD
# 编译openvswitch源码
yum install -y openssl-devel rpm-build
wget http://openvswitch.org/releases/openvswitch-2.5.0.tar.gz
mkdir -p ~/rpmbuild/SOURCES
cp openvswitch-2.5.0.tar.gz ~/rpmbuild/SOURCES/
tar xzf openvswitch-2.5.0.tar.gz
yum install rpm-build -y
rpmbuild -bb --without check openvswitch-2.5.0/rhel/openvswitch.spec
# 安装生成的软件包
yum localinstall -y rpmbuild/RPMS/x86_64/openvswitch-2.5.0-1.x86_64.rpm
/etc/init.d/openvswitch start
# 执行OpenvSwitch脚本配置网卡
curl -sSL https://github.com/daolinet/toolset/raw/master/scripts/ovsconf | bash -s
# 如果有多个网卡,可以指定一个
curl -sSL https://github.com/daolinet/toolset/raw/master/scripts/ovsconf | bash -s -- <DEVNAME>
因为daolinet的虚拟网卡创建后,运行到ovs-vsctl set-controller 最后一条命令时,会出现全部的网络不能访问的情况,才添加一下的虚拟网卡:
vim /etc/sysconfig/network-scripts/ifcfg-eth1114
DEVICE=eth1114
TYPE=Bridge
ONBOOT=yes
BOOTPROTO=none
ovs-vsctl add-port daolinet eth1114
2.2.4. 安装OpenvSwitch Plugin
# https://github.com/daolinet/
pip install gunicorn flask netaddr
git clone https://github.com/daolinet/ovsplugin.git
python setup.py install
systemctl start daoliplugin.service
上边的git clone下来之后,你会发现没有start.sh这个文件,你可以从下方的地址找到旧版的程序里的start.sh拷贝到新的地址里的ovsplugin目录下用。
git clone https://github.com/daolicloud/ovsplugin.git
cd ovsplugin/
./start.sh
2.2.5. 安装DaoliNet Agent Service
# Install daolinet
mkdir $HOME/daolinet
cd $HOME/daolinet
export GOPATH=$HOME/daolinet
go get github.com/tools/godep
export PATH=$PATH:$GOPATH/bin
mkdir -p src/github.com/daolinet
cd src/github.com/daolinet
git clone https://github.com/daolinet/daolinet.git
cd daolinet
godep go build -ldflags "-s -w"
mv daolinet ../../../../bin/
# Run agent service
# daolinet agent --iface <DEVNAME:DEVIP> etcd://172.16.0.30:4001
daolinet agent --iface daolinet:172.16.0.27 etcd://172.16.0.30:4001
daolinet agent --iface daolinet:172.16.0.31 etcd://172.16.0.30:4001
daolinet agent --iface daolinet:172.16.0.32 etcd://172.16.0.30:4001
这里的代码显然是不能运行的,如果调试会提示:
WARN[0334] Watch to disconnected, retrying again.
然后循环10分钟左右会告诉你不能连接,提示:ERRO[0600] error chan: Error to watch path (Docker/network/v1.0/network),
说明daolinet官网给出来的文件是过时的,不可用的。
2.2.6. 连接OpenFlow控制器
在agent节点完成以上步骤,最后配置ovs连接到daolicontroller控制器:
# ovs-vsctl set-controller daolinet tcp:<CONTROLLER-IP>:6633
ovs-vsctl set-controller daolinet tcp:<CONTROLLER-IP1>:6633,tcp:<CONTROLLER-IP2>:6633
注意:为了提高系统可用性,集群中可以启动多个daolicontroller控制器,同时在配置ovs时指定多个控制器地址:
ovs-vsctl set-controller daolinet tcp:<CONTROLLER-IP1>:6633,tcp:<CONTROLLER-IP2>:6633
来源:https://github.com/daolinet/daolinet/blob/master/docs/%E4%B8%AD%E6%96%87%E5%AE%89%E8%A3%85%E6%96%87%E6%A1%A3.md