docker
docker安装
centos安装docker,参见https://yeasy.gitbooks.io/docker_practice/content/install/centos.html
docker-compose安装
curl -L https://github.com/docker/compose/releases/download/1.25.0-rc2/docker-compose-`uname -s`-`uname -m` -o /usr/local/bin/docker-compose
chmod +x /usr/local/bin/docker-compose
harbor安装
安装之前确保前置条件是否满足，需要安装docker-compose、docker以及python2.7以上还有openssl
github-harbor安装指南:https://github.com/goharbor/harbor/blob/master/docs/installation_guide.md
harbor离线安装包,下载地址:https://storage.googleapis.com/harbor-releases/release-1.9.0/harbor-offline-installer-v1.9.0.tgz
解压下载的harbor安装包
tar -zxvf harbor-offline-installer-v1.9.0.tgz
配置harbor.yml
必要参数
修改如下参数后,需要重新执行install.sh重新安装才能生效
hostname:设置本机ip地址,访问harbor-ui界面使用,请勿使用localhost或127.0.0.1或0.0.0.0
data_volume:将harbor数据存储到宿主机的那个目录下
harbor_admin_password:初始化的harbor登录密码,default username/password are admin/Harbor12345
database：数据库相关的配置
password：启动后会创建一个harbor-db容器,里面的数据库密码
max_idle_conns：连接池中的最大空闲连接数。如果<= 0，则不保留任何空闲连接。默认值为50，如果未配 置，则默认值为2。
max_open_conns：最大连接数。如果<= 0，则打开的连接数没有限制。默认值为100。如果未配置，则值为 0。
jobservice：与jobservice相关的服务
max_job_workers：启动几个进程工作,小于cpu核心数吧
log: 相关配置,使用默认即可
harbor.yml
这里只修改hostname,其他默认即可
# Configuration file of Harbor
# The IP address or hostname to access admin UI and registry service.
# DO NOT use localhost or 127.0.0.1, because Harbor needs to be accessed by external clients.
hostname: 192.168.41.18
# http related config
http:
# port for http, default is 80. If https enabled, this port will redirect to https port
port: 80
# Uncomment external_url if you want to enable external proxy
# And when it enabled the hostname will no longer used
# external_url: https://reg.mydomain.com:8433
# The initial password of Harbor admin
# It only works in first time to install harbor
# Remember Change the admin password from UI after launching Harbor.
harbor_admin_password: Harbor12345
# Harbor DB configuration
database:
# The password for the root user of Harbor DB. Change this before any production use.
password: root123
# The maximum number of connections in the idle connection pool. If it <=0, no idle connections are retained.
max_idle_conns: 50
# The maximum number of open connections to the database. If it <= 0, then there is no limit on the number of open connections.
# Note: the default number of connections is 100 for postgres.
max_open_conns: 100
# The default data volume
data_volume: /data
# Harbor Storage settings by default is using /data dir on local filesystem
# Uncomment storage_service setting If you want to using external storage
# storage_service:
# # ca_bundle is the path to the custom root ca certificate, which will be injected into the truststore
# # of registry's and chart repository's containers. This is usually needed when the user hosts a internal storage with self signed certificate.
# ca_bundle:
# # storage backend, default is filesystem, options include filesystem, azure, gcs, s3, swift and oss
# # for more info about this configuration please refer https://docs.docker.com/registry/configuration/
# filesystem:
# maxthreads: 100
# # set disable to true when you want to disable registry redirect
# redirect:
# disabled: false
# Clair configuration
clair:
# The interval of clair updaters, the unit is hour, set to 0 to disable the updaters.
updaters_interval: 12
jobservice:
# Maximum number of job workers in job service
max_job_workers: 10
notification:
# Maximum retry count for webhook job
webhook_job_max_retry: 10
chart:
# Change the value of absolute_url to enabled can enable absolute url in chart
absolute_url: disabled
# Log configurations
log:
# options are debug, info, warning, error, fatal
level: info
# configs for logs in local storage
local:
# Log files are rotated log_rotate_count times before being removed. If count is 0, old versions are removed rather than rotated.
rotate_count: 50
# Log files are rotated only if they grow bigger than log_rotate_size bytes. If size is followed by k, the size is assumed to be in kilobytes.
# If the M is used, the size is in megabytes, and if G is used, the size is in gigabytes. So size 100, size 100k, size 100M and size 100G
# are all valid.
rotate_size: 200M
# The directory on your host that store log
location: /var/log/harbor
# Uncomment following lines to enable external syslog endpoint.
# external_endpoint:
# # protocol used to transmit log to external endpoint, options is tcp or udp
# protocol: tcp
# # The host of external endpoint
# host: localhost
# # Port of external endpoint
# port: 5140
#This attribute is for migrator to detect the version of the .cfg file, DO NOT MODIFY!
_version: 1.9.0
# Uncomment external_database if using external database.
# external_database:
# harbor:
# host: harbor_db_host
# port: harbor_db_port
# db_name: harbor_db_name
# username: harbor_db_username
# password: harbor_db_password
# ssl_mode: disable
# max_idle_conns: 2
# max_open_conns: 0
# clair:
# host: clair_db_host
# port: clair_db_port
# db_name: clair_db_name
# username: clair_db_username
# password: clair_db_password
# ssl_mode: disable
# notary_signer:
# host: notary_signer_db_host
# port: notary_signer_db_port
# db_name: notary_signer_db_name
# username: notary_signer_db_username
# password: notary_signer_db_password
# ssl_mode: disable
# notary_server:
# host: notary_server_db_host
# port: notary_server_db_port
# db_name: notary_server_db_name
# username: notary_server_db_username
# password: notary_server_db_password
# ssl_mode: disable
# Uncomment external_redis if using external Redis server
# external_redis:
# host: redis
# port: 6379
# password:
# # db_index 0 is for core, it's unchangeable
# registry_db_index: 1
# jobservice_db_index: 2
# chartmuseum_db_index: 3
# Uncomment uaa for trusting the certificate of uaa instance that is hosted via self-signed cert.
# uaa:
# ca_file: /path/to/ca
# Global proxy
# Config http proxy for components, e.g. http://my.proxy.com:3128
# Components doesn't need to connect to each others via http proxy.
# Remove component from `components` array if want disable proxy
# for it. If you want use proxy for replication, MUST enable proxy
# for core and jobservice, and set `http_proxy` and `https_proxy`.
# Add domain to the `no_proxy` field, when you want disable proxy
# for some special registry.
proxy:
http_proxy:
https_proxy:
no_proxy: 127.0.0.1,localhost,.local,.internal,log,db,redis,nginx,core,portal,postgresql,jobservice,registry,registryctl,clair
components:
- core
- jobservice
- clair
执行install.sh
出现如下信息,表示harbor安装成功,可以打开浏览器输入192.168.41.18,账户admin,密码上面配置的初始化密码
配置https访问
生成证书
openssl genrsa -out ca.key 4096
将下面出现的所有yourdomain.com改为harbor所在的服务器ip
openssl req -x509 -new -nodes -sha512 -days 3650 \
-subj "/C=CN/ST=Beijing/L=xicheng/O=zdjizhi/OU=Personal/CN=yourdomain.com" \
-key ca.key \
-out ca.crt
openssl genrsa -out yourdomain.com.key 4096
openssl req -sha512 -new \
-subj "/C=CN/ST=Beijing/L=xicheng/O=zdjizhi/OU=Personal/CN=yourdomain.com" \
-key yourdomain.com.key \
-out yourdomain.com.csr
cat > v3.ext <<-EOF
authorityKeyIdentifier=keyid,issuer
basicConstraints=CA:FALSE
keyUsage = digitalSignature, nonRepudiation, keyEncipherment, dataEncipherment
extendedKeyUsage = serverAuth
subjectAltName = @alt_names
[alt_names]
DNS.1=yourdomain.com
DNS.2=hostname
EOF
openssl x509 -req -sha512 -days 3650 \
-extfile v3.ext \
-CA ca.crt -CAkey ca.key -CAcreateserial \
-in yourdomain.com.csr \
-out yourdomain.com.crt
获取yourdomain.com.crt和yourdomain.com.key文件后，您可以将它们放入目录，例如
/data/cert/
#harbor.yml中使用
cp 192.168.41.18.crt /data/cert/
cp 192.168.41.18.key /data/cert/
为Docker配置服务器证书，密钥和CA
openssl x509 -inform PEM -in yourdomain.com.crt -out yourdomain.com.cert
mkdir -p /etc/docker/certs.d/yourdomain.com/
cp yourdomain.com.cert /etc/docker/certs.d/yourdomain.com/
cp yourdomain.com.key /etc/docker/certs.d/yourdomain.com/
cp ca.crt /etc/docker/certs.d/yourdomain.com/
修改harbor.yml
添加
# https related config
https:
# https port for harbor, default is 443
port: 443
# The path of cert and key files for nginx
certificate: /data/cert/192.168.41.18.crt
private_key: /data/cert/192.168.41.18.key
执行./prepare
[[email protected] harbor]# ./prepare
prepare base dir is set to /home/harbor/harbor
Clearing the configuration file: /config/log/logrotate.conf
Clearing the configuration file: /config/log/rsyslog_docker.conf
Clearing the configuration file: /config/nginx/nginx.conf
Clearing the configuration file: /config/core/env
Clearing the configuration file: /config/core/app.conf
Clearing the configuration file: /config/registry/config.yml
Clearing the configuration file: /config/registry/root.crt
Clearing the configuration file: /config/registryctl/env
Clearing the configuration file: /config/registryctl/config.yml
Clearing the configuration file: /config/db/env
Clearing the configuration file: /config/jobservice/env
Clearing the configuration file: /config/jobservice/config.yml
Generated configuration file: /config/log/logrotate.conf
Generated configuration file: /config/log/rsyslog_docker.conf
Generated configuration file: /config/nginx/nginx.conf
Generated configuration file: /config/core/env
Generated configuration file: /config/core/app.conf
Generated configuration file: /config/registry/config.yml
Generated configuration file: /config/registryctl/env
Generated configuration file: /config/db/env
Generated configuration file: /config/jobservice/env
Generated configuration file: /config/jobservice/config.yml
loaded secret from file: /secret/keys/secretkey
Generated configuration file: /compose_location/docker-compose.yml
Clean up the input dir
如果harbor已经启动,则先停止容器,在启动
[[email protected] harbor]# docker-compose down -v
Stopping harbor-jobservice ... done
Stopping nginx ... done
Stopping harbor-core ... done
Stopping registryctl ... done
Stopping harbor-portal ... done
Stopping registry ... done
Stopping redis ... done
Stopping harbor-db ... done
Stopping harbor-log ... done
Removing harbor-jobservice ... done
Removing nginx ... done
Removing harbor-core ... done
Removing registryctl ... done
Removing harbor-portal ... done
Removing registry ... done
Removing redis ... done
Removing harbor-db ... done
Removing harbor-log ... done
Removing network harbor_harbor
[[email protected] harbor]# docker-compose up -d
Creating network "harbor_harbor" with the default driver
Creating harbor-log ... done
Creating redis ... done
Creating registryctl ... done
Creating harbor-db ... done
Creating harbor-portal ... done
Creating registry ... done
Creating harbor-core ... done
Creating nginx ... done
Creating harbor-jobservice ... done
[[email protected] harbor]# ll
java向harbor中提交镜像
maven配置
在settings.xml文件中添加如下信息
<server>
<id>docker-repo</id>
<username>harbor的用户名</username>
<password>harbor的密码</password>
<configuration>
<email>[email protected]</email>
</configuration>
</server>
pom.xml配置,方式1(不使用Dockerfile)
在pom.xml中添加如下信息
<plugin>
<groupId>com.spotify</groupId>
<artifactId>docker-maven-plugin</artifactId>
<version>1.0.0</version>
<configuration>
<!--maven的settings.xml中设置的harbor仓库账户密码-->
<serverId>docker-repo</serverId>
<!--提交到私有仓库地址-->
<registryUrl>192.168.41.18</registryUrl>
<pushImage>true</pushImage>
<!--生成的镜像名称,镜像名称，只能有 a-z 小写字母(不能有大写字母)，0-9 ，下划线"_"，和点"." 组成
192.168.41.18:5000表示仓库地址，
mir-docker表示镜像名，
1.0.0表示镜像版本，如果不指定，docker有该镜像名，版本号自动更替，没有版本号为latest-->
<imageName>192.168.41.18/tsg/${project.artifactId}:${project.version}</imageName>
<!--<imageName>192.168.41.18:5000/${project.build.finalName}</imageName>-->
<!--覆盖已存在的标签 镜像-->
<forceTags>true</forceTags>
<imageTags>
<imageTag>${project.version}</imageTag>
<!--可以指定多个标签-->
<!--<imageTag>latest</imageTag>-->
</imageTags>
<!--基础镜像,相当于 Dockerfile 中的 from-->
<!--<baseImage>jdk:1.8.0_73</baseImage>-->
<baseImage>192.168.41.18/common/jdk:1.8.0_73</baseImage>
<!--入口点，容器启动时自动执行的命令-->
<entryPoint>["java", "-jar", "/${project.build.finalName}.jar"]</entryPoint>
<resources>
<resource>
<targetPath>/</targetPath>
<directory>${project.build.directory}</directory>
<include>${project.build.finalName}.jar</include>
</resource>
</resources>
<!--指定宿主机地址-->
<dockerHost>http://192.168.41.18:2375</dockerHost>
</configuration>
</plugin>
pom.xml配置,方式2(使用dockerfile形式)
在pom.xml中添加如下信息
<plugin>
<groupId>com.spotify</groupId>
<artifactId>docker-maven-plugin</artifactId>
<version>1.0.0</version>
<configuration>
<!--maven的settings.xml中设置的harbor仓库账户密码-->
<serverId>docker-repo</serverId>
<!--镜像先build到docker.build的机器上-->
<registryUrl>${docker.build}</registryUrl>
<!--是否向镜像registry(harbor)中推送镜像,如果为false则需要在执行mvn时添加-DpushImage参数-->
<pushImage>true</pushImage>
<!--生成的镜像名称,镜像名称，只能有 a-z 小写字母(不能有大写字母)，0-9 ，下划线"_"，和点"." 组成
例如192.168.41.160:5000/organizationName/projectName:version
192.168.41.160:5000表示仓库地址，
organizationName表示组织名称(可以没有)，
version表示镜像版本，如果不指定，docker有该镜像名，版本号自动更替，没有版本号为latest-->
<imageName>
${docker.registry}/${docker.registry.name}/${project.build.finalName}:${project.version}
</imageName>
<!--如需重复构建相同标签名称的镜像，可将forceTags设为true，这样就会覆盖构建相同标签的镜像-->
<forceTags>false</forceTags>
<!-- <imageTags>
<imageTag>${project.version}</imageTag>
<!–可以指定多个标签–>
<imageTag>123</imageTag>
</imageTags>-->
<!--Dockerfile的路径,下面放置Dockerfile文件及Dockerfile中依赖的内容,例如config文件夹(数据卷共享)-->
<dockerDirectory>src/main/resources/docker</dockerDirectory>
<buildArgs>
<!--向Dockerfile中传入参数,k-v格式-->
<JDK_IMAGE>${docker.registry}/common/jdk:1.8.0_73</JDK_IMAGE>
<JAR_FILE>${project.build.finalName}.jar</JAR_FILE>
</buildArgs>
<resources>
<resource>
<!--将jar拷贝到/target/docker目录下与Dockerfile放在一起-->
<targetPath>/</targetPath>
<directory>${project.build.directory}</directory>
<include>${project.build.finalName}.jar</include>
</resource>
<resource>
<!--将properties,logback.xml拷贝到/target/docker/config目录下与Dockerfile放在一起-->
<targetPath>/config</targetPath>
<directory>${project.build.directory}/classes/</directory>
<include>**/*.properties</include>
<include>**/logback.xml</include>
</resource>
</resources>
<!--指定宿主机地址-->
<dockerHost>http://${docker.build}:2375</dockerHost>
</configuration>
</plugin>
Dockerfile
ARG JDK_IMAGE
#设置依赖于jdk:1.8.0_73(自定义jdk),需要在docker中安装该版本的jdk,如不想使用该版本,可自行指定jdk版本
FROM ${JDK_IMAGE}
MAINTAINER renkaige [email protected]
#设置时区,编码(防止中文乱码)等环境变量
ENV TimeZone=Asia/Almaty LANG=en_US.UTF-8 LANGUAGE=en_US:en LC_ALL=en_US.UTF-8
#设置时区
RUN echo $TimeZone > /etc/timezone
#指定工作目录,进入docker容器的默认目录
WORKDIR /home/ceiec/bifang/webfocus
#将当前目录下的config目录复制到docker的WORKDIR中,项目启动的时候直接读取里面的配置文件
COPY config config
#复制jar到docker的WORKDIR目录
ARG JAR_FILE
COPY ${JAR_FILE} mapping-subid-ip.jar
#默认启动jar
ENTRYPOINT ["java","-jar","mapping-subid-ip.jar"]
项目工程结构
mvn提交
mvn clean package -Dmaven.test.skip=true docker:build -DpushImage
常见错误
Connection refused: connect
[INFO] Building image 192.168.41.18/tsg/mapping-subid-ip:1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 16.484 s
[INFO] Finished at: 2019-10-21T16:32:11+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.spotify:docker-maven-plugin:1.0.0:build (default-cli) on project mapping-subid-ip: Exception caught: java.util.concurrent.Exec
utionException: com.spotify.docker.client.shaded.javax.ws.rs.ProcessingException: org.apache.http.conn.HttpHostConnectException: Connect to 192.168.41.18:2375 [/
192.168.41.18] failed: Connection refused: connect -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
修改192.168.41.18机器中的 /usr/lib/systemd/system/docker.service在ExecStart后添加如下内容 -H tcp://192.168.41.18:2375 -H unix:///var/run/docker.sock
ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock -H tcp://192.168.41.18:2375 -H unix:///var/run/docker.sock
重启docker服务
systemctl daemon-reload
systemctl restart docker
Unrecognized SSL message, plaintext connection?
ubid-ip.jar
[INFO] Building image 192.168.41.18/tsg/mapping-subid-ip:1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 11.205 s
[INFO] Finished at: 2019-10-21T17:53:24+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.spotify:docker-maven-plugin:1.0.0:build (default-cli) on project mapping-subid-ip: Exception caught: java.util.concurrent.Exec
utionException: com.spotify.docker.client.shaded.javax.ws.rs.ProcessingException: javax.net.ssl.SSLException: Unrecognized SSL message, plaintext connection? ->
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
查看pom.xml中的dockerHost是否是以https开头,如果以https开头改为http
cannot validate certificate for
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 27.130 s
[INFO] Finished at: 2019-10-21T17:58:17+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.spotify:docker-maven-plugin:1.0.0:build (default-cli) on project mapping-subid-ip: Exception caught: Get https://192.168.41.18
/v2/: x509: cannot validate certificate for 192.168.41.18 because it doesn't contain any IP SANs -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
在192.168.41.18的/etc/docker/daemon.json中添加
insecure-registries
{
"registry-mirrors":
[
"http://hub-mirror.c.163.com",
"https://docker.mirrors.ustc.edu.cn"
],
"insecure-registries":
[
"192.168.41.18"
]
}
重启docker服务
systemctl daemon-reload
systemctl restart docker
connect timed out
[ERROR] Failed to execute goal com.spotify:docker-maven-plugin:1.0.0:build (default-cli) on project mapping-subid-ip: Exception caught: Timeout: GET http://192.1
68.31.11:2375/version: com.spotify.docker.client.shaded.javax.ws.rs.ProcessingException: org.apache.http.conn.ConnectTimeoutException: Connect to 192.168.31.11:2
375 [/192.168.31.11] failed: connect timed out -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
检查是否添加dockerHost