docker的坑

1、docker集群集体被kill

查看docker的日志,/var/logs/messages文件的部分日志:

Dec  9 08:19:41 ip-172-29-165-141 NetworkManager[680]: <info>  [1575879581.6938] device (veth626cd35): carrier: link connected
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.257817957Z" level=info msg="Container de5832c7de3ce648d065e52884bbf168859948b4af000cd163ee637a610c9941 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.257866037Z" level=info msg="Container 2df8a0336d41f5d68a798c3683d1b4a14a3869ccef3a2482e4b685dbb6624d66 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.257894688Z" level=info msg="Container 2e501e65718213661323994c4a59d59f1d21c08c6d9f37853886129bef2c978d failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.257928073Z" level=info msg="Container 7ea0ac5a6b5d398b7088a6f2cb7ed5f3ff1203cb77ea893faafe4a5689d89e02 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.257938744Z" level=info msg="Container b27573ac911f9cd4c79dac7ea2bed6f74c36f180eb99fbc779e2aa1f84f32ddc failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.261259009Z" level=info msg="Container 56cb469c8cd6f01b5df00ed52b548fe4805d7fb20417644a08a4cd908b8fdfa0 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.264256778Z" level=info msg="Container b232c683067f19f06a4952c62aea6cc26fdc00164b4b75ea8a24ba949021c7fe failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.269827997Z" level=info msg="Container 1974b205e185dce2c1722fb157de930c6934dac1d355f3002cce9f7689638360 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.277284232Z" level=info msg="Container 166a6972805f25cb50ff6d934691fb595fb5a9739f871dd1ed1c50c616e89688 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.277347817Z" level=info msg="Container 23870f879820c423cbf9e9383919ae025ff65a356e6aa7ae801e8e3df1657df6 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.277434078Z" level=info msg="Container d3dd46394bc61878b45f12a580e916cd384231ca5ee6c6a06c94d5c44244ddb4 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.278722777Z" level=info msg="Container cdb65ea38199f7c07a024909bf84fe894f1939783184c0e0cfb26557b4eb77ff failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.278818759Z" level=info msg="Container 2038557fb59d13e74ed396b49b0d8e074459c293291236f64490eedaf6b47281 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.278889018Z" level=info msg="Container 5ad6b88a4c6aa5f58e2707d043371dbc59cb8dff983f6ae97cc56bcc6bed69cd failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.279595863Z" level=info msg="Container 52a618ce57e08777194232779e2615d0b1cfde2173ce01d50f3cf026ba462fee failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.284058387Z" level=info msg="Container 5c615f146e663997fd8e5a8cdb06b8c322604c085d7eb9e672c3001a05aabfa4 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49.284440589Z" level=info msg="Container e9dc38796810400e56e4c36a0e09b17f27782fa29866acf09b1fec51a9708653 failed to exit within 10 seconds of signal 15 - using the force"
Dec  9 08:19:49 ip-172-29-165-141 dockerd: time="2019-12-09T08:19:49Z" level=info msg="shim reaped" id=7ea0ac5a6b5d398b7088a6f2cb7ed5f3ff1203cb77ea893faafe4a5689d89e02 module="containerd/tasks"

原因:

docker 本身的bug引起的

解决办法:

  https://github.com/moby/moby/issues/35091
        https://github.com/docker/for-linux/issues/1

升级docker版本到18.09即可解决。

 

posted on 2019-01-09 23:33  duanxz  阅读(3848)  评论(0编辑  收藏  举报