[Starlingx-discuss] Download images and push to local registry failures

Thu Jan 7 04:30:49 UTC 2021

TASK [common/push-docker-images : Download images and push to local
registry] *********************************************************************************
fatal: [localhost]: FAILED! => {"changed": true, "msg": "non-zero
return code", "rc": 1, "stderr": "Traceback (most recent call last):\n
 File \"/tmp/.ansible-sysadmin/tmp/ansible-tmp-1609990355.96-174918334532347/download_images.py\",
line 144, in <module>\n    raise Exception(\"Failed to download images
%s\" % failed_downloads)\nException: Failed to download images
['k8s.gcr.io/etcd:3.4.3-0', 'docker.io/nfvpe/multus:v3.4',
'docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2',
'quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic',
'docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0']\n", "stderr_lines":
["Traceback (most recent call last):", "  File
\"/tmp/.ansible-sysadmin/tmp/ansible-tmp-1609990355.96-174918334532347/download_images.py\",
line 144, in <module>", "    raise Exception(\"Failed to download
images %s\" % failed_downloads)", "Exception: Failed to download
images ['k8s.gcr.io/etcd:3.4.3-0', 'docker.io/nfvpe/multus:v3.4',
'docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2',
'quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic',
'docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0']"], "stdout": "Image
is up to date for
sha256:a595af0107f98768274e9143be61c7c80a8df2505ced520c9160f4e16ed42cd1\nImage
is up to date for
sha256:d1ccdd18e6ed8d91e3754e90c4b6cee42750ba165c75d3c78b4a31f057dd0423\nImage
is up to date for
sha256:6c9320041a7b5d00da54dda3a6bf9d6983b432ca5245a8254c83fc694d023810\nImage
is up to date for
sha256:4e68534e24f67f912c02ef114131e0ffcd060af0365988800ce0e24af323b165\nImage
is up to date for
sha256:80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c\nImage
is up to date for
sha256:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5\nImage
is up to date for
sha256:cb6799752c46cb16c0c5bebcb355e988a1cd1b3745ce8b67e004abe9a81340a8\nImage
is up to date for
sha256:fc05bc4225f39e81dcbd0035457977276ed8a6054e6bde6406e39b672e9724f5\nImage
is up to date for
sha256:53aa421faf0acd88f8a4cb113e9db2cc65b2a2954640ed96a56c4b94233674d8\nImage
is up to date for
sha256:98793d0a88c823c4fc0fb1b3833d12932be270fc4b6d62bc181f0f54413fe12d\nImage
download succeeded: k8s.gcr.io/kube-apiserver:v1.18.1\nImage push
succeeded: registry.local:9001/k8s.gcr.io/kube-apiserver:v1.18.1\nImage
k8s.gcr.io/kube-apiserver:v1.18.1 download succeeded by
containerd\nImage download succeeded:
k8s.gcr.io/kube-controller-manager:v1.18.1\nImage push succeeded:
registry.local:9001/k8s.gcr.io/kube-controller-manager:v1.18.1\nImage
k8s.gcr.io/kube-controller-manager:v1.18.1 download succeeded by
containerd\n Image download failed:
k8s.gcr.io/kube-scheduler:v1.18.1500 Server Error: Internal Server
Error (\"Get https://k8s.gcr.io/v2/: net/http: request canceled while
waiting for connection (Client.Timeout exceeded while awaiting
headers)\")\nSleep 20s before retry downloading image
k8s.gcr.io/kube-scheduler:v1.18.1 ...\nImage download succeeded:
k8s.gcr.io/kube-scheduler:v1.18.1\nImage push succeeded:
registry.local:9001/k8s.gcr.io/kube-scheduler:v1.18.1\nImage
k8s.gcr.io/kube-scheduler:v1.18.1 download succeeded by
containerd\nImage download succeeded:
k8s.gcr.io/kube-proxy:v1.18.1\nImage push succeeded:
registry.local:9001/k8s.gcr.io/kube-proxy:v1.18.1\nImage
k8s.gcr.io/kube-proxy:v1.18.1 download succeeded by containerd\nImage
download succeeded: k8s.gcr.io/pause:3.2\nImage push succeeded:
registry.local:9001/k8s.gcr.io/pause:3.2\nImage k8s.gcr.io/pause:3.2
download succeeded by containerd\nImage download succeeded:
k8s.gcr.io/etcd:3.4.3-0\n Image download failed:
k8s.gcr.io/etcd:3.4.3-0404 Client Error: Not Found (\"No such image:
k8s.gcr.io/etcd:3.4.3-0\")\nImage download succeeded:
k8s.gcr.io/coredns:1.6.7\nImage push succeeded:
registry.local:9001/k8s.gcr.io/coredns:1.6.7\nImage
k8s.gcr.io/coredns:1.6.7 download succeeded by containerd\nImage
download succeeded: quay.io/calico/cni:v3.12.0\nImage push succeeded:
registry.local:9001/quay.io/calico/cni:v3.12.0\nImage
quay.io/calico/cni:v3.12.0 download succeeded by containerd\nImage
download succeeded: quay.io/calico/node:v3.12.0\nImage push succeeded:
registry.local:9001/quay.io/calico/node:v3.12.0\nImage
quay.io/calico/node:v3.12.0 download succeeded by containerd\n Image
download failed: quay.io/calico/kube-controllers:v3.12.0500 Server
Error: Internal Server Error (\"Get
https://quay.io/v2/calico/kube-controllers/manifests/v3.12.0: Get
https://quay.io/v2/auth?scope=repository%3Acalico%2Fkube-controllers%3Apull&service=quay.io:
net/http: request canceled while waiting for connection
(Client.Timeout exceeded while awaiting headers)\")\nSleep 20s before
retry downloading image quay.io/calico/kube-controllers:v3.12.0
...\nImage download succeeded:
quay.io/calico/kube-controllers:v3.12.0\nImage push succeeded:
registry.local:9001/quay.io/calico/kube-controllers:v3.12.0\nImage
quay.io/calico/kube-controllers:v3.12.0 download succeeded by
containerd\n Image download failed:
quay.io/calico/pod2daemon-flexvol:v3.12.0500 Server Error: Internal
Server Error (\"Get
https://quay.io/v2/calico/pod2daemon-flexvol/manifests/v3.12.0: dial
tcp 34.192.15.65:443: i/o timeout\")\nSleep 20s before retry
downloading image quay.io/calico/pod2daemon-flexvol:v3.12.0 ...\nImage
download succeeded: quay.io/calico/pod2daemon-flexvol:v3.12.0\nImage
push succeeded:
registry.local:9001/quay.io/calico/pod2daemon-flexvol:v3.12.0\nImage
quay.io/calico/pod2daemon-flexvol:v3.12.0 download succeeded by
containerd\n Image download failed: docker.io/nfvpe/multus:v3.4500
Server Error: Internal Server Error (\"Get
https://registry-1.docker.io/v2/: net/http: request canceled while
waiting for connection (Client.Timeout exceeded while awaiting
headers)\")\nSleep 20s before retry downloading image
docker.io/nfvpe/multus:v3.4 ...\n Image download failed:
docker.io/nfvpe/multus:v3.4500 Server Error: Internal Server Error
(\"Get https://registry-1.docker.io/v2/: net/http: request canceled
while waiting for connection (Client.Timeout exceeded while awaiting
headers)\")\nSleep 20s before retry downloading image
docker.io/nfvpe/multus:v3.4 ...\n Image download failed:
docker.io/nfvpe/multus:v3.4500 Server Error: Internal Server Error
(\"Get https://registry-1.docker.io/v2/: net/http: request canceled
while waiting for connection (Image is up to date for
sha256:a2bef2b25274b1acbdfde5e2f3de432475e15d4036b2108cea2dce968b0c29ea\nImage
is up to date for
sha256:1f92aa902d739d544e621fe2ceaee04a4fc5b67c3e3ed8cf0b19aa2620763d3a\nImage
is up to date for
sha256:7fb3c2364b87e9241db7549bf11d42c129130f44e930d1ce36523fc693186e89\nImage
is up to date for
sha256:d4553944fbf7b50f20eece0ec3f638202fdbe2a1a597af8c3f3823201cc695b3\nClient.Timeout
exceeded while awaiting headers)\")\nSleep 20s before retry
downloading image docker.io/nfvpe/multus:v3.4 ...\nImage download
succeeded: docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2\n Image
download failed: docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2404
Client Error: Not Found (\"No such image:
starlingx/k8s-cni-sriov:stx.3.0-v2.2\")\n Image download failed:
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae500
Server Error: Internal Server Error (\"error parsing HTTP 408 response
body: invalid character '<' looking for beginning of value:
\"<html><body><h1>408 Request Time-out</h1>\\nYour browser didn't send
a complete request in time.\\n</body></html>\\n\\n\"\")\nSleep 20s
before retry downloading image
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae
...\n Image download failed:
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae500
Server Error: Internal Server Error (\"Get
https://registry-1.docker.io/v2/: net/http: request canceled while
waiting for connection (Client.Timeout exceeded while awaiting
headers)\")\nSleep 20s before retry downloading image
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae
...\nImage download succeeded:
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae\nImage
push succeeded:
registry.local:9001/docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae\nImage
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae
download succeeded by containerd\nImage download succeeded:
gcr.io/kubernetes-helm/tiller:v2.16.1\nImage push succeeded:
registry.local:9001/gcr.io/kubernetes-helm/tiller:v2.16.1\nImage
gcr.io/kubernetes-helm/tiller:v2.16.1 download succeeded by
containerd\nImage download succeeded:
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic\n
Image download failed:
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic404
Client Error: Not Found (\"No such image:
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic\")\n
Image download failed:
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0500 Server Error:
Internal Server Error (\"Get https://registry-1.docker.io/v2/:
net/http: request canceled while waiting for connection
(Client.Timeout exceeded while awaiting headers)\")\nSleep 20s before
retry downloading image docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0
...\n Image download failed:
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0500 Server Error:
Internal Server Error (\"Get https://registry-1.docker.io/v2/:
net/http: request canceled while waiting for connection
(Client.Timeout exceeded while awaiting headers)\")\nSleep 20s before
retry downloading image docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0
...\nImage download succeeded:
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0\n Image download failed:
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0404 Client Error: Not
Found (\"No such image: starlingx/n3000-opae:stx.4.0-v1.0.0\")\nImage
download succeeded:
quay.io/stackanetes/kubernetes-entrypoint:v0.3.1\nImage push
succeeded: registry.local:9001/quay.io/stackanetes/kubernetes-entrypoint:v0.3.1\nImage
quay.io/stackanetes/kubernetes-entrypoint:v0.3.1 download succeeded by
containerd\nImage download succeeded:
quay.io/k8scsi/snapshot-controller:v2.0.0-rc2\nImage push succeeded:
registry.local:9001/quay.io/k8scsi/snapshot-controller:v2.0.0-rc2\nImage
quay.io/k8scsi/snapshot-controller:v2.0.0-rc2 download succeeded by
containerd\n", "stdout_lines": ["Image is up to date for
sha256:a595af0107f98768274e9143be61c7c80a8df2505ced520c9160f4e16ed42cd1",
"Image is up to date for
sha256:d1ccdd18e6ed8d91e3754e90c4b6cee42750ba165c75d3c78b4a31f057dd0423",
"Image is up to date for
sha256:6c9320041a7b5d00da54dda3a6bf9d6983b432ca5245a8254c83fc694d023810",
"Image is up to date for
sha256:4e68534e24f67f912c02ef114131e0ffcd060af0365988800ce0e24af323b165",
"Image is up to date for
sha256:80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c",
"Image is up to date for
sha256:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5",
"Image is up to date for
sha256:cb6799752c46cb16c0c5bebcb355e988a1cd1b3745ce8b67e004abe9a81340a8",
"Image is up to date for
sha256:fc05bc4225f39e81dcbd0035457977276ed8a6054e6bde6406e39b672e9724f5",
"Image is up to date for
sha256:53aa421faf0acd88f8a4cb113e9db2cc65b2a2954640ed96a56c4b94233674d8",
"Image is up to date for
sha256:98793d0a88c823c4fc0fb1b3833d12932be270fc4b6d62bc181f0f54413fe12d",
"Image download succeeded: k8s.gcr.io/kube-apiserver:v1.18.1", "Image
push succeeded:
registry.local:9001/k8s.gcr.io/kube-apiserver:v1.18.1", "Image
k8s.gcr.io/kube-apiserver:v1.18.1 download succeeded by containerd",
"Image download succeeded:
k8s.gcr.io/kube-controller-manager:v1.18.1", "Image push succeeded:
registry.local:9001/k8s.gcr.io/kube-controller-manager:v1.18.1",
"Image k8s.gcr.io/kube-controller-manager:v1.18.1 download succeeded
by containerd", " Image download failed:
k8s.gcr.io/kube-scheduler:v1.18.1500 Server Error: Internal Server
Error (\"Get https://k8s.gcr.io/v2/: net/http: request canceled while
waiting for connection (Client.Timeout exceeded while awaiting
headers)\")", "Sleep 20s before retry downloading image
k8s.gcr.io/kube-scheduler:v1.18.1 ...", "Image download succeeded:
k8s.gcr.io/kube-scheduler:v1.18.1", "Image push succeeded:
registry.local:9001/k8s.gcr.io/kube-scheduler:v1.18.1", "Image
k8s.gcr.io/kube-scheduler:v1.18.1 download succeeded by containerd",
"Image download succeeded: k8s.gcr.io/kube-proxy:v1.18.1", "Image push
succeeded: registry.local:9001/k8s.gcr.io/kube-proxy:v1.18.1", "Image
k8s.gcr.io/kube-proxy:v1.18.1 download succeeded by containerd",
"Image download succeeded: k8s.gcr.io/pause:3.2", "Image push
succeeded: registry.local:9001/k8s.gcr.io/pause:3.2", "Image
k8s.gcr.io/pause:3.2 download succeeded by containerd", "Image
download succeeded: k8s.gcr.io/etcd:3.4.3-0", " Image download failed:
k8s.gcr.io/etcd:3.4.3-0404 Client Error: Not Found (\"No such image:
k8s.gcr.io/etcd:3.4.3-0\")", "Image download succeeded:
k8s.gcr.io/coredns:1.6.7", "Image push succeeded:
registry.local:9001/k8s.gcr.io/coredns:1.6.7", "Image
k8s.gcr.io/coredns:1.6.7 download succeeded by containerd", "Image
download succeeded: quay.io/calico/cni:v3.12.0", "Image push
succeeded: registry.local:9001/quay.io/calico/cni:v3.12.0", "Image
quay.io/calico/cni:v3.12.0 download succeeded by containerd", "Image
download succeeded: quay.io/calico/node:v3.12.0", "Image push
succeeded: registry.local:9001/quay.io/calico/node:v3.12.0", "Image
quay.io/calico/node:v3.12.0 download succeeded by containerd", " Image
download failed: quay.io/calico/kube-controllers:v3.12.0500 Server
Error: Internal Server Error (\"Get
https://quay.io/v2/calico/kube-controllers/manifests/v3.12.0: Get
https://quay.io/v2/auth?scope=repository%3Acalico%2Fkube-controllers%3Apull&service=quay.io:
net/http: request canceled while waiting for connection
(Client.Timeout exceeded while awaiting headers)\")", "Sleep 20s
before retry downloading image quay.io/calico/kube-controllers:v3.12.0
...", "Image download succeeded:
quay.io/calico/kube-controllers:v3.12.0", "Image push succeeded:
registry.local:9001/quay.io/calico/kube-controllers:v3.12.0", "Image
quay.io/calico/kube-controllers:v3.12.0 download succeeded by
containerd", " Image download failed:
quay.io/calico/pod2daemon-flexvol:v3.12.0500 Server Error: Internal
Server Error (\"Get
https://quay.io/v2/calico/pod2daemon-flexvol/manifests/v3.12.0: dial
tcp 34.192.15.65:443: i/o timeout\")", "Sleep 20s before retry
downloading image quay.io/calico/pod2daemon-flexvol:v3.12.0 ...",
"Image download succeeded: quay.io/calico/pod2daemon-flexvol:v3.12.0",
"Image push succeeded:
registry.local:9001/quay.io/calico/pod2daemon-flexvol:v3.12.0", "Image
quay.io/calico/pod2daemon-flexvol:v3.12.0 download succeeded by
containerd", " Image download failed: docker.io/nfvpe/multus:v3.4500
Server Error: Internal Server Error (\"Get
https://registry-1.docker.io/v2/: net/http: request canceled while
waiting for connection (Client.Timeout exceeded while awaiting
headers)\")", "Sleep 20s before retry downloading image
docker.io/nfvpe/multus:v3.4 ...", " Image download failed:
docker.io/nfvpe/multus:v3.4500 Server Error: Internal Server Error
(\"Get https://registry-1.docker.io/v2/: net/http: request canceled
while waiting for connection (Client.Timeout exceeded while awaiting
headers)\")", "Sleep 20s before retry downloading image
docker.io/nfvpe/multus:v3.4 ...", " Image download failed:
docker.io/nfvpe/multus:v3.4500 Server Error: Internal Server Error
(\"Get https://registry-1.docker.io/v2/: net/http: request canceled
while waiting for connection (Image is up to date for
sha256:a2bef2b25274b1acbdfde5e2f3de432475e15d4036b2108cea2dce968b0c29ea",
"Image is up to date for
sha256:1f92aa902d739d544e621fe2ceaee04a4fc5b67c3e3ed8cf0b19aa2620763d3a",
"Image is up to date for
sha256:7fb3c2364b87e9241db7549bf11d42c129130f44e930d1ce36523fc693186e89",
"Image is up to date for
sha256:d4553944fbf7b50f20eece0ec3f638202fdbe2a1a597af8c3f3823201cc695b3",
"Client.Timeout exceeded while awaiting headers)\")", "Sleep 20s
before retry downloading image docker.io/nfvpe/multus:v3.4 ...",
"Image download succeeded:
docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2", " Image download
failed: docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2404 Client
Error: Not Found (\"No such image:
starlingx/k8s-cni-sriov:stx.3.0-v2.2\")", " Image download failed:
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae500
Server Error: Internal Server Error (\"error parsing HTTP 408 response
body: invalid character '<' looking for beginning of value:
\"<html><body><h1>408 Request Time-out</h1>\\nYour browser didn't send
a complete request in time.\\n</body></html>\\n\\n\"\")", "Sleep 20s
before retry downloading image
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae
...", " Image download failed:
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae500
Server Error: Internal Server Error (\"Get
https://registry-1.docker.io/v2/: net/http: request canceled while
waiting for connection (Client.Timeout exceeded while awaiting
headers)\")", "Sleep 20s before retry downloading image
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae
...", "Image download succeeded:
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae",
"Image push succeeded:
registry.local:9001/docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae",
"Image docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae
download succeeded by containerd", "Image download succeeded:
gcr.io/kubernetes-helm/tiller:v2.16.1", "Image push succeeded:
registry.local:9001/gcr.io/kubernetes-helm/tiller:v2.16.1", "Image
gcr.io/kubernetes-helm/tiller:v2.16.1 download succeeded by
containerd", "Image download succeeded:
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic",
" Image download failed:
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic404
Client Error: Not Found (\"No such image:
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic\")",
" Image download failed:
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0500 Server Error:
Internal Server Error (\"Get https://registry-1.docker.io/v2/:
net/http: request canceled while waiting for connection
(Client.Timeout exceeded while awaiting headers)\")", "Sleep 20s
before retry downloading image
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0 ...", " Image download
failed: docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0500 Server Error:
Internal Server Error (\"Get https://registry-1.docker.io/v2/:
net/http: request canceled while waiting for connection
(Client.Timeout exceeded while awaiting headers)\")", "Sleep 20s
before retry downloading image
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0 ...", "Image download
succeeded: docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0", " Image
download failed: docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0404
Client Error: Not Found (\"No such image:
starlingx/n3000-opae:stx.4.0-v1.0.0\")", "Image download succeeded:
quay.io/stackanetes/kubernetes-entrypoint:v0.3.1", "Image push
succeeded: registry.local:9001/quay.io/stackanetes/kubernetes-entrypoint:v0.3.1",
"Image quay.io/stackanetes/kubernetes-entrypoint:v0.3.1 download
succeeded by containerd", "Image download succeeded:
quay.io/k8scsi/snapshot-controller:v2.0.0-rc2", "Image push succeeded:
registry.local:9001/quay.io/k8scsi/snapshot-controller:v2.0.0-rc2",
"Image quay.io/k8scsi/snapshot-controller:v2.0.0-rc2 download
succeeded by containerd"]}

PLAY RECAP ****************************************************************************************************************************************************
localhost                  : ok=183  changed=67   unreachable=0    failed=1