[Starlingx-discuss] Download images and push FAIL

Wed Jun 30 15:44:02 UTC 2021

Hi there - we discussed this on the Community Call today, and it was suggested to try to download the images individually to see if that works.

The suspicion is that there may have been a connectivity issue causing some of your images to fail to download.

Thanks, Bill...  

-----Original Message-----
From: Embedded Devel <lists at optimcloud.com> 
Sent: Saturday, June 26, 2021 11:37 AM
To: starlingx-discuss at lists.starlingx.io
Subject: [Starlingx-discuss] Download images and push FAIL

[Please note: This e-mail is from an EXTERNAL e-mail address]

stx 5.0 simplex on bare-metal seems some images "tiller" not found.

TASK [common/push-docker-images : Download images and push to local registry]
*********************************************************************************

fatal: [localhost]: FAILED! => {"changed": true, "msg": "non-zero return code", "rc": 1, "stderr": "Traceback (most recent call last):\n  File \"/tmp/.ansible-sysadmin/tmp/ansible-tmp-1624706034.05-101836802298463/download_images.py\",
line 144, in <module>\n    raise Exception(\"Failed to download images %s\"
% failed_downloads)\nException: Failed to download images ['k8s.gcr.io/kube-proxy:v1.18.1', 'gcr.io/kubernetes-helm/tiller:v2.16.1']\n", "stderr_lines": ["Traceback (most recent call last):", "  File \"/tmp/.ansible-sysadmin/tmp/ansible-tmp-1624706034.05-101836802298463/download_images.py\",
line 144, in <module>", "    raise Exception(\"Failed to download images
%s\" % failed_downloads)", "Exception: Failed to download images ['k8s.gcr.io/kube-proxy:v1.18.1', 'gcr.io/kubernetes-helm/tiller:v2.16.1']"], "stdout": "Image is up to date for sha256:a595af0107f98768274e9143be61c7c80a8df2505ced520c9160f4e16ed42cd1\nImage
is up to date for
sha256:d1ccdd18e6ed8d91e3754e90c4b6cee42750ba165c75d3c78b4a31f057dd0423\nImage
is up to date for
sha256:6c9320041a7b5d00da54dda3a6bf9d6983b432ca5245a8254c83fc694d023810\nImage
is up to date for
sha256:80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c\nImage
is up to date for
sha256:303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f\nImage
is up to date for
sha256:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5\nImage
is up to date for
sha256:cb6799752c46cb16c0c5bebcb355e988a1cd1b3745ce8b67e004abe9a81340a8\nImage
is up to date for
sha256:fc05bc4225f39e81dcbd0035457977276ed8a6054e6bde6406e39b672e9724f5\nImage
is up to date for
sha256:53aa421faf0acd88f8a4cb113e9db2cc65b2a2954640ed96a56c4b94233674d8\nImage
is up to date for
sha256:98793d0a88c823c4fc0fb1b3833d12932be270fc4b6d62bc181f0f54413fe12d\nImage
is up to date for
sha256:7cf8e2d1b7337338a3f977d07abdf63d80d5005458dfab3ab8962c2bab99d40d\nImage
is up to date for
sha256:f2a1744e620d3bf673f8351dcfaa5334fe4888cfcd5476b0222499ccc1b158fe\nImage
is up to date for
sha256:a2bef2b25274b1acbdfde5e2f3de432475e15d4036b2108cea2dce968b0c29ea\nImage
is up to date for
sha256:3061a8a540ac0dee710c1b37edad7855581dc027a18890759c91792615505f13\nImage
is up to date for
sha256:fb95693fe5c67fc46893c1735d85f00f462dc7f5254f5ddbcbbe85fd4ef71717\nImage
download succeeded: k8s.gcr.io/kube-apiserver:v1.18.1\nImage push
succeeded: registry.local:9001/k8s.gcr.io/kube-apiserver:v1.18.1\nImage
k8s.gcr.io/kube-apiserver:v1.18.1 download succeeded by containerd\nImage download succeeded: k8s.gcr.io/kube-controller-manager:v1.18.1\nImage push
succeeded:
registry.local:9001/k8s.gcr.io/kube-controller-manager:v1.18.1\nImage
k8s.gcr.io/kube-controller-manager:v1.18.1 download succeeded by containerd\nImage download succeeded:
k8s.gcr.io/kube-scheduler:v1.18.1\nImage push succeeded:
registry.local:9001/k8s.gcr.io/kube-scheduler:v1.18.1\nImage
k8s.gcr.io/kube-scheduler:v1.18.1 download succeeded by containerd\nImage download succeeded: k8s.gcr.io/kube-proxy:v1.18.1\n Image download failed:
k8s.gcr.io/kube-proxy:v1.18.1404 Client Error: Not Found (\"No such image:
k8s.gcr.io/kube-proxy:v1.18.1\")\nImage download succeeded:
k8s.gcr.io/pause:3.2\nImage push succeeded:
registry.local:9001/k8s.gcr.io/pause:3.2\nImage k8s.gcr.io/pause:3.2 download succeeded by containerd\nImage download succeeded:
k8s.gcr.io/etcd:3.4.3-0\nImage push succeeded:
registry.local:9001/k8s.gcr.io/etcd:3.4.3-0\nImage k8s.gcr.io/etcd:3.4.3-0 download succeeded by containerd\nImage download succeeded:
k8s.gcr.io/coredns:1.6.7\nImage push succeeded:
registry.local:9001/k8s.gcr.io/coredns:1.6.7\nImage
k8s.gcr.io/coredns:1.6.7 download succeeded by containerd\n Image download
failed: quay.io/calico/cni:v3.12.0500 Server Error: Internal Server Error (\"Get https://quay.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)\")\nSleep 20s before retry downloading image quay.io/calico/cni:v3.12.0 ...\nImage download succeeded: quay.io/calico/cni:v3.12.0\nImage push succeeded:
registry.local:9001/quay.io/calico/cni:v3.12.0\nImage
quay.io/calico/cni:v3.12.0 download succeeded by containerd\nImage download
succeeded: quay.io/calico/node:v3.12.0\nImage push succeeded:
registry.local:9001/quay.io/calico/node:v3.12.0\nImage
quay.io/calico/node:v3.12.0 download succeeded by containerd\nImage download succeeded: quay.io/calico/kube-controllers:v3.12.0\nImage push
succeeded:
registry.local:9001/quay.io/calico/kube-controllers:v3.12.0\nImage
quay.io/calico/kube-controllers:v3.12.0 download succeeded by containerd\nImage download succeeded:
quay.io/calico/pod2daemon-flexvol:v3.12.0\nImage push succeeded:
registry.local:9001/quay.io/calico/pod2daemon-flexvol:v3.12.0\nImage
quay.io/calico/pod2daemon-flexvol:v3.12.0 download succeeded by containerd\nImage download succeeded: docker.io/nfvpe/multus:v3.4\nImage
push succeeded: registry.local:9001/docker.io/nfvpe/multus:v3.4\nImage
docker.io/nfvpe/multus:v3.4 download succeeded by containerd\nImage download succeeded:
docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8\nImage push
succeeded:
registry.local:9001/docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8\nImage
docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8 download succeeded by containerd\nImage download succeeded:
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae\nImage
push succeeded:
registry.local:9001/docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae\nImage
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae
download succeeded by containerd\nImage download succeeded:
gcr.io/kubernetes-helm/tiller:v2.16.1\n Image download failed:
gcr.io/kubernetes-helm/tiller:v2.16.1404 Client Error: Not Found (\"No such
image: gcr.io/kubernetes-helm/tiller:v2.16.1\")\nImage download succeeded:
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic\nImage
push succeeded:
registry.local:9001/quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic\nImage
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic
download succeeded by containerd\nImage download succeeded:
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0\nImage push succeeded:
registry.local:9001/docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0\nImage
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0 doImage is up to date for sha256:7fb3c2364b87e9241db7549bf11d42c129130f44e930d1ce36523fc693186e89\nImage
is up to date for
sha256:d4553944fbf7b50f20eece0ec3f638202fdbe2a1a597af8c3f3823201cc695b3\nwnload
succeeded by containerd\nImage download succeeded:
quay.io/stackanetes/kubernetes-entrypoint:v0.3.1\nImage push succeeded:
registry.local:9001/quay.io/stackanetes/kubernetes-entrypoint:v0.3.1\nImage
quay.io/stackanetes/kubernetes-entrypoint:v0.3.1 download succeeded by containerd\nImage download succeeded:
quay.io/k8scsi/snapshot-controller:v2.0.0-rc2\nImage push succeeded:
registry.local:9001/quay.io/k8scsi/snapshot-controller:v2.0.0-rc2\nImage
quay.io/k8scsi/snapshot-controller:v2.0.0-rc2 download succeeded by containerd\n", "stdout_lines": ["Image is up to date for sha256:a595af0107f98768274e9143be61c7c80a8df2505ced520c9160f4e16ed42cd1",
"Image is up to date for
sha256:d1ccdd18e6ed8d91e3754e90c4b6cee42750ba165c75d3c78b4a31f057dd0423",
"Image is up to date for
sha256:6c9320041a7b5d00da54dda3a6bf9d6983b432ca5245a8254c83fc694d023810",
"Image is up to date for
sha256:80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c",
"Image is up to date for
sha256:303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f",
"Image is up to date for
sha256:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5",
"Image is up to date for
sha256:cb6799752c46cb16c0c5bebcb355e988a1cd1b3745ce8b67e004abe9a81340a8",
"Image is up to date for
sha256:fc05bc4225f39e81dcbd0035457977276ed8a6054e6bde6406e39b672e9724f5",
"Image is up to date for
sha256:53aa421faf0acd88f8a4cb113e9db2cc65b2a2954640ed96a56c4b94233674d8",
"Image is up to date for
sha256:98793d0a88c823c4fc0fb1b3833d12932be270fc4b6d62bc181f0f54413fe12d",
"Image is up to date for
sha256:7cf8e2d1b7337338a3f977d07abdf63d80d5005458dfab3ab8962c2bab99d40d",
"Image is up to date for
sha256:f2a1744e620d3bf673f8351dcfaa5334fe4888cfcd5476b0222499ccc1b158fe",
"Image is up to date for
sha256:a2bef2b25274b1acbdfde5e2f3de432475e15d4036b2108cea2dce968b0c29ea",
"Image is up to date for
sha256:3061a8a540ac0dee710c1b37edad7855581dc027a18890759c91792615505f13",
"Image is up to date for
sha256:fb95693fe5c67fc46893c1735d85f00f462dc7f5254f5ddbcbbe85fd4ef71717",
"Image download succeeded: k8s.gcr.io/kube-apiserver:v1.18.1", "Image push
succeeded: registry.local:9001/k8s.gcr.io/kube-apiserver:v1.18.1", "Image
k8s.gcr.io/kube-apiserver:v1.18.1 download succeeded by containerd", "Image download succeeded: k8s.gcr.io/kube-controller-manager:v1.18.1", "Image push succeeded:
registry.local:9001/k8s.gcr.io/kube-controller-manager:v1.18.1", "Image
k8s.gcr.io/kube-controller-manager:v1.18.1 download succeeded by containerd", "Image download succeeded: k8s.gcr.io/kube-scheduler:v1.18.1",
"Image push succeeded:
registry.local:9001/k8s.gcr.io/kube-scheduler:v1.18.1", "Image
k8s.gcr.io/kube-scheduler:v1.18.1 download succeeded by containerd", "Image download succeeded: k8s.gcr.io/kube-proxy:v1.18.1", " Image download
failed: k8s.gcr.io/kube-proxy:v1.18.1404 Client Error: Not Found (\"No such
image: k8s.gcr.io/kube-proxy:v1.18.1\")", "Image download succeeded:
k8s.gcr.io/pause:3.2", "Image push succeeded:
registry.local:9001/k8s.gcr.io/pause:3.2", "Image k8s.gcr.io/pause:3.2 download succeeded by containerd", "Image download succeeded:
k8s.gcr.io/etcd:3.4.3-0", "Image push succeeded:
registry.local:9001/k8s.gcr.io/etcd:3.4.3-0", "Image
k8s.gcr.io/etcd:3.4.3-0 download succeeded by containerd", "Image download
succeeded: k8s.gcr.io/coredns:1.6.7", "Image push succeeded:
registry.local:9001/k8s.gcr.io/coredns:1.6.7", "Image
k8s.gcr.io/coredns:1.6.7 download succeeded by containerd", " Image download failed: quay.io/calico/cni:v3.12.0500 Server Error: Internal Server Error (\"Get https://quay.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)\")", "Sleep 20s before retry downloading image
quay.io/calico/cni:v3.12.0 ...", "Image download succeeded:
quay.io/calico/cni:v3.12.0", "Image push succeeded:
registry.local:9001/quay.io/calico/cni:v3.12.0", "Image
quay.io/calico/cni:v3.12.0 download succeeded by containerd", "Image download succeeded: quay.io/calico/node:v3.12.0", "Image push succeeded:
registry.local:9001/quay.io/calico/node:v3.12.0", "Image
quay.io/calico/node:v3.12.0 download succeeded by containerd", "Image download succeeded: quay.io/calico/kube-controllers:v3.12.0", "Image push
succeeded: registry.local:9001/quay.io/calico/kube-controllers:v3.12.0",
"Image quay.io/calico/kube-controllers:v3.12.0 download succeeded by containerd", "Image download succeeded:
quay.io/calico/pod2daemon-flexvol:v3.12.0", "Image push succeeded:
registry.local:9001/quay.io/calico/pod2daemon-flexvol:v3.12.0", "Image
quay.io/calico/pod2daemon-flexvol:v3.12.0 download succeeded by containerd", "Image download succeeded: docker.io/nfvpe/multus:v3.4", "Image push succeeded: registry.local:9001/docker.io/nfvpe/multus:v3.4",
"Image docker.io/nfvpe/multus:v3.4 download succeeded by containerd", "Image download succeeded:
docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8", "Image push
succeeded:
registry.local:9001/docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8",
"Image docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8 download succeeded by containerd", "Image download succeeded:
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae",
"Image push succeeded:
registry.local:9001/docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae",
"Image
docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae
download succeeded by containerd", "Image download succeeded:
gcr.io/kubernetes-helm/tiller:v2.16.1", " Image download failed:
gcr.io/kubernetes-helm/tiller:v2.16.1404 Client Error: Not Found (\"No such
image: gcr.io/kubernetes-helm/tiller:v2.16.1\")", "Image download
succeeded:
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic",
"Image push succeeded:
registry.local:9001/quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic",
"Image
quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic
download succeeded by containerd", "Image download succeeded:
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0", "Image push succeeded:
registry.local:9001/docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0", "Image
docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0 doImage is up to date for sha256:7fb3c2364b87e9241db7549bf11d42c129130f44e930d1ce36523fc693186e89",
"Image is up to date for
sha256:d4553944fbf7b50f20eece0ec3f638202fdbe2a1a597af8c3f3823201cc695b3",
"wnload succeeded by containerd", "Image download succeeded:
quay.io/stackanetes/kubernetes-entrypoint:v0.3.1", "Image push succeeded:
registry.local:9001/quay.io/stackanetes/kubernetes-entrypoint:v0.3.1",
"Image quay.io/stackanetes/kubernetes-entrypoint:v0.3.1 download succeeded by containerd", "Image download succeeded:
quay.io/k8scsi/snapshot-controller:v2.0.0-rc2", "Image push succeeded:
registry.local:9001/quay.io/k8scsi/snapshot-controller:v2.0.0-rc2", "Image
quay.io/k8scsi/snapshot-controller:v2.0.0-rc2 download succeeded by containerd"]}

PLAY RECAP
****************************************************************************************************************************************************

localhost                  : ok=187  changed=65   unreachable=0    failed=1

_______________________________________________
Starlingx-discuss mailing list
Starlingx-discuss at lists.starlingx.io
http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss