Thanks Liu Chang with the patch to optimize the mirror download scripts. Question: with this patch, have you successfully setup your local mirror already? Or anything particular you expect WR or Intel to do further to accelerate it?

 

Thx. - cindy

 

From: liuchang77@chinaunicom.cn [mailto:liuchang77@chinaunicom.cn]
Sent: Tuesday, August 14, 2018 10:01 AM
To: Lin, Shuicheng <shuicheng.lin@intel.com>
Cc: starlingx-discuss@lists.starlingx.io
Subject: [Starlingx-discuss] 回复: Re: So many packages are missing

 

Hi Shuicheng

 

    According to your advice. I found it is really a problem with my network speed. But in the process of my repeated attempts. I found that some packages that have

already been downloaded will be re-downloaded. This takes up bandwidth and increases deployment time. So I think we should judge whether we have downloaded the package
before downloading it. And I made a change to implement this function. Hope this will help.

    https://review.openstack.org/#/c/591544/ 



Chang

 

 

 

发送时间： 2018-08-10 10:16

主题： Re: RE: [Starlingx-discuss] So many packages are missing

Hi Shuicheng,

 

    Thanks for your advice. 

    I can access the links you provided. But the speed is very slow. So I think this is really a problem with my network speed. I work at the carrier, so our network is definitely fine. Maybe the real problem is Chinese firewall. 

    I spent  a few hours to re-run the download package script, and the missing list has not changed. So the only way I can think of now is to use vpn inside the container. But after I tried if, I found that the kernel of the system inside the container does not support pptp. I will keep trying to find another way to solve it.

    Thank you very much!



Best Regards

Chang

 

 

 

Date: 2018-08-09 16:05

Subject: RE: [Starlingx-discuss] So many packages are missing

Hi Chang,

I try to check some package in the missing list. Can you access below link for the package?

http://vault.centos.org/7.5.1804/os/Source/SPackages/bash-4.2.46-30.el7.src.rpm

https://s3.amazonaws.com/influxdb/influxdb-0.9.5.1-1.x86_64.rpm

 

If yes, I think it maybe network speed issue. You could re-run the download package script. And check whether the missing list be shorter or not.

 

If not, you may need check the networking setting.

 

Best Regards

Shuicheng

 

From: liuchang77@chinaunicom.cn [mailto:liuchang77@chinaunicom.cn]
Sent: Thursday, August 9, 2018 3:28 PM
To: Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; starlingx-discuss@lists.starlingx.io
Subject: Re: [Starlingx-discuss] So many packages are missing

 

Thanks，Erich，

    

    According to your advice, I ran "yum makecache" inside the container. Although it was slow, the  task was complete with no error. Attachment 1 is my execution log. And attachment 2 is my missing packages' list. I also think that there are so many missing packages that are not normal. I suspect this is related to Chinese firewall. But I couldn't connect my vpn server in the container. I sincerely hope that you can give me some advice.




    Chang

 

 

Date: 2018-08-09 11:28

Subject: Re: [Starlingx-discuss] So many packages are missing

Hi Chang,

 

You are right, download manually that amount of packages is a painful task. It’s not normal to have so many failures, my guess is that some of the repositories is down or blocked in the network. You can try to identify from where those packages are being downloaded to root cause the problem.

 

Inside the mirror container you can run “yum makecache” to sync the repositories and try to see which repo failed. Also if you can share the list of failed packages we can help to identify what is the problematic repository.

 

-Erich