Thanks a lot to everyone that help us to test and verify this issue

During the building meeting, Scott agreed to help us to talk with CENGN to fix this issue

In the meantime a local repo with the RPMs from

[1] http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/latest_build/outputs/RPMS/std/
[2]http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/latest_build/inputs/RPMS/

is the solution.

If you download them you just need to run

createrepo -c <path to your repo>. This is just a temporary solution since the idea is that anyone of us can build w/o the need for heavy workstations.

Thanks a lot Scott

Regards

Victor R

On Wed, Aug 14, 2019 at 10:08 PM Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com> wrote:

I can see it also and it's easily reproducible with this line:

$ while true; do curl -I -q http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/ && sleep 1; done

HTTP/1.1 200 OK
Server: nginx/1.15.8
Date: Thu, 15 Aug 2019 02:03:46 GMT
Content-Type: text/html
Vary: Accept-Encoding
Via: 1.1 jfdmzpr03, 1.1 jfintpr01
Proxy-Connection: Keep-Alive
Connection: Keep-Alive

HTTP/1.1 403 Forbidden
Server: nginx/1.15.8
Date: Thu, 15 Aug 2019 02:03:48 GMT
Content-Type: text/html
Content-Length: 153
Via: 1.1 jfdmzpr04, 1.1 jfintpr02
Proxy-Connection: Keep-Alive
Connection: Keep-Alive

HTTP/1.1 200 OK
Server: nginx/1.15.8
Date: Thu, 15 Aug 2019 02:03:49 GMT
Content-Type: text/html
Vary: Accept-Encoding
Via: 1.1 jfdmzpr04, 1.1 jfintpr02
Proxy-Connection: Keep-Alive
Connection: Keep-Alive

HTTP/1.1 403 Forbidden
Server: nginx/1.15.8
Date: Thu, 15 Aug 2019 02:03:51 GMT
Content-Type: text/html
Content-Length: 153
Via: 1.1 jfdmzpr04, 1.1 jfintpr02
Proxy-Connection: Keep-Alive
Connection: Keep-Alive

HTTP/1.1 200 OK
Server: nginx/1.15.8
Date: Thu, 15 Aug 2019 02:03:52 GMT
Content-Type: text/html
Vary: Accept-Encoding
Via: 1.1 jfdmzpr04, 1.1 jfintpr02
Proxy-Connection: Keep-Alive
Connection: Keep-Alive

HTTP/1.1 403 Forbidden
Server: nginx/1.15.8
Date: Thu, 15 Aug 2019 02:03:53 GMT
Content-Type: text/html
Content-Length: 153
Via: 1.1 jfdmzpr04, 1.1 jfintpr02
Proxy-Connection: Keep-Alive
Connection: Keep-Alive

On 8/14/19, 5:43 PM, "Dean Troyer" <dtroyer@gmail.com> wrote:

On Wed, Aug 14, 2019 at 2:18 PM Scott Little <scott.little@windriver.com> wrote:
> I've never seen a 404 or 403 myself, outside of the 3 or 4 extended
> outages attributed to know issues at cengn.
[...]
> How many folks have seen this? What was the time of the event? How
> long did it persist? Please report events in UTC.

So I've been poking at this for the last few minutes, so around 2200-2230 UTC

These links work:

http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190811T053000Z/
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190813T033000Z/

These do not:

http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190812T033004Z/
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190814T053000Z/

Until I tried them again to write this email, then they swapped.

Is there perchance a load balancer in front of multiple web servers
and one of the backends is having trouble? Even if that isn't the
case that seems to describe the observed behaviour well enough.

dt

--
Dean Troyer
dtroyer@gmail.com

_______________________________________________
Starlingx-discuss mailing list
Starlingx-discuss@lists.starlingx.io
http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss