On 1/26/21 1:28 PM, Scott Little wrote:
The jenkins in the cengn build is offline while we repair the file system on the mirror. The build machine both read from, and writes to the mirror, and I don't want it to cause further corruptions while the mirror is being repaired.
The cengn mirror has been cut over to the new storage back end. However any corrupt files from the old storage back end will remain corrupted on the new one.
Restoration of rpm repos will proceed in several phases:
1) An audit of all rpm repos is underway. Rpm's that fail their checksum are being removed and repodata will be updated to reflect the missing RPMS.
2) The mirror update job (downloading rpms from upstream rpm repos) will be run to restore as many missing files as possible. Many rpms may no longer be available as we kept old versions of packages that upstream drops when a new version is available,
3) If rpms that are not available from upstream, but are required for our build, we can attempt to restore them from one of several places. e.g. the inputs directory of various builds, or the downloads directory on the cengn build server (independent storage from the mirror)
4) Resume building new loads
All of the release iso's on cengn were corrupt.
I've been able to restore 4.0.1 and 2.0.1 from the original build artifacts.
Original build artifacts for 3.0.0 are missing. I do have build artifacts for builds that were intended to lead up to a 3.0.1 release. If a verifiable copy of 3.0.0 can't be found, we may want to consider issuing a 3.0.1. Alternatively I can rebuild 3.0.0, but the file checksums wont match the original build due to embedded timestamps.
Scott
OUCH...!!!