Re: [Starlingx-discuss] [ Test ] Sanity results - summary posted
Juan Carlos, I am confused. Why are we looking at the behaviour of ISOs from August? That seems like a waste of time. If I look at the sanity page, ISOs have been produced since then: https://wiki.openstack.org/wiki/StarlingX/Test#Latest_ISO_image_Sanity_Summa... The latest used there is Sept 6th? I believe that Mitch's ISO is more recent than that; I would have to check. Is there a reason we are not discussing the September 10th build? Does it display the same installer error on the console of controller-1? Certainly, we have not seen that virtually or physically on any system. Regards, Ken Y On 2018-09-11, 4:07 PM, "Alonso, Juan Carlos" <juan.carlos.alonso@intel.com> wrote: Hi, I also posted a comment on 1790213 with some findings. About the ISO sharing, I don't know if we are still able to continue with it. The installation fail on compute nodes have the same behavior. Regards. Juan Carlos Alonso -----Original Message----- From: Michel Thebeau [mailto:michel.thebeau@windriver.com] Sent: Tuesday, September 11, 2018 2:09 PM To: Khalil, Ghada <Ghada.Khalil@windriver.com>; Alonso, Juan Carlos <juan.carlos.alonso@intel.com>; Martinez Monroy, Elio <elio.martinez.monroy@intel.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [ Test ] Sanity results - summary posted Hi Ghada, I have posted a comment on #1790716 recommending closing that bug, but referring everyone to #1790213. I have not yet received the iso named stx-2018-08-30-97, but the iso stx-2018-08-28-88 presented a broken installer on the controller-1 console: " Error populating transaction after 10 retries: failure: Packages/python2-qpid-proton-0.24.0-1.el7.x86_64.rpm from anaconda: [Errno 256] No more mirrors to try." I think one could refocus on finding out why the installer broke after 2018-08-25-81, before 2018-08-28-88 M On 2018-09-11 09:53 AM, Khalil, Ghada wrote: > Hello Juan, > I read the notes in the Launchpad. > > And, just to confirm, are you following the instructions under: > https://wiki.openstack.org/wiki/StarlingX/Installation_Guide_Virtual_E > nvironment/Controller_Storage and still reproducing the two issues > below? > > I was not able to definitively tell from the Launchpad notes. It's important that both our teams are comparing apples to apples. > > Thanks, > Ghada > > -----Original Message----- > From: Alonso, Juan Carlos [mailto:juan.carlos.alonso@intel.com] > Sent: Monday, September 10, 2018 1:50 PM > To: Khalil, Ghada; Martinez Monroy, Elio; Jones, Bruce E; Cabrales, > Ada; starlingx-discuss@lists.starlingx.io; Thebeau, Michel > Subject: RE: [ Test ] Sanity results - summary posted > > Hi, > > Such launchpads were updated. > > A VM was set to upload the ISO tx-2018-08-28-88.iso, such ISO present two issues. Michael will upload his ISO, then we will re test witch each iso in our environment. > > An script is being developed to get the differences between ISOs. > > Regards. > Juan Carlos Alonso > > -----Original Message----- > From: Khalil, Ghada [mailto:Ghada.Khalil@windriver.com] > Sent: Friday, September 7, 2018 4:43 PM > To: Khalil, Ghada <Ghada.Khalil@windriver.com>; Martinez Monroy, Elio > <elio.martinez.monroy@intel.com>; Jones, Bruce E > <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; > starlingx-discuss@lists.starlingx.io; Thebeau, Michel > <Michel.Thebeau@windriver.com> > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Hi Elio/Ada, > Are there any updates from your side on these two Launchpads? > https://bugs.launchpad.net/starlingx/+bug/1790213 > https://bugs.launchpad.net/starlingx/+bug/1790716 > > Michel Thebeau (Wind River) has been trying to reproduce these two issues (following the starlingx wikis) without success for two days now. He has been adding his findings to the bugs and communicating with your team. > As a result of his investigation, he will be pushing some small fixes to stx-tools shortly (some cleanup). > > Please let us know if you need any further help from us. > > Thanks, > Ghada > > -----Original Message----- > From: Khalil, Ghada [mailto:Ghada.Khalil@windriver.com] > Sent: Wednesday, September 05, 2018 5:39 PM > To: Martinez Monroy, Elio; Jones, Bruce E; Cabrales, Ada; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Please see inline. There are notes in all the launchpads as well. > > I have tagged the last bug for the October release. The rest need more information to determine whether they gate or not: two maybe procedural and one requires more information. > > -----Original Message----- > From: Martinez Monroy, Elio [mailto:elio.martinez.monroy@intel.com] > Sent: Wednesday, September 05, 2018 2:23 PM > To: Jones, Bruce E; Cabrales, Ada; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > My opinion below > > -----Original Message----- > From: Jones, Bruce E [mailto:bruce.e.jones@intel.com] > Sent: Wednesday, September 5, 2018 12:56 PM > To: Cabrales, Ada <ada.cabrales@intel.com>; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Should the bugs coming out of this be tagged/fixed for the October release? > > Related bugs: > https://bugs.launchpad.net/starlingx/+bug/1790213 < --- Must, this bug is related with 2nd controller provisioning [[GK]] Using the instructions published on the wiki, our designer was not able to reproduce this issue. What instructions are the test team using? > > https://bugs.launchpad.net/starlingx/+bug/1790514 < --- Can wait until other issues are solved, will fail some test cases related to SSH [[GK]] Requested more information. This cannot be debugged further without this information. > > https://bugs.launchpad.net/starlingx/+bug/1790716 < --- Must, all > instances need at least one compute for multimode [[GK]] Using the > instructions published on the wiki, our designer was not able to > reproduce this issue. The test team points to internal instructions > which we have no access to. The supported install recipes need to be > on the wiki. I think it is an invalid bug > > https://bugs.launchpad.net/starlingx/+bug/1790718 < --- Can wait since is related to FM , test cases will fail [[GK]] As Brent pointed out, this is dependent on the integration of stx-gui which is in progress. > > -----Original Message----- > From: Cabrales, Ada [mailto:ada.cabrales@intel.com] > Sent: Wednesday, September 5, 2018 10:50 AM > To: starlingx-discuss@lists.starlingx.io > Subject: [Starlingx-discuss] [ Test ] Sanity results - summary posted > > Hello all, > > As mentioned on the project meeting today, we're posting the summary of the sanity test runs on the Test wiki [0]. The sanity is triggered each time an ISO is generated (a daily task). > > Right now we are posting the results manually, and working on a way for automating it. Logs of the run are not included, if you want to have them, you can contact Elio to get them sent to you. > > > [0] > https://wiki.openstack.org/wiki/StarlingX/Test#Latest_ISO_image_Sanity > _Summary > > Regards > Ada > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Hi Ken, Because the issues started from August's ISOs and followed ISOs have the same issues. We focused to find from what ISO the issues started, we did it. Now we are focusing on confirm if such package is the root cause of issues, if it is then latest ISOs should work well. Regards. Juan Carlos Alonso -----Original Message----- From: Young, Ken [mailto:Ken.Young@windriver.com] Sent: Tuesday, September 11, 2018 3:19 PM To: Alonso, Juan Carlos <juan.carlos.alonso@intel.com> Cc: Thebeau, Michel <Michel.Thebeau@windriver.com>; Khalil, Ghada <Ghada.Khalil@windriver.com>; Martinez Monroy, Elio <elio.martinez.monroy@intel.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary posted Juan Carlos, I am confused. Why are we looking at the behaviour of ISOs from August? That seems like a waste of time. If I look at the sanity page, ISOs have been produced since then: https://wiki.openstack.org/wiki/StarlingX/Test#Latest_ISO_image_Sanity_Summa... The latest used there is Sept 6th? I believe that Mitch's ISO is more recent than that; I would have to check. Is there a reason we are not discussing the September 10th build? Does it display the same installer error on the console of controller-1? Certainly, we have not seen that virtually or physically on any system. Regards, Ken Y On 2018-09-11, 4:07 PM, "Alonso, Juan Carlos" <juan.carlos.alonso@intel.com> wrote: Hi, I also posted a comment on 1790213 with some findings. About the ISO sharing, I don't know if we are still able to continue with it. The installation fail on compute nodes have the same behavior. Regards. Juan Carlos Alonso -----Original Message----- From: Michel Thebeau [mailto:michel.thebeau@windriver.com] Sent: Tuesday, September 11, 2018 2:09 PM To: Khalil, Ghada <Ghada.Khalil@windriver.com>; Alonso, Juan Carlos <juan.carlos.alonso@intel.com>; Martinez Monroy, Elio <elio.martinez.monroy@intel.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [ Test ] Sanity results - summary posted Hi Ghada, I have posted a comment on #1790716 recommending closing that bug, but referring everyone to #1790213. I have not yet received the iso named stx-2018-08-30-97, but the iso stx-2018-08-28-88 presented a broken installer on the controller-1 console: " Error populating transaction after 10 retries: failure: Packages/python2-qpid-proton-0.24.0-1.el7.x86_64.rpm from anaconda: [Errno 256] No more mirrors to try." I think one could refocus on finding out why the installer broke after 2018-08-25-81, before 2018-08-28-88 M On 2018-09-11 09:53 AM, Khalil, Ghada wrote: > Hello Juan, > I read the notes in the Launchpad. > > And, just to confirm, are you following the instructions under: > https://wiki.openstack.org/wiki/StarlingX/Installation_Guide_Virtual_E > nvironment/Controller_Storage and still reproducing the two issues > below? > > I was not able to definitively tell from the Launchpad notes. It's important that both our teams are comparing apples to apples. > > Thanks, > Ghada > > -----Original Message----- > From: Alonso, Juan Carlos [mailto:juan.carlos.alonso@intel.com] > Sent: Monday, September 10, 2018 1:50 PM > To: Khalil, Ghada; Martinez Monroy, Elio; Jones, Bruce E; Cabrales, > Ada; starlingx-discuss@lists.starlingx.io; Thebeau, Michel > Subject: RE: [ Test ] Sanity results - summary posted > > Hi, > > Such launchpads were updated. > > A VM was set to upload the ISO tx-2018-08-28-88.iso, such ISO present two issues. Michael will upload his ISO, then we will re test witch each iso in our environment. > > An script is being developed to get the differences between ISOs. > > Regards. > Juan Carlos Alonso > > -----Original Message----- > From: Khalil, Ghada [mailto:Ghada.Khalil@windriver.com] > Sent: Friday, September 7, 2018 4:43 PM > To: Khalil, Ghada <Ghada.Khalil@windriver.com>; Martinez Monroy, Elio > <elio.martinez.monroy@intel.com>; Jones, Bruce E > <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; > starlingx-discuss@lists.starlingx.io; Thebeau, Michel > <Michel.Thebeau@windriver.com> > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Hi Elio/Ada, > Are there any updates from your side on these two Launchpads? > https://bugs.launchpad.net/starlingx/+bug/1790213 > https://bugs.launchpad.net/starlingx/+bug/1790716 > > Michel Thebeau (Wind River) has been trying to reproduce these two issues (following the starlingx wikis) without success for two days now. He has been adding his findings to the bugs and communicating with your team. > As a result of his investigation, he will be pushing some small fixes to stx-tools shortly (some cleanup). > > Please let us know if you need any further help from us. > > Thanks, > Ghada > > -----Original Message----- > From: Khalil, Ghada [mailto:Ghada.Khalil@windriver.com] > Sent: Wednesday, September 05, 2018 5:39 PM > To: Martinez Monroy, Elio; Jones, Bruce E; Cabrales, Ada; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Please see inline. There are notes in all the launchpads as well. > > I have tagged the last bug for the October release. The rest need more information to determine whether they gate or not: two maybe procedural and one requires more information. > > -----Original Message----- > From: Martinez Monroy, Elio [mailto:elio.martinez.monroy@intel.com] > Sent: Wednesday, September 05, 2018 2:23 PM > To: Jones, Bruce E; Cabrales, Ada; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > My opinion below > > -----Original Message----- > From: Jones, Bruce E [mailto:bruce.e.jones@intel.com] > Sent: Wednesday, September 5, 2018 12:56 PM > To: Cabrales, Ada <ada.cabrales@intel.com>; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Should the bugs coming out of this be tagged/fixed for the October release? > > Related bugs: > https://bugs.launchpad.net/starlingx/+bug/1790213 < --- Must, this bug is related with 2nd controller provisioning [[GK]] Using the instructions published on the wiki, our designer was not able to reproduce this issue. What instructions are the test team using? > > https://bugs.launchpad.net/starlingx/+bug/1790514 < --- Can wait until other issues are solved, will fail some test cases related to SSH [[GK]] Requested more information. This cannot be debugged further without this information. > > https://bugs.launchpad.net/starlingx/+bug/1790716 < --- Must, all > instances need at least one compute for multimode [[GK]] Using the > instructions published on the wiki, our designer was not able to > reproduce this issue. The test team points to internal instructions > which we have no access to. The supported install recipes need to be > on the wiki. I think it is an invalid bug > > https://bugs.launchpad.net/starlingx/+bug/1790718 < --- Can wait since is related to FM , test cases will fail [[GK]] As Brent pointed out, this is dependent on the integration of stx-gui which is in progress. > > -----Original Message----- > From: Cabrales, Ada [mailto:ada.cabrales@intel.com] > Sent: Wednesday, September 5, 2018 10:50 AM > To: starlingx-discuss@lists.starlingx.io > Subject: [Starlingx-discuss] [ Test ] Sanity results - summary posted > > Hello all, > > As mentioned on the project meeting today, we're posting the summary of the sanity test runs on the Test wiki [0]. The sanity is triggered each time an ISO is generated (a daily task). > > Right now we are posting the results manually, and working on a way for automating it. Logs of the run are not included, if you want to have them, you can contact Elio to get them sent to you. > > > [0] > https://wiki.openstack.org/wiki/StarlingX/Test#Latest_ISO_image_Sanity > _Summary > > Regards > Ada > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
I have narrowed down a little bit the issue, these are my findings. - I compared the bootimage_michel.iso with the stx-2018-09-11-111.iso, which is today's ISO. - The are not significant package differences between them, minor versions has changed in some packages. - The issue is that once the kernel has been loaded through PXE, anaconda is unable to find python2-qpid package. Not sure if this is the first package that is requested. - From the anaconda shell I can see the http://pxecontroller/ serving the files and the repodata seems to be updated there. I installed yum manually and I was able to install python2-qpid package, (and any other available). - The content of the pxe-network-installer package is not the same, WR squashfs.img file has the kernel 3.10.0-693.2.2 but ours has 3.10.0- 862.6.3. We regenerate those files when the kernel was upgraded. (maybe this matches with the date where the issue started to arise..) So, my guess now is that the problem could be caused by the pxe-network-installer package. We create those files with the update- network-installer script. That's the same used in WR to generate these files? I'll keep diging in the generation of these files to see if there is any problem. -Erich On 9/11/18, 3:34 PM, "Alonso, Juan Carlos" <juan.carlos.alonso@intel.com> wrote: Hi Ken, Because the issues started from August's ISOs and followed ISOs have the same issues. We focused to find from what ISO the issues started, we did it. Now we are focusing on confirm if such package is the root cause of issues, if it is then latest ISOs should work well. Regards. Juan Carlos Alonso -----Original Message----- From: Young, Ken [mailto:Ken.Young@windriver.com] Sent: Tuesday, September 11, 2018 3:19 PM To: Alonso, Juan Carlos <juan.carlos.alonso@intel.com> Cc: Thebeau, Michel <Michel.Thebeau@windriver.com>; Khalil, Ghada <Ghada.Khalil@windriver.com>; Martinez Monroy, Elio <elio.martinez.monroy@intel.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary posted Juan Carlos, I am confused. Why are we looking at the behaviour of ISOs from August? That seems like a waste of time. If I look at the sanity page, ISOs have been produced since then: https://wiki.openstack.org/wiki/StarlingX/Test#Latest_ISO_image_Sanity_Summa... The latest used there is Sept 6th? I believe that Mitch's ISO is more recent than that; I would have to check. Is there a reason we are not discussing the September 10th build? Does it display the same installer error on the console of controller-1? Certainly, we have not seen that virtually or physically on any system. Regards, Ken Y On 2018-09-11, 4:07 PM, "Alonso, Juan Carlos" <juan.carlos.alonso@intel.com> wrote: Hi, I also posted a comment on 1790213 with some findings. About the ISO sharing, I don't know if we are still able to continue with it. The installation fail on compute nodes have the same behavior. Regards. Juan Carlos Alonso -----Original Message----- From: Michel Thebeau [mailto:michel.thebeau@windriver.com] Sent: Tuesday, September 11, 2018 2:09 PM To: Khalil, Ghada <Ghada.Khalil@windriver.com>; Alonso, Juan Carlos <juan.carlos.alonso@intel.com>; Martinez Monroy, Elio <elio.martinez.monroy@intel.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [ Test ] Sanity results - summary posted Hi Ghada, I have posted a comment on #1790716 recommending closing that bug, but referring everyone to #1790213. I have not yet received the iso named stx-2018-08-30-97, but the iso stx-2018-08-28-88 presented a broken installer on the controller-1 console: " Error populating transaction after 10 retries: failure: Packages/python2-qpid-proton-0.24.0-1.el7.x86_64.rpm from anaconda: [Errno 256] No more mirrors to try." I think one could refocus on finding out why the installer broke after 2018-08-25-81, before 2018-08-28-88 M On 2018-09-11 09:53 AM, Khalil, Ghada wrote: > Hello Juan, > I read the notes in the Launchpad. > > And, just to confirm, are you following the instructions under: > https://wiki.openstack.org/wiki/StarlingX/Installation_Guide_Virtual_E > nvironment/Controller_Storage and still reproducing the two issues > below? > > I was not able to definitively tell from the Launchpad notes. It's important that both our teams are comparing apples to apples. > > Thanks, > Ghada > > -----Original Message----- > From: Alonso, Juan Carlos [mailto:juan.carlos.alonso@intel.com] > Sent: Monday, September 10, 2018 1:50 PM > To: Khalil, Ghada; Martinez Monroy, Elio; Jones, Bruce E; Cabrales, > Ada; starlingx-discuss@lists.starlingx.io; Thebeau, Michel > Subject: RE: [ Test ] Sanity results - summary posted > > Hi, > > Such launchpads were updated. > > A VM was set to upload the ISO tx-2018-08-28-88.iso, such ISO present two issues. Michael will upload his ISO, then we will re test witch each iso in our environment. > > An script is being developed to get the differences between ISOs. > > Regards. > Juan Carlos Alonso > > -----Original Message----- > From: Khalil, Ghada [mailto:Ghada.Khalil@windriver.com] > Sent: Friday, September 7, 2018 4:43 PM > To: Khalil, Ghada <Ghada.Khalil@windriver.com>; Martinez Monroy, Elio > <elio.martinez.monroy@intel.com>; Jones, Bruce E > <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; > starlingx-discuss@lists.starlingx.io; Thebeau, Michel > <Michel.Thebeau@windriver.com> > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Hi Elio/Ada, > Are there any updates from your side on these two Launchpads? > https://bugs.launchpad.net/starlingx/+bug/1790213 > https://bugs.launchpad.net/starlingx/+bug/1790716 > > Michel Thebeau (Wind River) has been trying to reproduce these two issues (following the starlingx wikis) without success for two days now. He has been adding his findings to the bugs and communicating with your team. > As a result of his investigation, he will be pushing some small fixes to stx-tools shortly (some cleanup). > > Please let us know if you need any further help from us. > > Thanks, > Ghada > > -----Original Message----- > From: Khalil, Ghada [mailto:Ghada.Khalil@windriver.com] > Sent: Wednesday, September 05, 2018 5:39 PM > To: Martinez Monroy, Elio; Jones, Bruce E; Cabrales, Ada; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Please see inline. There are notes in all the launchpads as well. > > I have tagged the last bug for the October release. The rest need more information to determine whether they gate or not: two maybe procedural and one requires more information. > > -----Original Message----- > From: Martinez Monroy, Elio [mailto:elio.martinez.monroy@intel.com] > Sent: Wednesday, September 05, 2018 2:23 PM > To: Jones, Bruce E; Cabrales, Ada; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > My opinion below > > -----Original Message----- > From: Jones, Bruce E [mailto:bruce.e.jones@intel.com] > Sent: Wednesday, September 5, 2018 12:56 PM > To: Cabrales, Ada <ada.cabrales@intel.com>; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Should the bugs coming out of this be tagged/fixed for the October release? > > Related bugs: > https://bugs.launchpad.net/starlingx/+bug/1790213 < --- Must, this bug is related with 2nd controller provisioning [[GK]] Using the instructions published on the wiki, our designer was not able to reproduce this issue. What instructions are the test team using? > > https://bugs.launchpad.net/starlingx/+bug/1790514 < --- Can wait until other issues are solved, will fail some test cases related to SSH [[GK]] Requested more information. This cannot be debugged further without this information. > > https://bugs.launchpad.net/starlingx/+bug/1790716 < --- Must, all > instances need at least one compute for multimode [[GK]] Using the > instructions published on the wiki, our designer was not able to > reproduce this issue. The test team points to internal instructions > which we have no access to. The supported install recipes need to be > on the wiki. I think it is an invalid bug > > https://bugs.launchpad.net/starlingx/+bug/1790718 < --- Can wait since is related to FM , test cases will fail [[GK]] As Brent pointed out, this is dependent on the integration of stx-gui which is in progress. > > -----Original Message----- > From: Cabrales, Ada [mailto:ada.cabrales@intel.com] > Sent: Wednesday, September 5, 2018 10:50 AM > To: starlingx-discuss@lists.starlingx.io > Subject: [Starlingx-discuss] [ Test ] Sanity results - summary posted > > Hello all, > > As mentioned on the project meeting today, we're posting the summary of the sanity test runs on the Test wiki [0]. The sanity is triggered each time an ISO is generated (a daily task). > > Right now we are posting the results manually, and working on a way for automating it. Logs of the run are not included, if you want to have them, you can contact Elio to get them sent to you. > > > [0] > https://wiki.openstack.org/wiki/StarlingX/Test#Latest_ISO_image_Sanity > _Summary > > Regards > Ada > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
I'm not familiar with the "update-network-installer" script. I assume it's an Intel creation? We hand-manage updates to the installer images, with steps described in stx-metal/installer/initrd/README, updating the images only as needed. The kickstarts provide "repo" directives to Anaconda to point it at the repos under /www/ on the controller, with the base load being in /www/pages/feed/rel-XXXX. Anaconda should be able to install everything from there. -----Original Message----- From: Cordoba Malibran, Erich [mailto:erich.cordoba.malibran@intel.com] Sent: Tuesday, September 11, 2018 9:51 PM To: Alonso, Juan Carlos; Young, Ken Cc: starlingx-discuss@lists.starlingx.io Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary posted I have narrowed down a little bit the issue, these are my findings. - I compared the bootimage_michel.iso with the stx-2018-09-11-111.iso, which is today's ISO. - The are not significant package differences between them, minor versions has changed in some packages. - The issue is that once the kernel has been loaded through PXE, anaconda is unable to find python2-qpid package. Not sure if this is the first package that is requested. - From the anaconda shell I can see the http://pxecontroller/ serving the files and the repodata seems to be updated there. I installed yum manually and I was able to install python2-qpid package, (and any other available). - The content of the pxe-network-installer package is not the same, WR squashfs.img file has the kernel 3.10.0-693.2.2 but ours has 3.10.0- 862.6.3. We regenerate those files when the kernel was upgraded. (maybe this matches with the date where the issue started to arise..) So, my guess now is that the problem could be caused by the pxe-network-installer package. We create those files with the update- network-installer script. That's the same used in WR to generate these files? I'll keep diging in the generation of these files to see if there is any problem. -Erich On 9/11/18, 3:34 PM, "Alonso, Juan Carlos" <juan.carlos.alonso@intel.com> wrote: Hi Ken, Because the issues started from August's ISOs and followed ISOs have the same issues. We focused to find from what ISO the issues started, we did it. Now we are focusing on confirm if such package is the root cause of issues, if it is then latest ISOs should work well. Regards. Juan Carlos Alonso -----Original Message----- From: Young, Ken [mailto:Ken.Young@windriver.com] Sent: Tuesday, September 11, 2018 3:19 PM To: Alonso, Juan Carlos <juan.carlos.alonso@intel.com> Cc: Thebeau, Michel <Michel.Thebeau@windriver.com>; Khalil, Ghada <Ghada.Khalil@windriver.com>; Martinez Monroy, Elio <elio.martinez.monroy@intel.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary posted Juan Carlos, I am confused. Why are we looking at the behaviour of ISOs from August? That seems like a waste of time. If I look at the sanity page, ISOs have been produced since then: https://wiki.openstack.org/wiki/StarlingX/Test#Latest_ISO_image_Sanity_Summa... The latest used there is Sept 6th? I believe that Mitch's ISO is more recent than that; I would have to check. Is there a reason we are not discussing the September 10th build? Does it display the same installer error on the console of controller-1? Certainly, we have not seen that virtually or physically on any system. Regards, Ken Y On 2018-09-11, 4:07 PM, "Alonso, Juan Carlos" <juan.carlos.alonso@intel.com> wrote: Hi, I also posted a comment on 1790213 with some findings. About the ISO sharing, I don't know if we are still able to continue with it. The installation fail on compute nodes have the same behavior. Regards. Juan Carlos Alonso -----Original Message----- From: Michel Thebeau [mailto:michel.thebeau@windriver.com] Sent: Tuesday, September 11, 2018 2:09 PM To: Khalil, Ghada <Ghada.Khalil@windriver.com>; Alonso, Juan Carlos <juan.carlos.alonso@intel.com>; Martinez Monroy, Elio <elio.martinez.monroy@intel.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [ Test ] Sanity results - summary posted Hi Ghada, I have posted a comment on #1790716 recommending closing that bug, but referring everyone to #1790213. I have not yet received the iso named stx-2018-08-30-97, but the iso stx-2018-08-28-88 presented a broken installer on the controller-1 console: " Error populating transaction after 10 retries: failure: Packages/python2-qpid-proton-0.24.0-1.el7.x86_64.rpm from anaconda: [Errno 256] No more mirrors to try." I think one could refocus on finding out why the installer broke after 2018-08-25-81, before 2018-08-28-88 M On 2018-09-11 09:53 AM, Khalil, Ghada wrote: > Hello Juan, > I read the notes in the Launchpad. > > And, just to confirm, are you following the instructions under: > https://wiki.openstack.org/wiki/StarlingX/Installation_Guide_Virtual_E > nvironment/Controller_Storage and still reproducing the two issues > below? > > I was not able to definitively tell from the Launchpad notes. It's important that both our teams are comparing apples to apples. > > Thanks, > Ghada > > -----Original Message----- > From: Alonso, Juan Carlos [mailto:juan.carlos.alonso@intel.com] > Sent: Monday, September 10, 2018 1:50 PM > To: Khalil, Ghada; Martinez Monroy, Elio; Jones, Bruce E; Cabrales, > Ada; starlingx-discuss@lists.starlingx.io; Thebeau, Michel > Subject: RE: [ Test ] Sanity results - summary posted > > Hi, > > Such launchpads were updated. > > A VM was set to upload the ISO tx-2018-08-28-88.iso, such ISO present two issues. Michael will upload his ISO, then we will re test witch each iso in our environment. > > An script is being developed to get the differences between ISOs. > > Regards. > Juan Carlos Alonso > > -----Original Message----- > From: Khalil, Ghada [mailto:Ghada.Khalil@windriver.com] > Sent: Friday, September 7, 2018 4:43 PM > To: Khalil, Ghada <Ghada.Khalil@windriver.com>; Martinez Monroy, Elio > <elio.martinez.monroy@intel.com>; Jones, Bruce E > <bruce.e.jones@intel.com>; Cabrales, Ada <ada.cabrales@intel.com>; > starlingx-discuss@lists.starlingx.io; Thebeau, Michel > <Michel.Thebeau@windriver.com> > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Hi Elio/Ada, > Are there any updates from your side on these two Launchpads? > https://bugs.launchpad.net/starlingx/+bug/1790213 > https://bugs.launchpad.net/starlingx/+bug/1790716 > > Michel Thebeau (Wind River) has been trying to reproduce these two issues (following the starlingx wikis) without success for two days now. He has been adding his findings to the bugs and communicating with your team. > As a result of his investigation, he will be pushing some small fixes to stx-tools shortly (some cleanup). > > Please let us know if you need any further help from us. > > Thanks, > Ghada > > -----Original Message----- > From: Khalil, Ghada [mailto:Ghada.Khalil@windriver.com] > Sent: Wednesday, September 05, 2018 5:39 PM > To: Martinez Monroy, Elio; Jones, Bruce E; Cabrales, Ada; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Please see inline. There are notes in all the launchpads as well. > > I have tagged the last bug for the October release. The rest need more information to determine whether they gate or not: two maybe procedural and one requires more information. > > -----Original Message----- > From: Martinez Monroy, Elio [mailto:elio.martinez.monroy@intel.com] > Sent: Wednesday, September 05, 2018 2:23 PM > To: Jones, Bruce E; Cabrales, Ada; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > My opinion below > > -----Original Message----- > From: Jones, Bruce E [mailto:bruce.e.jones@intel.com] > Sent: Wednesday, September 5, 2018 12:56 PM > To: Cabrales, Ada <ada.cabrales@intel.com>; > starlingx-discuss@lists.starlingx.io > Subject: Re: [Starlingx-discuss] [ Test ] Sanity results - summary > posted > > Should the bugs coming out of this be tagged/fixed for the October release? > > Related bugs: > https://bugs.launchpad.net/starlingx/+bug/1790213 < --- Must, this bug is related with 2nd controller provisioning [[GK]] Using the instructions published on the wiki, our designer was not able to reproduce this issue. What instructions are the test team using? > > https://bugs.launchpad.net/starlingx/+bug/1790514 < --- Can wait until other issues are solved, will fail some test cases related to SSH [[GK]] Requested more information. This cannot be debugged further without this information. > > https://bugs.launchpad.net/starlingx/+bug/1790716 < --- Must, all > instances need at least one compute for multimode [[GK]] Using the > instructions published on the wiki, our designer was not able to > reproduce this issue. The test team points to internal instructions > which we have no access to. The supported install recipes need to be > on the wiki. I think it is an invalid bug > > https://bugs.launchpad.net/starlingx/+bug/1790718 < --- Can wait since is related to FM , test cases will fail [[GK]] As Brent pointed out, this is dependent on the integration of stx-gui which is in progress. > > -----Original Message----- > From: Cabrales, Ada [mailto:ada.cabrales@intel.com] > Sent: Wednesday, September 5, 2018 10:50 AM > To: starlingx-discuss@lists.starlingx.io > Subject: [Starlingx-discuss] [ Test ] Sanity results - summary posted > > Hello all, > > As mentioned on the project meeting today, we're posting the summary of the sanity test runs on the Test wiki [0]. The sanity is triggered each time an ISO is generated (a daily task). > > Right now we are posting the results manually, and working on a way for automating it. Logs of the run are not included, if you want to have them, you can contact Elio to get them sent to you. > > > [0] > https://wiki.openstack.org/wiki/StarlingX/Test#Latest_ISO_image_Sanity > _Summary > > Regards > Ada > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
participants (4)
-
Alonso, Juan Carlos
-
Cordoba Malibran, Erich
-
Penney, Don
-
Young, Ken