Hi Scott & All, Query : 1 I am facing issue with openstack dashboard login as admin when I am trying to build stx-horizon locally (without any changes). Raised launchpad for same : https://bugs.launchpad.net/starlingx/+bug/1905517 . (A) Working case: 1. I have build latest master code (Following internal wiki<https://wiki.ith.intel.com/display/StarlingX/Procedure+for+Layered+build+for+Starlingx> ) ISO and deployed on machine. 2. Pulled openstack application from location here<http://mirror.starlingx.cengn.ca/mirror/starlingx/release/4.0.1/centos/flock/outputs/helm-charts/stx-openstack-1.0-49-centos-stable-versioned.tgz>. 3. I am able to login into the openstack dashboard and starlingX dashboard. (B) Non-Working case(Containerize horizon build): 1. Used same environment as above (ISO, deployed machine and stx-openstack application) 2. Build “stx-horizon locally”. Pushed it on to github, updated openstack-application (on top of working case tgz file) files “stx-openstack.yaml”, “checksum.md5” accordingly with location and md5 number. 3. Applied openstack application. 4. But not able to login into openstack-dashboard as admin. Whereas able to login into starlingX dashboard. 5. Error message invalid credentials. 6. Logs are attached in launchpad. (C) Working Case: Used same environment as above Non-Working case (ISO, deployed machine and stx-openstack application), Except Instead of taking stx-openstack from flock ‘s output folder. I took from container’s output folder<http://mirror.starlingx.cengn.ca/mirror/starlingx/release/4.0.1/centos/containers/outputs/helm-charts/stx-openstack-1.0-49-centos-stable-latest.tgz>. With this I am able to apply and able to login into openstack dashboard. But whatever changes I am doing (mario patch in horizon), and build successfully, those changes are not getting reflected in the dashboard (FM panel in openstack dashboard), the same works in 3.0 release. So I have following queries and request your support in resolving it. Please let me know if we can have 30 minutes discussion today ? 1. What is the difference in flock’s and containers’s stx-openstack application ? You can further check with Scott. 1. Which one to use ? We usually use flock one. 1. Why changes are not reflecting neither in the filesystem of horizon nor on the dashboard, whereas same steps works on the 3.0 release. Stx-horizon build file (latest of master. Have attached too) : ./starlingx/workspace/localdisk/designer/intel/distro/cgcs-root/stx/upstream/openstack/python-horizon/centos/stx-horizon.stable_docker_image Query : 2 I am trying to build RMPS and local wheels, so that during stx-horizon build it can refer latest wheels. But this is not happening and I get same error as package/wheel not found. Followed below steps suggested by Austin; “ I think it is from the wheel is generated by this script https://opendev.org/starlingx/root/src/branch/master/build-tools/build-wheel... Those wheel should be extracted from local build rpms. So from my understanding , here should be steps: 1) change spec files for stx gui, to support python3 2) build gui rpms in local w/ python3 3) build wheels for gui python3 4) build docker images. ” In docker build; we export wheels to be picked from here<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/latest_docker_image_build/outputs/wheels/stx-centos-stable-wheels.tar>. So is this is the reason why it is not picking local build wheels ? How to club both ? Request support in building local wheel and stx-horizon docker with below pipi packages mentioned in https://review.opendev.org/c/starlingx/upstream/+/661423/4/openstack/python-... Thanks, Haridhar Kalvala From: Hu, Yong <yong.hu@intel.com> Sent: Friday, November 27, 2020 2:40 PM To: Kalvala, Haridhar <haridhar.kalvala@intel.com> Cc: Sun, Austin <austin.sun@intel.com>; Liu, ZhipengS <zhipengs.liu@intel.com>; Liu, Zhipeng <zhipeng.liu@intel.com>; Chen, Yan <yan.chen@intel.com>; Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com>; Kumar, Sharath <sharath.kumar@intel.com> Subject: Re: Openstack dashboard login. Again, pls DO have the discussions in the mailing list. 发自我的iPhone 在 2020年11月27日，下午5:00，Kalvala, Haridhar <haridhar.kalvala@intel.com<mailto:haridhar.kalvala@intel.com>> 写道：  Hi Austin, I did step 1 and 2. Step 3 throwing error for to get wheels. I will debug further and update here. Thanks, Haridhar Kalvala From: Sun, Austin <austin.sun@intel.com<mailto:austin.sun@intel.com>> Sent: Friday, November 27, 2020 12:26 PM To: Liu, ZhipengS <zhipengs.liu@intel.com<mailto:zhipengs.liu@intel.com>>; Kalvala, Haridhar <haridhar.kalvala@intel.com<mailto:haridhar.kalvala@intel.com>>; Hu, Yong <yong.hu@intel.com<mailto:yong.hu@intel.com>>; Liu, Zhipeng <zhipeng.liu@intel.com<mailto:zhipeng.liu@intel.com>> Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com<mailto:sanjay.k.mukherjee@intel.com>>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com<mailto:gopalkrishna.bhat@intel.com>>; Kumar, Sharath <sharath.kumar@intel.com<mailto:sharath.kumar@intel.com>> Subject: RE: Openstack dashboard login. Hi Haridhar: I think it is from the wheel is generated by this script https://opendev.org/starlingx/root/src/branch/master/build-tools/build-wheel... Those wheel should be extracted from local build rpms. So from my understanding , here should be steps: 1) change spec files for stx gui, to support python3 2) build gui rpms in local w/ python3 3) build wheels for gui python3 4) build docker images. Thanks. BR Austin Sun. From: Liu, ZhipengS <zhipengs.liu@intel.com<mailto:zhipengs.liu@intel.com>> Sent: Thursday, November 26, 2020 1:22 PM To: Kalvala, Haridhar <haridhar.kalvala@intel.com<mailto:haridhar.kalvala@intel.com>>; Sun, Austin <austin.sun@intel.com<mailto:austin.sun@intel.com>>; Hu, Yong <yong.hu@intel.com<mailto:yong.hu@intel.com>>; Liu, Zhipeng <zhipeng.liu@intel.com<mailto:zhipeng.liu@intel.com>> Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com<mailto:sanjay.k.mukherjee@intel.com>>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com<mailto:gopalkrishna.bhat@intel.com>>; Kumar, Sharath <sharath.kumar@intel.com<mailto:sharath.kumar@intel.com>> Subject: RE: Openstack dashboard login. Hi Haridhar, Please see my inline comment below. You’d better send it to starlingx mail list as well. Thanks! Zhipeng From: Kalvala, Haridhar <haridhar.kalvala@intel.com<mailto:haridhar.kalvala@intel.com>> Sent: 2020年11月26日 12:26 To: Liu, ZhipengS <zhipengs.liu@intel.com<mailto:zhipengs.liu@intel.com>>; Sun, Austin <austin.sun@intel.com<mailto:austin.sun@intel.com>>; Hu, Yong <yong.hu@intel.com<mailto:yong.hu@intel.com>>; Liu, Zhipeng <zhipeng.liu@intel.com<mailto:zhipeng.liu@intel.com>> Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com<mailto:sanjay.k.mukherjee@intel.com>>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com<mailto:gopalkrishna.bhat@intel.com>>; Kumar, Sharath <sharath.kumar@intel.com<mailto:sharath.kumar@intel.com>> Subject: RE: Openstack dashboard login. Hi Yong & Team, Instead of taking stx-openstack from flock ‘s output folder. I took from container’s output folder. With this I am able to apply and able to login into openstack dashboard. But whatever changes I am doing (mario patch in horizon), and build successfully, those changes are not getting reflected in the dashboard (FM panel in openstack dashboard), the same works in 3.0 release. So I have following queries and request your support in resolving it. Please let me know if we can have 30 minutes discussion today ? 1. What is the difference in flock’s and containers’s stx-openstack application ? You can further check with Scott. 1. Which one to use ? We usually use flock one. 1. Why changes are not reflecting neither in the filesystem of horizon nor on the dashboard, whereas same steps works on the 3.0 release. Thanks, Haridhar Kalvala From: Liu, ZhipengS <zhipengs.liu@intel.com<mailto:zhipengs.liu@intel.com>> Sent: Wednesday, November 25, 2020 11:09 AM To: Kalvala, Haridhar <haridhar.kalvala@intel.com<mailto:haridhar.kalvala@intel.com>>; Sun, Austin <austin.sun@intel.com<mailto:austin.sun@intel.com>>; Hu, Yong <yong.hu@intel.com<mailto:yong.hu@intel.com>>; Liu, Zhipeng <zhipeng.liu@intel.com<mailto:zhipeng.liu@intel.com>> Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com<mailto:sanjay.k.mukherjee@intel.com>>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com<mailto:gopalkrishna.bhat@intel.com>>; Kumar, Sharath <sharath.kumar@intel.com<mailto:sharath.kumar@intel.com>> Subject: RE: Openstack dashboard login. Horizon code should be OK since we build it on cengn with latest code every week. You can also compare the build log for the pass one and failure one, to see if any difference for the dependent package version used for building image. Below one is from cengn. http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/latest_docke... compare with your failure log you built locally. Especially for RBAC, neutron related packages. Zhipeng From: Kalvala, Haridhar <haridhar.kalvala@intel.com<mailto:haridhar.kalvala@intel.com>> Sent: 2020年11月25日 12:14 To: Liu, ZhipengS <zhipengs.liu@intel.com<mailto:zhipengs.liu@intel.com>>; Sun, Austin <austin.sun@intel.com<mailto:austin.sun@intel.com>>; Hu, Yong <yong.hu@intel.com<mailto:yong.hu@intel.com>>; Liu, Zhipeng <zhipeng.liu@intel.com<mailto:zhipeng.liu@intel.com>> Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com<mailto:sanjay.k.mukherjee@intel.com>>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com<mailto:gopalkrishna.bhat@intel.com>>; Kumar, Sharath <sharath.kumar@intel.com<mailto:sharath.kumar@intel.com>> Subject: RE: Openstack dashboard login. Hi Zhipeng, Thank you. Yes nothing changed in horizon and is just build and included in openstack-application. W.r.t point -1 already retried On few times on different machine. I will check point-2. But is their anything that cause communication with neutron endpoint failure ? Thank you, Haridhar Kalvala From: Liu, ZhipengS <zhipengs.liu@intel.com<mailto:zhipengs.liu@intel.com>> Sent: Wednesday, November 25, 2020 8:42 AM To: Kalvala, Haridhar <haridhar.kalvala@intel.com<mailto:haridhar.kalvala@intel.com>>; Sun, Austin <austin.sun@intel.com<mailto:austin.sun@intel.com>>; Hu, Yong <yong.hu@intel.com<mailto:yong.hu@intel.com>>; Liu, Zhipeng <zhipeng.liu@intel.com<mailto:zhipeng.liu@intel.com>> Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com<mailto:sanjay.k.mukherjee@intel.com>>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com<mailto:gopalkrishna.bhat@intel.com>>; Kumar, Sharath <sharath.kumar@intel.com<mailto:sharath.kumar@intel.com>> Subject: RE: Openstack dashboard login. Hi Haridhar, It seems you did not change any code, also not related to your build script, no issue found. You just rebuild it locally, right? Error code from log is below. [ERROR] openstack_dashboard.dashboards.admin.rbac_policies.panel: Call to list enabled services failed. This is likely due to a problem communicating with the Neutron endpoint. RBAC Policies panel will not be displayed. I can give you 2 ideas that you can further check. 1. Remove openstack application, upload and apply again. 2. Compare the horizon code you build with the code without issue. Thanks! Zhipeng From: Kalvala, Haridhar <haridhar.kalvala@intel.com<mailto:haridhar.kalvala@intel.com>> Sent: 2020年11月24日 22:58 To: Sun, Austin <austin.sun@intel.com<mailto:austin.sun@intel.com>>; Hu, Yong <yong.hu@intel.com<mailto:yong.hu@intel.com>>; Liu, Zhipeng <zhipeng.liu@intel.com<mailto:zhipeng.liu@intel.com>>; Liu, ZhipengS <zhipengs.liu@intel.com<mailto:zhipengs.liu@intel.com>> Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com<mailto:sanjay.k.mukherjee@intel.com>>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com<mailto:gopalkrishna.bhat@intel.com>>; Kumar, Sharath <sharath.kumar@intel.com<mailto:sharath.kumar@intel.com>> Subject: Openstack dashboard login. Hi Austin & Yong, As discussed in distro meeting today, please find the details below and request for support. Working case: 1. I have build latest master code (Following internal wiki<https://wiki.ith.intel.com/display/StarlingX/Procedure+for+Layered+build+for+Starlingx> ) ISO and deployed on machine. 2. Pulled openstack application from location here<https://plxv1256.pdx.intel.com/index.php?main_page=reservation_my_clients&group_id=56476901>. 3. I am able to login into the openstack dashboard and starlingX dashboard. Non-Working case(Containerize horizon build): 1. Used same environment as above (ISO, deployed machine and stx-openstack application) 2. Build “stx-horizon locally”. Pushed it on to github, updated openstack-application (on top of working case tgz file) files “stx-openstack.yaml”, “checksum.md5” accordingly with location and md5 number. 3. Applied openstack application. 4. But not able to login into openstack-dashboard as admin. Whereas able to login into starlingX dashboard. 5. Error message invalid credentials. 6. Attached docker build file,stx-horizon build file, keystone logs and horizon logs. Stx-horizon build file (latest of master. Have attached too) : ./starlingx/workspace/localdisk/designer/intel/distro/cgcs-root/stx/upstream/openstack/python-horizon/centos/stx-horizon.stable_docker_image Note: I need to rename file_extension to txt because of outlook policy. I will raise launchpad issue and keep you updated with ID. Please let me know if any more information needed. Horizon log: [cid:image002.jpg@01D6C7CB.031E8A70] Thank you, Haridhar Kalvala