Yes Henry. Also #131/#133

And also when we migrate(as python3.6) fmclient, cgtsclient, distributed cloud etc… deployment fails because sysinv can’t find the modules in 2.7.

 

Thank you,

Haridhar Kalvala

 

From: Bailey, Henry Albert (Al) <Al.Bailey@windriver.com>
Sent: Tuesday, January 5, 2021 6:47 PM
To: Kalvala, Haridhar <haridhar.kalvala@intel.com>; starlingx-discuss@lists.starlingx.io; Wold, Saul <Saul.Wold@windriver.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Sun, Austin <austin.sun@intel.com>
Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com>; Kumar, Sharath <sharath.kumar@intel.com>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com>; Khalil, Ghada <Ghada.Khalil@windriver.com>; Wensley, Barton <Barton.Wensley@windriver.com>
Subject: Re: [Starlingx-discuss] Flock components python3 migration query on master.

 

Are you referring to the hard-coding in the spec file?

https://github.com/starlingx/config/blob/master/sysinv/sysinv/centos/sysinv.spec#L60

 

which gets used when its built

https://github.com/starlingx/config/blob/master/sysinv/sysinv/centos/sysinv.spec#L79

 

Al


From: Kalvala, Haridhar <haridhar.kalvala@intel.com>
Sent: Tuesday, January 5, 2021 2:49 AM
To: Bailey, Henry Albert (Al) <Al.Bailey@windriver.com>; starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io>; Wold, Saul <Saul.Wold@windriver.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Sun, Austin <austin.sun@intel.com>
Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com>; Kumar, Sharath <sharath.kumar@intel.com>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com>; Khalil, Ghada <Ghada.Khalil@windriver.com>; Kalvala, Haridhar <haridhar.kalvala@intel.com>; Wensley, Barton <Barton.Wensley@windriver.com>
Subject: RE: [Starlingx-discuss] Flock components python3 migration query on master.

 

[Please note this e-mail is from an EXTERNAL e-mail address]

Hello All,

 

In continuation to issue below, After migrating(as per below changing specs and cfg files) few flock components and built/pushed horizon container. But did not observe presence of migration components in python3.6 path of controller (/usr/lib/python3.6/site-packages….). So, I proceed with building all of packages and iso with changes.

Deployment of ISO failed because sysinv couldn’t find migrated flock components ( fmclient, cgtsclient etc) , since sysinv is built and search in python2.7 path while these components are migrated to python3.6. Any thoughts, on how to do and solve partial (few components which are also inter dependent)  migration to pyhton3.6 on master branch ?

 

Thank you,

Haridhar Kalvala

 

From: Kalvala, Haridhar <haridhar.kalvala@intel.com>
Sent: Tuesday, December 15, 2020 11:28 AM
To: Bailey, Henry Albert (Al) <Al.Bailey@windriver.com>; starlingx-discuss@lists.starlingx.io; Wensley, Barton <Barton.Wensley@windriver.com>; Wold, Saul <Saul.Wold@windriver.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Sun, Austin <austin.sun@intel.com>
Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com>; Kumar, Sharath <sharath.kumar@intel.com>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com>; Khalil, Ghada <Ghada.Khalil@windriver.com>
Subject: Re: [Starlingx-discuss] Flock components python3 migration query on master.
Importance: High

 

Hi Henry,

 

Thank you for response.

I tried the same approach(spec and setup configuration file changes) on master branch for few flock components related with fault containerization.

After changing few requires to python3, I observe below issues. Which I am not clear how to solve.

Below are the few more blocker we are facing:

  • Starlingx-dashboard :
    • can’t migrate python-pbr to python3-pbr.
    • Cephclient is throwing errors on trying to migrate to py3.
  • Fmclient  :
    • Nfv components migration is a issue.

 

So I am looking for some inputs here who have done it earlier.

 

 

Sample error log:

 

 

INFO: pip is looking at multiple versions of horizon to determine which version is compatible with other requirements. This could take a while.

INFO: pip is looking at multiple versions of distributedcloud-client to determine which version is compatible with other requirements. This could take a while.

INFO: pip is looking at multiple versions of coverage to determine which version is compatible with other requirements. This could take a while.

INFO: pip is looking at multiple versions of cgtsclient to determine which version is compatible with other requirements. This could take a while.

^[[91mERROR: Cannot install pylint==1.4.0, pylint==1.4.1, pylint==1.4.2, pylint==1.4.3, pylint==1.4.4 and pylint==1.4.5 because these package versions have conflicting dependencies.

^[[0m

The conflict is caused by:

    pylint 1.4.5 depends on logilab-common>=0.53.0

    pylint 1.4.4 depends on logilab-common>=0.53.0

    pylint 1.4.3 depends on logilab-common>=0.53.0

    pylint 1.4.2 depends on logilab-common>=0.53.0

    pylint 1.4.1 depends on logilab-common>=0.53.0

    pylint 1.4.0 depends on logilab-common>=0.53.0

 

To fix this you could try to:

1. loosen the range of package versions you've specified

2. remove package versions to allow pip attempt to solve the dependency conflict

 

^[[91mERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies

^[[0m^[[91mWARNING: You are using pip version 20.3.1; however, version 20.3.2 is available.

You should consider upgrading via the '/var/lib/openstack/bin/python -m pip install --upgrade pip' command.

^[[0mThe command '/bin/sh -c /opt/loci/scripts/install.sh' returned a non-zero code: 1

Command (docker) failed, attempt 1 of 1.

Max command attempts reached. Aborting...

 

Thank you,

Haridhar Kalvala

From: Bailey, Henry Albert (Al) <Al.Bailey@windriver.com>
Sent: Tuesday, December 15, 2020 4:25 AM
To: Kalvala, Haridhar <haridhar.kalvala@intel.com>; starlingx-discuss@lists.starlingx.io; Wensley, Barton <Barton.Wensley@windriver.com>; Wold, Saul <Saul.Wold@windriver.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Sun, Austin <austin.sun@intel.com>
Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com>; Kumar, Sharath <sharath.kumar@intel.com>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com>; Khalil, Ghada <Ghada.Khalil@windriver.com>
Subject: Re: [Starlingx-discuss] Flock components python3 migration query on master.

 

The containers typically install the python components they need using wheels

If the flock components are updated in their setup.cfg to be built universal wheels  (which are py2 and py3 compatible) then the wheels being generated from the spec should be able to be included.

That can be done in master, assuming the code  runs in both py2 and py3 without needing major changes.

Al

 


From: Kalvala, Haridhar <haridhar.kalvala@intel.com>
Sent: Monday, December 14, 2020 6:12 AM
To: starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io>; Wensley, Barton <Barton.Wensley@windriver.com>; Wold, Saul <Saul.Wold@windriver.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Sun, Austin <austin.sun@intel.com>
Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com>; Kumar, Sharath <sharath.kumar@intel.com>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com>; Khalil, Ghada <Ghada.Khalil@windriver.com>
Subject: Re: [Starlingx-discuss] Flock components python3 migration query on master.

 

[Please note this e-mail is from an EXTERNAL e-mail address]

Reminder for below request.

 

Thank You,

Haridhar Kalvala

 

From: Kalvala, Haridhar
Sent: Thursday, December 10, 2020 10:18 AM
To: starlingx-discuss@lists.starlingx.io; Wensley, Barton <Barton.Wensley@windriver.com>; Saul Wold <Saul.Wold@windriver.com>; Jones, Bruce E <bruce.e.jones@intel.com>; Sun, Austin <austin.sun@intel.com>
Cc: Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com>; Kumar, Sharath <sharath.kumar@intel.com>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com>; Khalil, Ghada <Ghada.Khalil@windriver.com>
Subject: Flock components python3 migration query on master.

 

Hello All,

 

We are working on FM containerization (FM panel in open stack dashboard and backend pod service(fault)).

As part  of this activity, we are doing stx-horizon docker build. Which will include components from flock (for fm calls). As a reference example, please refer to this patch.

The  front panel would be calling flock components fmclient, cgtsclient, distributedcloud etc.

These components are python2 build.  For FM panel to work we need migration of these components (seeing lot of dependency issues) from python2 to python3 on master branch.

 

Yesterday(9-Dec-2020) in non-openstack distro meeting, the discussion was flock python2 dependent components cannot  be migrated in master branch and will done in centos8 migration branch/stream.

 

So, I request for clarity/decision from community on this blocker for FM containerization.

 

Earlier in stx-3.0(stein’s openstack) as in above link, these component were part of stx-horizon docker build. But these were removed(as per patch below) as part of stx-4.0 migration (stein àtrain à Ussuri), as latest openstack only supports python3.

 

Patch details:

commit b8b897a028cda3936f17c5ac6b73af146c5de96b (tag: v4.0.0.rc0)

Author: yuchengde <yu.chengde@99cloud.net>

Depends-on: https://review.opendev.org/#/c/731461/

Change-Id: I415ea75eb24d8b1c3151b63efd2e82075e68f26e

Signed-off-by: Yu Chengde yu.chengde@99cloud.com

 

 

Thank you,

Haridhar Kalvala