[Starlingx-discuss] [starlingx-discuss][devstack/deploy]How to deploy starlingx in a ready centos system?

Wed Jul 31 16:03:04 UTC 2019

Hi everyone

Sorry for the delay. Kunpeng I will try to show you what we did for
multi os time ago for our Debian base experiment porting and what we
discuss on Monday morning multi os meeting (you are more than welcome
to join this meeting where we can discuss all this kind of topics)

>From the journey we have had, trying to port starling X to a different
OS than the one provided by CENGN are, this is my feedback:

1)  If you grab the RPMs from the CENGN and try to install on a
vanilla CentOS it might face some runtime dependencies due to
different versions of the libraries that starling x is using. is
necessary to fix all these installation problems. However, is worth to
try first to install all the flock services

2) Hopefully, there will be no need to rebuild, since we are using
CentOS 7.6 as a base, however as I mentioned before, Starting X uses
some specific versions of the libraries (the reason why to use that
specific version of the library is not clear to me yet, but the build
system is configured that way) and it might be necessary to rebuild
them. I was working on fixing missing build requirements a few months
ago, in order to have all the build req complete and being able to
build using plain mock.

4) When running the services you will realize they don't use systemd
as standard, however, is possible to as long as all the runtime
requirements are fulfilled.

5) As mentioned before, the kernel has many patches that are applied
on the top of the SRPM. After an analysis that Mario Carrillo, Saul,
and Abraham did months ago it was possible to reduce the patches to
only 5 when we port to Debian kernel LTS (4.15). These ones are
documented on the https://github.com/starlingx-staging/stx-packaging
repository:

0001-StarlingX-Death-of-Arbitrary-Process-Notification.patch
0002-StarlingX-Kernel-Threads-Compute-CPU-Affinity.patch
0003-StarlingX-Kernel-Threads-Workqueues-IRQs.patch
0004-StarlingX-Kernel-Threads-iSCSI.patch

( the other patches are for performance or are already applied on the
LTS 4.15 kernel )

After having the kernel and flock services compiled and installed on
the vanilla CentOS, is necessary to install the starling X version of
other components of the OS such as bash and systemd, packages that
have patches for starling X

After that, we would be able to start to test that each flock service
works as expected. We are working on the development of white-box
tests for the flock services, but in the meantime, we are learning of
the intrinsics of the code to understand what to test.

It has been a long journey to arrive here, but we hope that our
findings could help you.

In the multi os team, we keep working to make this possible, we are
short of hands but if you are interested to join we would be more than
welcome.

Regards

Victor Rodriguez

On Wed, Jul 31, 2019 at 5:32 AM Xie, Cindy <cindy.xie at intel.com> wrote:
>
> Kernel-rt: real time Linux kernel;
> Kernel-std: standard kernel.
>
> -----Original Message-----
> From: 张鲲鹏 [mailto:zhang.kunpeng at 99cloud.net]
> Sent: Wednesday, July 31, 2019 5:19 PM
> To: Lin, Shuicheng <shuicheng.lin at intel.com>
> Cc: Chen, Yan <yan.chen at intel.com>; Xie, Cindy <cindy.xie at intel.com>; Victor Rodriguez <vm.rod25 at gmail.com>; starlingx-discuss at lists.starlingx.io
> Subject: Re: [Starlingx-discuss] [starlingx-discuss][devstack/deploy]How to deploy starlingx in a ready centos system?
>
> Emmmmmmm, I think it’s hard for me to study these so many kernel patches.
> By the way, I have a naive question that what are the meanings of "kernel-rt" and "kernel-std”.
>
> Thanks
> Kunpeng
>
> > On Jul 31, 2019, at 14:32, Lin, Shuicheng <shuicheng.lin at intel.com> wrote:
> >
> > Hi Kunpeng,
> > You could find kernel patches in below link. Most of them are performance/bug related.
> > https://opendev.org/starlingx/integ/src/branch/master/kernel/kernel-st
> > d/centos/patches Sorry, but I don’t have data which flock services
> > will be affected by it.
> >
> >
> > Best Regards
> > Shuicheng
> >
> >
> > -----Original Message-----
> > From: 张鲲鹏 [mailto:zhang.kunpeng at 99cloud.net]
> > Sent: Wednesday, July 31, 2019 11:44 AM
> > To: Lin, Shuicheng <shuicheng.lin at intel.com>; Chen, Yan
> > <yan.chen at intel.com>; Xie, Cindy <cindy.xie at intel.com>; Victor
> > Rodriguez <vm.rod25 at gmail.com>
> > Cc: starlingx-discuss at lists.starlingx.io
> > Subject: Re: [Starlingx-discuss] [starlingx-discuss][devstack/deploy]How to deploy starlingx in a ready centos system?
> >
> > What are the differences between StarlingX kernel and standard CentOS kernel? On the other hand, which flock services are affected?
> > I mean, is the StarlingX complete if those based services(eg,docker/libvirt/ceph) and flock services(eg, fm) are installed and launched, and the risk is that the flock services cannot be launched well in standard kernel?
> >
> > Thanks
> > Kunpeng
> >
> >> On Jul 31, 2019, at 10:21, Lin, Shuicheng <shuicheng.lin at intel.com> wrote:
> >>
> >> My concern is that, the CentOS kernel used in StarlingX is customized, it is not the same as the CentOS.
> >> So some feature/component may not work with a standard CentOS system.
> >>
> >> Best Regards
> >> Shuicheng
> >>
> >> -----Original Message-----
> >> From: Chen, Yan [mailto:yan.chen at intel.com]
> >> Sent: Wednesday, July 31, 2019 9:39 AM
> >> To: Xie, Cindy <cindy.xie at intel.com>; 张鲲鹏
> >> <zhang.kunpeng at 99cloud.net>; Victor Rodriguez <vm.rod25 at gmail.com>
> >> Cc: starlingx-discuss at lists.starlingx.io
> >> Subject: Re: [Starlingx-discuss] [starlingx-discuss][devstack/deploy]How to deploy starlingx in a ready centos system?
> >>
> >> No, I think a ready CentOS means a standard CentOS system, which is not installed from StarlingX ISO.
> >> We didn’t try to install StarlingX on such a system.
> >>
> >>
> >> Yan
> >>
> >> -----Original Message-----
> >> From: Xie, Cindy
> >> Sent: Tuesday, July 30, 2019 20:52
> >> To: 张鲲鹏 <zhang.kunpeng at 99cloud.net>; Victor Rodriguez
> >> <vm.rod25 at gmail.com>; Chen, Yan <yan.chen at intel.com>
> >> Cc: starlingx-discuss at lists.starlingx.io
> >> Subject: RE: [Starlingx-discuss] [starlingx-discuss][devstack/deploy]How to deploy starlingx in a ready centos system?
> >>
> >> I think it's doable. @Yan, did you ever try to run the provision scripts on a ready CentOS bare-metal?
> >>
> >> Thx. - cindy
> >>
> >> -----Original Message-----
> >> From: 张鲲鹏 [mailto:zhang.kunpeng at 99cloud.net]
> >> Sent: Tuesday, July 30, 2019 6:10 PM
> >> To: Victor Rodriguez <vm.rod25 at gmail.com>
> >> Cc: starlingx-discuss at lists.starlingx.io
> >> Subject: Re: [Starlingx-discuss] [starlingx-discuss][devstack/deploy]How to deploy starlingx in a ready centos system?
> >>
> >> Hi Victor,
> >>
> >> I haven’t started yet, because I don’t know how to do it. I'm glad you are performing this experiments, could you share your experience or documents? You know, booting from iso isn’t a well deployment in some cases.
> >> Recently, I studied the kickstart configs in bootimage.iso, and my idea is to operate the ready system according to the ks.cfg, but I’m not sure if it’s a right way.
> >>
> >> Thanks
> >> Kunpeng
> >>
> >>> On Jul 29, 2019, at 20:13, Victor Rodriguez <vm.rod25 at gmail.com> wrote:
> >>>
> >>> Hi Kunpeng
> >>>
> >>> In the MultiOS subproject, we are performing such experiments, at
> >>> the moment with Open SUSE. We are facing some technical problems
> >>> with the runtime dependencies and the way the services start. Can
> >>> you please describe the steps you are following and what kind of
> >>> specific problems do you have?
> >>>
> >>> Thanks
> >>>
> >>> Victor Rodriguez
> >>>
> >>>
> >>> On Mon, Jul 29, 2019 at 1:48 AM 张鲲鹏 <zhang.kunpeng at 99cloud.net> wrote:
> >>>>
> >>>> Hi all,
> >>>>
> >>>> Are there anyone to try install StarlingX in a ready centos system or others systems? It looks like to deploy devstack.
> >>>>
> >>>> Thanks
> >>>> Kunpeng
> >>>> _______________________________________________
> >>>> Starlingx-discuss mailing list
> >>>> Starlingx-discuss at lists.starlingx.io
> >>>> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discus
> >>>> s
> >>>
> >>> _______________________________________________
> >>> Starlingx-discuss mailing list
> >>> Starlingx-discuss at lists.starlingx.io
> >>> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
> >>
> >>
> >> _______________________________________________
> >> Starlingx-discuss mailing list
> >> Starlingx-discuss at lists.starlingx.io
> >> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
> >> _______________________________________________
> >> Starlingx-discuss mailing list
> >> Starlingx-discuss at lists.starlingx.io
> >> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
> >> _______________________________________________
> >> Starlingx-discuss mailing list
> >> Starlingx-discuss at lists.starlingx.io
> >> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
> >
> > _______________________________________________
> > Starlingx-discuss mailing list
> > Starlingx-discuss at lists.starlingx.io
> > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
>