<div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-size:small">I added some points/questions inline. <br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Mar 28, 2019 at 6:02 PM Arce Moreno, Abraham <<a href="mailto:abraham.arce.moreno@intel.com">abraham.arce.moreno@intel.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US">
<div class="gmail-m_4444689907214800038WordSection1">
<p class="MsoNormal">Hi StarlingX Community,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">We need your advice to determine the most appropriate way to migrate an existing demo deployed via containers to StarlingX infrastructure with cloud features in mind (e.g. zero touch provisioning).<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">We are integrating this demo in our spare time to ramp up in cloud technologies and one of its imperatives is a working solution. It started as a use case proposal around unmanned aerial systems [0], then decided to avoid some of the complexity
involved in flying the drones, and finally landed it as a use case around home automation / smart cities at the network edge.</p></div></div></blockquote><div><br></div><div><div style="font-size:small" class="gmail_default">First off, I'd like to let people know that we are planning on doing some kind of "edge" proof-of-concept with Packet.com resources, so perhaps the project you discuss could fit in with that. I'm sure we'll chat about it at some point here. <br></div></div><div> </div><div><div style="font-size:small" class="gmail_default">At the next TSC meeting we'll discuss how to get the packet projects off the ground, so feel free to attend. :)</div></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-US"><div class="gmail-m_4444689907214800038WordSection1"><p class="MsoNormal"><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Three key aspects for you to consider:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">- Edge computing foundation is all about “things” interchanging “data” with “servers”, same foundation when both use case proposals were envisioned.<u></u><u></u></p>
<p class="MsoNormal">- ”Data” will include “video streaming” pipelines, considered in both use case proposals.<u></u><u></u></p>
<p class="MsoNormal">- “Video streaming” pipelines will serve as an input to “machine learning / deep learning” services offloaded to different hardware (CPU, GPU, VPU, FPGA) also considered in both use case proposal, which gives an interesting workload to
showcase some of the StarlingX characteristics: reliability, scalability and ultra-low latency.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">[ General Architecture ]<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">The high level architecture [2] is compromised of the following components (naming still under review):<u></u><u></u></p>
<p class="MsoNormal">- Core Applications<u></u><u></u></p>
<p class="MsoNormal">- Services<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">[ Core Applications ]<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Core Applications [3] give the foundation of the demo, the following have been integrated:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">- Home Assistant: Open Source Home Automation<u></u><u></u></p>
<p class="MsoNormal">- InfluxDB: Time Seria Database Platform<u></u><u></u></p>
<p class="MsoNormal">- Grafana: Data Visualization and Monitoring<u></u><u></u></p>
<p class="MsoNormal">- Mosquitto: MQTT Message Broker<u></u><u></u></p>
<p class="MsoNormal">- Glances: System Monitoring Tool<u></u><u></u></p>
<p class="MsoNormal">- Portainer: Docker Environment Manager<u></u><u></u></p>
<p class="MsoNormal">- Node-RED: Programming Tool for Hardware Devices<u></u><u></u></p>
<p class="MsoNormal">- Netdata: Systems and Applications Monitoring<u></u><u></u></p>
<p class="MsoNormal">- Plex: Media Server<u></u><u></u></p>
<p class="MsoNormal">- motionEye: Video Signal Monitoring<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">[ Services ]<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Services [4] are designed to perform a specific function in a specific device for a specific period of time (on demand) and will work with other micro services to form higher-level decisions, from a machine learning ‘bot’ service that use
time-series data from the different sensors for simple control and personalization to a deep learning computer vision service that use existing network video recorder streams for video surveillance and video analytics.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">This demo has currently integrated samples of computer vision applications with the following services:<u></u><u></u></p>
<p class="MsoNormal"> - OpenCV (Computer Vision)<u></u><u></u></p>
<p class="MsoNormal"> - Haar Cascades<u></u><u></u></p>
<p class="MsoNormal"> - OpenVINO (Computer Vision)<u></u><u></u></p>
<p class="MsoNormal"> - Gstreamer (Video Stream)<u></u><u></u></p>
<p class="MsoNormal"> - Mjpeg- Streamer (Video Stream)<u></u><u></u></p>
<p class="MsoNormal"> - You Only Look Once (Object Detection)<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">This demo has currently integrated the following acceleration resources:<u></u><u></u></p>
<p class="MsoNormal">- GPU<u></u><u></u></p>
<p class="MsoNormal">- VPU (<span class="gmail_default" style="font-size:small"></span><span class="gmail_default" style="font-size:small"></span>Movidius NCS)</p></div></div></blockquote><div><br></div><div><div style="font-size:small" class="gmail_default">I would not expect a USB device like the <span class="gmail_default" style="font-size:small"></span><span class="gmail_default" style="font-size:small"></span>Movidius NCS to be available in most STX deployments, but maybe?</div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-US"><div class="gmail-m_4444689907214800038WordSection1"><p class="MsoNormal"><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Once demo has a solid foundation and stability with these first services, the following components are next to be integrated:<u></u><u></u></p>
<p class="MsoNormal">- FPGA<u></u><u></u></p>
<p class="MsoNormal">- Intel Accelerated Stack<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">[ StarlingX Deployment ] [ Offload ]<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">What would be the preferred way to deploy this use case proposal in StarlingX? We understand the following options are available including its preference:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">1. Via Kubernetes (Not Preferred)<u></u><u></u></p>
<p class="MsoNormal">2. Via Virtual Machine (Preferred)<u></u><u></u></p>
<p class="MsoNormal">3. Via Bare Metal (Preferred)<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Are the above options and their preference, correct? If not, can you please give us some hints behind your answer.</p></div></div></blockquote><div><br></div><div><div style="font-size:small" class="gmail_default">From my standpoint, I think #3 would be the least common option. #2 would be a good place to start, but I don't think #1 is "not preferred", I guess it depends on where these preferences are coming from.</div></div><div style="font-size:small" class="gmail_default"></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-US"><div class="gmail-m_4444689907214800038WordSection1"><p class="MsoNormal"><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">[ StarlingX Deployment ] [ Provisioning ]<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">As mentioned at the beginning, another of our imperatives, is to exercise zero touch provisioning.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Does it makes sense to split the provisioning in 2 parts based in the required time for the demo components to live?<u></u><u></u></p>
<p class="MsoNormal"> - The core applications 100% uptime<u></u><u></u></p>
<p class="MsoNormal"> - Services on demand / 100 uptime in some cases</p></div></div></blockquote><div><br></div><div><div style="font-size:small" class="gmail_default">By zero touch provisioning do you just mean automation using IaaS APIs? eg. the docker compose file you link to? Or something else?<br></div></div><div><div style="font-size:small" class="gmail_default"></div><div style="font-size:small" class="gmail_default">Thanks,</div><div style="font-size:small" class="gmail_default">Curtis</div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-US"><div class="gmail-m_4444689907214800038WordSection1"><p class="MsoNormal"><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Is there any other cloud feature we would want consider, to take a look and use for this first version of the demo?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">[ StarlingX Deployment ] [ Provisioning ] [ Core Applications ]<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Would it make sense to create a cloud image with the core applications integrated? If not, what would be your best approach for the core applications? <br></p></div></div></blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-US"><div class="gmail-m_4444689907214800038WordSection1"><p class="MsoNormal"><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">[ StarlingX Deployment ] [ Provisioning ] [ Services ]<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Since Services will be on demand, there might be some options:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="gmail-m_4444689907214800038MsoListParagraph"><u></u><span>-<span style="font:7pt "Times New Roman"">
</span></span><u></u>Service running in containers under a virtual machine / bare metal<u></u><u></u></p>
<p class="gmail-m_4444689907214800038MsoListParagraph"><u></u><span>-<span style="font:7pt "Times New Roman"">
</span></span><u></u>Services running in single virtual machines<u></u><u></u></p>
<p class="gmail-m_4444689907214800038MsoListParagraph"><u></u><span>-<span style="font:7pt "Times New Roman"">
</span></span><u></u>Any other?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">This part is the most important for the demo since user experience might be affected (e.g. time taken for the system to start a face recognition service under camera one)<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">[ Thanks ]<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">We appreciate your time to read this email and your support so we can understand the best provisioning architecture for the use case proposal / demo. One of the additional things we are working on is a workshop taking this learning with
the final objective to deploy in StarlingX in community events, still in an early development phase [5].<u></u><u></u></p>
<p class="MsoNormal">
<u></u><u></u></p>
<p class="MsoNormal">[0] <a href="https://wiki.openstack.org/wiki/Edge_Computing_Group/Use_Cases#Unmanned_Aircraft_Systems_.28Drones.29" target="_blank">
https://wiki.openstack.org/wiki/Edge_Computing_Group/Use_Cases#Unmanned_Aircraft_Systems_.28Drones.29</a><u></u><u></u></p>
<p class="MsoNormal">[1] <a href="https://wiki.openstack.org/wiki/Edge_Computing_Group/Use_Cases#Smart_Home" target="_blank">
https://wiki.openstack.org/wiki/Edge_Computing_Group/Use_Cases#Smart_Home</a><u></u><u></u></p>
<p class="MsoNormal">[2] <a href="https://github.com/bacabhome/bacabhome" target="_blank">https://github.com/bacabhome/bacabhome</a><u></u><u></u></p>
<p class="MsoNormal">[3] <a href="https://github.com/bacabhome/bacabhome/blob/master/docker-compose.yml" target="_blank">
https://github.com/bacabhome/bacabhome/blob/master/docker-compose.yml</a><u></u><u></u></p>
<p class="MsoNormal">[4] <a href="https://github.com/bacabhome/bacabhome/tree/master/services" target="_blank">
https://github.com/bacabhome/bacabhome/tree/master/services</a><u></u><u></u></p>
<p class="MsoNormal">[5] <a href="http://bit.ly/SmartHomeSolution" target="_blank">http://bit.ly/SmartHomeSolution</a><u></u><u></u></p>
</div>
</div>
_______________________________________________<br>
Starlingx-discuss mailing list<br>
<a href="mailto:Starlingx-discuss@lists.starlingx.io" target="_blank">Starlingx-discuss@lists.starlingx.io</a><br>
<a href="http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss" rel="noreferrer" target="_blank">http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss</a><br>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature">Blog: <a href="http://serverascode.com" target="_blank">serverascode.com</a></div></div>