[Starlingx-discuss] [ Test ][ discussion ] Unified test framework

[Waheed, Numan]

http://reportportal.io/


-----Original Message-----
From: Young, Ken 
Sent: January-02-19 9:18 AM
To: Waheed, Numan <Numan.Waheed at windriver.com>; Zvonar, Bill <Bill.Zvonar at windriver.com>; Cabrales, Ada <ada.cabrales at intel.com>; 'starlingx-discuss at lists.starlingx.io' <starlingx-discuss at lists.starlingx.io>
Subject: Re: [Starlingx-discuss] [ Test ][ discussion ] Unified test framework

Numan,

Do you have a pointer to the report portal?  I am interested in the dashboard.

Thanks!

/KenY

On 2018-12-31, 9:28 AM, "Waheed, Numan" <Numan.Waheed at windriver.com> wrote:

    Yes. That is one possibility. As far as our investigation goes, reportportal.io dashboard has the capability to integrate with both PyTest and RobotFW.
    
    Thanks,
    
    Numan.
    
    -----Original Message-----
    From: Zvonar, Bill 
    Sent: December-28-18 3:25 PM
    To: Cabrales, Ada <ada.cabrales at intel.com>; Waheed, Numan <Numan.Waheed at windriver.com>; 'starlingx-discuss at lists.starlingx.io' <starlingx-discuss at lists.starlingx.io>
    Subject: RE: [ Test ][ discussion ] Unified test framework
    
    Hi Ada/Numan - apologies if this was discussed & I don't recall - is it an option for us to carry on with both (as long as they can both feed up into the same dashboard)?
    
    -----Original Message-----
    From: Cabrales, Ada <ada.cabrales at intel.com> 
    Sent: Friday, December 21, 2018 5:59 PM
    To: 'starlingx-discuss at lists.starlingx.io' <starlingx-discuss at lists.starlingx.io>
    Subject: [Starlingx-discuss] [ Test ][ discussion ] Unified test framework
    
    Hello,
    
       We currently have 2 testing frameworks proposed:
    
        - Robot [0]
    	- Sanity check at Intel's premises is done using it
    	- Deployment on virtual environment, and running the tests is automated.
    	- ~200 tests automated so far.
    	
        - PyTest [1]
    	- used by Wind River for their testing
    	- A big amount of test cases automated (Numan, can you provide a number?)
    
    Both frameworks are similar, there must be some re-work required on one of the sides to align with the chosen one.
    What I would like to have, is an informed decision, bringing the best impact to the project and thinking about the future, not only the current picture.  
    
    Even knowing these days are going to be quiet, I want to continue the conversation: which one best serves StarlingX? 
    
    Regards
    Ada
    
    [0] http://robotframework.org/
    [1] https://docs.pytest.org/en/latest/
    
    
    _______________________________________________
    Starlingx-discuss mailing list
    Starlingx-discuss at lists.starlingx.io
    http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
    _______________________________________________
    Starlingx-discuss mailing list
    Starlingx-discuss at lists.starlingx.io
    http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss