Overview

QAFramework is an OpenMRS’ behaviour driven development (BDD) quality assurance framework. 

BDD brings technical(developers, QA) together with business(non-technical, Business analysts) people to foster collaboration and ease problem-solving.

QAFramework uses cucumber for its  BDD test case descriptions;

BDD largely uses a simple domain-specific natural language (DSL) to represent the test cases cucumber specifically uses Gherkin for this.

Video Tutorial

In addition to the clear guidance below, you can see this recording for a tutorial we hosted on setting up Selenium tests for the Reference Application: 

https://iu.mediaspace.kaltura.com/media/Design+Meeting/1_dh12nkr0?st=321

GitHub repo from example in Tutorial: https://github.com/openmrs/openmrs-contrib-qaframework/pull/9

Setup

Install java8, git and maven

QAFramework depends on UITestFramework and Reference application distro to support Reference application distribution out of the box quality assurance.

Compile the Reference application distribution (Optional)

This is the default OpenMRS community-supported distribution, it should be pulled by default while compiling the QAFramework, but in-case this doesn’t happen, please clone and compile it separately.

Compile UITestFramework

This is the Reference application distribution’s user interface test framework, it uses selenium for its webdriver.

Clone and compile its bdd branch

Run QAFramework

To change the default runtime settings. Please edit src/test/resources/org/openmrs/uitestframework/test.properties

Properties explanation;

webapp.url=https://qa-refapp.openmrs.org/openmrs [openmrs instance URL]

login.username=admin [Above OpenMRS instance username]

login.password=Admin123 [Above OpenMRS instance password]

login.location=Pharmacy [Above OpenMRS instance login location]

webdriver=chrome [Browser instance; chrome/firefox]

login.auto=false [Auto login or not on each scenario; true/false]

headless=true [Launch browser in the background without UI; true/false]

webdriver.gecko.driver=firefoxdriver/mac/geckodriver

To Run UI tests

In order to test within a physical web browser, you will need a webdriver to connect to your browser either firefox or chrome, the webdriver.

1. First set  webdriver=chrome [chrome/firefox]
2. Then disable running the tests in a headless browser headless=false
3. Then download the corresponding webdriver version that matches your system and browser version;
• Chrome
• Firefox
• Others
4. Move your downloaded browser webdriver into the right locations as follows
• Chrome:  src/main/resources/chromedriver/<linux/mac>/chromedriver or src/main/resources/chromedriver/windows/chromedriver.exe
• Firefox: Set the location for the geckodriver (should be within the test resources directory) within the properties file

  • webdriver.gecko.driver=firefoxdriver/mac/geckodriver

5. Then Run ui tests again: mvn clean test

Infrastructure

Collaboratively, business analysts translate requirements into test cases and define from them features, scenarios, steps written in a Behavior Driven Development (BDD) approach through a human readable language; Gherkin, this is made easier graphically through cucumber studio.

Exporting the project from cucumber studio for automation avails a feature file with the human readable test case which file can be written from any texteditor and which is imported into the automation library (qaframework) and an automation layer (with step descriptions) is written by a test engineer or developer through a preferred automation framework such as selenium (for the reference application), cypress (OCL) etc.

Running the QA framework locally or in Bamboo CI runs the automated test suite;
- this will read test.properties and launch RunTest.java(junit with cucumber runner) with the loaded configurations which reads all feature files tagged @run and locates each respective step description from mapped (glued) automation package,
- automation steps launch the automation framework (e.g selenium/cypress) by scenario and each scenarios by step order, steps load pages (some are from uitestframework/distribution/qaframework) and return results to the build through its web driver
- the build posts test results to reports.cucumber.io if configured to in cucumber.properties which happens by default within bamboo CI
- Bamboo CI is also configured to post results back into cucumber studio and a result green/red label (build status) is displayed on qaframework basing on CI build result.

Samples on automation

Simple Styles guide

• feature file
• page
• steps definition

Conditions feature

• feature file
• condition page
• manage conditions page
• steps definition