Testing MobileFirst applications with IBM MobileFirst Platform Test Workbench

improve this page | report issue

Overview

IBM MobileFirst Platform Test Workbench provides several unique resources to test MobileFirst applications.

  • With the test workbench, you can create functional tests hybrid and native applications that run on iOS 7.x or Android
  • The test workbench creates tests in a natural language, and provides visual test editing
  • The test workbench runs within Eclipse, and is integrated with MobileFirst Studio

The testing approach with the test workbench consists of four stages:

  • Recording: You first play your test with the recording-ready app, and generate a test script
  • Authoring: You edit and enhance the test script by adding verification points and others instructions
  • Playback: You run the test script on a real device or a simulator
  • Reporting: You generate an HTML report

Jump to:

Installing and configuring

To use the IBM Mobile Test Workbench, you must install an Eclipse plug-in into an existing instance of MobileFirst Studio.

In MobileFirst Studio, go to Help > Eclipse Marketplace, and search for "mobilefirst".
When you locate the IBM Mobile Test Workbench, click on Install.

Note: New installations of IBM Mobile Test Workbench require the latest version of MobileFirst Studio.

After the Mobile Test Workbench plug-in is installed, you can see that a new Test Workbench perspective is available in Eclipse:

missing_alt

If you do not see the perspective button above, select Window > Open Perspective > Other... and choose Test Workbench.

Also, note the following icons in the Eclipse toolbar:

missing_alt

  • The left icon, opens the Mobile Applications view. This view lists all the applications that are available for testing
  • The right icon, opens the Mobile Devices view. This view lists the devices that you use to test your application

The Mobile Client

With the mobile client application, you can record tests, run test playbacks and view reports on the mobile device.
The mobile application must be installed on a real device or on a simulator/emulator.

The mobile client communicates with the test workbench to install applications, store test scripts and to test results. Important to note the Workbench URL in the Mobile Devices view:

missing_alt

Installing the Android mobile client

To install the mobile client on an Android device or a Emulator:

  • Use the QR code that is available in the Mobile Devices view to open an installation page on the device.
  • On the device, the QR code opens a page that displays installation instructions.

missing_alt

Follow the instructions to download and install the mobile application on your Android device.
missing_alt

When the IBM Rational Test Workbench application is installed on your device, start the application.

  • Configure the address of the test workbench in the Workbench settings section. The URL is the same as the URL of the page opened by the QR code, without /mobile at the end. The URL has the following structure: http://host-ipaddress:7878

    missing_alt

Press the device's Back button. If the connection is correctly established, you can see the connection icon at the bottom of the screen.

missing_alt

Installing the iOS mobile client

missing_alt
On iOS, the mobile client is a web application that runs in the Safari or Chrome browser on your device.

To run the client, type the Workbench URL in the following format, in a browser on your device: http://Workbench_URL:port/mobile.

When using the mobile test client on an iOS device, make sure to enable pop-up windows. Pop-up windows must be allowed for the
Workbench IP address. Safari silently disables pop-up windows and Google Chrome prompts you to allow pop-up windows. To change this setting for Safari, navigate to Settings.app > Safari and disable the option to Block Pop-ups.

Creating a test project

To start testing an IBM MobileFirst application, you must create a test project.

There are 2 paths to create a test project:

  1. After creating the MobileFirst application, and before clicking on Finish, select to create a test project from the IBM Mobile Test Workbench section:

    missing_alt

  2. You can also go to File > New > Test Workbench Project to create a test project.

    missing_alt

    Preparing an application for testing

    Before you can test a MobileFirst hybrid application, you must make sure that:

    • You performed a build and deployment action on your project by right-clicking the project name, and clicking Run As > Run on MobileFirst Development Server, in order to ensure the native project is built and the application is deployed to the server
    • If building for iOS in order to test on a physical device, make sure the appropriate certificate is specified in Xcode
    • Right-click the Android, iPhone, or iPad environment in your IBM MobileFirst application, and click Run As > Test with IBM Mobile Test Workbench

      missing_alt

    • You can now see the test-ready application in the Mobile Applications view in the test workbench (and in the mobile client as well):

      missing_alt

    • The state of the application must be set to Available in the Mobile Applications view before you can start recording a test.

    Creating a test

    Android

    To start recording a test on the Android client: select the application in the list of managed apps, and click Record in the mobile client on the device.

    iOS

    To start recording a test on the iOS web client: select the application in the list of managed apps, install the app on the device by clicking Install. When the installation is complete, click Record.

    If you are using an iOS 7.1 or higher, it is not possible to click the install button.
    Instead, the application can be installed from the Mobile Devices view:

    missing_alt

    missing_alt

    Everything that you do with the application is recorded and sent to the test workbench. For example, the script records the moment when you press a button, or enter text in an entry field.

    To stop recording, close the application by clicking Home (iOS) or Back (Android).

    A message that reports the availability of a new recording is displayed on the test workbench.

    missing_alt

    Follow the wizard instructions to generate a test from the recording. You are then asked to store the test in the test project.
    For more information about how to create a test, see the Rational Test Workbench Mobile Test Edition user documentation.

    Editing a test

    After the recording, you can edit the test in the natural language editor.

    missing_alt

    You can edit the test to insert verification points (for example, to verify the value of a user interface element), to replace recorded test values with variable test data, or to add dynamic data to the test.

    missing_alt

    For more information about how to edit the test script, see the Rational Test Workbench Mobile Test Edition user documentation.

    Running a test

    missing_alt

    Run a test to ensure that the app matches the expected behavior that is defined in the verification points.
    During the test, each verification point is checked, and receives a pass, fail or inconclusive status.

    The available tests are visible in the mobile client, and you can run the test from this application.

    For more information

    For more information about IBM MobileFirst Platform functional testing and the IBM Mobile Test Workbench, see this user documentation topic.

Last modified on December 02, 2015