Mobile Testing with ConfidenceAmy Phillips

@itjustbroke

• Fragmentation

• Reduced control over versions being used

• Release process can be slow

• Less control over environment (settings, other apps, etc)

Confidenceˈkɒnfɪd(ə)ns/

Belief in oneself and one’s powers or abilities

• Fragmentation

• Fragmentation

Releases can be slow

Reduced Control

• Releases

• Environment

PANIC!!!

DON’T PANIC!!!

What is Testing?An empirical, technical, investigation conducted to provide stakeholders with information about the quality of the product or service under test.

- James Bach

What is Quality?

“value to some person who matters”

- Michael Bolton

What Makes A Tester?

What Are We Trying To Do?

• Have we built the right thing?

• Have we broken stuff that used to work?

• Have we introduced unintended behaviour?

Test Approach

Don’t Test

Develop

Test At The End

Develop TestBug Fix

Develop TestBug Fix

Test As We Go

Develop Test

Choose The Right Approach

• The right approach is the one that works for you

• It might change over time

• Do what’s right for your users

What To Test?

Features• Do they look right? • Do they work correctly?

Memory Usage

• Download size

• Runtime size

• Memory management

Crashes

Battery Usage

Performance

Security

Settings

Time

Orientation

Connectivity• 4G

• 3G

• WIFI

• GPRS

• No Service

Accessibility

Uninstalling

• Remove all data

• Leave device in state that allows re-install

Automation

Plan Your Testing

• Pick and choose test areas

• Focus on risk

• Monitor coverage

Where To Test?

Test Device or Emulator?

Test Environment

Test Environment

Live Environment

Test Environment

Engage Users

Mobile Testing• Plan your testing in advance

• Focus on risk

• Learn from your mistakes

• Make it easy for the user to recover from problems

Questions?Amy Phillips@itjustbroke