质量管理方案总览主题演讲质量管理方案总览主题演讲质量管理方案总览主题演讲质量管理方案总览主题演讲

Software Quality Optimization

Agenda

• Setting the stage

– Business expectations exceed I/T’s ability to deliver

ROI

• Executive summary & the Jazz vision

• The Rational Quality Management Portfolio

• What customers are saying

• A look ahead – Cloud computing

Business expectations exceed I/T’s ability to deliver expected

ROI from traditional software delivery methods

“Business leaders and CIOs are under pressure to enable their teams to become catalysts for change. However, change is outpacing their ability to deliver.

They are reorienting their teams to focus on ROI and quantified business outcomes and to mitigate risk and reduce costs.”

– IBM CIO Survey, 2008

Growing focuson business outcomes

“Only 22% of executives felt that their IT and business strategy were tightly integrated”

“49% of budgets suffer overruns and 62% fail to meet their scheduled”

“34% of software projects are deemed successful costing $300B annually”

30% of project costs are due to rework and poor execution of requirements”

“50% of outsourced projects are expected to under perform”

Source: Standish Group, Business Week, Forrester Research

140 (!!!)3%Production

70 (!!)36%UAT

16(!)23%System Test

1012%Unit Test

76%Detailed Design Review

29%Detailed Requirements Review

47%High Level Design Review

14%Requirements Review

Cost Multiplier

($120)Expected Defects Distribution

(Valid and Invalid - Best of Breed)Defect Removal

Activity

The increasing costs of fixing a defect

Source: Based on finding by IBM, Barry Boehm and Caper-Jones

Note: (!) – Expensive (!!) – Very Expensive (!!!) – Outrageously Expensive

Delivering greater valuefrom your investments in software

Executive summaryHelp customers continuously improve their ability to achieve desired business outcomes and deliver enduring software quality

• Cut risk and cost

– Collaborate seamlessly to reduce rework and the cost

of bugs with integrated processes aligned to business goals

• Speed time to market

– Smart automations reduce human error and improve

quality and operational efficiency

• Make confident decisions

– Real-time metrics and measures for full visibility into

quality status for informed action, greater predictability

and ongoing improvement

Three Common ThemesJazz infrastructure enables delivery of software & systems as robust process

Achieve common goals by optimizing how

people work

Increase controland efficiency by

integrating workflows

Collaborate

Continuously improveby measuring progress

in real time

ReportAutomate

The first wave of Jazz products

8

Team Concert

Collaborative software delivery

Unify by “thinking & working” in

unison with real-time project heath

Quality Manager

Lifecycle quality management

Coordinate quality assurance plans,

processes and resources

Requirements Composer

Elicit, capture, elaborate, discuss

and review requirements

Business Expert Collaboration

Storage

Collaboration

QueryDiscovery

Administration: Users, projects, process

Best Practice Processes

Presentation:

Mashups

FutureIBM

Capabilities

Product & Project

Management

Collaborative Lifecycle

Management Engineering& SoftwareTools

BusinessPlanning &Alignment

Yourexisting

capabilities3rd-PartyJazz

Capabilities

Compliance& Security

Customer Speak!

Cut risk and cost Collaborate seamlessly to reduce rework and the cost of bugswith integrated processes aligned to business goals

Reduce time to quality with ALM process integrationMake the integration transparent to keep stakeholders and team

focused on the task at hand

Unify the team through real-time, in-context collaboration

A single, dynamic quality contract provides clear and accountable direction

* Source: IBM

“Testing consumes 20% to

40+% of the average

software application life

cycle effort”*

I just got a budget cut, what testing should I eliminate?

What impact will it have on application production quality?

“Some large projects have found that 41% of all

defects have their origin in bad requirements.”*

Achieve quality objectives by identifying and managing

sources of riskRisk cannot be removed – but it can be understood and controlled

Unify the team through real-time, in-context collaborationA single, dynamic quality contract provides clear and accountable direction

• Unify the entire team with

a shared view of quality assets

– Central location for assets

(e.g., business objectives requirements,

resources, platform, exit criteria)

• Comprehensive dynamic

planning and updates

– Integrated process workflow, not

artifacts drives team activities, hand-offs,

reviews/approvals and sign-offs

• Know what others are doing

and what others expect of you

– Task management for individuals and team

QA Manager

Security Officer

Project Manager

Tester

Business Stakeholder

Test Cases

Skill Availability

Project Logs

Use Cases

Requirements

Security Mandates

Defect Logs

Business Objectives

Quality Asset Infrastructure Central hub captures

everything that matters for quality releases

QA Manager

Security OfficerSecurity Officer

Project ManagerProject Manager

TesterTester

Business StakeholderBusiness Stakeholder

Test Cases

Skill Availability

Project Logs

Use Cases

Requirements

Security Mandates

Defect Logs

Business Objectives

Test Cases

Skill Availability

Project Logs

Use Cases

Requirements

Security Mandates

Defect Logs

Business Objectives

Quality Asset Infrastructure Central hub captures

everything that matters for quality releases

IBM Rational Quality Manager(Standard and Express Editions)

IBM Rational Test Lab Manager v2.0

Achieve quality objectives by identifying and managing sources of riskRisk cannot be removed – but it can be understood and controlled

• Advanced defect prevention removes biggest risk and cost of test quality!

– Discover defect source for corrective action and prevent duplicates from occurring

• Risk based testing to prioritize the features and functions to be tested

– Automatic/full documentation of risk related decisions

• Test coverage optimization

– Day-1 confidence with vital configurations covered

IBM Rational Quality Manager

IBM Rational Test Lab Manager

RISKMANAGEMENT

Business Reporting Business Reporting

Business Reporting Business Reporting

Business Reporting Business Reporting

Objective progress measurement

Ensure that the project is doing the right thing

Ensure goodgovernance

Effective implementation

Avoid surprises Ensure that the project is doing things right

12

Reduce time to quality with collaborative ALMIntegrated Web UI and data to enhance team productivity & reduce risk

Architect Developer

REST API

Quality

Management

REST API

Requirements

Definition &

Management

Change &

Configuration

Management

REST API

Association

Changes; notification

Tester finds defects,

Defect statusDefects closed

Requirement linked to work itemAnalyst Tester

● Coordinate analysts, developers and testers● Collaborate in context and track status

● Align teams on project plans● Which requirements are in the development plan?

● Track builds and the impact of defects● What build is ready for test?

● What defects are blocking test from proceeding?

● Track status with C/ALM dashboard mashups● Transparency across teams and artifacts

Collaboration fosters business alignment & high qualityRequirement links foster clarity

13

Analyst

Developer

TesterRational Quality Manager v2.0

Rational Team Concert

Rational Requirements Composer

Testers link to requirements from test plans and test cases

Analysts communicate requirements with links to development and test plans

Developers link to requirements from work-items

Collaboration fosters business alignment & high qualityDefect links speed time to resolution

14

AnalystDeveloper

Tester

Rational Quality Manager v2.0Rational Team ConcertRational Requirements Composer

Defects can link to requirements

Defects link to Test Execution results

Test Execution Results link to defects

Customer Speak!

Speed time to marketSmart automations reduce human error and improve operational efficiency

Leverage investments in existing tooling and infrastructure

Consolidate and reduce costs with support for heterogeneous environments and business partner offerings

Optimize lab efficiency and asset utilizationSave on test lab overhead, infrastructure and duration costs

Ramp up productive teams day-1 Productivity boosters automate repetitive, mundane tasks for rapid ROI

•Sources: *IBM, ** Standish Group

“Testers are spending 40% of their time building

test environments”*

“Testing can account for 30% to 50% of

maintenance efforts”*

“We should reuse requirements and test

artifacts and save time and money”

Ramp up productive teams day-1Productivity boosters automate repetitive, mundane tasks for rapid ROI

• Jump start testing regardless of expertise level

– Storyboard testing visualizes test actions through words and pictures without reading/writing test script code

• Maximize efficiency of manual testing

– Step-by-step capture and execution of manual tests with assisted data entry and keyword support

– Less keystrokes with better and faster navigation

• Organize and find assets easily!

– User defined visualization based on asset relationships that make sense to you

IBM Rational Functional Tester

IBM Rational Quality Manager

Ramp up productive teams day-1 (cont.)Productivity boosters automate repetitive, mundane tasks for rapid ROI

IBM Rational Performance Tester

IBM Rational Service Tester for SOA Quality

• Assess performance results against business objectives

– No need to mine raw data, results automatically rolled up and visually reported against user-defined SLAs

• “See” into encoded data for editing, data variation and data correlation

– OOTB and extensible custom format support for Web 2.0 applications

• Agile, incremental testing even if all the services are not yet available

– Test the business logic of an SOA application early and often to catch defects

Optimize lab efficiency and asset utilizationSave on test lab overhead, infrastructure and duration costs

IBM Rational Test Lab Manager

• Avoid delays and configure automatic execution of lab management tasks

– Lab manager deployment triggered by build notification to one or more test environments

• Easier test machine reservation

– Reservation blocking to better handle reserving machines for test execution

• Remove manual effort and time to inventory and maintain lab assets

– Tivoli Provisioning Manager (TPM) remotely installs and configures machines

– Tivoli Application Dependency Discovery Manager (TADDM) maintains list of available lab machines

Leverage investments in existing tooling and infrastructureConsolidate and reduce costs with support for heterogeneous environments and business partner offerings

• Reduce risk and increase quality for business-critical ERP systems

– Partner extensions automate the functional, regression, load and scalability testing of Oracle ERP applications

• Extend and reuse existing test assets into new, emerging environments

– Deliver functional, service, and performance testing capability across a variety of platforms and technologies

• Extensibility built-in with an open, common architecture to reduce your TOC

– Use your homegrown, IBM, or third-party tooling, data and quality assets

IBM Rational Quality Manager

IBM Rational Test Lab Manager

IBM Rational Functional Tester

IBM Rational Performance Tester

IBM Rational Service Tester for SOA Quality

Customer Speak!

Make confident decisions Real-time metrics and measures for full visibility into quality status for informed action, greater predictability and ongoing improvement

Confidently deliver incremental quality improvements

Manage, measure and improve quality software delivery capability

with a proven, repeatable approach

Achieve project quality objectives each and every timeComplete traceability across quality assets

Make informed decisions and proactive changewith real-time analysis and actionable reportingMeasure and manage quality, project and team status performance and results

“We can do better, but don’t know what's

not working, how bad it is, or where to start.”

“2/3 of executives make more than half of their

decisions based on ‘gut feel’ rather than

verifiable information”*

“77% of managers are aware of bad decisions

made due to lack of access to accurate

information”*

*Source: Business Week

Make informed decisions and proactive change with real-time

analysis and actionable reportingMeasure and manage quality, project and team status performance and results

• Measure quality process and project outcomes

– Real-time intelligence based on IT industry best-practice metrics, dashboards and models

• Inform quality decisions and drill into issues

– Alerts and automated analysis focuses owner to take action on root causes

– 52 out-of-the-box, customizable Cognos test management reports

• Take real-time action on relevant quality and project data

– Proven business intelligence backbone automates collection and analysis to improve lifecycle productivity

IBM Rational Quality Manager

IBM Rational Test Lab Manager

A customized report

Cognos reportin the dashboard

Achieve project quality objectives each and every timeComplete traceability across quality assets

• Capture history and versioning of quality assets as changed and compare differences

– Respond easily to regulatory requirements and compliance audits

– Support management decision-making with status relative to quality objectives

• Create test cases based on requirements and automatically associate requirements to a new test case

• Track status with C/ALM dashboard

– Easy, fast integration of data and functionality to provide the visibility you need

Create test case based on

requirements

Requirements are automatically associated

with new test case

IBM Rational Quality Manager integrations:IBM Rational Team Concert, IBM Rational DOORS,

IBM Rational Test Lab Manager v2.0

Confidently deliver incremental quality improvementsManage, measure and improve quality software delivery capability with a proven, repeatable approach

• Reach goals and maximize value with improvement roadmap

– Identify customer business challengeand align to operational objectives

– Apply proven best practice to achieve objectives

• Drive continuous and measurable improvement

– End-to-end lifecycle framework drives 15-25% productivity improvement of selected priorities

• Check results and iterate as needed

– Progress checkpoints and data analysis determines results and improvements still needed

IBM Rational Quality Manager

IBM Rational Test Lab Manager

Establish business and operational objectives

Prioritize practices and define roadmap

Accelerate adoption with tools and services

Report, analyze and act on results

Phase

1

Phase

2

Phase

3

Phase

4

Start next incremental improvement

Control

Efficiency

Business Value

Individual Team BusinessOrganization

ECONOMIC IMPACTS

Improve Automation

ImproveProcess

ImproveCollaboration

Summary, achieve continuous improvement by measuring cost

against business outcomes

Cost to Implement:<5%

Very Predictable

Productivity:5-25%

Timeframe = Days

Cost to Implement:10%-35%

Some culture change

Productivity:25-100%

Timeframe = Months

Cost to Implement: 5%-10%Predictable

Productivity:15-35%

Timeframe = Weeks

Cost to Implement:25%-50%

Much culture change

Productivity:2x – 10x

Timeframe = Years

Increase Flexibility& Investment Value

Implementation costs are per person per year

Source: Based on hundreds of client interactions of the IBM Rational Services Organization, as observed by VP Services, IBM Rational

25

Global SI Perspective: SogetiNijs Blokland, Leader International Testing Community

Our Need:

– Leverage proven test management business process in client engagements

– Apply a risk based approach to analysis, unify tracking, validation and traceability of requirements to defects in

context of enterprise processes

– Deliver a holistic, cost-effective quality solution across clients’ in-house, outsourced and 3rd party application

portfolio

Our Solution:

� Sogeti TMap® plug-in for IBM Rational solutions provides:

� Process guidance based on Sogeti’s structured test methodology

� Master Test Plan template for use with IBM Rational Quality Manager

� Requirements template facilitates risk based analysis

Why Rational:

� “IBM Rational offerings provide a business driven quality environment. By integrating and automating our

process and Rational tools, Sogeti can deliver a consistent engagement approach, provide clients with

process customization and transparency and accelerate the development of test plans and assets within

Rational Quality Manager.” – Nijs Blokland, Leader, International Testing Community, Sogeti

� IBM Rational is committed to continuous improvement of their offerings and collaboration with their strategic

alliance partners.

A look ahead: Quality Management and the IBM Cloud New customer choices to drive greater efficiency, productivity and control

• What is IBM Smart Business Cloud?

– A dynamically provisioned and scaled runtime environment that provides everything needed to develop and test applications.

– Application lifecycle management offerings from Rational that can be provisioned as services on the cloud.

– Free-up resources by leveraging a cloud delivery model, and instead invest in innovation

• Testing on the Cloud

– Rational Quality Manager leverages elastic computing power of cloud to run automated tests with Rational Functional Tester and Rational Performance Tester

• Reduce costs

– Capital preservation with lower TCO (no installation, no admin costs)

– Consolidate hardware through virtualized tools and resources

• Speed time to market

– Provision in minutes with no download, installation or setup

– Preconfigured software uses best practices

– Global access anywhere anytime with Web

• Increase flexibility to share and use resources

– Provisioning and management for any deployment and runtime configurations

– Easy access and consumption using a flexible licensing model

– Flexible deployment options (Private, hybrid or public deployment)

Benefits

© Copyright IBM Corporation 2009. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.

Learn more at:

• IBM Rational software

•Rational launch announcements

•Rational Software Delivery Platform

•Accelerate change & delivery

•Deliver enduring quality

•Enable enterprise modernization

•Rational trial downloads

• developerWorks Rational

• Leading Innovation

• IBM Rational TV

• IBM Business Partners

• IBM Rational Case Studies

•Ensure Web security & compliance

• Improve project success

•Manage architecture

•Manage evolving requirements

•Small & midsized business

• Targeted solutions

Quality Management offers a centralized test management hub

and full lifecycle support across all types of testing and platforms

Storage

Collaboration

Search & QueryDiscovery

Administration: Users, projects, process

Presentation:Mashups

Best Practice Processes

ManageTest Lab

CreatePlan

BuildTests

ReportResults

ExecuteTests

IBM Collaborative Application Lifecycle Management

Test Management

Rational Quality Manager

Quality Dashboard

RequirementsManagement Defect

Management

Open Lifecycle Service Integrations

FunctionalTesting Performance

TestingWeb Service

Quality

CodeQuality

Security andCompliance

Open Platform

homegrown

Test Data Quality

Java System z, iSAP .NET