Post on 09-Jun-2022
质量管理方案总览主题演讲质量管理方案总览主题演讲质量管理方案总览主题演讲质量管理方案总览主题演讲
Software Quality Optimization
Agenda
• Setting the stage
– Business expectations exceed I/T’s ability to deliver
ROI
• Executive summary & the Jazz vision
• The Rational Quality Management Portfolio
• What customers are saying
• A look ahead – Cloud computing
Business expectations exceed I/T’s ability to deliver expected
ROI from traditional software delivery methods
“Business leaders and CIOs are under pressure to enable their teams to become catalysts for change. However, change is outpacing their ability to deliver.
They are reorienting their teams to focus on ROI and quantified business outcomes and to mitigate risk and reduce costs.”
– IBM CIO Survey, 2008
Growing focuson business outcomes
“Only 22% of executives felt that their IT and business strategy were tightly integrated”
“49% of budgets suffer overruns and 62% fail to meet their scheduled”
“34% of software projects are deemed successful costing $300B annually”
30% of project costs are due to rework and poor execution of requirements”
“50% of outsourced projects are expected to under perform”
Source: Standish Group, Business Week, Forrester Research
140 (!!!)3%Production
70 (!!)36%UAT
16(!)23%System Test
1012%Unit Test
76%Detailed Design Review
29%Detailed Requirements Review
47%High Level Design Review
14%Requirements Review
Cost Multiplier
($120)Expected Defects Distribution
(Valid and Invalid - Best of Breed)Defect Removal
Activity
The increasing costs of fixing a defect
Source: Based on finding by IBM, Barry Boehm and Caper-Jones
Note: (!) – Expensive (!!) – Very Expensive (!!!) – Outrageously Expensive
Delivering greater valuefrom your investments in software
Executive summaryHelp customers continuously improve their ability to achieve desired business outcomes and deliver enduring software quality
• Cut risk and cost
– Collaborate seamlessly to reduce rework and the cost
of bugs with integrated processes aligned to business goals
• Speed time to market
– Smart automations reduce human error and improve
quality and operational efficiency
• Make confident decisions
– Real-time metrics and measures for full visibility into
quality status for informed action, greater predictability
and ongoing improvement
Three Common ThemesJazz infrastructure enables delivery of software & systems as robust process
Achieve common goals by optimizing how
people work
Increase controland efficiency by
integrating workflows
Collaborate
Continuously improveby measuring progress
in real time
ReportAutomate
The first wave of Jazz products
8
Team Concert
Collaborative software delivery
Unify by “thinking & working” in
unison with real-time project heath
Quality Manager
Lifecycle quality management
Coordinate quality assurance plans,
processes and resources
Requirements Composer
Elicit, capture, elaborate, discuss
and review requirements
Business Expert Collaboration
Storage
Collaboration
QueryDiscovery
Administration: Users, projects, process
Best Practice Processes
Presentation:
Mashups
FutureIBM
Capabilities
Product & Project
Management
Collaborative Lifecycle
Management Engineering& SoftwareTools
BusinessPlanning &Alignment
Yourexisting
capabilities3rd-PartyJazz
Capabilities
Compliance& Security
Customer Speak!
Cut risk and cost Collaborate seamlessly to reduce rework and the cost of bugswith integrated processes aligned to business goals
Reduce time to quality with ALM process integrationMake the integration transparent to keep stakeholders and team
focused on the task at hand
Unify the team through real-time, in-context collaboration
A single, dynamic quality contract provides clear and accountable direction
* Source: IBM
“Testing consumes 20% to
40+% of the average
software application life
cycle effort”*
I just got a budget cut, what testing should I eliminate?
What impact will it have on application production quality?
“Some large projects have found that 41% of all
defects have their origin in bad requirements.”*
Achieve quality objectives by identifying and managing
sources of riskRisk cannot be removed – but it can be understood and controlled
Unify the team through real-time, in-context collaborationA single, dynamic quality contract provides clear and accountable direction
• Unify the entire team with
a shared view of quality assets
– Central location for assets
(e.g., business objectives requirements,
resources, platform, exit criteria)
• Comprehensive dynamic
planning and updates
– Integrated process workflow, not
artifacts drives team activities, hand-offs,
reviews/approvals and sign-offs
• Know what others are doing
and what others expect of you
– Task management for individuals and team
QA Manager
Security Officer
Project Manager
Tester
Business Stakeholder
Test Cases
Skill Availability
Project Logs
Use Cases
Requirements
Security Mandates
Defect Logs
Business Objectives
Quality Asset Infrastructure Central hub captures
everything that matters for quality releases
QA Manager
Security OfficerSecurity Officer
Project ManagerProject Manager
TesterTester
Business StakeholderBusiness Stakeholder
Test Cases
Skill Availability
Project Logs
Use Cases
Requirements
Security Mandates
Defect Logs
Business Objectives
Test Cases
Skill Availability
Project Logs
Use Cases
Requirements
Security Mandates
Defect Logs
Business Objectives
Quality Asset Infrastructure Central hub captures
everything that matters for quality releases
IBM Rational Quality Manager(Standard and Express Editions)
IBM Rational Test Lab Manager v2.0
Achieve quality objectives by identifying and managing sources of riskRisk cannot be removed – but it can be understood and controlled
• Advanced defect prevention removes biggest risk and cost of test quality!
– Discover defect source for corrective action and prevent duplicates from occurring
• Risk based testing to prioritize the features and functions to be tested
– Automatic/full documentation of risk related decisions
• Test coverage optimization
– Day-1 confidence with vital configurations covered
IBM Rational Quality Manager
IBM Rational Test Lab Manager
RISKMANAGEMENT
Business Reporting Business Reporting
Business Reporting Business Reporting
Business Reporting Business Reporting
Objective progress measurement
Ensure that the project is doing the right thing
Ensure goodgovernance
Effective implementation
Avoid surprises Ensure that the project is doing things right
12
Reduce time to quality with collaborative ALMIntegrated Web UI and data to enhance team productivity & reduce risk
Architect Developer
REST API
Quality
Management
REST API
Requirements
Definition &
Management
Change &
Configuration
Management
REST API
Association
Changes; notification
Tester finds defects,
Defect statusDefects closed
Requirement linked to work itemAnalyst Tester
● Coordinate analysts, developers and testers● Collaborate in context and track status
● Align teams on project plans● Which requirements are in the development plan?
● Track builds and the impact of defects● What build is ready for test?
● What defects are blocking test from proceeding?
● Track status with C/ALM dashboard mashups● Transparency across teams and artifacts
Collaboration fosters business alignment & high qualityRequirement links foster clarity
13
Analyst
Developer
TesterRational Quality Manager v2.0
Rational Team Concert
Rational Requirements Composer
Testers link to requirements from test plans and test cases
Analysts communicate requirements with links to development and test plans
Developers link to requirements from work-items
Collaboration fosters business alignment & high qualityDefect links speed time to resolution
14
AnalystDeveloper
Tester
Rational Quality Manager v2.0Rational Team ConcertRational Requirements Composer
Defects can link to requirements
Defects link to Test Execution results
Test Execution Results link to defects
Customer Speak!
Speed time to marketSmart automations reduce human error and improve operational efficiency
Leverage investments in existing tooling and infrastructure
Consolidate and reduce costs with support for heterogeneous environments and business partner offerings
Optimize lab efficiency and asset utilizationSave on test lab overhead, infrastructure and duration costs
Ramp up productive teams day-1 Productivity boosters automate repetitive, mundane tasks for rapid ROI
•Sources: *IBM, ** Standish Group
“Testers are spending 40% of their time building
test environments”*
“Testing can account for 30% to 50% of
maintenance efforts”*
“We should reuse requirements and test
artifacts and save time and money”
Ramp up productive teams day-1Productivity boosters automate repetitive, mundane tasks for rapid ROI
• Jump start testing regardless of expertise level
– Storyboard testing visualizes test actions through words and pictures without reading/writing test script code
• Maximize efficiency of manual testing
– Step-by-step capture and execution of manual tests with assisted data entry and keyword support
– Less keystrokes with better and faster navigation
• Organize and find assets easily!
– User defined visualization based on asset relationships that make sense to you
IBM Rational Functional Tester
IBM Rational Quality Manager
Ramp up productive teams day-1 (cont.)Productivity boosters automate repetitive, mundane tasks for rapid ROI
IBM Rational Performance Tester
IBM Rational Service Tester for SOA Quality
• Assess performance results against business objectives
– No need to mine raw data, results automatically rolled up and visually reported against user-defined SLAs
• “See” into encoded data for editing, data variation and data correlation
– OOTB and extensible custom format support for Web 2.0 applications
• Agile, incremental testing even if all the services are not yet available
– Test the business logic of an SOA application early and often to catch defects
Optimize lab efficiency and asset utilizationSave on test lab overhead, infrastructure and duration costs
IBM Rational Test Lab Manager
• Avoid delays and configure automatic execution of lab management tasks
– Lab manager deployment triggered by build notification to one or more test environments
• Easier test machine reservation
– Reservation blocking to better handle reserving machines for test execution
• Remove manual effort and time to inventory and maintain lab assets
– Tivoli Provisioning Manager (TPM) remotely installs and configures machines
– Tivoli Application Dependency Discovery Manager (TADDM) maintains list of available lab machines
Leverage investments in existing tooling and infrastructureConsolidate and reduce costs with support for heterogeneous environments and business partner offerings
• Reduce risk and increase quality for business-critical ERP systems
– Partner extensions automate the functional, regression, load and scalability testing of Oracle ERP applications
• Extend and reuse existing test assets into new, emerging environments
– Deliver functional, service, and performance testing capability across a variety of platforms and technologies
• Extensibility built-in with an open, common architecture to reduce your TOC
– Use your homegrown, IBM, or third-party tooling, data and quality assets
IBM Rational Quality Manager
IBM Rational Test Lab Manager
IBM Rational Functional Tester
IBM Rational Performance Tester
IBM Rational Service Tester for SOA Quality
Customer Speak!
Make confident decisions Real-time metrics and measures for full visibility into quality status for informed action, greater predictability and ongoing improvement
Confidently deliver incremental quality improvements
Manage, measure and improve quality software delivery capability
with a proven, repeatable approach
Achieve project quality objectives each and every timeComplete traceability across quality assets
Make informed decisions and proactive changewith real-time analysis and actionable reportingMeasure and manage quality, project and team status performance and results
“We can do better, but don’t know what's
not working, how bad it is, or where to start.”
“2/3 of executives make more than half of their
decisions based on ‘gut feel’ rather than
verifiable information”*
“77% of managers are aware of bad decisions
made due to lack of access to accurate
information”*
*Source: Business Week
Make informed decisions and proactive change with real-time
analysis and actionable reportingMeasure and manage quality, project and team status performance and results
• Measure quality process and project outcomes
– Real-time intelligence based on IT industry best-practice metrics, dashboards and models
• Inform quality decisions and drill into issues
– Alerts and automated analysis focuses owner to take action on root causes
– 52 out-of-the-box, customizable Cognos test management reports
• Take real-time action on relevant quality and project data
– Proven business intelligence backbone automates collection and analysis to improve lifecycle productivity
IBM Rational Quality Manager
IBM Rational Test Lab Manager
A customized report
Cognos reportin the dashboard
Achieve project quality objectives each and every timeComplete traceability across quality assets
• Capture history and versioning of quality assets as changed and compare differences
– Respond easily to regulatory requirements and compliance audits
– Support management decision-making with status relative to quality objectives
• Create test cases based on requirements and automatically associate requirements to a new test case
• Track status with C/ALM dashboard
– Easy, fast integration of data and functionality to provide the visibility you need
Create test case based on
requirements
Requirements are automatically associated
with new test case
IBM Rational Quality Manager integrations:IBM Rational Team Concert, IBM Rational DOORS,
IBM Rational Test Lab Manager v2.0
Confidently deliver incremental quality improvementsManage, measure and improve quality software delivery capability with a proven, repeatable approach
• Reach goals and maximize value with improvement roadmap
– Identify customer business challengeand align to operational objectives
– Apply proven best practice to achieve objectives
• Drive continuous and measurable improvement
– End-to-end lifecycle framework drives 15-25% productivity improvement of selected priorities
• Check results and iterate as needed
– Progress checkpoints and data analysis determines results and improvements still needed
IBM Rational Quality Manager
IBM Rational Test Lab Manager
Establish business and operational objectives
Prioritize practices and define roadmap
Accelerate adoption with tools and services
Report, analyze and act on results
Phase
1
Phase
2
Phase
3
Phase
4
Start next incremental improvement
Control
Efficiency
Business Value
Individual Team BusinessOrganization
ECONOMIC IMPACTS
Improve Automation
ImproveProcess
ImproveCollaboration
Summary, achieve continuous improvement by measuring cost
against business outcomes
Cost to Implement:<5%
Very Predictable
Productivity:5-25%
Timeframe = Days
Cost to Implement:10%-35%
Some culture change
Productivity:25-100%
Timeframe = Months
Cost to Implement: 5%-10%Predictable
Productivity:15-35%
Timeframe = Weeks
Cost to Implement:25%-50%
Much culture change
Productivity:2x – 10x
Timeframe = Years
Increase Flexibility& Investment Value
Implementation costs are per person per year
Source: Based on hundreds of client interactions of the IBM Rational Services Organization, as observed by VP Services, IBM Rational
25
Global SI Perspective: SogetiNijs Blokland, Leader International Testing Community
Our Need:
– Leverage proven test management business process in client engagements
– Apply a risk based approach to analysis, unify tracking, validation and traceability of requirements to defects in
context of enterprise processes
– Deliver a holistic, cost-effective quality solution across clients’ in-house, outsourced and 3rd party application
portfolio
Our Solution:
� Sogeti TMap® plug-in for IBM Rational solutions provides:
� Process guidance based on Sogeti’s structured test methodology
� Master Test Plan template for use with IBM Rational Quality Manager
� Requirements template facilitates risk based analysis
Why Rational:
� “IBM Rational offerings provide a business driven quality environment. By integrating and automating our
process and Rational tools, Sogeti can deliver a consistent engagement approach, provide clients with
process customization and transparency and accelerate the development of test plans and assets within
Rational Quality Manager.” – Nijs Blokland, Leader, International Testing Community, Sogeti
� IBM Rational is committed to continuous improvement of their offerings and collaboration with their strategic
alliance partners.
A look ahead: Quality Management and the IBM Cloud New customer choices to drive greater efficiency, productivity and control
• What is IBM Smart Business Cloud?
– A dynamically provisioned and scaled runtime environment that provides everything needed to develop and test applications.
– Application lifecycle management offerings from Rational that can be provisioned as services on the cloud.
– Free-up resources by leveraging a cloud delivery model, and instead invest in innovation
• Testing on the Cloud
– Rational Quality Manager leverages elastic computing power of cloud to run automated tests with Rational Functional Tester and Rational Performance Tester
• Reduce costs
– Capital preservation with lower TCO (no installation, no admin costs)
– Consolidate hardware through virtualized tools and resources
• Speed time to market
– Provision in minutes with no download, installation or setup
– Preconfigured software uses best practices
– Global access anywhere anytime with Web
• Increase flexibility to share and use resources
– Provisioning and management for any deployment and runtime configurations
– Easy access and consumption using a flexible licensing model
– Flexible deployment options (Private, hybrid or public deployment)
Benefits
© Copyright IBM Corporation 2009. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.
Learn more at:
• IBM Rational software
•Rational launch announcements
•Rational Software Delivery Platform
•Accelerate change & delivery
•Deliver enduring quality
•Enable enterprise modernization
•Rational trial downloads
• developerWorks Rational
• Leading Innovation
• IBM Rational TV
• IBM Business Partners
• IBM Rational Case Studies
•Ensure Web security & compliance
• Improve project success
•Manage architecture
•Manage evolving requirements
•Small & midsized business
• Targeted solutions
Quality Management offers a centralized test management hub
and full lifecycle support across all types of testing and platforms
Storage
Collaboration
Search & QueryDiscovery
Administration: Users, projects, process
Presentation:Mashups
Best Practice Processes
ManageTest Lab
CreatePlan
BuildTests
ReportResults
ExecuteTests
IBM Collaborative Application Lifecycle Management
Test Management
Rational Quality Manager
Quality Dashboard
RequirementsManagement Defect
Management
Open Lifecycle Service Integrations
FunctionalTesting Performance
TestingWeb Service
Quality
CodeQuality
Security andCompliance
Open Platform
homegrown
Test Data Quality
Java System z, iSAP .NET