Deming Cycle | Maturity Modeling | MODELS --> | CMM | CMMI | People CMM | PMMM | ACMM | IT Services CMM | ITIL Says | CobIT | Sustaining Gains |
Rate of change, that is, rate of improvement, is a key competitive factor in today's world. PDSA allows for major 'jumps' in performance ('breakthroughs' often desired in a Western approach), as well as Kaizen (frequent small improvements associated with an Eastern approach). In the United States a PDSA approach is usually associated with a sizable project involving numerous people's time, and thus managers want to see large 'breakthrough' improvements to justify the effort expended. However, the Scientific Method and PDSA apply to all sorts of projects and improvement activities.
The power of Deming's concept lies in its apparent simplicity. The concept of feedback in the Scientific Method, in the abstract sense, is today firmly rooted in education. While apparently easy to understand, it is often difficult to accomplish on an on-going basis due to the intellectual difficulty of judging one's proposals (hypotheses) on the basis of measured results. Many people have an emotional fear of being shown "wrong," even by objective measurements. To avoid such comparisons, we may instead cite complacency, distractions, loss of focus, lack of commitment, re-assigned priorities, lack of resources, etc.
Deming CritiqueR Deming's 14 pointsR Watch Video of Deming's Impact on management |
CMMI Background
The Deming Cycle's application was intended for quality control purposes and proposed continuous improvement in quality of products/experiments. The cycle works well in this restricted application, but not as well when applied to major organizational improvement. ISO recognized the need to provide better guidance in this regard and published the ISO standard ISO 9004:2000, which replaced the use of the term continuous improvement with continual improvementR. IT Service improvements may be difficult to achieve if the organization's supporting processes aren't up to the task. The assessment and improvement of a wide range of internal processes is the subject of process maturity models. An awareness of (and perhaps a supporting strategic framework for) internal process capabilities is crucial to the successful implementation of service improvement initiatives.R
The adaptation of the PDCA to a process maturity framework was the work of Watts Humphrey and his colleagues at IBM® in the early 1980sR. Humphrey noticed that the quality of a software product was directly related to the quality of the process used to develop it. Having observed the success of total quality management in other parts of industry, Humphrey wanted to install a Shewart-Deming improvement cycle (Plan-Do-Check-Act - PDCA) into a software organization as a way to continually improve its development processes.
At the time of Humphrey's outline organizations had been installing advanced software technologies for a decade using methods akin to the PDCA cycle but without much success. Humphrey’s unique insight was that organizations had to eliminate implementation problems in a specific order if they were to create an environment that supported continuous improvement. Hence, Humphrey concluded that the Shewart-Deming cycle had to be installed in stages to systematically remove impediments to continuous improvement.
This staged structure underlying the maturity framework was further elaborated by Crosby in "Quality is Free". Crosby’s quality management maturity grid described five evolutionary stages in adopting quality practices in an organization. This framework was then adapted to the software process by Ron Radice and his colleagues working under the direction of Humphrey at IBM. Their model postulated that the adoption of any new practice by an organization would occur in five stages. The organization would...
In Humphrey’s original maturity framework these stages would integrate principles from three domains in vogue at the time:
People CMM, Section 2, p.16 |
The movement through these stages can be represented graphically in Graphic 1 prepared by Suzanne Garcia for Carnegie-Melon:R
![]() Graphic 1: Maturity Levels - Evolving Improvement Paradigms: Capability Maturity Models | Regardless of the target of improvement, either an individual process or an entire organization, both continuous and staged perspectives of CMM Integrated reflect an evolution along two dimensions of interest that are notionally captured in the figure to the left. Using the staged model maturity level terms, it illustrates an evolution from the use of primarily qualitative data or opinion to much greater use of quantitative data, and a cyclic focus between process control and process improvement. |
![]() Graphic 2: Maturity Levels - Process at Different Stages |
An organization can have process areas at different maturity levels. graphic 2 illustrates one way of viewing process
(area)s at differing maturity levels. Each diamond notationally
represents the amount of focus needed on a particular topic
to achieve the kinds of improvement shifts highlighted in
the quadrant illustrated previously. Nor do the characteristics of a process area imply identical maturity requirements. Some topics require a heavy focus early on, and either continue in that focus (see the diamond with an elongated middle portion) or require less focus to hang on to the improvements achieved (see diamonds with wide areas at the bottom and narrower areas at the top). Moreover. some topics have other processes as prerequisites for their improvement to be successful, and so their focus early on is much lighter (indicated by a space below the level at which focus becomes plausible). We might view each ITIL process area as one of these diamonds, or, if we wish, we can express a more granular approach, by selecting specific activities within ITIL best practice areas for review. The choice is up to the organization undertaking a service improvement initiative. |
The movement towards the top, right quadrant (ie. continual improvement through quantitative analysis) is accompanied by a shift in the organization's cultural domain from reacting to events, to proactively managing events and finally to predicting events and removing their cause before it happens. In this migration the organization will exhibit the following characteristics:
Capability Maturity Models Today
Software Capability Maturity Model (CMM)
The original formulation of the maturity framework adopted Crosby’s
approach of evolving each process through these five stages. However, Humphrey realized
organizations were not succeeding in long-term adoption of improved software development
practices when they applied this maturity framework to individual practices or technologies. Humphrey identified serious impediments to long-term adoption that had to be eliminated if improved practices were to thrive in an organization. Since many of these problems were deeply ingrained in an organization’s culture, Humphrey realized that he had to formulate an approach that addressed the organization, not just its individual processes. The success of software CMM is demonstrated by the following finding of the Software Engineering Institute.
|
![]() |
Today, the SW-CMM is widely used for guiding software process improvement programs both
in the U.S. and abroad. Although originally adopted by aerospace firms, the SW-CMM is now
used in commercial software and information systems organizations. After reviewing
improvement results from 14 companies, the SEI found that software process improvement
programs guided by the CMM achieved an average return on investment of $5.70 saved for
every $1 invested on SW-CMM-based improvement.
People CMM - Section 2, p. 12 |
CMM Integrated (CMMI)
Many organizations wanted began to see that the methodology underscoring CMM had a much wider applicability and began to devise CMM-like maturity outlines in other fields. Eventually, the differences among discipline-specific models, including their architecture, content, and
approach, limited the ability to successfully focus improvements efforts,and, furthermore, applying multiple models which lacked integration within and across an organization proved costly
in terms of training, appraisals, and improvement activities. Thus, an integrated model that addressed multiple disciplines proved highly useful.
The aim of CMM Integrated, CMMI, was to provide guidance for improving an organization’s processes and an ability to manage the development, acquisition, and maintenance of products or services. CMMI places different approaches into a structure that assists an organization in assessing it's organizational maturity or process area capability, establish priorities for improvement, and implement these improvements.
The theoretical marriage involved in integrating the theory in different disciples led to the creation of two 'streams' or representations. The Continuous representation allows an organization greater flexibility in implementing CMMI methods. It suggests that an organization can select different orderings of improvement initiatives. These orders will uniquely reflect the needs of the organization.
The Staged representation requires that certain improvements must occur first as necessary conditions for subsequent improvements. This staged representation provides a sequence of improvements, beginning with basic management practices and progressing through a pre-defined and proven path of successive levels, each serving as a foundation for the next stage or maturity level.
The CMMI disciple with the greatest similarity to IT Service Management processes is Product and Process Development (IPPD). This area portrays systematic
approach that seeks a collaboration of relevant stakeholders
throughout the life of the product to better satisfy customer needs,
expectations, and requirements. The staged representation organizes process areas into five maturity
levels (with the same descriptors as for Software CMM) to support and guide process improvement. The staged
representation groups process areas by maturity level, indicating which
process areas to implement to achieve each maturity level. Maturity
levels represent a process-improvement
path illustrating improvement evolution for the entire organization
pursuing process improvement.
The CMMI model describes general and specific goals which must be achieved to successfully operate at a particular maturity level. The features common to the general functions are:
|
![]() |
The staged representation identifies the maturity levels through which an organization should evolve to establish a culture of excellence. Because each maturity level forms a necessary foundation on which to build the next level, trying to skip maturity levels is usually counter-productive However, it should be recognized that process improvement efforts should focus on the needs of the organization in the context of its business environment and that process areas at higher maturity levels may address the current needs of an organization or project. For example, organizations seeking to move from maturity level 1 to maturity level 2 are frequently told to establish a process group, which is addressed by the Organizational Process Focus process area that resides at maturity level 3. While a process group is not a necessary characteristic of a maturity level 2 organization, it can be a useful part of the organization’s approach to achieving maturity level 2.
Each maturity level in CMMI is characterized by defined processes.
Maturity Level | Description | Processes |
Incomplete | A process that is either non existent or only partially performed. It fails to meet the criteria established for a Performed process. | No articulated description(s) |
Performed |
A performed process supports and enables the work needed to produce
identified output work products using identified input work products. Practices can be informal - ie., without following a
documented process description or plan. The rigor with which these
practices are performed depends on the individuals managing and
performing the work and may vary considerably.
Note
| Practices are informal. |
ManagedN |
A performed process that is planned and executed in accordance with policy, employs skilled
people having adequate resources to produce controlled outputs, involves relevant stakeholders; is monitored, controlled, and reviewed; and is evaluated for adherence to its process description. The process
may be instantiated by an individual project, group, or organizational
function. Management of the process is concerned with the
institutionalization of the process area and the achievement of other
specific objectives established for the process, such as cost, schedule,
and quality objectives. A managed process is planned and the performance of the process is managed against the plan. Corrective actions are taken when the actual results and performance deviate significantly from the plan. The objectives for the process are determined based on an understanding of the project’s or organization’s particular needs. Objectives may be quantitative or qualitative and may be unique to the individual process or defined for a broader set of processes with each individual processes contributing to achieving the objectives for the set. The control provided by a managed process helps ensure process stability in times of crisis. The delivery of IT services are made aware to management at pre-defined milestones and commitments are established among those performing the work and relevant stakeholders. process outputs are reviewed with stakeholders.
Note |
Engineering
Project Management
Support
Generic Practices
|
Defined |
A managed process that is
tailored from the organization's set of standard processes according to
the organization’s tailoring guidelines, and contributes outputs, measures, and other process -improvement information to the
organizational process assets. The set of standard processes, which are the basis of the defined process, are established and improved over time. Standard processes document fundamental process elements and describe relationships (e.g., the ordering and interfaces) amongst the process elements. The corporate infrastructure to support current and future use of the set of standard processes is established and improved over time. Process assets are artifacts that relate to describing, implementing, and improving processes. They are assets because they facilitate meeting the business objectives, and represent investments that are expected to provide current and future business value.
Note |
Engineering
Process Management
Project Management
Support
Generic Practices
|
Quantitatively Managed | A defined process that is controlled using statistical and other quantitative
techniques. Quantitative objectives for quality and process performance
are established and used as criteria in managing the process. The
quality and process performance are understood in statistical terms and
are managed throughout the life of the process. The quantitative objectives are based on the capability of the set of standard processes, the business objectives, and the needs of the customer, end users, organization, and process implementers, subject to resource availability.
Note |
Process Management
Project Management
Generic Practices
|
Optimizing | An optimizing process is a quantitatively managed process that is changed and adapted to meet relevant current and
projected business objectives. An optimizing process focuses on
continually improving the process performance through both
incremental and innovative technological improvements. Process
improvements that would address root causes of process variation and
measurably improve the organization’s processes are identified,
evaluated, and deployed as appropriate. These improvements are
selected based on a quantitative understanding of their expected
contribution to achieving process-improvement objectives versus the cost and impact to the organization. Selected incremental and innovative technological process improvements are systematically managed and deployed and the effects of the deployed process improvements are measured and evaluated against the quantitative process-improvement objectives.
Note |
Process Management
Support
Generic Practices
|
CMMI Version 3, Continuous Representation, Chapter 4 Visit Terraquest web site for a comprehensive description of CMMI Practice Areas |
People Capability Maturity Model (P-CMM)
R
The People Capability Maturity Model (People CMM) is a road map for implementing
workforce practices that continuously improve the capability of an organization’s workforce. It is vitally important for process improvement because it enables the defined organization. Many organizations undertake extensive process mapping of current and envisioned processes only to find they either cannot achieve the conceived process or fail to maintain the desired improvements if they are momentarily achieved. One frequent reason for this "backsliding" is that the achievement of Organizational Process Definition capability must be accompanied by realization of Organizational Process Focus; - ie., the continuing ability to utilize the process descriptions.
The People CMM's primary objective is to improve the capability of the workforce. Workforce
capability can be defined as the level of knowledge, skills, and process abilities available for
performing an organization's business activities. Workforce capability indicates an
organization's:
Part One. The People Capability Maturity Model: Background, Concepts, Structure, and Usage, p. 4 |
P-CMM place in establishing the necessary foundation for successfully implementing service improvement initiatives like ITIL or CobIT is evident in the following quotation from P-CMM.
Changing an organization’s culture through staged improvements to its operating processes is a
unique approach to organizational development. These cultural changes provide much of the
CMM’s power for implementing lasting improvements and distinguish it from other quality and
process improvement standards. Although many process standards can transform an
organization’s culture, few include a road map for implementation. Consequently, organizations
often fail to implement the standard effectively because they attempt to implement too much too
soon and do not lay the right initial foundation of practices.
People CMM - Section 2, p. 16 |
The overall goal of P-CMM is embodied in the following excerpt.
As an organization adopts the practices that satisfy the goals of the People CMM’s process areas,
it establishes the shared patterns of behavior that underlie a culture of professionalism dedicated
to continuous improvement.
People CMM - Section 2, p. 16 |
Since an organization cannot implement all of the best workforce practices in an afternoon, the People CMM introduces them in stages. Each progressive level of the People CMM produces a unique transformation in the organization's culture by equipping it with more powerful practices for attracting, developing, organizing, motivating, and retaining its workforce. Thus, the People CMM establishes an integrated system of workforce practices that matures through increasing alignment with the organization's business objectives, performance, and changing needs.
Workforce capability can be defined as the level of knowledge, skills, and process abilities available for performing an organization's business activities. Workforce capability indicates an organization's:
Like all Maturity models, each maturity level in P-CMMM has specific process requirements which must be adequately performed to achieve that maturity level.
Maturity Level | Description | Processes |
Managed | Process Areas focus on establishing a foundation of basic workforce practices that can be continuously improved to develop the capability of the workforce. This foundation of practices is initially built within units to instill a discipline for managing people and to provide a supportive work environment with adequate work resources. The unit balances work commitments with available resources. Qualified people are recruited, selected, and transitioned into assignments within the unit. Performance objectives are established for the committed work, and performance is periodically discussed to identify actions that can improve it. Individuals develop interpersonal communication skills to ensure that work dependencies are coordinated effectively. The knowledge and skills required for performing assignments are identified and appropriate training and development opportunities are provided. The compensation is based on an articulated strategy and is periodically adjusted to ensure equity. |
|
Defined | Process Areas focus on establishing an organizational framework for developing the workforce. The organization identifies the knowledge, skills, and process abilities that underlie the workforce competencies needed to perform its business activities. The organization develops strategic plans for the workforce needed to accomplish current and future business objectives. Development opportunities are established for assisting individuals in improving their capability in these workforce competencies. Graduated career opportunities are developed around growth in one or more workforce competencies. The workforce practices implemented at Level 2 are adjusted to motivate and support development in the organization’s workforce competencies. The process abilities defined for each workforce competency are used for tailoring defined processes and establishing roles that provide the next step in workgroup development. A participatory culture is established that enables the most effective use of the organization’s talent for making decisions and executing work. |
|
Predictable | Process Areas focus on exploiting the knowledge and experience of the workforce framework developed at Level 3. The competency-based processes used by different workforce competencies are interwoven to create integrated, multi disciplinary processes. Workgroups are empowered to manage their own work processes and conduct some of their internal workforce activities. The artifacts produced through the performance of competency-based processes are captured and developed for reuse. Individuals and workgroups quantitatively manage the competency-based processes that are important for achieving their performance objectives. The organization manages the capability of its workforce and of the competency-based processes they perform. The effect of workforce practices on these capabilities is evaluated and corrective actions taken if necessary. Mentors use infrastructure provided by the organization’s workforce competencies to assist individuals and workgroups in developing their capability. |
|
Optimizing | Process Areas focus on continually improving the organization’s capability and workforce practices. Individuals continually improve the personal work processes they use in performing competency based processes. Workgroups continuously improve their operating processes through improved integration of the personal work processes of their members. The organization evaluates and improves the alignment of performance among its individuals, workgroups, and units both with each other and with the organization’s business objectives. The organization continually evaluates opportunities for improving its workforce practices through incremental adjustments or by adopting innovative workforce practices and technologies. |
|
People CMM |
Project Management Maturity Models
The Project Management area in CMMI provided the theoretical impetus for a more exacting scrutiny by the large project management practitioners in the United states and Britain. The Project Management Institute (PMI) has maintained the standard for project management - the Project Management Book of Knowledge (PMBOK)N. PMBOK divides project management into 8 primary "knowledge areas"N
OPM3 provides a framework for advancing project management improvement within an organization. It is roughly based on the Software Engineering Institute's (SEI) Capability Maturity Model's (CMM®) five evolutionary maturity levels, and examines maturity development across nine knowledge areas in PMBOK R. OPM3 integrates standards for project and process management, the PMBOK Guide and CMM, respectively, to provide a plan for advancing organizational project management maturity.
![]() |
Within OPM3, best practices are obtained by demonstrating mastery of a series of Capabilities that incrementally indicate the achievement of progressively higher levels of maturity. A Capability is demonstrated by the existence of corresponding Outcome(s) as demonstrated on the left. An Outcome is the tangible or intangible result of demonstrating or applying a Capability. Every Outcome should have a Key Performance Indicator (KPI), which represents the means to measure an Outcome. The OPM3 standard goes further by outlining the dependencies among the best practices. This complexity allows organizations trying to improve project management services to understand all of the Capabilities that may impact the achievement of a specific project management area. An OPM3 assessment element provides a means to navigate these components and compare an organization against industry averages according to the PMBOK Guide Process Groups N. This initial high-level assessment provides a macro look at an organization's organizational project management maturity. The identification of dependencies between the Capabilities, the use of multiple categorizations for both Best Practices and Capabilities, and the provision to conduct both high level and detailed assessments collectively provide organizations with flexibility in analyzing the results of their assessment and developing a detailed improvement plan.
|
Consistent with an evolving recognition of maturity modeling the Office of Government Commerce in Great Britain introduced a government standard Project Management Maturity Model (PMMM), designed to measure project management maturity across the wider organization and the effectiveness of the project outputs and outcomes. Like, OPM3, it was based upon PMBOK..
Levels of PMMM | Level 1 | Level 2 | Level 3 | Level 4 | Level 5 |
Initial | Structured Process & Standards | Organizational Standards & Institutionalized Process | Managed | Optimized | |
IntegrationN | No established practices, standards, or Project Office. Work performed in ad hoc fashion. | Basic, documented processes for project planning and reporting. Management only involved on high visibility projects. | Project integration efforts institutionalized with procedures and standards. Project Office beginning to integrate project data. | Processes/standards utilized by all projects and integrated with other corporate processes/systems. Decisions based on performance metrics. | Project integration improvement procedures utilized. Lessons learned regularly examined and used to improve documented processes. |
ScopeN | General statement of business requirements. Little/no scope management or documentation. Management aware of key milestones only. | Basic scope management process in place. Scope management techniques regularly applied on larger, more visible projects. | Full project management process documented and utilized by most projects. Stakeholders actively participating in scope decisions. | Project management processes used on all projects. Projects managed and evaluated in light of other projects. | Effectiveness and efficiency metrics drive project scope decisions by appropriate levels of management. Focus on high utilization of value. |
TimeN | No established planning or scheduling standards. Lack of documentation makes it difficult to achieve repeatable project success. | Basic processes exist but not required for planning and scheduling. Standard scheduling approaches utilized for large, visible projects. | Time management processes documented and utilized by most projects. Organization wide integration includes inter-project dependencies. | Time management utilizes historical data to forecast future performance. Management decisions based on efficiency and effectiveness metrics. | Improvement procedures utilized for time management processes. Lessons learned are examined and used to improve documented processes. |
CostN | No established practices or standards. Cost process documentation is ad hoc and individual project teams follow informal practices. | Processes exist for cost estimating, reporting, and performance measurement. Cost management processes are used for large, visible projects. | Cost processes are organizational standard and utilized by most projects. Costs are fully integrated into project office resource library. | Cost planning and tracking integrated with Project Office, financial, and human resources systems. Standards tied to corporate processes. | Lessons learned improve documented processes. Management actively uses efficiency and effectiveness metrics for decision-making. |
QualityN | No established project quality practices or standards. Management is considering how they should define “quality.” | Basic organizational project quality policy has been adopted. Management encourages quality policy application on large, visible projects. | Quality process is well documented and an organizational standard. Management involved in quality oversight for most projects. | All projects required to use quality planning standard processes. The Project Office coordinates quality standards and assurance. | The quality process includes guidelines for feeding improvements back into the process. Metrics are key to product quality decisions. |
HRN | No repeatable process applied to planning and staffing projects. Project teams are ad hoc. Human resource time and cost is not measured. | Repeatable process in place that defines how to plan and manage the human resources. Resource tracking for highly visible projects only. | Most projects follow established resource management process. Professional development program establishes project management career path. | Resource forecasts used for project planning and prioritization. Project team performance measured and integrated with career development. | Process engages teams to document project lessons learned. Improvements are incorporated into human resources management process. |
CommunicationsN | There is an ad hoc communications process in place whereby projects are expected to provide informal status to management. | Basic process is established. Large, highly visible projects follow the process and provide progress reporting for triple constraints. | Active involvement by management for project performance reviews. Most projects are executing a formal project communications plan. | Communications management plan is required for all projects. Communications plans are integrated into corporate communications structure. | An improvement process is in place to continuously improve project communications management. Lessons learned are captured and incorporated. |
RiskN | No established practices or standards in place. Documentation is minimal and results are not shared. Risk response is reactive. | Processes are documented and utilized for large projects. Management consistently involved with risks on large, visible projects. | Risk management processes are utilized for most projects. Metrics are used to support risk decisions at the project and the program levels. | Management is actively engaged in organization-wide risk management. Risk systems are fully integrated with time, cost, and resource systems. | Improvement processes are utilized to ensure projects are continually measured and managed against value-based performance metrics. |
Procurement/VendorN | No project procurement process in place. Methods are ad hoc. Contracts managed at a final delivery level. | Basic process documented for procurement of goods and services. Procurement process mostly utilized by large or highly visible projects. | Process an organizational standard and used by most projects. Project team and purchasing department integrated in the procurement process. | Make/buy decisions are made with an organizational perspective. Vendor is integrated into the organization’s project management mechanisms. | Procurement process reviewed periodically. On-going process improvements focus on procurement efficiency and effective metrics. |
View PMMM vs 5.0 from CCTA OGC
The Department of Commerce IT Architecture Capability Maturity Model consists of six levels and nine architecture characteristics. The six levels are highlighted on the left. The nine IT Architecture Characteristics are:
| ![]() |
Architecture Characteristics | 1 Initial | 2 Under Development | 3 Defined | 4 Managed | 5 Optimizing |
Architecture Process | Exists in ad-hoc or localized form or early draft form may exist. Some IT Architecture processes are defined. There is no unified architecture process across technologies or business processes. Success depends on individual efforts. | Being actively developed. Basic IT Architecture Process program is documented based on OMB Circular A-130 and Department of Commerce IT Architecture Guidance. The architecture process has developed clear roles and responsibilities. | well defined and communicated to IT staff and business management with Operating Unit IT responsibilities. The process is largely followed. | IT Architecture process is part of the culture, with strong linkages to other core IT and business processes. Quality metrics associated with the architecture process are captured. These metrics include the cycle times necessary to generate IT Architecture revisions, technical environment stability, and time to implement a new or upgraded application or system. | optimize and continuously improve architecture process. |
Architecture Development | IT Architecture processes, documentation and standards are established by a variety of ad hoc means and are localized or informal. | IT Vision, Principles, Business Linkages, Baseline, and Target Architecture are identified. Architecture standards exist, but not necessarily linked to Target Architecture. Technical Reference Model and Standards Profile framework established. | Gap Analysis and Migration Plan are completed. Architecture standards linked to Business Drivers via Best Practices, IT Principles and Target Architecture. Fully developed Technical Reference Model and Standards Profile. The architecture aligns with the DoC and Federal Enterprise Architectures. | documentation is updated on a regular cycle to reflect the updated IT Architecture. Business, Information, Application and Technical Architectures defined by appropriate de-jure and de-facto standards. The architecture continues alignment with the DoC and Federal Enterprise Architectures. An automated tool is used to improve the usability of the architecture. | Defined and documented IT Architecture metrics are used to drive continuous process improvements. A standards and waivers process is used to improve architecture development process improvements. |
Business Linkage | Minimal, or implicit linkage to business strategies or business drivers. | Explicit linkage to business strategies. | integrated with capital planning and investment control and supports e-government. Explicit linkage to business drivers and information requirements. | Capital planning and investment control are adjusted based on the feedback received and lessons learned from updated IT Architecture. Periodic re-examination of business drivers. | Architecture process metrics are used to optimize and drive business linkages. Business involved in the continuous process improvements of IT Architecture. |
Senior-Management Involvement | What is Architecture? Why do we need it? Limited management team awareness or involvement in the architecture process. | Management awareness of Architecture effort. Much nodding of heads. Occasional/ selective management team involvement in the architecture process with various degrees of commitment/ resistance. | Senior-management team aware of and supportive of the enterprise-wide architecture process. Management actively supports architectural standards. | Senior management reviews architecture and variances. | Senior-management team directly involved in the optimization of the enterprise-wide architecture development process and governance. |
Operating Unit Participation | Limited Operating Unit acceptance of the IT Architecture process. We support the architecture process as long as it represents the standards we have already chosen. Standards will only inhibit our ability to deliver business value. | IT Architecture responsibilities are assigned and work is underway. There is a clear understanding of where the organization=s architecture is at present time. Recognition that it is painful supporting too many kinds of technologies. Perhaps tired of distributing Anot fully-developed or tested applications@ to Operating Unit IT operations and support. | Most elements of Operating Unit show acceptance of or are actively participate in the IT Architecture process. Recognition that architectural standards can reduce integration complexity and enhance overall ability to Operating Unit IT to achieve business goals. | The entire Operating Unit accepts and actively participates in the IT Architecture process. | Feedback on architecture process from all Operating Unit elements is used to drive architecture process improvements. |
Architecture Communication | Little communication exists about the IT Architecture process and possible process improvements. The DoC IT Architecture Web Page contains the latest version of the Operating Unit=s IT Architecture documentation. | The Operating Unit Architecture Home Page, which can be accessed from the DoC IT Architecture Web Page is updated periodically and is used to document architecture deliverables. Few tools (e.g., office suite, graphics packages) are used to document architecture. Communication about architecture process via meetings, etc., may happen, but sporadic. May have been handed out to IT staff. | Architecture documents updated and expanded regularly on DoC IT Architecture Web Page. Tools are used to support maintaining architecture documentation. Periodic presentations to IT staff on Architecture content. | Architecture documents are updated regularly, and frequently reviewed for latest architecture developments/ standards. Regular presentations to IT staff on Architecture content. Organizational personnel understand the architecture and its uses. | Architecture documents are used by every decision maker in the organization for every IT-related business decision. |
IT Security | considerations are ad hoc and localized. | IT Security Architecture has defined clear roles and responsibilities. | IT Security Architecture Standards Profile is fully developed and is integrated with IT Architecture. | Performance metrics associated with IT Security Architecture are captured. | Feedback from IT Security Architecture metrics are used to drive architecture process improvements. |
Governance | No explicit governance of architectural standards. Limited agreement with governance structure. | Governance of a few architectural standards (e. g. desktops, database management systems) and some adherence to existing Standards Profile. Variances may go undetected in the design and implementation phases. Various degrees of understanding of the proposed governance structure. | Explicit documented governance of majority IT investments. Formal processes for managing variances. Senior management team is supportive of enterprise-wide architecture standards and subsequent required compliance. | Explicit governance of all IT investments. Formal processes for managing variances feed back into IT Architecture. Senior-management team takes ownership of enterprise-wide architecture standards and governance structure. | Explicit governance of all IT investments. A standards and waivers process is used to improve architecture development and governance - process improvements. |
IT Investment and Acquisition Strategy | strategic planning and acquisition personnel in enterprise architecture process. Little or no adherence to existing Standards Profile. | Little or no formal governance of IT Investment and Acquisition Strategy. Operating Unit demonstrates some adherence to existing Standards Profile. | IT acquisition strategy exists and includes compliance measures to IT Enterprise Architecture. Operating Unit adheres to existing Standards Profile. RFQ, RFI and RFP content is influenced by the IT Architecture. Acquisition personnel are actively involved in IT Architecture governance structure. Cost-benefits are considered in identifying projects. | All planned IT acquisitions are guided and governed by the IT Architecture. RFI and RFP evaluations are integrated into the IT Architecture planning activities. | Operating Unit has no unplanned IT investment or acquisition activity. |
IT Service Capability
R
Between 1995 and 1999, two research projects were carried out in the Netherlands by three Dutch companies and three Dutch universities. Both projects were sponsored by the Dutch Ministry of Economic Affairs and had the goal of developing methods and techniques for improving IT services. A number methods and techniques were researched leading to an observation of significant variability in an organization's ability to enact service management practices. This led us to the hypothesis that some IT service providers were more mature than other IT service providers.
Termed the Kwintes project, it led to efforts to describe the maturity of IT service providers. A group of experts on IT service management and on the Software CMM developed a first sketch of the IT Service CMM and a detailed specification of the level two key process areas. In September 2000, a follow-up project was started, aimed at further specifying level three of the IT Service CMM.
The IT Service CMM is a maturity growth model, consisting of five maturity levels. Each maturity level describes a stage in the maturity of an IT service provider:
Maturity Level | Description | Processes |
Repeatable |
A Repeatable Service is aimed at implementing a number of basic capabilities that every IT service providers needs, and that are needed for every IT service. There are two primary kinds of processes that an organization has to implement at this level:
|
|
Standardized |
After the organization has established these capabilities it can progress to implementing Standardized services and service processes. By describing the services in a service catalogue and by developing standard processes for those standard services, the organization can standardize and unify its performance. Standardized Services fall into one of three categories.
|
|
Managed | On level four, the standard processes are managed quantitatively to reduce process variance. Organizations gain a quantitative understanding of their standard processes by taking detailed measures of service performance and service quality (Quantitative Process Management) and by using these quantitative data to control the quality of the delivered services (Service Quality Management). This results in more predictable performance and increases the ability of the organization to draw up realistic service level agreements. |
|
Continuous Improvement | Level five finally, is aimed at changing and improving processes and technology in a controlled manner. Service providers learn to change their processes to increase service quality and service process performance (Process Change Management). Changes in the processes are triggered by improvement goals, new technologies or problems that need to be resolved. New technologies are evaluated and introduced into the organization when feasible (Technology Change Management). Problems that occur are prevented from recurring by changing the processes (Problem Prevention). |
|
![]()
The organization's maturity level is determined by the IT organization's primary focus which migrates as it matures through the following stages:
|
The following grid compares these elements against the primary foci:
Stage | Vision and strategy | Steering | Processes | People | Technology | Culture |
Technology | Business views role of IT as Infrastructure provider of hardware, software and network provider). No clear vision statement on role of IT. | Principally driven by cost. Stability, availability and performance of IT platforms and networks are the main focus and implicit steering parameters. | Focus on Systems and Network Management, IT design and implementation | Technology excellence. | Systems and Network Management tools are independently purchased and used to manage technology subsets. | 'We are IT experts'. There is little interaction or understanding of providing 'services' to the business |
Product/Service | The IT Organization recognizes that it delivers a portfolio of products and services to the business. Evidence of IT strategic planning, little input from business. | Services are defined in technology terms such as bandwidth, processing performance, disc capacity. Reporting and steering on IT defined parameters. | Strong focus on ITIL Service Support processes and the more operational aspects of the ITIL Service Delivery processes, such as performance measurement and tuning, availability measurement and building resilience. Reporting mechanisms are used to improve product and service performance. | Clearer definition of IT functions. Recognition of first and second-line expertise. | More product standardization. Design of architectures and integration into management tools and systems. | Team and product orientation. Customer awareness and promotion towards Customers. |
Customer Focus | IT seen as IT service provider IT strategy linked to business strategy. | Service Level Agreements steer IT. Change Management integrated into project structure for ensuring smooth hand over from new IT development. | Service Level Management, formalized Account Management. More focus on planning aspects in delivery processes. Support processes deliver clear service and Customer related performance. Process reporting under pins service level agreements. | Service Management training and defined activities and roles. Evidence of process ownership, Formalized Account Management and Service Management roles in place. | Integrated systems and Service Management platforms, manageability built into technology designs and solutions. Operational requirements defined for hand-over into production environment | Customer satisfaction. |
Business Focus | IT is seen as a partner to the business. IT demonstrates strategy realization for the business. IT strategy input to business strategy making process | IT strategic goals, IT proposals made and discussed at board level. Business priority and risk assessments of investing and not investing in IT. Service levels are defined more in business terms, such as 'business transactions processed', 'availability of business functionality' | Business and IT-alignment processes. Strong Integration between Systems development and IT Service Management processes. Processes deliver 'dashboard steering information'. Service delivery and support processes integrated. Delivery processes deliver sound planning and advice to the business. | Business intelligence and business competencies. CIO role and CTO role. Equal roles in business and IT. | R and D and technology pilots. An enterprise-wide management framework exists defining integrated service and systems management tool sets. | The IT Organization provides help and advice to the business. |
Value chain | IT is seen as business enabler. IT helps shape and drive business Change and is seen as a value-added partner that helps determine business strategy. | IT is steered on added value to the business. Business improvements through use of IT. | Business and IT strategy making. The IT Organization ensures seamless integration with systems development and all other IT suppliers in the value chain to manage real end-to-end services for the business. | Strategy making, business planning, managing partners and suppliers. Infrastructure Integrators. | Technology interaction between suppliers. Solutions integration. | The IT Organization enables the business. |
In 1997, the CCTA reacted to this need and introduced a five-level process maturity model, based on similar models that had been developed for software production units, e.g. the Software Engineering Institute’s Capability Maturity Model (CMM) and ISO’s
Software Process Improvement and Capability determination (SPICE). This was revised to include intermediate stages with the result being a nine stage ITIL implementation measure. The CCTA developed a series of questions for each stage. The total score in any ITIL area would determine the organization's maturity with regard to that process.
This treatment acknowledges maturity as a key concept but by modifying the definitions at each level abandons much of the CMM maturity framework at each of those levels. CMM Integrated describes a key set of activities at each of those levels. These activities are replaced in this treatment with another broad (though related) set of descriptors deemed more reflective of processes such as ITIL.
This does, of course, follow directly from the intent of this scale which is to devise a set of questions which permits the assignment of a scale reflective of the maturity of that process area in order for the consulting firm to recommend and implement improvements. Once must, however, be careful in interpreting the scales...
IT Governance Maturity Framework (COBIT)
The COBIT framework utilizes a maturity model to provide benchmarks for the 34 processes (many of which are the same as ITIL).
MATURITY MODELS for control over IT processes consist of developing a method of scoring so that an organization can
grade itself from non-existent to optimized (from 0 to 5). This approach has been derived from the Maturity Model that the
Software Engineering Institute defined for the maturity of the software development capability. Against these levels, developed
for each of COBIT’s 34 IT processes, management can map:
|
The COBIT scale is based upon the Software Institute CMM scale. Each maturity has a general description which is subsequently adapted for meaning with each of the 34 governance process areas. The Maturity Models are built up starting from the generic qualitative model to which practices and principles from each of the following domains are added in increasing manner through the levels:
|
![]() |
The following table describes this increasing application of practices over the levels for the different topics. COBIT suggest that together with the qualitative model, it constitutes a generic maturity model applicable to most IT processes.
Level | Initial | Repeatable | Defined | Managed | Optimized |
Understanding & Awareness | Recognition | Awareness | Understanding of need to act | Understand full requirements | Advanced, forward-looking understanding |
Training & Communications | Sporadic communication on issues | Communication on the overall issue and needs | Informal training supports individual initiatives | Formal training supports a managed program | Training and communications support external best practices and use leading edge concepts |
Processes & Practices | Ad hoc approach to process and practice | Similar/common, but intuitive process emerges | Practices are defined, standardized and documented; sharing of better practices begins | Process ownership and responsibilities are set; process is sound and complete; internal best practices are applied | Best external practices are applied |
Techniques & Automation | Common tools are appearing | Tool set is standardized; currently available practices are used and enforced | Mature techniques are used; standard tools are enforced; limited tactical use of technology | Sophisticated techniques are deployed; extensive optimized use of technology | |
Compliance | Inconsistent monitoring on isolated issues | Inconsistent monitoring; measurement emerges; balanced score card adopted occasionally; root cause analysis is intuitive | Balanced scorecards are used in some areas; exceptions are noted; root cause analysis is standardized | Balanced scorecard is globally applied; exceptions are consistently noted and acted upon; root cause analysis is always applied | |
Expertise | Involvement of IT specialists in business processes | Involvement of all internal domain experts | Use of external experts and industry leaders for guidance |
CobIT Maturity Descriptions
The following table describes each of the 34 CobIT process areas by maturity characteristics. The CobIT processes outlined against a dark brown background are considered to be core processesN.
CobIT Process Area | Maturity Level | Description | ||||
1 | 2 | 3 | 4 | 5 | ||
PLANNING AND ORGANIZATION | ||||||
Strategic Planning | ![]() | ![]() | ![]() | ![]() | ![]() | |
Architectural Planning
| ![]() | ![]() | ![]() | ![]() | ![]() | |
Technology Direction | ![]() | ![]() | ![]() | ![]() | ![]() | |
IT Organization and Relationships | ![]() | ![]() | ![]() | ![]() | ![]() | |
IT Investment Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
Communicate Mgmt Aims & Directions | ![]() | ![]() | ![]() | ![]() | ![]() | |
Manage HR | ![]() | ![]() | ![]() | ![]() | ![]() | |
Ensure Compliance w. External Requirements | ![]() | ![]() | ![]() | ![]() | ![]() | |
Assess Risks | ![]() | ![]() | ![]() | ![]() | ![]() | |
Manage Projects | ![]() | ![]() | ![]() | ![]() | ![]() | |
Quality Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
ACQUISITION AND IMPLEMENTATION | ||||||
Solutions Development | ![]() | ![]() | ![]() | ![]() | ![]() | |
App SW Acquisition & Maintenance | ![]() | ![]() | ![]() | ![]() | ![]() | |
Tech. Acquisition & Maintenance | ![]() | ![]() | ![]() | ![]() | ![]() | |
Tech. Procedures Documentation | ![]() | ![]() | ![]() | ![]() | ![]() | |
Implementation & Accreditation | ![]() | ![]() | ![]() | ![]() | ![]() | |
Change Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
DELIVERY AND SUPPORT | ||||||
Service Level Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
External Provider Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
Performance/Capacity Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
Service Continuity Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
Security Access Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
Cost Accounting | ![]() | ![]() | ![]() | ![]() | ![]() | |
User Education and Training | ![]() | ![]() | ![]() | ![]() | ![]() | |
Service Desk | ![]() | ![]() | ![]() | ![]() | ![]() | |
Configuration Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
Incident/Problem Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
Data Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
Facilities Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
Operations Management | ![]() | ![]() | ![]() | ![]() | ![]() | |
MONITORING | ||||||
Process Monitoring | ![]() | ![]() | ![]() | ![]() | ![]() | |
Controls Assessment | ![]() | ![]() | ![]() | ![]() | ![]() | |
Assurance Reviews | ![]() | ![]() | ![]() | ![]() | ![]() | |
IT Audit | ![]() | ![]() | ![]() | ![]() | ![]() |
The achievement of higher levels of maturity must be preceded by an increasing involvement and participation of management. As sponsors of the movement they cannot simply "start the ball rolling" and hope that the momentum will be maintained. Instead, support must be continuous and include:
Sustaining Gains
Both CMMI and People make a distinction between practices designed to implement a habit and practices designed to institutionalize it. Without the later, all too often newly embedded practices will revert to previous, well-entrenched behaviors. The four institutional practices are displayed below.
![]() | Best Practices ![]() |