Essential Reference and Master Data Management

Essential:
Reference &
Master Data
© Copyright 2022 by Peter Aiken Slide # 1
peter.aiken@anythingawesome.com +1.804.382.5957 Peter Aiken, PhD
Peter Aiken, Ph.D.
• I've been doing this a long time
• My work is recognized as useful
• Associate Professor of IS (vcu.edu)
• Institute for Defense Analyses (ida.org)
• DAMA International (dama.org)
• MIT CDO Society (iscdo.org)
• Anything Awesome (anythingawesome.com)
• Experienced w/ 500+ data
management practices worldwide
• Multi-year immersions
– US DoD (DISA/Army/Marines/DLA)
– Nokia
– Deutsche Bank
– Wells Fargo
– Walmart
– HUD …
• 12 books and
dozens of articles
https://anythingawesome.com
+
• DAMA International President 2009-2013/2018/2020
• DAMA International Achievement Award 2001
(with Dr. E. F. "Ted" Codd
• DAMA International Community Award 2005

https://anythingawesome.com © Copyright 2022 by Peter Aiken Slide # 3
• Data Management Overview
• What is Reference and MDM?
• Why is Reference and MDM important?
• Reference & MDM Building Blocks
• Guiding Principles & Best Practices
• Take Aways, References & Q&A
Business Value from
Reference/Master
Data Strategies
Program
Data Management Practices Hierarchy
© Copyright 2022 by Peter Aiken Slide #
You can accomplish
Advanced Data Practices
without becoming proficient
in the Foundational Data
Management Practices
however this will:
• Take longer
• Cost more
• Deliver less
• Present
greater
risk
(with thanks to Tom DeMarco)
Advanced
Data
Practices
• MDM
• Mining
• Big Data
• Analytics
• Warehousing
• SOA
Foundational Data Management Practices
4
Data Platform/Architecture
Data Governance Data Quality
Data Operations
Data Management Strategy
T
e
c
h
n
o
l
o
g
i
e
s
C
a
p
a
b
i
l
i
t
i
e
s

Data$Management$
Strategy
Data Management Goals
Corporate Culture
Data Management Funding
Data Requirements Lifecycle
Data
Governance
Governance Management
Business Glossary
Metadata Management
Data
Quality
Data Quality Framework
Data Quality Assurance
Data
Operations
Standards and Procedures
Data Sourcing
Platform$&$
Architecture
Architectural Framework
Platforms & Integration
Supporting$
Processes
Measurement & Analysis
Process Management
Process Quality Assurance
Risk Management
Configuration Management
Component Process$Areas
Data
Governance
Data
Management
Strategy
Data
Operations
Platform
Architecture
Supporting
Processes
Maintain fit-for-purpose data,
efficiently and effectively
5
Manage data coherently
Manage data assets professionally
Data life cycle
management
Organizational support
Data
Quality
Data$Management$
Strategy
Corporate Culture
Data
Governance
Business Glossary
Metadata Management
Data
Quality
Data
Operations
Data Sourcing
Platform$&$
Architecture
Supporting$
Processes
Process Management
Risk Management
Data$Management$
Strategy
Corporate Culture
Data
Governance
Business Glossary
Metadata Management
Data
Quality
Data
Operations
Data Sourcing
Platform$&$
Architecture
Supporting$
Processes
Process Management
Risk Management
Data$Management$
Strategy
Corporate Culture
Data
Governance
Business Glossary
Metadata Management
Data
Quality
Data
Operations
Data Sourcing
Platform$&$
Architecture
Supporting$
Processes
Process Management
Risk Management
Data$Management$
Strategy
Corporate Culture
Data
Governance
Business Glossary
Metadata Management
Data
Quality
Data
Operations
Data Sourcing
Platform$&$
Architecture
Supporting$
Processes
Process Management
Risk Management
Data$Management$
Strategy
Corporate Culture
Data
Governance
Business Glossary
Metadata Management
Data
Quality
Data
Operations
Data Sourcing
Platform$&$
Architecture
Supporting$
Processes
Process Management
Risk Management
Data architecture
implementation
DMM℠ Structure of
5 Integrated
DM Practice Areas
Data architecture
implementation
Data
Governance
Data
Management
Strategy
Data
Operations
Platform
Architecture
Supporting
Processes
Maintain fit-for-purpose data,
efficiently and effectively
6
Manage data coherently
Manage data assets professionally
Data life cycle
management
Organizational support
Data
Quality
Data
Governance
Data
Quality
Platform
Architecture
Data
Operations
Data
Management
Strategy
3 3
1
1
Supporting
Processes
Optimized
Measured
Defined
Managed
Initial
Optimized
Measured
Defined
Managed
Initial
Optimized
Measured
Defined
Managed
Initial
Optimized
Measured
Defined
Managed
Initial
Your data foundation
can only be as strong
as its weakest link!
Optimized
Measured
Defined
Managed
Initial
Data
Management
Strategy
3

Blind Persons and the Elephant
https://anythingawesome.com http://www.dailymirror.lk/print/opinion/editorial-we-need-to-become-channels-of-peace/172-27164
It is like a fan!
It is like a snake!
It is like a wall!
It is like a rope!
It is like a tree!
Unrefined
data management
definition
Sources
Uses
Data Management

More refined
data management
definition
Sources
Reuse
Data Management
➜ ➜
Better still data management definition
Sources
➜ Use
➜Reuse
➜
Formal Data Reuse Management

Business Value from
Reference/Master
Data Strategies
Program
Metadata
Management
12
Data
Management
Body
of
Knowledge
(DM
BoK
V2)
Practice
Areas
from The DAMA Guide to the Data Management Body of Knowledge 2E © 2017 by DAMA International

Definitions
• Planning, implementation and control activities to ensure
consistency with a "golden" version of contextual data values
• … as opposed to mobile device management
• Gartner holds that MDM is a discipline or strategy
– "… where the business and the IT organization
work together to ensure the uniformity, accuracy,
semantic persistence, stewardship and accountability
of the enterprise's official, shared master data."
• Sold as technology-based solution
• Official, consistent set of identifiers - examples of these core entities
include:
– Parties (customers, prospects, people, citizens, employees, vendors, suppliers,
trading partners, individuals, organizations, citizens, patients, vendors, supplies,
business partners, competitors, students, products, financial structures *LEI*)
– Places (locations, offices, regional alignments, geographies)
– Things (accounts, assets, policies, products, services)
Definition: Reference Data Management
• Control over defined domain values (also known as vocabularies),
including:
– Control over standardized terms, code values and other unique identifiers;
– Business definitions for each value, business relationships within and across
domain value lists, and the;
– Consistent, shared use of
accurate, timely and
relevant reference data
values to classify and
categorize data.
Current Customer
Ex-Customer?
Potential Customer
VIP-Customer?
Residential
Customer
Commercial
Customer
Customer

Reference Data
• Reference Data:
– Data used to classify or categorize other data, the value domain
– Order status: new, in progress, closed, cancelled
– Two-letter USPS state code abbreviations (VA)
• Reference Data Sets
US United States
GB (not UK) United Kingdom
from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
Master Data
• Data about business entities providing
context for transactions but not limited
to pre-defined values
• Business rules dictate format and allowable ranges
– Parties (individuals, organizations, customers, citizens, patients, vendors,
supplies, business partners, competitors, employees, students)
– Locations, products, financial structures
• Provide context for transactions
• From the term "Master File"

Example Transaction Processing System
$5
Balance=$100 Balance=$95
Reference Data versus Master Data
• Reference Data:
– Control over defined
domain values
(vocabularies) for
standardized terms,
code values, and other
unique identifiers
– The fact that we
maintain these 9
specific gender codes
• Master Data:
– Control over master
data values to enable
consistent, shared,
contextual use across
systems
– The "golden" source of
the gender of your
customer "Pat"
Both provide the context for
transaction data

Business Value from
Reference/Master
Data Strategies
Program
Three Types of Data
• Reference
– Controls accessible data values
• Master
– Controls access to system capabilities
• Transaction
– Instances of values
Countries where we do business?
Types of accounts available?
Controlled vocabulary items
Are you a member of our premium club?
Authorizing uses/users?
Common/standard data structures
$5
Authorized
Like
Example from: Dr. Christopher Bradley of DMAdvisors–he has more, ping him at chris.bradley@dmadvisors.co.uk

What is Strategy?
• Current use derived from military
- a pattern in a stream of decisions
[Henry Mintzberg]
A thing
+ 1 Year
• Confusion as to the system's value
– Users lack confidence
– Business did not know how to use
"the MDM"
• General agreement
– Restart the effort
• "Root cause" analysis
– Consensus
– Poor quality data
– Inadequate training
• Response
– Get data quality-ing!
• Inexperienced
– Immature data quality practices
– Tool/technological focus
– Purchased a data quality tool

My most profound lesson! (so far)
Garbage In ➜ Garbage Out!
+
The consultant says "our methodology"
A realistic way to begin practicing MDM
• Select 3 data
management
practice areas
(for example)
– Reference
and Master
Data Management
– Data Quality
Management
– Data Governance

Interdependencies
Data Governance
Master Data
Data Quality
makes the
case and is
responsible for
is a necessary but
insufficient prerequisite
to success
MD capabilities
constrain governance
effectiveness
Iteration 1
Data
Strategy
Data
Governance
BI/
Warehouse
Perfecting
operations in 3
data management
practice areas
1X
1X
1X
Metadata
Data
Quality

Iteration 2
Data
Strategy
Data
Governance
BI/
Warehouse
Perfecting
operations in 3
data management
practice areas
Metadata
2X
2X
1X
Iteration 3
Data
Strategy
Data
Architecture
Data
Governance
Reference &
Master Data
Perfecting
operations in 3
data management
practice areas 1X
3X
3X

Vocabulary is Important-Tank, Tanks, Tankers
Multiple Sources of Master/Reference Data
Payroll Application
(3rd GL)
Payroll Data
(database)
R& D Applications
(researcher supported, no documentation)
R & D
Data
(raw) Mfg. Data
(home grown
database)
Mfg. Applications
(contractor supported)
Marketing Application
(4rd GL, query facilities,
no reporting, very large)
Marketing Data
(external database)
Finance
Data
(indexed)
Finance Application
(3rd GL, batch
system, no source)
Personnel App.
(20 years old,
un-normalized data)
Personnel Data
(database)
30

Reference Data Architecture
Master Data Architecture

Combined R/M Data Architecture
Task vs. Process Orientation
• What is meant by a task
orientation?
– Industrial work should be broken
down into its simplest and most
basic tasks
• What is meant by a process
orientation?
– Reunifying tasks into coherent
business processes
• What else must be part of the
analysis?
– Identify and abandon outdated rules
and assumptions that underlie
current business operations
Task 1
Task 2
Task 3
Task 4
Task 5
Task 6
Task 7
Task 8
Task 9
Task 10
Task 11
Task 12
Task 1
Task 7
Task 9
34

Automating Business Process Discovery (qpr.com)
• Benefits
– Obtain holistic perspective on roles
and value creation
– Customers understand and value
outputs
– All develop better shared
understanding
• Results
– Speed up process
– Cost savings
– Increased compliance
– Increased output
– IT systems documentation
35
Activities and Flows with amounts and durations

Process Flows and Durations
Traditional Engine

Prius Hybrid Engine

Sample MDM Business Process Overview
Attributed to Steven Steinerman
Business Value from
Reference/Master
Data Strategies
Program

Goals and Principles
1. Provide authoritative
source of reconciled,
high-quality master
and reference data.
2. Lower cost and
complexity through
reuse and leverage
of standards.
3. Support business
intelligence and
information integration efforts
https://anythingawesome.com from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
Reference & MDM Activities
• Understand reference and master
data integration needs
• Identify master and reference data
sources and contributors
• Define and maintain the data
integration architecture
• Implement reference and master
data management solutions
• Define and maintain match rules
• Establish “golden” records
• Define and maintain hierarchies and affiliations
• Plan and implement integration of new data sources
• Replicate and distribute reference and master data
• Manage changes to reference and master data

Specific Reference and MDM Investigations
• Who needs what information?
• What data is available from
different sources?
• How does data from different
sources differ?
• How can inconsistencies be reconciled?
• How should valid values be shared?
Primary Deliverables
• Data Cleansing Services
• Master and Reference
Data Requirements
• Data Models and Documentation
• Reliable Reference and Master Data
• "Golden Record" Data Lineage
• Data Quality Metrics and Reports

Roles and Responsibilities
• Suppliers:
– Steering Committees
– Business Data Stewards
– Subject Matter Experts
– Data Consumers
– Standards Organizations
– Data Providers
– ...
• Consumers:
– Application Users
– BI and Reporting Users
– Application Developers and Architects
– Data integration Developers and Architects
– BI Vendors and Architects
– Vendors, Customers and Partners
– ...
• Participants:
– Data Stewards
– Subject Matter Experts
– Data Architects
– Data Analysts
– Application Architects
– Data Governance Council
– Data Providers
– Other IT Professionals
– ...
Technology
• ETL
• Reference Data
Management Applications
• Master Data
Management Applications
• Data Modeling Tools
• Process Modeling Tools
• Meta-data Repositories
• Data Profiling Tools
• Data Cleansing Tools
• Data Integration Tools
• Business Process and Rule Engines
• Change Management Tools

Sample Solution Framework
SORs
SOR 1
SOR 2
SOR 3
SOR 4
SOR 5
SOR 6
SOR 7
SOR 8
Repository
Indicator
Extraction
Service
(could be
segmented by
day of week
month,
system, etc.)
Update
Addresses
Latency
Check
Service
Ch 1
Ch 2
Ch 3
Ch 4
Ch 5
Ch 6
Channels
Ch 7
Ch 8
External Address
Validation Processing
Customer
Contact
Inextricably intertwined implementations and …
Organized Knowledge 'Data'
Improved Quality Data
Data Organization Practices
Operational Data
Data Quality
Engineering
Master Data
Management
Practices
Suspected/
Identified
Data
Quality
Problems
Routine Data Scans
Master Data Catalogs
Routine Data Scans
Knowledge
Management
Practices
Data that might benefit from
Master Management
Sources( (
Metadata(Governance(
(
Metadata(
Engineering(
(
Metadata(
Delivery(
Uses(
Metadata(Prac8ces((dashed lines not in existence)
Metadata(
Storage(

Interactions
Improved Quality Data
Master
Data
Monitoring
Data
Governance
Practices
Master Data
Management
Practices
Governance
Violations
Monitoring
Data Quality
Engineering
Practices
Data
Quality
Monitoring
Monitoring
Results:
Suspected/
Identified
Data
Quality
Problems Data
Quality
Rules
Monitoring
Results:
Suspected/
Master
Data &
Characteristics
Routine
Data
Scans
Master
Data
Catalogs
Governance
Rules
Routine
Data
Scans
Monitoring
Rules
Focused
Data
Scans
Operational Data
Data
Harvesting
Quality
Rules
Business Value from
Reference/Master
Data Strategies
Program

"180% Failure Rate" Fred Cohen, Patni
http://www.igatepatni.com/bfs/solutions/payments.aspx
MDM Failure Root-Causes
• 30% of MDM programs are regarded as failures
• 70% of SOA projects in complex, heterogeneous
environments had failed to yield the expected
business benefits unless MDM is included
• Root-causes of failures:
– 80% percent of MDM initiatives fail because of ineffective leadership,
underestimated magnitudes or an inability to deal with the cultural impact of the
change
– MDM was implemented as a technology or as a project
– MDM was an Enterprise Data Warehouse (EDW) or an ERP
– MDM was an IT Effort
– MDM is separate to data governance and data quality
– MDM initiatives are implemented with inappropriate technology
– Internal politics and the silo mentality impede the MDM initiatives

15 MDM Success Factors
1. Success is more likely and when users and prospects understand
MDM limitations/strengths.
2. Taking small steps and remaining educated will increase
longer-term success with MDM.
3. Set the right expectations.
4. Long-term MDM success requires information architecture.
5. Create incentives to ensure that manage master data is desirable.
6. Strong alignment with the organization's business vision, will underpin MDM
success.
7. Use a framework through all stages of the MDM program — strategize, evaluate,
execute and review.
8. Gain high-level business sponsorship and build strong stakeholder support.
9. Creating an MDM vision and a strategy aligned to the organization’s business
vision.
10. Use MDM metrics to communicate success and measure progress.
11. Use a business case to increase business engagement.
12. Get the business to propose and own the KPIs.
13. Measure the situation before and after.
14. Translate the change in metrics into financial results.
15. Achieve a single view of master data
[Source: unknown]
10 Best Practices for MDM
• Active, involved executive sponsorship
• The business should own the data governance
process and the MDM or CDI project
• Strong project management and organizational change management
• Use a holistic approach - people, process, technology and
information
• Build your processes to be ongoing and repeatable, supporting
continuous improvement
• Management needs to recognize the importance of a dedicated team
of data stewards
• Understand your MDM hub's data model and how it integrates with
your internal source systems and external content providers
• Resist the urge to customize
• Stay current with vendor-provided patches
• Test, test, test and then test again.
Source:http://www.mdmsource.com/master-data-management-tips-best-practices.html
https://www.ase.org.uk/bestpractice

Guiding Principles
1. Shared R/M data belong to the organization
2. R/M data management is an on-going data quality improvement
program – goals cannot be achieved by 1 project alone.
3. Business data stewards are the authorities accountable at
determining the golden values.
4. Golden values represent the "best" sources.
5. Replicate master data values only from golden sources.
6. Reference data changes require formal change management
Seven Sisters (from British Telecom)
58
Thanks to Dave Evans
https://anythingawesome.com/sevensisters.html

Summary: Reference and MDM
References

Additional References
• http://www.mdmsource.com/master-data-management-tips-best-practices.html
• http://www.igate.com/22926.aspx
• http://www.itbusinessedge.com/cm/blogs/lawson/just-the-stats-master-data-
management/?cs=50349
• http://searchcio-midmarket.techtarget.com/news/2240150296/Smart-grid-
systems-expert-devises-business-transformation-template
• http://www.itbusinessedge.com/cm/blogs/lawson/free-report-shows-businesses-
fed-up-with-bad-data/?cs=50416
• http://www.itbusinessedge.com/cm/blogs/lawson/whats-ahead-for-master-data-
management/?cs=50082
• http://www.itbusinessedge.com/cm/blogs/vizard/master-data-management-
reaches-for-the-cloud/?cs=49264
• http://www.information-management.com/channels/master-data-
management.html
• http://www.dataversity.net/applying-six-sigma-to-master-data-management-
mdm-framework-for-integrating-mdm-into-ea-part-2/
• http://www.dataqualityfirst.com/getting_master_data_facts_straight_is_hard.htm
[ Clicking any webinar title will link directly to the registration page ]
Upcoming Events
Key Elements of a Successful
Data Governance Program
10 May 2022
Data Preparation Fundamentals
14 June 2022
Conceptual vs. Logical vs. Physical Data
12 July 2022
Brought to you by:
Time: 19:00 UTC (2:00 PM NYC) | Presented by: Peter Aiken, PhD

Peter.Aiken@AnythingAwesome.com +1.804.382.5957
Thank You!
Book a call with Peter to discuss anything - https://anythingawesome.com/OfficeHours.html
Strategic Review?
Hiring Assistance?
Reverse Engineering Expertise?
Training?
Mentoring?

Essential Reference and Master Data Management

More Related Content

What's hot

Similar to Essential Reference and Master Data Management

More from DATAVERSITY

Recently uploaded

Essential Reference and Master Data Management