Final Friday of the Month: Part 4 – Assessing Your T&D/ Learning/ Knowledge Systems

In this month’s Final Friday Feature we will address…

3 O’clock: T&D Cost/Benefits Measurement System

3.1    Cost/Benefits Measurement System Design and Deployment Process

3.2    Ongoing Cost/Benefits Measurement and Feedback Receiving Process

3.3    T&D Project Lessons Learned Process

3.4    Results Reporting and Archiving Process

This 12-part Blog series addresses the systems and processes of an organizational entity addressing T&D/ Learning/ Knowledge Management. Original source is my 2001 book:

2001 TDSV Book Cover

Free Book PDF

For more on this model please see the free 400+ page book: T&D Systems View at www.eppic.biz – which is intended as both an analytic and design tool – here.

The T&D/ L&D Clockface Model

We are “rockin’ round the clock” starting from the 12 O’Clock portion of the model – the most important sub-system in the system you have in place for T&D/ Learning/ Knowledge Management – IMO.

Your models may vary.

The 12 clockface positions of the T&D Systems View model each represent a subset of the total system’s Processes of T&D.

They are organized into three groupings.

– T&D Leadership Systems and Processes

– T&D Core Systems and Processes

– T&D Support Systems and Processes

Slide39

3 O’clock: T&D Cost/Benefits Measurement System

3.1    Cost/Benefits Measurement System Design and Deployment Process

3.2    Ongoing Cost/Benefits Measurement and Feedback Receiving Process

3.3    T&D Project Lessons Learned Process

3.4    Results Reporting and Archiving Process

T&D Cost/Benefits Measurement System – This system’s processes organize the measurement and reporting of all T&D metrics and provide the data and interpretations, where appropriate, to the T&D leadership, staff, and all of the key customers and stakeholders in the T&D marketplace.

3.1 Cost/Benefits Measurement System Design and Deployment Process Outputs and Their Utilities

The key outputs from the Cost/Benefits Measurement System Design and Deployment Process include the following:

Key Outputs Key Utilities
T&D measurement system design, e.g., BSC This design allows the T&D Governance and Advisory System to judge the need for and potential effectiveness of the planned process, before development/deployment planning.
T&D measurement system development and deployment plans These plans guide the effort to create (or buy) and install the T&D measurement system.

Is It Broken? Clues and Cues

Your Cost/Benefits Measurement System Design and Deployment Process may be broken if

  • You don’t measure or plan to measure key T&D efforts.
  • There is not a systematic business approach used to decide which efforts get measured and which do not.
  • Measurement is inconsistent, labor intensive, and the results reported are not insightful.
  • You rarely or never measure learning, performance, and/or business results.

3.2 Ongoing Cost/Benefits Measurement and Feedback Receiving Process Outputs and Their “Utilities”

The key outputs from the Ongoing Cost/Benefits Measurement and Feedback Receiving Process include the following:

Key Outputs Key Utilities
Measurement (raw) data Provides specific data regarding any one T&D product(s) or other T&D effort, enabling calculations and projections for return on investment, cost of conformance, and cost of nonconformance.
Measurement reports and interpretations Provide both generalized and specific data (depending on the target audience for the report) regarding any one or any group of T&D products or other T&D efforts, enabling calculations and projections for return on investment, cost of conformance, and cost of nonconformance.

Is It Broken? Clues and Cues

Your Ongoing Cost/Benefits Measurement and Feedback Receiving Process may be broken if you

Don’t know your general or specific costs, satisfaction levels for any or all of your stakeholders, mastery levels of learners after training, transfer levels back to the job, and return on investment for any or all of your critical T&D efforts.

Initially collected data, but efforts to do it have declined over time.

3.3 T&D Project Lessons Learned Process Outputs and Their “Utilities”

The key outputs from the T&D Project Lessons Learned Process include the following:

Key Outputs Key Utilities
Lessons learned reports (by project) Provide feedback to all involved in the particular project/effort.
Lessons learned archives Enable a search for information about what works and what doesn’t under certain conditions in similar projects/efforts. It is an enterprise wide compilation, organized by system and process type.

Is It Broken? Clues and Cues

Your T&D Project Lessons Learned Process may be broken if

  • You keep seeing the same kinds of mistakes and ineffective, costly approaches being used over and over again in successive projects.
  • Your team doesn’t know what worked and what didn’t work in the past, or why.

3.4 Results Reporting and Archiving Process Outputs and Their “Utilities”

The key outputs from the Results Reporting and Archiving Process include the following:

Key Outputs Key Utilities
Results reports Provide feedback to project teams and sponsors soon after projects are completed (or in process, depending on the system design) for individual project management.
Results summaries Provide feedback to T&D management and the governance and advisory groups soon after projects are completed (or in process, depending on the system design) for overall system management.

Is It Broken? Clues and Cues

Your Results Reporting and Archiving Process may be broken if

  • Your stakeholders don’t know the results of the investments and expenses made in enterprise T&D.
  • You can’t really begin to predict the future in terms of T&D costs and returns based on past T&D projects/efforts.
  • You can’t go back and look at or find past project results.

Prior Posts In This 2015 Series

Part 1: 12 O’clock: The T&D Governance & Advisory System – January 2015

Part 2: 1 O’clock: The T&D Strategic Planning System –  February 2015

Part 3: 2 O’clock: The T&D Operations Planning & Management System – March 2015

Clock - no bg copy

Free Book PDF

For more on this model please see the free 400+ page book: T&D Systems View at www.eppic.biz – which is intended as both an analytic and design tool – here.

Guy W. Wallace

Guy W. Wallace, has been an external ISD/HPT consultant since 1982, is the president of EPPIC Inc., and is a past president of ISPI – the International Society for Performance Improvement. He has consulted with 75+ clients on ISD efforts since 1982, including projects with more than 45 F500 firms.

WIN_20150207_091512 - Copy

He is the author of the book:  leanISD, a recipient of an ISPI 2002 Award of Excellence. He has also authored/co-authored 13 other books.

He may be reached via, and related resources may be obtained, at his web site: www.eppic.biz or via email at: guy.wallace @ eppic.biz

# # #

Monday Morning Quarter PACT #49

Take a Quarter Hour or Less

To develop your ability to adopt and adapt the PACT Processes for ISD – to meet your Requirements and Constraints.

For Performance Improvement and positive ROI when properly targeted.

Slide1

The PACT Video Shorts Series Index and Links

Series Index Page

A- PACT Overviews

B- PACT Analysis

C- CAD – Curriculum Architecture Design

D- MCD – Modular Curriculum Development

E- IAD – Instructional Activity Development

F- Project Planning & Management

G- Group Process Facilitation Tips

H- EPPI – Performance Improvement

*** *** *** ***

This week’s video…

G6- PACT Facilitation Via the Web 

Video Short G6- PACT Facilitation Via the Web

Reminder – this is just one video of a collection of over 55 free “School of PACT” videos, that in combination with free books, articles, presentations and for fee books intends to enable the practice of performance-based Instructional Systems Design. To improve Performance Competence at the worker level, the work level, and the workplace level. For Individual, Process and Organizational performance improvement.

You may view them in sequence – or bounce around to eventually do just some or all of them.

See the Resource Tab or The Pursuing Performance Blog and the EPPIC Web Site for additional free resources – here.

See the entire School of PACT video collection Index – here.

What is PACT?

PACT is performance-based ISD… at 3 levels… with common analysis and project management approaches, tools and techniques… to speed the ISD process… to be effective while being efficient…

PACT Logo w 5 Methodologies 2

Other PACT Resources

See all of the EPPIC Videos on YouTube – here.

Books for free – here.

Books for sale – here.

Slide3

This MMQP Series

This Blog series will post each Monday at 8 am east coast time (USA).

Gopher-perched-transparent

Go for it – here – Monday Mornings!

Why PACT?

The benefits?

Slide40

PACT is Proven

# # #

Remembering the Late Geary A. Rummler

Join Me In My Annual Rummler Booster Shot

Tomorrow – April 17th – is the anniversary of the birth of the late Geary A. Rummler, PhD.

hqdefault

***Note: my apologies. I have had his birth date off by one day for a decade. He never corrected my early wishes. Again, my apologies. The 17th is the correct date. ***

I would normally get my annual booster shot at the ISPI Conferences (and NSPI before that) – every April.

rummlerbd2010

But since Geary passed away in October of 2008 – that last time I saw and spoke with him was at the ISPI Conference in 2008 – and I had the pleasure of video recording him in my HPT Practitioner Series – see that video below.

g1

Here are 4 videos for your Booster Shots…

Video 2008

Video 1981

Here I sit with others in a Motorola conference room in April 1981 – with the good doctor Rummler addressing us. This was 1 week before my official start date at Motorola’s Training & Education Center (MTEC). This is but one hour of a day long session. Wish I had all of the video shot that day.

This next photo is from a business trip he and I took to Arizona for MTEC in 1982.

82-007gearymtec

Video 1986

This 1986 Video is on Performance Engineering…

hqdefault (1)

Video 1986

Another video from 1986 on Needs Analysis

And – an Audio File

This audio file – is now buried in my Web Site “Resource” page – under My Mentors (Rummler); and I am posting it here as well:

Linking Organizational & Individual Performance Through Measures – Geary A Rummler 1994

It will be a very important 90 minutes in Your Development – if you are in any number of Performance Improvement arenas where Measurement is important (and where not!?!) – or performance-based Learning/Training and Performance Support – and – it is classic Rummler – dry humor – makes fun of himself (his: “you can also get this on the head of a pin” reminded me of the late Claude (Butch) Lineberry’s comment crediting Rummler with the invention of the “point oh four” sized font).

Rummler Tribute at ISPI 2009

RIP – Geary

I hope you get something of value from me sharing with you my Booster Shots!2009-03-07-031

For more about the late Geary A. Rummler – please visit the Performance Design Lab – PDL – web site  – here.

# # #

My Model for the Enablers of Process Performance

And Learning Is But One of 12 Sets of Enablers 

Which was/is important to me as a L&D professional who wants to help his clients achieve their real – if sometimes unstated – goal of improving the Performance in some Process – or many Processes.

So this is My Fishbone Diagram, My Ishikawa Diagram…

Slide3

Once you determine any gaps in Products from the Process – you can trace back the gaps in the enabling systems’ Products & Processes – using the same set of analysis models.

The Provisioning Systems of the Enterprise

Don’t look like this – the model below – but this is what I use to start the assessment of who is responsible for providing the Enablers to the Processes where there is a gap.

P Analysis and HAMS-EAMS

Peeling back the onion – so to speak. Matrix the Org Chart against this model.

Going the other way … up …

The Big Picture of EPPI

Slide1

Side 2 if you will…

Slide2

These are my starting place models – which get adapted if they cannot be adopted.

Slide1

Your models may vary.

# # #

Monday Morning Quarter PACT #48

Take a Quarter Hour or Less

To develop your ability to adopt and adapt the PACT Processes for ISD – to meet your Requirements and Constraints.

For Performance Improvement and positive ROI when properly targeted.

Slide1

The PACT Video Shorts Series Index and Links

Series Index Page

A- PACT Overviews

B- PACT Analysis

C- CAD – Curriculum Architecture Design

D- MCD – Modular Curriculum Development

E- IAD – Instructional Activity Development

F- Project Planning & Management

G- Group Process Facilitation Tips

H- EPPI – Performance Improvement

*** *** *** ***

This week’s video…

G5- PACT Facilitation Tips 10-11-12 

Video Short G5- PACT Facilitation Tips 10-11-12

Reminder – this is just one video of a collection of over 55 free “School of PACT” videos, that in combination with free books, articles, presentations and for fee books intends to enable the practice of performance-based Instructional Systems Design. To improve Performance Competence at the worker level, the work level, and the workplace level. For Individual, Process and Organizational performance improvement.

You may view them in sequence – or bounce around to eventually do just some or all of them.

See the Resource Tab or The Pursuing Performance Blog and the EPPIC Web Site for additional free resources – here.

See the entire School of PACT video collection Index – here.

What is PACT?

PACT is performance-based ISD… at 3 levels… with common analysis and project management approaches, tools and techniques… to speed the ISD process… to be effective while being efficient…

PACT Logo w 5 Methodologies 2

Other PACT Resources

See all of the EPPIC Videos on YouTube – here.

Books for free – here.

Books for sale – here.

Slide3

This MMQP Series

This Blog series will post each Monday at 8 am east coast time (USA).

Gopher-perched-transparent

Go for it – here – Monday Mornings!

Why PACT?

The benefits?

Slide40

PACT is Proven

# # #

Monday Morning Quarter PACT #47

Take a Quarter Hour or Less

To develop your ability to adopt and adapt the PACT Processes for ISD – to meet your Requirements and Constraints.

For Performance Improvement and positive ROI when properly targeted.

Slide1

The PACT Video Shorts Series Index and Links

Series Index Page

A- PACT Overviews

B- PACT Analysis

C- CAD – Curriculum Architecture Design

D- MCD – Modular Curriculum Development

E- IAD – Instructional Activity Development

F- Project Planning & Management

G- Group Process Facilitation Tips

H- EPPI – Performance Improvement

*** *** *** ***

This week’s video…

G4- PACT Facilitation Tips 7-8-9 

Video Short G4- PACT Facilitation Tips 7-8-9

Reminder – this is just one video of a collection of over 55 free “School of PACT” videos, that in combination with free books, articles, presentations and for fee books intends to enable the practice of performance-based Instructional Systems Design. To improve Performance Competence at the worker level, the work level, and the workplace level. For Individual, Process and Organizational performance improvement.

You may view them in sequence – or bounce around to eventually do just some or all of them.

See the Resource Tab or The Pursuing Performance Blog and the EPPIC Web Site for additional free resources – here.

See the entire School of PACT video collection Index – here.

What is PACT?

PACT is performance-based ISD… at 3 levels… with common analysis and project management approaches, tools and techniques… to speed the ISD process… to be effective while being efficient…

PACT Logo w 5 Methodologies 2

Other PACT Resources

See all of the EPPIC Videos on YouTube – here.

Books for free – here.

Books for sale – here.

Slide3

This MMQP Series

This Blog series will post each Monday at 8 am east coast time (USA).

Gopher-perched-transparent

Go for it – here – Monday Mornings!

Why PACT?

The benefits?

Slide40

PACT is Proven

# # #