Confirmative Evaluation

Description

This much-needed book offers trainers, consultants, evaluation professionals, and human resource executives and practitioners a hands-on resource for understanding and applying the proven principles of confirmative evaluation. Confirmative evaluation is a marriage of evaluation and continuous improvement. Unlike other types of evaluation—which are used during the design of a learning program or applied immediately after conducting a program—confirmative evaluation follows several months after the program is implemented. It tests the endurance of outcomes, the return on investment, and establishes the effectivenss, efficiency, impact, and value of the training over time.

Confirmative Evaluation: Practical Strategies for Valuing Continuous Improvement 10
CONTENTS 14
LIST OF FIGURES, TABLES, AND PERFORMANCE SUPPORT TOOLS 18
- Figures 18
- Tables 18
- Performance Support Tools (PSTs) 19
ACKNOWLEDGMENTS 20
INTRODUCTION 22
PART 1 The Challenge 32
- 1 Full-Scope Evaluation: Raising the Bar 34
  - Evaluation: The Full Scope 36
    - Formative Evaluation 36
    - Summative Evaluation 37
    - Confirmative Evaluation 38
    - A Rose by Any Other Name 39

Confirmative Evaluation: Practical Strategies for Valuing Continuous Improvement 10
CONTENTS 14
LIST OF FIGURES, TABLES, AND PERFORMANCE SUPPORT TOOLS 18
- Figures 18
- Tables 18
- Performance Support Tools (PSTs) 19
ACKNOWLEDGMENTS 20
INTRODUCTION 22
PART 1 The Challenge 32
- 1 Full-Scope Evaluation: Raising the Bar 34
  - Evaluation: The Full Scope 36
    - Formative Evaluation 36
    - Summative Evaluation 37
    - Confirmative Evaluation 38
    - A Rose by Any Other Name 39
    - Meta Evaluation 40
  - Comparing the Four Types of Evaluation 42
    - Timing 43
    - Purpose 45
    - Customers 45
  - Evaluation: Full-Scope Model 46
  - Challenges to Full-Scope Evaluation 48
    - Daring to Go Beyond Formative and Summative Evaluation 48
    - Adjusting for Context Factors 49
    - Adapting to the New Organization 49
    - Overcoming the “Success Syndrome” 50
  - SUMMARY: LESSONS LEARNED IN CHAPTER ONE 51
  - NEXT STEPS 51
- 2 Confirmative Evaluation: A Model Guides the Way 52
  - Confirmative Evaluation Model 53
    - Inputs to Confirmative Evaluation 53
    - Process of Confirmative Evaluation 56
    - Outputs of Confirmative Evaluation 57
    - Outcomes of Confirmative Evaluation 58
    - Example of a Follow-Up Evaluation of Learning Outcomes 59
    - Meta Evaluation Centers Confirmative Evaluation 60
  - Challenges to Implementing Confirmative Evaluation 60
    - Gain and Maintain Organizational Support 61
    - Overcome Time Warp Factors 61
    - Model Continuous Improvement 62
    - Monitor Implementation 63
    - Conduct CBA or ROI 63
  - Why Bother? 64
    - Verify Accountability 65
    - Support Decision Making 65
    - Validate Success 66
    - Establish Professional Credibility 67
    - Respond to Trigger Events 67
  - SUMMARY: LESSONS LEARNED IN CHAPTER TWO 68
  - NEXT STEPS 68
- PART 2 Meeting the Challenge 70
  - 3 Preplan: Assess Training Program Evaluability 72
    - When to Plan Confirmative Evaluation 74
      - Proactive Planning 75
      - Reactive Planning 75
      - Movement Toward Proactive Planning? 76
    - How to Plan a Confirmative Evaluation 76
      - Planning Process Flow 77
      - Blended Approach 77
    - Assess Evaluability 79
      - Assess the Program 84
      - Assess Needs 85
      - Assess Outcomes 94
    - Challenges to Evaluability Assessment 99
    - SUMMARY: LESSONS LEARNED IN CHAPTER THREE 100
    - NEXT STEPS 100
  - 4 Plan: The Plan’s the Thing 104
    - What’s in a Confirmative Evaluation Plan? 106
      - Introduction 113
      - Evaluation Design 113
      - Executive Summary 113
      - Data Analysis and Interpretation Plan 127
      - Communication Plan 131
      - Administration Plan 131
    - Review, Validate, and Approve the Plan 132
    - SUMMARY: LESSONS LEARNED IN CHAPTER FOUR 133
    - NEXT STEPS 133
  - 5 Do: For Goodness’ Sake 138
    - Jump-Start Data Collection 139
      - Maintain the Plan 141
      - Just-in-Time Review 142
    - Focus Data Collection 143
    - Collect the Data 147
      - Extant Data Analysis Techniques and Tools 148
      - Interview Techniques and Tools 151
      - Group Techniques and Tools 151
      - Survey Techniques and Tools 153
      - Observation Techniques and Tools 157
    - Train the Data Collectors 158
    - Store the Data 158
    - Manage the Data-Collection Process 159
    - SUMMARY: LESSONS LEARNED IN CHAPTER FIVE 160
    - NEXT STEPS 160
  - 6 Analyze: Everything Old Is New Again 164
    - Get Ready, Get Set 165
    - Prepare the Confirmative Evaluation Data 166
      - Retrieve the Data 166
      - Inspect the Data 167
      - Organize the Data 167
    - Now Analyze 168
      - Quantitative Data Analysis 168
      - Qualitative Data Analysis 170
      - Cost Analysis 170
      - Return on Investment (ROI) Analysis 173
      - Add Risk Analysis to the Mix 174
    - Interpret Confirmative Evaluation Results 174
    - Make Results-Based Recommendations 177
    - Report Confirmative Evaluation Results 178
      - Consider Style, Format, and Content 178
      - Communicate, Communicate, Communicate 178
      - Use Communication Tools Wisely and Well 181
      - Inform and Inspire 181
    - SUMMARY: LESSONS LEARNED IN CHAPTER SIX 182
    - NEXT STEPS 182
  - 7 Improve: Now What? 188
    - Focus on Utilization 189
      - Improve Performance 190
      - Improve the Training Program 190
      - Improve Quality 192
      - Improve the Evaluation Process 193
    - Assume the Role 193
    - Accept the Challenge 194
      - Accept Accountability for Continuous Improvement 195
      - Maintain Stakeholder Commitment 195
      - Establish Credibility as a Partner 196
      - Overcome Inertia from Positive Evaluations 197
      - Maintain Focus on Utilization 197
      - Take Risks 198
      - Become a Change Agent 198
    - Alignment: The Last Word 199
    - SUMMARY: LESSONS LEARNED IN CHAPTER SEVEN 202
    - NEXT STEPS 202
  - PART 3 Lessons from Oz 204
    - 8 Case Study: Lions and Tigers and Bears, Oh My! 206
      - The Case Study 207
        
        Program Overview 207
        
        Trigger Event 210
        
        Stakeholder Input 211
        
        Confirmative Evaluation Activities 212
      - Meta Evaluation 217
      - Final Thoughts 219
      - SUMMARY: LESSONS LEARNED IN CHAPTER EIGHT 220
      - NEXT STEPS 220
    - 9 Conclusion: We’re Not in Oz Anymore 222
      - Issues That Challenge Confirmative Evaluators 223
        
        Need for a More Sophisticated Evaluation Workforce 224
        
        Forming Partnerships with Stakeholders 224
        
        Growing Respect for the Confirmative Evaluation Process 224
        
        The Challenge of Permanent Change 225
        
        Commitment to Advocacy Evaluation 225
        
        Evaluation-Driven Improvement and Decision Making 225
        
        Confirmative Evaluation as a Quality Kaleidoscope 226
        
        Knowing the Territory 226
        
        Emphasis on Ethics and Ethical Standards 227
      - Evaluation as an Emerging Discipline 228
      - Improving the Process 229
      - Put Yourself in the Picture 230
      - SUMMARY: LESSONS LEARNED IN CHAPTER NINE 233
      - NEXT STEPS 233
    - GLOSSARY 234
    - REFERENCES 242
    - INDEX 252
    - ABOUT THE AUTHORS 258
    - ABOUT THE SERIES EDITORS 260
    - ABOUT THE ADVISORY BOARD MEMBERS 264
    - Pfeiffer Publications Guide 266
      - FORMATS 266
      - METHODOLOGIES 267
      - TOPICS 269
    - What will you find on pfeiffer.com? 270
    - Customer Care 271
    - EULA 272

Practical Strategies for Valuing Continuous Improvement

Description

TOC

Reviews (0)