The fourth edition of the bestselling utilizationfocused evaluation provides expert, detailed advice on conducting program evaluations from one of leading experts. What is evaluation back to determining the evaluation question. The results of any particular effort cannot be guaranteed. F utilization focused evaluation a primer for evaluators. Brazil has its own brazilian evaluation network and in october of this year the latin american evaluation association will be launched in peru. Although the evaluation client and the primary intended user may be different, they are often one and the same, and for this reason we use the terms client and primary intended user interchangeably. In pattons latest book, essentials of utilizationfocused evaluation. A theory of change explains how to produce desired outcomes. Utilization focused evaluation makes this a priority patton, 2012, pp. Secondary audiences have limited direct involvement with running the project but are still interested in the evaluation report because the results may affect them in some way.
Indeed, pawson has described policies as theories incarnate. Evaluation models have not always supported such a range of needs. The checklist is based on essentials of utilization focused evaluation patton, 2012, sage. State of the art and practice of developmental evaluation. The book offers practical exercises at the end of each chapter. An evaluation of the diploma in adult and continuing education programme offered at great zimbabwe university david pesanai chipatiso lecturer, department of adult and continuing education, great zimbabwe university. The book includes the following ten sections and makes use of case examples and stories, cartoons, sidebars, and summary tables. This brief describes practical steps for designing and using theories of change and strategic learning debriefs as tools for creating the space and structure for strategic learning. It evaluation report 2 june 2012 this report describes the activities and findings of the useit uniting science education, inquiry, and technology iii project that ran from september 2011 to april 2012. In traditional evaluation, patton describes the evaluator as controlling the. Sph 504 health promotion planning and evaluation mccaffrey f2015. Triangulation in qualitative inquiry involves gathering and. Stufflebeams ipp evaluation model defining evaluation. Step 1 assess and build program and organizational readiness for utilizationfocused evaluation.
Download it once and read it on your kindle device, pc, phones or tablets. How to use qualitative methods in evaluation michael quinn. Developmental evaluation developmental evaluation was introduced by patton 2008 in his discussion of the concepts of utilizationfocused evaluation, which was first presented in the late 1980s and further developed in a rebuttal patton, 1996 to scrivens published description of the. I havent yet succumbed to the michael quinn patton. In the encyclopedia of evaluation, torres 2005 describes three distinct audiences for evaluations. For many years evaluation experts focused on simply measuring program outcomes patton 2011. The end of the book chapter 9 includes a lengthy discussion of qualitative. Patton has done this with essentials of utilization focused evaluation. Promoting personcentred practice within acute care. Utilizationfocused evaluation by michael quinn patton. Curran and colleagues 2012 suggest that evaluation of the interventions effectiveness will require or involve use of quantitative measures while evaluation of the implementation process will require or involve use of mixed methods. Evaluation involves the systematic collection of information about the activities, characteristics and outcomes of programs, personnel, and productsto reduce uncertainties, improve effectiveness and make decisions with regard to what those programs, personnel, or products are doing and affecting. It involves collecting and analyzing information about a programs activities, characteristics, and outcomes. The preface describes the basics of what developmental evaluation is, how it.
He has been teaching at the evaluators institute since its beginning. Qualitative research and evaluation methods for those in music education trying to present all approaches to research as reasonable and viable options, patton provides a biasfree presentation of appropriate terminology. June 2012 this report describes the activities and findings of the useit uniting science education, inquiry, and technology iii project that ran from september 2011 to april 2012. For many years evaluation experts focused on simply measuring program outcomes patton, 2011.
Chock full of useful pedagogyincluding a unique utilizationfocused evaluation checklistthis book presents michael quinn pattons distinctive opinions based on more than thirty years of experience. In this book, michael quinn patton describes the process of conducting developmental evaluations for ongoing program development. The preface describes the basics of what developmental evaluation is, how it has evolved, and its niche as evaluating innovations in complex dynamic environments. Designing qualitative studies 169 purposeful sampling perhaps nothing better captures the difference between quantitative and qualitative methods. Pattons utilization focused evaluation ufe is probably the most. Defining systems to evaluate system efficiency and. Sph 504 health promotion planning and evaluation mccaffrey. An evaluation of the diploma in adult and continuing. When conducting a hybrid type 1 design conducting a process evaluation of implementation in the context of a. This audience includes program participants and staff in the organization. One way to do this is for the evaluator and program people to develop a very good description of. Patton begins his book by identifying three kinds of data collection in qualitative.
The second was qualitative and was designed to assess search evaluations and doc. Qualitative research methods in sure start local programme evaluations. Michael quinn patton, phd, directs an organizational development and evaluation consulting business, utilizationfocused evaluation. This volume, the fourth in the kit, explains the basic assumptions underlying qualitative procedures, suggests evaluation situations where qualitative designs are useful, and provides guidelines for designing qualitative evaluations, including how to use observational methods. Evaluation is part of initial program design, including conceptualizing the theory of change evaluator s role is to help users clarify their purpose, hopedfor results, and change model. The evaluation of educational innovations in the 1950s. Wilson 2012 revised and expanded the evaluation theory tree framework beyond use, method. Newer evaluation models support learning about the dynamic processes within the programs. Hemmer2 1office of educational development, university of texas medical branch, 301 university boulevard, galveston, texas 775550408, usa, 2department of medicine, uniformed services, university of the health sciences, f. This audience would also be considered the primary intended users of the evaluation patton, 2012. Mertens and wilson 2012 revised and expanded the evaluation theory tree framework beyond use, method. Drawing on more than 40 years of experience conducting applied social science research and program evaluation, author mi.
Browse michael quinn patton resources innovation network. Evidence of process use is represented by the following kind of statement after an evaluation. Evaluation is a process that critically examines a program. Determine the extent to which qualitative methods are appropriate given the evaluations purposes and intended uses. The discussion shares lessons learned, and notes the relationship between methods used in system and program evaluation. The purpose of this chapter is to describe several of the most influential and useful evaluation models. Michael quinn patton ces, 2009 some evaluation premises.
Utilizationfocused evaluation ufe, developed by michael quinn patton, is an approach based on the principle that an evaluation should be judged on its usefulness to its intended users. When matched to an appropriate complex situation and circumstance, the developmental evaluator in effect becomes part of. The completely revised and updated edition of this methodological classic continues to provide practical, comprehensive and strategic guidance on qualitative design, purposeful sampling, interviewing, fieldwork, observation methods, and qualitative analysis and interpretation while integrating the extensive qualitative literature of the last decade. Here, evaluation questions are raised about the resources that will be used to develop and con. After a brief overview of the project activities and evaluation methods, the report describes the. Creates and integrates program goals, objectives, and evaluation criteria for a public health initiative. Jun 01, 2009 michael quinn patton ces, 2009 some evaluation premises. Pattons utilization focused evaluation ufe is probably the most wellknown theory of use though not without its critics3. Each evaluation being a blend of unique ingredients, no standardized recipe can assure the outcome. The checklist is based on essentials of utilizationfocused evaluation patton, 2012, sage publications.
These are not exercises for which one can go back and find the answer in the book, but rather applications that require a person to reflect and think. Describes steps and procedures for the planning, implementation, and evaluation of public health programs, policies and interventions. Thus, the evaluators sought a framework that could describe any relationship. Displaying sph 504 health promotion planning and evaluation mccaffrey f2015. The new material and innovative graphics present the utilizationfocused evaluation process as a complex adaptive system. Purposeful sampling for qualitative data collection and. A read is counted each time someone views a publication summary such as the title, abstract, and list of authors, clicks on a figure, or views or downloads the fulltext. Many timehonored evaluation models remain available for that limited but important purpose. Readers interested in that use are referred to the ufe curriculum. The cse program evaluation kit is a series of nine books intended to assist people conducting program evaluations. All references in the checklist to exhibits and menus refer to this book. Applying complexity concepts to enhance innovation and use. Designing qualitative studies 169 purposeful sampling perhaps nothing better captures the difference between quantitative and qualitative methods than the different logics that undergird sampling approaches. The paper describes how each of these elements informs the evaluation of step two of setevaluating system efficiency.
An evaluation can help a program improve their services, but can also help ensure that the program is delivering the right services. Michael patton, the father of developmental evaluation, describes this approach to evaluation as grounded in systems thinking, and supportive of innovation by collecting and analyzing real time data in ways that lad to informed and ongoing decision making as part of the design, development and implementation process. According to patton 1997, utilizationfocused program evaluation is evaluation done for and with specific, intended primary users for specific, intended uses p. Qualitative research and evaluation methods request pdf. Defining systems to evaluate system efficiency and effectiveness. Utilizationfocused evaluation begins with the premise that evaluations should be judged by their utility and actual use. Michael quinn patton, utilizationfocused evaluation, 740 mississippi river. Pdf utilizationfocused evaluation checklist researchgate. Patton started a ref lective practice process with the. The impact on our program came not so much from the findings but from going through the thinking process that. Therefore evaluations should be planned and conducted in ways that enhance the likely utilization of both the findings and of the process itself to inform. After receiving his doctorate in sociology from the university of wisconsinmadison, he spent 18 years.
Chock full of useful pedagogyincluding a unique utilizationfocused evaluation checklistthis book presents michael quinn patton s distinctive opinions based on more than thirty years of experience. This description helps to identify how the program should lead to the. Apr 01, 1978 the fourth edition of the bestselling utilizationfocused evaluation provides expert, detailed advice on conducting program evaluations from one of leading experts. A strong program evaluation process supports accountability while allowing educators to gain useful knowledge about their program and sustain ongoing program development goldie, 2006. Formative evaluation is evaluation designed, done, and in tended to support the process of improvement, and normally commissioned or done by, and delivered to, someone who can make improvements. The impact on our program came not so much from the findings but from going through the thinking process that the evaluation required. Evaluators canshould offer conceptual and methodological options. Be prepared to explain the variations, strengths, and weaknesses of qualitative evaluations. Evaluations, and those who request them, may often benefit, though, from a consideration of these other questions. He is the founder and director of utilizationfocused evaluation. Evaluation is part of initial program design, including conceptualizing the theory of change evaluators role is to help users clarify their purpose, hopedfor results, and change model.
Mertens and wilson 2012 revised and expanded the evaluation theory tree framework beyond use, method, and valuing oriented theories, showing the importance of a separate. How to use qualitative methods in evaluation michael. Integrating theory and practice kindle edition by quinn, patton michael. Details displaying sph 504 health promotion planning and evaluation mccaffrey f2015. Oct 26, 2012 maria mcduffie rated it it was amazing. Michael quinn patton, phd tei the evaluators institute. Michael quinn patton is an independent evaluation consultant with. Useit final evaluation report 2012 bowling green state.
He has been an independent evaluation practitioner for over 35 years and has worked at local, state, national, and international levels. As such, it assumes that stakeholders will have a high degree of involvement in many, if. Michael quinn patton born 1945 is an independent organizational development and program evaluation consultant, and former president of the american evaluation association. Utilizationfocused evaluation ufe, developed by michael quinn patton, is an. Its purpose is to make judgments about a program, to improve its effectiveness, andor to inform programming decisions patton, 1987. Utilization focused evaluation a primer for evaluators.
227 1428 181 907 563 506 395 448 697 120 511 1183 1276 1283 581 1417 1390 1034 1421 1556 1631 634 497 1232 403 963 633 685 1167 459 924 860 116 935