Distance Courses

The Domain of Evaluation

Dr. Michael Scriven

November 21-22, 2009. 10:00 am - 11:30 am (Pacific) each day.

An overview of evaluation that goes far beyond the usual emphasis on (i) program evaluation, even program evaluation as including the evaluation of organizations, institutions, processes, projects, and services, to include: (ii) the other standard divisions of evaluation—product evaluation (includes produce evaluation and technology assessment), proposal evaluation, performance evaluation, personnel evaluation, policy analysis, and portfolio evaluation; (iii) the three new divisions—meta-evaluation, public evaluation (by professional evaluators, professionals who are not evaluators, consumers, and politicians), and intradisciplinary evaluation (especially the evaluation of research); (iv) the classical evaluative subjects—logic and ethics, (v) the implicitly evaluative subjects of medicine, engineering, and political science. (vi) The relevance of the core logic of evaluation will be illustrated in each case, and the theory of evaluation as a transdiscipline explained.

This course will be taught in a live "virtual classroom" setting for 2 days, 1.5 hours per session. The courses are open to participants from anywhere on the globe. Students will interact with each other and Dr. Scriven through the aid of electronic video and voice contact, electronic whiteboard, and asynchronous access to the recordings of each class.

Technology Requirements: High-speed internet connection. Speakers necessary. Computer microphone a plus.

We are pleased to offer this exclusive online workshop at a very competitive price:

• Full workshop (3 hours): $45 (Nov 21-22, includes instruction and discussion)
• First Day of Instruction Only (1.5 hours): $25 (Nov. 21, instruction period only)

What Counts as Credible Evidence in Evaluation and Applied Research?

Dr. Stewart I. Donaldson

November 30 & December 1, 2009. 10:00 am - 11:30 am (Pacific) each day.

This short course is designed to explore one of the most fundamental issues facing evaluators today -- what counts as credible evidence in contemporary evaluation practice? Many thorny debates about what counts as evidence have occurred in recent years, but few have sorted out the issues in a way that directly informs contemporary evaluation and evidence-based practice. In a new book about credible evidence from SAGE, internationally renowned evaluators explore the challenges of designing and executing high quality evaluations. A summary of what can be learned from the chapter authors about the strengths and weaknesses of both experimental and non-experimental approaches for gathering credible and actionable evidence will be presented. A proposal to revise the notion of an "Experimenting Society" to an "Evidence-based Global Society", which includes replacing the "RCT Gold Standard" with the gold standard of "Methodological Appropriateness" will be offered as a avenue toward improving evaluation practice. Participants will come away from this course with an understanding of the philosophical, theoretical, methodological, political, and ethical dimensions of gathering credible evidence and will be able to apply these dimensions to fundamental evaluation choices we encounter in practice. Attendees should have a basic background in evaluation.

Students are encouraged to purchase and read in advance of the first class meeting:

• What Counts as Credible Evidence in Applied Research and Evaluation Practice? (2008) by Stewart I. Donaldson, Christina A, Christie, & Melvin M. Mark

Copies and a preview of this volume are available by following the link above.

This course will be taught in a live "virtual classroom" setting for 2 days, 1.5 hours per session. The courses are open to participants from anywhere on the globe. Students will interact with each other and Dr. Donaldson through the aid of electronic video and voice contact, electronic whiteboard, and asynchronous access to the recordings of each class.

Technology Requirements: High-speed internet connection. Speakers necessary. Computer microphone a plus.

We are pleased to offer this exclusive online workshop at a very competitive price:

• Full workshop (3 hours): $45 (Nov 30-Dec 1, includes instruction, discussion, and exercises)
• First Day of Instruction Only (1.5 hours): $25 (Nov 30, instruction period only)

Using Evaluation Theory to Improve Practice

Dr. Stewart I. Donaldson 

January 26-27, 2010. 10:00 am - 11:30 am (Pacific) each day.
SOLD OUT!

Contact us if you would like to be added to the waitlist for this event.

This short course will focus on how to use evaluation theory to improve evaluation practice. The basics of a range of evaluation theories will be reviewed, critiqued, and discussed by the participants. Strengths and limitations of these evaluation theories will be explored in the context of cases from evaluation practice. This course is designed to provide practicing evaluators an update on the key issues and challenges related to using contemporary evaluation theory in practice. It will also provide a broad overview and introduction to evaluation theory for those new to the field.

Students are encouraged to purchase and read in advance of the first class meeting:

• Donaldson, S.I. & Scriven, M. (2003). Evaluating social programs and problems: Visions for the new millennium. Mahwah, NJ: Erlbaum.

Copies and a preview of each volume are available by following the links above.

This course will be taught in a live "virtual classroom" setting for 2 days, 1.5 hours per session. The courses are open to participants from anywhere on the globe. Students will interact with each other and Dr. Donaldson through the aid of electronic video and voice contact, electronic whiteboard, and asynchronous access to the recordings of each class.

Technology Requirements: High-speed internet connection. Speakers necessary. Computer microphone a plus.

We are pleased to offer this exclusive online workshop at a very competitive price:

• Full workshop (3 hours): $45 (Nov 21-22, includes instruction and discussion)
• First Day of Instruction Only (1.5 hours): $25 (Nov. 21, instruction period only)

The Logic of Evaluation

Dr. Michael Scriven

February 20-21, 2010. 10:00 am - 11:30 am (Pacific) each day.
SOLD OUT!

The state of the art in extracting and formulating the common logic in program evaluation and all the other divisions of evaluation. Mastering this is analogous to learning basic statistics which you can then use to improve your work in many areas of research. The key types of evaluative claim, of evaluative operations, and of ways to combine evaluative claims with empirical findings.

The arguments that evaluation cannot be legitimated—e.g., the 'doctrine of value-free science'—and why these were accepted, despite their inconsistency with common sense. The relationship between evaluation, explanation, recommendation, classification, description, and prediction, and the problems in evaluation that result from failing to distinguish them. The special logical issues about causation, cost, and significance.

This course will be taught in a live "virtual classroom" setting for 2 days, 1.5 hours per session. The courses are open to participants from anywhere on the globe. Students will interact with each other and Dr. Scriven through the aid of electronic video and voice contact, electronic whiteboard, and asynchronous access to the recordings of each class.

Technology Requirements: High-speed internet connection. Speakers necessary. Computer microphone a plus.

We are pleased to offer this exclusive online workshop at a very competitive price:

• Full workshop (3 hours): $45 (Nov 21-22, includes instruction and discussion)
• First Day of Instruction Only (1.5 hours): $25 (Nov. 21, instruction period only)

Meta-Evaluation: A Checklist Approach

Dr. Michael Scriven

SOLD OUT!

March 13-14, 2010. 10:00 am - 11:30 am (Pacific) each day.

This seminar will be of general interest to evaluators interested in improving their work, and of special interest to those who have no intention of becoming professional evaluators, but realize they will probably have to use OR hire OR read and evaluate the work of professional evaluators. It will be taught so as to be accessible to both groups, as well as to evaluation students. Evaluators should have their own work meta-evaluated because doing so is crucial in showing that evaluators believe what they tell clients: that (particularly external) evaluation leads to improvement and accountability. A number of arguments for and against the use of, and particular approaches to meta-evaluation will be discussed, including the Meta-evaluation Checklist (MEC) which requires the determination of validity, credibility, utility, robustness, cost-effectiveness, and ethicality.

This course will be taught in a live "virtual classroom" setting for 2 days, 1.5 hours per session. The courses are open to participants from anywhere on the globe. Students will interact with each other and Dr. Scriven through the aid of electronic video and voice contact, electronic whiteboard, and asynchronous access to the recordings of each class.

Technology Requirements: High-speed internet connection. Speakers necessary. Computer microphone a plus.

We are pleased to offer this exclusive online workshop at a very competitive price:

• Full workshop (3 hours): $45 (March 13-14, includes instruction and discussion)
• First Day of Instruction Only (1.5 hours): $25 (March 13, instruction period only)

Ethnography: A Qualitative Approach for Evaluation and Applied Research

Dr. David Fetterman

May 11-12, 2010. 3:00 pm - 4:30 pm (Pacific) each day.

Dr. David Fetterman will be highlighting key concepts and techniques of one of the oldest qualitative approaches in the field -- ethnography. He will highlight concepts such as triangulation, culture, nonjudgmental orientation, inter- and intra-cultural diversity, and the emic perception of reality. He will also explore key classic methods and techniques such as interviewing and observation. A brief discussion about ethics will also be presented.
There will be a hands-on activity to help acquaint students with these approaches, techniques, and concerns. Dr. Fetterman will also demonstrate the value of digital photography, online surveys, blogs, collaborative web pages, and other tech tools to facilitate the process of conducting ethnographic work.

This workshop includes an exercise in which participants will share photos with a partner. All registrants are required to select, in advance, five electronic photos of objects that hold a special meaning to them. These photos will sent to another registrant at the end of the first session. A very short writing assignment will given between sessions. This portion of the workshop will require that participants exchange email addresses with their partner.

It is recommended that participants read, in advance of the workshop:

• Fetterman, D.M. (2010). Ethnography: Step by Step. (3rd edition). Thousand Oaks, CA: Sage.

• Full workshop (3 hours): $45 (May 11-12, includes instruction, discussion, and exercises)
• First Day of Instruction Only (1.5 hours): $25 (May 11, instruction period only)

Introduction to Practical Program Evaluation: A Theory-Driven Approach

Dr. Stewart I. Donaldson

REGISTRATION NOW CLOSED

May 25-26, 2010. 3:00 pm - 4:30 pm (Pacific) each day.

This short course will focus on how to design practical and cost-effective program evaluations. A step-by-step approach will be used to teach participants how to conduct accurate and useful program evaluations. Key topics will include how to articulate the importance of evidence-based decision making to clients, engaging stakeholders, developing conceptual frameworks such as program theories, theories of change, formulating and prioritizing evaluation questions, gathering credible evidence to answer key evaluation questions, managing resistance and excessive evaluation anxiety, and strategies for communicating and reporting evaluation findings to create positive social and organizational change.

Students are strongly encouraged to purchase and read in advance of the first class meeting:

• Program Theory-Driven Evaluation Science: Strategies and Applications (2007) by Stewart I. Donaldson
• What Counts as Credible Evidence in Applied Research and Evaluation Practice? (2008) by Stewart I. Donaldson, Christina A, Christie, & Melvin M. Mark

Copies and a preview of each volume are available by following the links above.

This course will be taught in a live "virtual classroom" setting for 2 days, 1.5 hours per session. The courses are open to participants from anywhere on the globe. Students will interact with each other and Dr. Donaldson through the aid of electronic video and voice contact, electronic whiteboard, and asynchronous access to the recordings of each class.

Technology Requirements: High-speed internet connection. Speakers necessary. Computer microphone a plus.

We are pleased to offer this exclusive online workshop at a very competitive price:

• Full workshop (3 hours): $45 (May 25-26, includes instruction, discussion, and exercises)
• First Day of Instruction Only (1.5 hours): $25 (May 25, instruction period only)

Using Technology to Enhance Evaluation and Applied Research

Dr. Tarek Azzam

June 8-9, 2010. 10:00 am - 11:30 am (Pacific) each day.

This workshop will focus on how to use a range of new technological tools to improve applied research and program evaluations. Specifically, we will explore the application of free or inexpensive software to engage clients and a range of stakeholders, collect research and evaluation data, formulate and prioritize research and evaluation questions, express and assess logic models and theories of change, track program implementation, provide continuous improvement feedback, determine program outcomes/impact, and to present data and findings. Participants will learn how to access tools such as Geographical Information Systems (GIS), data collection software, and interactive conceptual framing software to improve the quality of their applied research and evaluation projects. Participants will be provided with information sheets on each technological tool along with details about attaining free trials.

This course will be taught in a live "virtual classroom" setting for 2 days, 1.5 hours per session. The courses are open to participants from anywhere on the globe. Students will interact with each other and Dr. Azzam through the aid of electronic video and voice contact, electronic whiteboard, and asynchronous access to the recordings of each class.

Technology Requirements: High-speed internet connection. Speakers necessary. Computer microphone a plus.

We are pleased to offer this exclusive online workshop at a very competitive price:

• Full workshop (3 hours): $45 (June 8-9, includes instruction, discussion, and exercises)
• First Day of Instruction Only (1.5 hours): $25 (June 8, instruction period only)