Question 1

Evaluation research is unlike traditional social science research because:

Accepted Answer

A)  It is designed to test the implications of a social theory. 
B)  Program stakeholders have influence in how the study is designed. 
C)  Evaluation research cannot ethically use randomization. 
D)  Evaluation research rarely uses quantitative methods. 
E)  There is no dependent variable to be measured. 
A)  It is designed to test the implications of a social theory. 
B)  Program stakeholders have influence in how the study is designed. 
C)  Evaluation research cannot ethically use randomization. 
D)  Evaluation research rarely uses quantitative methods. 
E)  There is no dependent variable to be measured.

Question 2

What orientation to evaluation research expects researchers to be responsive primarily to the people involved with the program?

Accepted Answer

A)  Stakeholder approach 
B)  Social science approach 
C)  Integrative approach 
D)  Academic approach 
E)  Client approach 
A)  Stakeholder approach 
B)  Social science approach 
C)  Integrative approach 
D)  Academic approach 
E)  Client approach

Question 3

To lessen the potential detrimental impact of social programs, researchers should do all of the following, except:

Accepted Answer

A)  Vary treatments among settings rather than among individuals within a setting 
B)  Use the minimum sample size required to adequately test the results 
C)  Minimize the number in the untreated control group 
D)  Test just parts of new programs, rather than the entire program 
E)  Compare the presence and absence of treatments, rather than those that vary in intensity 
A)  Vary treatments among settings rather than among individuals within a setting 
B)  Use the minimum sample size required to adequately test the results 
C)  Minimize the number in the untreated control group 
D)  Test just parts of new programs, rather than the entire program 
E)  Compare the presence and absence of treatments, rather than those that vary in intensity

Question 4

What is the difference between an evaluation research project that assumes a black box and one that seeks to develop a program theory? What are the advantages and disadvantages to each?

Accepted Answer

Most evaluation research tries to determ

Question 5

One important difference between evaluation research and other social scientific research is:

Accepted Answer

A)  Evaluation research is often guided by politics. 
B)  Evaluation research rarely uses qualitative research. 
C)  Evaluation research rarely uses quantitative research. 
D)  Evaluation research is conducted by professional researchers. 
E)  Evaluation research is not widely respected by academics. 
A)  Evaluation research is often guided by politics. 
B)  Evaluation research rarely uses qualitative research. 
C)  Evaluation research rarely uses quantitative research. 
D)  Evaluation research is conducted by professional researchers. 
E)  Evaluation research is not widely respected by academics.

Question 6

Which of the following is a typical reason why a program cannot be evaluated?

Accepted Answer

A)  Management only wants its superior performance confirmed 
B)  Staff doesn't trust management to check on their performance 
C)  Personnel have no clear sense of what the program is trying to achieve 
D)  Program is not clearly distinct from other services provided by the agency 
E)  All of the above 
A)  Management only wants its superior performance confirmed 
B)  Staff doesn't trust management to check on their performance 
C)  Personnel have no clear sense of what the program is trying to achieve 
D)  Program is not clearly distinct from other services provided by the agency 
E)  All of the above

Question 7

Name some of the steps listed in the chapter that can be taken when ethical standards can't be met.

Accepted Answer

alter the group allocation ratios to min

Question 8

Impact analyses typically use quantitative data.

Accepted Answer

A) True 
 B)False

Question 9

Impact analysis generally relies on what sort of research design?

Accepted Answer

A)  Experimental and quasi-experimental 
B)  Open-ended surveys 
C)  Closed-ended surveys 
D)  One-shot case studies 
E)  Key informant interviewing 
A)  Experimental and quasi-experimental 
B)  Open-ended surveys 
C)  Closed-ended surveys 
D)  One-shot case studies 
E)  Key informant interviewing

Question 10

Which of the following is not a typical input in social programs?

Accepted Answer

A)  Clients 
B)  Customers 
C)  Cases 
D)  Participants 
E)  Feedback 
A)  Clients 
B)  Customers 
C)  Cases 
D)  Participants 
E)  Feedback

Question 11

The economic value of a social program when compared to the costs of that program is established in a:

Accepted Answer

A)  Cost-benefit analysis 
B)  Cost-effectiveness analysis 
C)  Process analysis 
D)  Summative assessment 
E)  Needs assessment 
A)  Cost-benefit analysis 
B)  Cost-effectiveness analysis 
C)  Process analysis 
D)  Summative assessment 
E)  Needs assessment

Question 12

Explain the two types of efficiency analysis and provide examples where each would be helpful.

Accepted Answer

a program may be evaluated for how effic

Question 13

Who are the individuals or groups that have some basis of concern about a social program?

Accepted Answer

A)  Sponsors 
B)  Clients 
C)  Stakeholders 
D)  Researchers 
E)  Professors 
A)  Sponsors 
B)  Clients 
C)  Stakeholders 
D)  Researchers 
E)  Professors

Question 14

Process evaluation investigates how a service is delivered.

Accepted Answer

A) True 
 B)False

Question 15

When is it appropriate to use qualitative methods for evaluation research?

Accepted Answer

A)  To uncover how different individuals react to treatment 
B)  For quick comparisons of categories 
C)  For systematically tracking change 
D)  For comparing outcomes between an experimental and a control group 
E)  None of the above 
A)  To uncover how different individuals react to treatment 
B)  For quick comparisons of categories 
C)  For systematically tracking change 
D)  For comparing outcomes between an experimental and a control group 
E)  None of the above

Question 16

Theory driven evaluation does which of the following?

Accepted Answer

A)  Assesses the relative costs of a social program 
B)  Determines the generalizability of a program 
C)  Guides the investigation of a program process 
D)  Suggests which outcomes should be measured 
E)  Designates the most theoretically significant outcome 
A)  Assesses the relative costs of a social program 
B)  Determines the generalizability of a program 
C)  Guides the investigation of a program process 
D)  Suggests which outcomes should be measured 
E)  Designates the most theoretically significant outcome

Question 17

Quasi-experimental designs are the preferred method for proving that a program created (or caused) a desired effect.

Accepted Answer

A) True 
 B)False

Question 18

The investigation of how a social program works is called a mechanism evaluation.

Accepted Answer

A) True 
 B)False

Question 19

In what circumstances should qualitative methods be used in evaluation research? In what circumstances should quantitative methods be used? Use examples to demonstrate your answer.

Accepted Answer

Qualitative methods, on the other hand,

Question 20

Stakeholders objectively define needs in a needs assessment.

Accepted Answer

A) True 
 B)False

Evaluation research is unlike traditional social science research because:

What orientation to evaluation research expects researchers to be responsive primarily to the people involved with the program?

To lessen the potential detrimental impact of social programs, researchers should do all of the following, except:

What is the difference between an evaluation research project that assumes a black box and one that seeks to develop a program theory? What are the advantages and disadvantages to each?

One important difference between evaluation research and other social scientific research is:

Which of the following is a typical reason why a program cannot be evaluated?

Name some of the steps listed in the chapter that can be taken when ethical standards can't be met.

Impact analyses typically use quantitative data.

Impact analysis generally relies on what sort of research design?

Which of the following is not a typical input in social programs?

The economic value of a social program when compared to the costs of that program is established in a:

Explain the two types of efficiency analysis and provide examples where each would be helpful.

Who are the individuals or groups that have some basis of concern about a social program?

Process evaluation investigates how a service is delivered.

When is it appropriate to use qualitative methods for evaluation research?

Theory driven evaluation does which of the following?

Quasi-experimental designs are the preferred method for proving that a program created (or caused) a desired effect.

The investigation of how a social program works is called a mechanism evaluation.

In what circumstances should qualitative methods be used in evaluation research? In what circumstances should quantitative methods be used? Use examples to demonstrate your answer.

Stakeholders objectively define needs in a needs assessment.

Science, Society, and Social Research

The Process and Problems of Social Research

Ethics in Research

Conceptualization and Measurement

Sampling and Generalizability

Causation and Experimental Design

Survey Research

Elementary Quantitative Data Analysis

Qualitative Methods: Observing, Participating, Listening

Qualitative Data Analysis

Evaluation Research

Filters

Exam 11: Unobtrusive Measures

Evaluation research is unlike traditional social science research because:

What orientation to evaluation research expects researchers to be responsive primarily to the people involved with the program?

To lessen the potential detrimental impact of social programs, researchers should do all of the following, except:

What is the difference between an evaluation research project that assumes a black box and one that seeks to develop a program theory? What are the advantages and disadvantages to each?

One important difference between evaluation research and other social scientific research is:

Which of the following is a typical reason why a program cannot be evaluated?

Name some of the steps listed in the chapter that can be taken when ethical standards can't be met.

Impact analyses typically use quantitative data.

Impact analysis generally relies on what sort of research design?

Which of the following is not a typical input in social programs?

The economic value of a social program when compared to the costs of that program is established in a:

Explain the two types of efficiency analysis and provide examples where each would be helpful.

Who are the individuals or groups that have some basis of concern about a social program?

Process evaluation investigates how a service is delivered.

When is it appropriate to use qualitative methods for evaluation research?

Theory driven evaluation does which of the following?

Quasi-experimental designs are the preferred method for proving that a program created (or caused) a desired effect.

The investigation of how a social program works is called a mechanism evaluation.

In what circumstances should qualitative methods be used in evaluation research? In what circumstances should quantitative methods be used? Use examples to demonstrate your answer.

Stakeholders objectively define needs in a needs assessment.

Science, Society, and Social Research

The Process and Problems of Social Research

Ethics in Research

Conceptualization and Measurement

Sampling and Generalizability

Causation and Experimental Design

Survey Research

Elementary Quantitative Data Analysis

Qualitative Methods: Observing, Participating, Listening

Qualitative Data Analysis

Evaluation Research

Filters