Question 1

What is the most useful indicator of reliability for the interpretation of individual scores?

Accepted Answer

A) split-half variance 
B) item sampling 
C) test-retest 
D) standard error of measurement 
A) split-half variance 
B) item sampling 
C) test-retest 
D) standard error of measurement

Question 2

Upon repeated applications of the same test, performance on the second application may be affected by previous experience on the test. This is known as

Accepted Answer

A) attenuation. 
B) a carryover effect. 
C) shrinkage. 
D) selected recall. 
A) attenuation. 
B) a carryover effect. 
C) shrinkage. 
D) selected recall.

Question 3

Who developed methods for evaluating sources of error in behavioral research?

Accepted Answer

A) Edward Thorndike 
B) Kuder and Richardson 
C) Charles Spearman 
D) Cronbach 
A) Edward Thorndike 
B) Kuder and Richardson 
C) Charles Spearman 
D) Cronbach

Question 4

Which of the following is a source of measurement error?

Accepted Answer

A) respondent sampling 
B) scorer sampling 
C) internal consistency 
D) external consistency 
A) respondent sampling 
B) scorer sampling 
C) internal consistency 
D) external consistency

Question 5

Which of the following is a problem in evaluating the agreement between observers in behavioral studies?

Accepted Answer

A) The observers are usually not trained. 
B) The behaviors being studied are usually not directly observable. 
C) There will always be some agreement by chance. 
D) There is no method for evaluating the agreement between observers. 
A) The observers are usually not trained. 
B) The behaviors being studied are usually not directly observable. 
C) There will always be some agreement by chance. 
D) There is no method for evaluating the agreement between observers.

Question 6

Classical Test Theory is based on certain assumptions. Discuss these basic assumptions and the theory behind them, and then address the challenges to any of these assumptions.

Accepted Answer

Classical Test Theory (CTT) is based on

Question 7

There are several methods to estimate reliability. Compare and contrast the different methods of reliability discussed in this chapter, stressing the importance of coefficient alpha.

Accepted Answer

Reliability is a crucial aspect of any m

Question 8

When talking about errors in terms of psychological testing, we are referring to the fact that:

Accepted Answer

A) someone got an answer incorrect. 
B) there is always some inaccuracy in the measurement. 
C) the test was inappropriate for that particular group. 
D) the score is too subjective to be accurate. 
A) someone got an answer incorrect. 
B) there is always some inaccuracy in the measurement. 
C) the test was inappropriate for that particular group. 
D) the score is too subjective to be accurate.

Question 9

Describe the reasons for the large movement from Classical Test Theory to Item Response Theory.

Accepted Answer

There are several reasons for the large

Question 10

Explain how someone might decide how reliable is "reliable enough" for a measure. What settings might warrant more stringent criteria for reliability, and why?

Accepted Answer

Deciding how reliable is "reliable enoug

Question 11

The reliability of a difference score is

Accepted Answer

A) equal to the reliability of the most reliable of the two measures. 
B) equal to the reliability of the least reliable of the two measures. 
C) the average reliability of the two measures. 
D) expected to be lower than the reliability of either of the two measures. 
A) equal to the reliability of the most reliable of the two measures. 
B) equal to the reliability of the least reliable of the two measures. 
C) the average reliability of the two measures. 
D) expected to be lower than the reliability of either of the two measures.

Question 12

The difference between David's two typing tests, one at the beginning of the semester and one at the end, reflects the fact that he typed quite a few term papers during the semester. This reflects

Accepted Answer

A) attenuation. 
B) random error. 
C) practice effects. 
D) domain sampling. 
A) attenuation. 
B) random error. 
C) practice effects. 
D) domain sampling.

Question 13

If a researcher is attempting to assess the reliability of a measure of depression, the method of choice would be

Accepted Answer

A) internal consistency. 
B) time sampling. 
C) the test-retest method. 
D) more than one of these. 
A) internal consistency. 
B) time sampling. 
C) the test-retest method. 
D) more than one of these.

Question 14

We can get an idea of how much measurement error is present in a score through the

Accepted Answer

A) true score. 
B) observed score. 
C) standard error of the mean. 
D) standard error of measurement. 
A) true score. 
B) observed score. 
C) standard error of the mean. 
D) standard error of measurement.

Question 15

An observed score is composed of

Accepted Answer

A) the residual and the true score. 
B) the criterion and the predictor. 
C) the measurement error and the predictor. 
D) the true score and the measurement error. 
A) the residual and the true score. 
B) the criterion and the predictor. 
C) the measurement error and the predictor. 
D) the true score and the measurement error.

Question 16

Why might different random samples of domain items yield different estimates of the true score?

Accepted Answer

A) sampling error 
B) poor reliability 
C) respondent error 
D) item bias 
A) sampling error 
B) poor reliability 
C) respondent error 
D) item bias

Question 17

Dr. Janine developed two equivalent forms of a test and administered them both, in counter-balanced order, to a group of people on the same day in order to assess reliability. What is this called?

Accepted Answer

A) test- retest 
B) parallel forms 
C) split-half 
D) KR 20 
A) test- retest 
B) parallel forms 
C) split-half 
D) KR 20

Question 18

Measures of test-retest reliability are sometimes considered inappropriate for the evaluation of health status because

Accepted Answer

A)  health status tests should not given at multiple points in time. 
B) variations in health status may be related to true changes over time rather than measurement error. 
C) there is no domain of health status. 
D) health status is too complicated to measure. 
A)  health status tests should not given at multiple points in time. 
B) variations in health status may be related to true changes over time rather than measurement error. 
C) there is no domain of health status. 
D) health status is too complicated to measure.

Question 19

Items are probably measuring the same thing when the correlation between an item and the total score

Accepted Answer

A) is high. 
B) is low. 
C) approaches 0. 
D) is negative. 
A) is high. 
B) is low. 
C) approaches 0. 
D) is negative.

What is the most useful indicator of reliability for the interpretation of individual scores?

Upon repeated applications of the same test, performance on the second application may be affected by previous experience on the test. This is known as

Who developed methods for evaluating sources of error in behavioral research?

Which of the following is a source of measurement error?

Which of the following is a problem in evaluating the agreement between observers in behavioral studies?

Classical Test Theory is based on certain assumptions. Discuss these basic assumptions and the theory behind them, and then address the challenges to any of these assumptions.

There are several methods to estimate reliability. Compare and contrast the different methods of reliability discussed in this chapter, stressing the importance of coefficient alpha.

When talking about errors in terms of psychological testing, we are referring to the fact that:

Describe the reasons for the large movement from Classical Test Theory to Item Response Theory.

Explain how someone might decide how reliable is "reliable enough" for a measure. What settings might warrant more stringent criteria for reliability, and why?

The reliability of a difference score is

The difference between David's two typing tests, one at the beginning of the semester and one at the end, reflects the fact that he typed quite a few term papers during the semester. This reflects

If a researcher is attempting to assess the reliability of a measure of depression, the method of choice would be

We can get an idea of how much measurement error is present in a score through the

An observed score is composed of

Why might different random samples of domain items yield different estimates of the true score?

Dr. Janine developed two equivalent forms of a test and administered them both, in counter-balanced order, to a group of people on the same day in order to assess reliability. What is this called?

Measures of test-retest reliability are sometimes considered inappropriate for the evaluation of health status because

Items are probably measuring the same thing when the correlation between an item and the total score

Introduction

Norms and Basic Statistics for Testing

Correlation and Regression

Validity

Writing and Evaluating Test Items

Test Administration

Interviewing Techniques

Theories of Intelligence and the Binet Scales

The Wechsler Intelligence Scales: Wais-Iv, Wisc-Iv, and Wppsi-III

Testing in Education: Tests of Ability in Education and Special Education

Standardized Tests in Education, Civil Service, and the Military

Applications in Clinical and Counseling Settings

Projective Personality Tests

Computers and Basic Psychological Science in Testing

Testing in Counseling Psychology

Testing in Health Psychology and Health Care

Testing in Industrial and Business Settings

Test Bias

Testing and the Law

The Future of Psychological Testing

Filters

Exam 4: Reliability

What is the most useful indicator of reliability for the interpretation of individual scores?

Upon repeated applications of the same test, performance on the second application may be affected by previous experience on the test. This is known as

Who developed methods for evaluating sources of error in behavioral research?

Which of the following is a source of measurement error?

Which of the following is a problem in evaluating the agreement between observers in behavioral studies?

Classical Test Theory is based on certain assumptions. Discuss these basic assumptions and the theory behind them, and then address the challenges to any of these assumptions.

There are several methods to estimate reliability. Compare and contrast the different methods of reliability discussed in this chapter, stressing the importance of coefficient alpha.

When talking about errors in terms of psychological testing, we are referring to the fact that:

Describe the reasons for the large movement from Classical Test Theory to Item Response Theory.

Explain how someone might decide how reliable is "reliable enough" for a measure. What settings might warrant more stringent criteria for reliability, and why?

The reliability of a difference score is

The difference between David's two typing tests, one at the beginning of the semester and one at the end, reflects the fact that he typed quite a few term papers during the semester. This reflects

If a researcher is attempting to assess the reliability of a measure of depression, the method of choice would be

We can get an idea of how much measurement error is present in a score through the

An observed score is composed of

Why might different random samples of domain items yield different estimates of the true score?

Dr. Janine developed two equivalent forms of a test and administered them both, in counter-balanced order, to a group of people on the same day in order to assess reliability. What is this called?

Measures of test-retest reliability are sometimes considered inappropriate for the evaluation of health status because

Items are probably measuring the same thing when the correlation between an item and the total score

Introduction

Norms and Basic Statistics for Testing

Correlation and Regression

Validity

Writing and Evaluating Test Items

Test Administration

Interviewing Techniques

Theories of Intelligence and the Binet Scales

The Wechsler Intelligence Scales: Wais-Iv, Wisc-Iv, and Wppsi-III

Testing in Education: Tests of Ability in Education and Special Education

Standardized Tests in Education, Civil Service, and the Military

Applications in Clinical and Counseling Settings

Projective Personality Tests

Computers and Basic Psychological Science in Testing

Testing in Counseling Psychology

Testing in Health Psychology and Health Care

Testing in Industrial and Business Settings

Test Bias

Testing and the Law

The Future of Psychological Testing

Filters