Question 1

Which of the following might lead to a decrease in test-retest reliability?

Accepted Answer

A)  the passage of time between the two administrations of the test. 
B)  coaching designed to increase test scores between the two administrations of the test. 
C)  practice with similar test materials between the two administrations of the test. 
D)  All of these 
A)  the passage of time between the two administrations of the test. 
B)  coaching designed to increase test scores between the two administrations of the test. 
C)  practice with similar test materials between the two administrations of the test. 
D)  All of these

Question 2

What type of reliability estimate is appropriate for use in a comparison of "Form A" to "Form B" of a picture vocabulary test?

Accepted Answer

A)  test-retest 
B)  alternate-forms 
C)  inter-rater 
D)  internal-consistency 
A)  test-retest 
B)  alternate-forms 
C)  inter-rater 
D)  internal-consistency

Question 3

A police officer administers a breathalyzer test to a suspected drunk driver,does not put on his glasses to read the meter,and as a result,mistakenly records the blood alcohol level.This is the kind of mistake that is BEST associated with which type of reliability estimates?

Accepted Answer

A)  test-retest 
B)  inter-scorer 
C)  internal-consistency 
D)  situational 
A)  test-retest 
B)  inter-scorer 
C)  internal-consistency 
D)  situational

Question 4

A test containing 100 items is revised by deleting 20 items.What might be expected to happen to the magnitude of the reliability estimate for that test?

Accepted Answer

A)  It will be expected to increase. 
B)  It will be expected to decrease. 
C)  It will be expected to stay the same. 
D)  It cannot be determined based on the information provided. 
A)  It will be expected to increase. 
B)  It will be expected to decrease. 
C)  It will be expected to stay the same. 
D)  It cannot be determined based on the information provided.

Question 5

Who are the primary users of IRT?

Accepted Answer

A)  classroom teachers 
B)  commercial test developers 
C)  instructors at universities in Departments of Education 
D)  life insurance actuaries 
A)  classroom teachers 
B)  commercial test developers 
C)  instructors at universities in Departments of Education 
D)  life insurance actuaries

Question 6

The greater the proportion of the total variance attributed to true variance,the more ____________ the test.

Accepted Answer

A)  scientific 
B)  variable 
C)  reliable 
D)  expensive 
A)  scientific 
B)  variable 
C)  reliable 
D)  expensive

Question 7

Which of the following is NOT a part of the formula for the standard error of measurement for a particular test?

Accepted Answer

A)  the validity of the test 
B)  the reliability of the test 
C)  the standard deviation of the group of test scores 
D)  Both the reliability of the test and the standard deviation of the group of test scores 
A)  the validity of the test 
B)  the reliability of the test 
C)  the standard deviation of the group of test scores 
D)  Both the reliability of the test and the standard deviation of the group of test scores

Question 8

Coefficient alpha is appropriate to use with all of the following test formats EXCEPT

Accepted Answer

A)  multiple-choice. 
B)  true-false. 
C)  short-answer for which partial credit is awarded. 
D)  essay exam with no partial credit awarded. 
A)  multiple-choice. 
B)  true-false. 
C)  short-answer for which partial credit is awarded. 
D)  essay exam with no partial credit awarded.

Question 9

Typically,adding items to a test will have what effect on the test's reliability?

Accepted Answer

A)  Reliability will decrease. 
B)  Reliability will increase. 
C)  Reliability will stay the same. 
D)  Reliability will first increase and then decrease. 
A)  Reliability will decrease. 
B)  Reliability will increase. 
C)  Reliability will stay the same. 
D)  Reliability will first increase and then decrease.

Question 10

The fact that young children develop rapidly and in "growth spurts" is a problem when it comes to the estimation which type of reliability for an infant development scale?

Accepted Answer

A)  internal-consistency reliability 
B)  alternate-forms reliability 
C)  test-retest reliability 
D)  interrater reliability 
A)  internal-consistency reliability 
B)  alternate-forms reliability 
C)  test-retest reliability 
D)  interrater reliability

Question 11

Which type(s)of reliability estimates would be appropriate for a speed test?

Accepted Answer

A)  test-retest 
B)  alternate-form 
C)  split-half from two independent testing sessions 
D)  All of these 
A)  test-retest 
B)  alternate-form 
C)  split-half from two independent testing sessions 
D)  All of these

Question 12

Which is an example of what is referred to as "QRP" in your textbook?

Accepted Answer

A)  collecting additional data to reach statistical significance 
B)  over-reporting of data with excessive detail 
C)  telling subjects in a control group that they need not participate 
D)  requesting detailed data from the original study author 
A)  collecting additional data to reach statistical significance 
B)  over-reporting of data with excessive detail 
C)  telling subjects in a control group that they need not participate 
D)  requesting detailed data from the original study author

Question 13

In which type(s)of reliability estimates would test construction NOT be a significant source of error variance?

Accepted Answer

A)  test-retest 
B)  alternate-form 
C)  split-half 
D)  Kuder-Richardson 
A)  test-retest 
B)  alternate-form 
C)  split-half 
D)  Kuder-Richardson

Question 14

Which is the BEST example of a dynamic characteristic?

Accepted Answer

A)  the stress level of a trapeze flyer at a circus 
B)  the intelligence of a college student during Spring Break 
C)  the anti-authority attitude of an inmate serving a life term 
D)  None of these 
A)  the stress level of a trapeze flyer at a circus 
B)  the intelligence of a college student during Spring Break 
C)  the anti-authority attitude of an inmate serving a life term 
D)  None of these

Question 15

Which of the following is NOT an acceptable way to divide a test when using the split-half reliability method?

Accepted Answer

A)  Randomly assign items to each half of the test. 
B)  Assign odd-numbered items to one half and even-numbered items to the other half of the test. 
C)  Assign the first-half of the items to one half of the test and the second half of the items to the other half of the test. 
D)  Assign easy items to one half of the test and difficult items to the other half of the test. 
A)  Randomly assign items to each half of the test. 
B)  Assign odd-numbered items to one half and even-numbered items to the other half of the test. 
C)  Assign the first-half of the items to one half of the test and the second half of the items to the other half of the test. 
D)  Assign easy items to one half of the test and difficult items to the other half of the test.

Question 16

The fact that the length of a test influences the size of the reliability coefficient is based on which theory of measurement?

Accepted Answer

A)  classical test theory (CTT) 
B)  generalizability theory 
C)  domain sampling theory 
D)  item response theory (IRT) 
A)  classical test theory (CTT) 
B)  generalizability theory 
C)  domain sampling theory 
D)  item response theory (IRT)

Question 17

Coefficient alpha is an expression of

Accepted Answer

A)  the mean of split-half correlations between odd- and even-numbered items. 
B)  the mean of split-half correlations between first- and second-half items. 
C)  the mean of all possible split-half correlations. 
D)  the mean of the best or "alpha" level split-half correlations. 
A)  the mean of split-half correlations between odd- and even-numbered items. 
B)  the mean of split-half correlations between first- and second-half items. 
C)  the mean of all possible split-half correlations. 
D)  the mean of the best or "alpha" level split-half correlations.

Question 18

With critical variables in a research study held constant,different methods used to estimate reliability will typically yield

Accepted Answer

A)  virtually no differences in the magnitude of the estimate. 
B)  sizable differences in the magnitude of the estimate. 
C)  skewed estimates of reliability. 
D)  identical estimates of reliability. 
A)  virtually no differences in the magnitude of the estimate. 
B)  sizable differences in the magnitude of the estimate. 
C)  skewed estimates of reliability. 
D)  identical estimates of reliability.

Question 19

Which type of reliability is directly affected by the heterogeneity of a test?

Accepted Answer

A)  test-retest 
B)  inter-rater 
C)  internal-consistency 
D)  alternate-forms or parallel-forms 
A)  test-retest 
B)  inter-rater 
C)  internal-consistency 
D)  alternate-forms or parallel-forms

Question 20

Item response theory is to latent trait theory as observer reliability is to

Accepted Answer

A)  generalizability theory. 
B)  domain sampling theory. 
C)  odd-even reliability. 
D)  inter-scorer reliability. 
A)  generalizability theory. 
B)  domain sampling theory. 
C)  odd-even reliability. 
D)  inter-scorer reliability.

Which of the following might lead to a decrease in test-retest reliability?

What type of reliability estimate is appropriate for use in a comparison of "Form A" to "Form B" of a picture vocabulary test?

A police officer administers a breathalyzer test to a suspected drunk driver,does not put on his glasses to read the meter,and as a result,mistakenly records the blood alcohol level.This is the kind of mistake that is BEST associated with which type of reliability estimates?

A test containing 100 items is revised by deleting 20 items.What might be expected to happen to the magnitude of the reliability estimate for that test?

Who are the primary users of IRT?

The greater the proportion of the total variance attributed to true variance,the more ____________ the test.

Which of the following is NOT a part of the formula for the standard error of measurement for a particular test?

Coefficient alpha is appropriate to use with all of the following test formats EXCEPT

Typically,adding items to a test will have what effect on the test's reliability?

The fact that young children develop rapidly and in "growth spurts" is a problem when it comes to the estimation which type of reliability for an infant development scale?

Which type(s)of reliability estimates would be appropriate for a speed test?

Which is an example of what is referred to as "QRP" in your textbook?

In which type(s)of reliability estimates would test construction NOT be a significant source of error variance?

Which is the BEST example of a dynamic characteristic?

Which of the following is NOT an acceptable way to divide a test when using the split-half reliability method?

The fact that the length of a test influences the size of the reliability coefficient is based on which theory of measurement?

Coefficient alpha is an expression of

With critical variables in a research study held constant,different methods used to estimate reliability will typically yield

Which type of reliability is directly affected by the heterogeneity of a test?

Item response theory is to latent trait theory as observer reliability is to

Psychological Testing and Assessment

Historical, Cultural, and Legalethical Considerations

A Statistics Refresher

Of Tests and Testing

Validity

Utility

Test Development

Intelligence and Its Measurement

Assessment for Education

Personality Assessment: an Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment,Careers,and Business

Filters

Exam 5: Reliability

Which of the following might lead to a decrease in test-retest reliability?

What type of reliability estimate is appropriate for use in a comparison of "Form A" to "Form B" of a picture vocabulary test?

A police officer administers a breathalyzer test to a suspected drunk driver,does not put on his glasses to read the meter,and as a result,mistakenly records the blood alcohol level.This is the kind of mistake that is BEST associated with which type of reliability estimates?

A test containing 100 items is revised by deleting 20 items.What might be expected to happen to the magnitude of the reliability estimate for that test?

Who are the primary users of IRT?

The greater the proportion of the total variance attributed to true variance,the more ____________ the test.

Which of the following is NOT a part of the formula for the standard error of measurement for a particular test?

Coefficient alpha is appropriate to use with all of the following test formats EXCEPT

Typically,adding items to a test will have what effect on the test's reliability?

The fact that young children develop rapidly and in "growth spurts" is a problem when it comes to the estimation which type of reliability for an infant development scale?

Which type(s)of reliability estimates would be appropriate for a speed test?

Which is an example of what is referred to as "QRP" in your textbook?

In which type(s)of reliability estimates would test construction NOT be a significant source of error variance?

Which is the BEST example of a dynamic characteristic?

Which of the following is NOT an acceptable way to divide a test when using the split-half reliability method?

The fact that the length of a test influences the size of the reliability coefficient is based on which theory of measurement?

Coefficient alpha is an expression of

With critical variables in a research study held constant,different methods used to estimate reliability will typically yield

Which type of reliability is directly affected by the heterogeneity of a test?

Item response theory is to latent trait theory as observer reliability is to

Psychological Testing and Assessment

Historical, Cultural, and Legalethical Considerations

A Statistics Refresher

Of Tests and Testing

Validity

Utility

Test Development

Intelligence and Its Measurement

Assessment for Education

Personality Assessment: an Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment,Careers,and Business

Filters