Question 1

The ________ in generalizability theory is analogous to the reliability coefficient in classical test theory.

Accepted Answer

A)  universe coefficient 
B)  coefficient of generalizability 
C)  universe score 
D)  Roulin coefficient 
A)  universe coefficient 
B)  coefficient of generalizability 
C)  universe score 
D)  Roulin coefficient

Question 2

What index of reliability would you use to compare two evaluators' assessments of a group of job applicants?

Accepted Answer

A)  KR-20 
B)  coefficient alpha 
C)  the Kappa statistic 
D)  the Spearman-Brown correction 
A)  KR-20 
B)  coefficient alpha 
C)  the Kappa statistic 
D)  the Spearman-Brown correction

Question 3

Typically,adding items to a test will have what effect on the test's reliability?

Accepted Answer

A)  Reliability will decrease. 
B)  Reliability will increase. 
C)  Reliability will stay the same. 
D)  Reliability will first increase and then decrease. 
A)  Reliability will decrease. 
B)  Reliability will increase. 
C)  Reliability will stay the same. 
D)  Reliability will first increase and then decrease.

Question 4

The fact that the length of a test influences the size of the reliability coefficient is based on which theory of measurement?

Accepted Answer

A)  classical test theory (CTT) 
B)  generalizability theory 
C)  domain sampling theory 
D)  item response theory (IRT) 
A)  classical test theory (CTT) 
B)  generalizability theory 
C)  domain sampling theory 
D)  item response theory (IRT)

Question 5

Which statistic can help the test user determine how large a difference must exist for scores yielded from two different tests to be considered statistically different?

Accepted Answer

A)  standard error of measurement between two scores 
B)  standard error of the difference between two scores 
C)  observed variance minus error variance 
D)  standard error of the difference between two means 
A)  standard error of measurement between two scores 
B)  standard error of the difference between two scores 
C)  observed variance minus error variance 
D)  standard error of the difference between two means

Question 6

The KR-21 reliability estimate was developed

Accepted Answer

A)  to yield greater consistency in reliability coefficients. 
B)  to facilitate computation by hand. 
C)  for use with less homogeneous items. 
D)  because Kuder wanted to "one-up" Richardson's 20. 
A)  to yield greater consistency in reliability coefficients. 
B)  to facilitate computation by hand. 
C)  for use with less homogeneous items. 
D)  because Kuder wanted to "one-up" Richardson's 20.

Question 7

The standard error of measurement is

Accepted Answer

A)  used to infer how far an observed score is from the true score. 
B)  also known as the standard error of a score. 
C)  is used in the context of classical test theory. 
D)  All of these 
A)  used to infer how far an observed score is from the true score. 
B)  also known as the standard error of a score. 
C)  is used in the context of classical test theory. 
D)  All of these

Question 8

Which is NOT a possible source of error variance?

Accepted Answer

A)  test administration 
B)  test scoring 
C)  test interpretation 
D)  All are possible sources of error variance. 
A)  test administration 
B)  test scoring 
C)  test interpretation 
D)  All are possible sources of error variance.

Question 9

Most reliability coefficients,regardless of the specific type of reliability they are measuring,range in value from:

Accepted Answer

A)  -1 to +1 
B)  0 to 100 
C)  0 to 1. 
D)  negative infinity to positive infinity 
A)  -1 to +1 
B)  0 to 100 
C)  0 to 1. 
D)  negative infinity to positive infinity

Question 10

The directions for scoring a particular motor ability test instruct the examiner to "Give credit if the child holds his hands open most of the time." Because what constitutes "most of the time" is not specifically defined,directions such as these could result in lowered reliability estimates for

Accepted Answer

A)  test-retest reliability. 
B)  alternate-form reliability. 
C)  inter-rater reliability. 
D)  parallel forms reliability. 
A)  test-retest reliability. 
B)  alternate-form reliability. 
C)  inter-rater reliability. 
D)  parallel forms reliability.

Question 11

If the variance of either variable in a correlational analysis is restricted by the sampling procedure used,then the resulting correlation coefficient tends to be

Accepted Answer

A)  higher. 
B)  lower. 
C)  unaffected. 
D)  unstable. 
A)  higher. 
B)  lower. 
C)  unaffected. 
D)  unstable.

Question 12

If items on a test are measuring very different traits,estimates of reliability yielded from split-half methods will typically be ________ as compared with estimates from KR-20.

Accepted Answer

A)  higher 
B)  lower 
C)  similar 
D)  approximately the same 
A)  higher 
B)  lower 
C)  similar 
D)  approximately the same

Question 13

With regard to a value found for coefficient alpha,

Accepted Answer

A)  "bigger is always better." 
B)  "smaller is always better." 
C)  "negative is best." 
D)  None of these 
A)  "bigger is always better." 
B)  "smaller is always better." 
C)  "negative is best." 
D)  None of these

Question 14

The standard deviation of a theoretically normal distribution of test scores obtained by one person on equivalent tests is

Accepted Answer

A)  the standard error of the difference between means. 
B)  the standard error of measurement. 
C)  the standard deviation of the reliability coefficient. 
D)  the variance. 
A)  the standard error of the difference between means. 
B)  the standard error of measurement. 
C)  the standard deviation of the reliability coefficient. 
D)  the variance.

Question 15

A difference between the use of coefficient alpha and IRT for evaluating a test's reliability is that with IRT,it is possible to learn

Accepted Answer

A)  how the precision of a scale varies depending on the level of the construct being measured. 
B)  how the level of the construct being measured varies depending on variations in the item characteristic curve. 
C)  the precise numerical value for the test's total interitem consistency. 
D)  All of these 
A)  how the precision of a scale varies depending on the level of the construct being measured. 
B)  how the level of the construct being measured varies depending on variations in the item characteristic curve. 
C)  the precise numerical value for the test's total interitem consistency. 
D)  All of these

Question 16

By definition,estimates of reliability can range from _______ to _______.

Accepted Answer

A)  -3.00; +3.00 
B)  1; 10 
C)  0; 1 
D)  -1 to 1 
A)  -3.00; +3.00 
B)  1; 10 
C)  0; 1 
D)  -1 to 1

Question 17

Which is NOT an assumption that should be met in order to use KR-21?

Accepted Answer

A)  Items should be dichotomous. 
B)  Items should be of equal difficulty. 
C)  Items should be homogeneous. 
D)  Items should be scorable by computer. 
A)  Items should be dichotomous. 
B)  Items should be of equal difficulty. 
C)  Items should be homogeneous. 
D)  Items should be scorable by computer.

Question 18

The universe score in Cronbach et al.'s generalizability theory analogous to the ________ in classical test theory.

Accepted Answer

A)  coefficient of generalizability 
B)  true score 
C)  standard deviation 
D)  internal-consistency estimate 
A)  coefficient of generalizability 
B)  true score 
C)  standard deviation 
D)  internal-consistency estimate

Question 19

In the formula X = T + E,T refers to

Accepted Answer

A)  the true score. 
B)  the time factor. 
C)  the average test score. 
D)  test-retest reliability. 
A)  the true score. 
B)  the time factor. 
C)  the average test score. 
D)  test-retest reliability.

Question 20

If the variance of either variable is restricted by the sampling procedures used,then the magnitude of the coefficient of reliability will be

Accepted Answer

A)  lowered. 
B)  raised. 
C)  unaffected. 
D)  affected only in tests with a true-false format. 
A)  lowered. 
B)  raised. 
C)  unaffected. 
D)  affected only in tests with a true-false format.

The ________ in generalizability theory is analogous to the reliability coefficient in classical test theory.

What index of reliability would you use to compare two evaluators' assessments of a group of job applicants?

Typically,adding items to a test will have what effect on the test's reliability?

The fact that the length of a test influences the size of the reliability coefficient is based on which theory of measurement?

Which statistic can help the test user determine how large a difference must exist for scores yielded from two different tests to be considered statistically different?

The KR-21 reliability estimate was developed

The standard error of measurement is

Which is NOT a possible source of error variance?

Most reliability coefficients,regardless of the specific type of reliability they are measuring,range in value from:

The directions for scoring a particular motor ability test instruct the examiner to "Give credit if the child holds his hands open most of the time." Because what constitutes "most of the time" is not specifically defined,directions such as these could result in lowered reliability estimates for

If the variance of either variable in a correlational analysis is restricted by the sampling procedure used,then the resulting correlation coefficient tends to be

If items on a test are measuring very different traits,estimates of reliability yielded from split-half methods will typically be ________ as compared with estimates from KR-20.

With regard to a value found for coefficient alpha,

The standard deviation of a theoretically normal distribution of test scores obtained by one person on equivalent tests is

A difference between the use of coefficient alpha and IRT for evaluating a test's reliability is that with IRT,it is possible to learn

By definition,estimates of reliability can range from _ to _.

Which is NOT an assumption that should be met in order to use KR-21?

The universe score in Cronbach et al.'s generalizability theory analogous to the ________ in classical test theory.

In the formula X = T + E,T refers to

If the variance of either variable is restricted by the sampling procedures used,then the magnitude of the coefficient of reliability will be

Psychological Testing and Assessment

Historical, cultural, and Legal Ethical Considerations

A Statistics Refresher

Of Tests and Testing

Validity

Utility

Test Development

Intelligence and Its Measurement

Tests of Intelligence

Assessment for Education

Personality Assessment: An Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment, Careers, and Business References

Filters

Exam 5: Reliability

The ________ in generalizability theory is analogous to the reliability coefficient in classical test theory.

What index of reliability would you use to compare two evaluators' assessments of a group of job applicants?

Typically,adding items to a test will have what effect on the test's reliability?

The fact that the length of a test influences the size of the reliability coefficient is based on which theory of measurement?

Which statistic can help the test user determine how large a difference must exist for scores yielded from two different tests to be considered statistically different?

The KR-21 reliability estimate was developed

The standard error of measurement is

Which is NOT a possible source of error variance?

Most reliability coefficients,regardless of the specific type of reliability they are measuring,range in value from:

The directions for scoring a particular motor ability test instruct the examiner to "Give credit if the child holds his hands open most of the time." Because what constitutes "most of the time" is not specifically defined,directions such as these could result in lowered reliability estimates for

If the variance of either variable in a correlational analysis is restricted by the sampling procedure used,then the resulting correlation coefficient tends to be

If items on a test are measuring very different traits,estimates of reliability yielded from split-half methods will typically be ________ as compared with estimates from KR-20.

With regard to a value found for coefficient alpha,

The standard deviation of a theoretically normal distribution of test scores obtained by one person on equivalent tests is

A difference between the use of coefficient alpha and IRT for evaluating a test's reliability is that with IRT,it is possible to learn

By definition,estimates of reliability can range from _______ to _______.

Which is NOT an assumption that should be met in order to use KR-21?

The universe score in Cronbach et al.'s generalizability theory analogous to the ________ in classical test theory.

In the formula X = T + E,T refers to

If the variance of either variable is restricted by the sampling procedures used,then the magnitude of the coefficient of reliability will be

Psychological Testing and Assessment

Historical, cultural, and Legal Ethical Considerations

A Statistics Refresher

Of Tests and Testing

Validity

Utility

Test Development

Intelligence and Its Measurement

Tests of Intelligence

Assessment for Education

Personality Assessment: An Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment, Careers, and Business References

Filters

By definition,estimates of reliability can range from _ to _.