Question 1

Generalizability theory is most closely related to

Accepted Answer

A)  developing norms. 
B)  item analysis. 
C)  test reliability. 
D)  the way things are "in general." 
A)  developing norms. 
B)  item analysis. 
C)  test reliability. 
D)  the way things are "in general."

Question 2

Which of the following is TRUE for parallel forms of a test?

Accepted Answer

A)  The means of the observed scores are equal for the two forms. 
B)  The variances of the estimated scores are equal for the two forms. 
C)  The means and variances of the observed scores are equal for the two forms. 
D)  The means and variances of the estimated scores are equal for the two forms. 
A)  The means of the observed scores are equal for the two forms. 
B)  The variances of the estimated scores are equal for the two forms. 
C)  The means and variances of the observed scores are equal for the two forms. 
D)  The means and variances of the estimated scores are equal for the two forms.

Question 3

When more than two scorers are used to determine inter-scorer reliability,the statistic of choice is

Accepted Answer

A)  Pearson r. 
B)  Spearman's rho. 
C)  KR-20. 
D)  coefficient alpha. 
A)  Pearson r. 
B)  Spearman's rho. 
C)  KR-20. 
D)  coefficient alpha.

Question 4

The more homogeneous a test is,the

Accepted Answer

A)  less inter-item consistency it can be expected to have. 
B)  more utility the test has for measuring multifaceted variables. 
C)  more inter-item consistency it can be expected to have. 
D)  None of these 
A)  less inter-item consistency it can be expected to have. 
B)  more utility the test has for measuring multifaceted variables. 
C)  more inter-item consistency it can be expected to have. 
D)  None of these

Question 5

A score earned by a testtaker on a psychological test may BEST be viewed as equal to

Accepted Answer

A)  the raw score plus the observed score. 
B)  the error score. 
C)  the true score. 
D)  the true score plus error. 
A)  the raw score plus the observed score. 
B)  the error score. 
C)  the true score. 
D)  the true score plus error.

Question 6

Which of the following statements is TRUE regarding the differences between a power test and a speed test?

Accepted Answer

A)  Power tests involve physical strength; speed tests do not. 
B)  In a power test, the testtaker has time to complete all items; in a speed test, a specific time limit is imposed. 
C)  In a power test, a broad range of knowledge is assessed; in a speed test, a narrower range of knowledge is assessed. 
D)  Both in a power test, the testtaker has time to complete all items; in a speed test, a specific time limit is imposed and in a power test, a broad range of knowledge is assessed; in a speed test, a narrower range of knowledge is assessed. 
A)  Power tests involve physical strength; speed tests do not. 
B)  In a power test, the testtaker has time to complete all items; in a speed test, a specific time limit is imposed. 
C)  In a power test, a broad range of knowledge is assessed; in a speed test, a narrower range of knowledge is assessed. 
D)  Both in a power test, the testtaker has time to complete all items; in a speed test, a specific time limit is imposed and in a power test, a broad range of knowledge is assessed; in a speed test, a narrower range of knowledge is assessed.

Question 7

For criterion-referenced tests,which of the following reliability estimates is recommended?

Accepted Answer

A)  test-retest reliability estimates 
B)  alternate-form reliability estimates 
C)  split-half reliability estimates 
D)  None of these 
A)  test-retest reliability estimates 
B)  alternate-form reliability estimates 
C)  split-half reliability estimates 
D)  None of these

Question 8

Which source of error variance affects parallel- or alternate-form reliability estimates but does not affect test-retest estimates?

Accepted Answer

A)  fatigue 
B)  learning 
C)  practice 
D)  item sampling 
A)  fatigue 
B)  learning 
C)  practice 
D)  item sampling

Question 9

Why might ability test scores among testtakers most typically vary?

Accepted Answer

A)  because of the true ability of the testtaker 
B)  because of irrelevant, unwanted influences 
C)  Both because of the true ability of the testtaker and because of irrelevant, unwanted influences 
D)  None of these 
A)  because of the true ability of the testtaker 
B)  because of irrelevant, unwanted influences 
C)  Both because of the true ability of the testtaker and because of irrelevant, unwanted influences 
D)  None of these

Question 10

Which of the following statements is TRUE about coefficient alpha?

Accepted Answer

A)  Kuder thought it to be single best measure of reliability. 
B)  It was first conceived by Alfalfa Alpha. 
C)  It is a characteristic of a particular set of scores, not of the test itself. 
D)  None of these 
A)  Kuder thought it to be single best measure of reliability. 
B)  It was first conceived by Alfalfa Alpha. 
C)  It is a characteristic of a particular set of scores, not of the test itself. 
D)  None of these

Question 11

Different types of reliability coefficients

Accepted Answer

A)  all reflect the same sources of error variance. 
B)  may reflect different sources of error variance. 
C)  never reflect the same source of error variance. 
D)  reflect on error variance during leisure activities. 
A)  all reflect the same sources of error variance. 
B)  may reflect different sources of error variance. 
C)  never reflect the same source of error variance. 
D)  reflect on error variance during leisure activities.

Question 12

Item response theory (IRT)focuses on the

Accepted Answer

A)  circumstances that inspired the development of the test. 
B)  test administration variables. 
C)  individual items of a test. 
D)  "how and why" of the Interborough Rapid Transit line. 
A)  circumstances that inspired the development of the test. 
B)  test administration variables. 
C)  individual items of a test. 
D)  "how and why" of the Interborough Rapid Transit line.

Question 13

If items on a test are measuring very different traits,estimates of reliability yielded from split-half methods will typically be ________ as compared with estimates from KR-20.

Accepted Answer

A)  higher 
B)  lower 
C)  similar 
D)  approximately the same 
A)  higher 
B)  lower 
C)  similar 
D)  approximately the same

Question 14

The term coefficient of generalizability refers to

Accepted Answer

A)  how generalizable scores obtained in one situation are to other situations. 
B)  test-retest reliability estimates with respect to different "universes." 
C)  split-half reliability estimates with respect to different "universes." 
D)  None of these 
A)  how generalizable scores obtained in one situation are to other situations. 
B)  test-retest reliability estimates with respect to different "universes." 
C)  split-half reliability estimates with respect to different "universes." 
D)  None of these

Question 15

The standard error of the difference between two scores is larger than the standard error of measurement for either score because the standard error of the difference between the two scores is affected by

Accepted Answer

A)  the true score variance of each score. 
B)  the standard deviation of each score summed. 
C)  the measurement error inherent in both scores. 
D)  All of these 
A)  the true score variance of each score. 
B)  the standard deviation of each score summed. 
C)  the measurement error inherent in both scores. 
D)  All of these

Question 16

If a student received a score of 50 on a math test with a standard error of measurement of 3,which of the following statements would be TRUE of the "true score"?

Accepted Answer

A)  In 68% of the cases, the "true score" would be expected to be between 44 and 56. 
B)  In 68% of the cases, the "true score" would be expected to be between 47 and 53. 
C)  In 95% of the cases, the "true score" would be expected to be between 47 and 53. 
D)  In 95% of the cases, the "true score" would be expected to be between 44 and 56. 
A)  In 68% of the cases, the "true score" would be expected to be between 44 and 56. 
B)  In 68% of the cases, the "true score" would be expected to be between 47 and 53. 
C)  In 95% of the cases, the "true score" would be expected to be between 47 and 53. 
D)  In 95% of the cases, the "true score" would be expected to be between 44 and 56.

Question 17

The fact that cultural factors may be operating to weaken an item's ability to discriminate between groups is evident from

Accepted Answer

A)  a general lack of reliability in culture-specific tests. 
B)  latent trait theory. 
C)  Georg Rasch's unauthorized biography, You Can Never Be Too Rich or Too "Rasch." 
D)  None of these 
A)  a general lack of reliability in culture-specific tests. 
B)  latent trait theory. 
C)  Georg Rasch's unauthorized biography, You Can Never Be Too Rich or Too "Rasch." 
D)  None of these

Question 18

In classical test theory,there exists only one true score.In Cronbach generalizability theory,how many "true scores" exist?

Accepted Answer

A)  one 
B)  as many as the number of times the test is administered to the same individual 
C)  many, depending on the number of different universes 
D)  None of these 
A)  one 
B)  as many as the number of times the test is administered to the same individual 
C)  many, depending on the number of different universes 
D)  None of these

Question 19

Which of the following factors may influence a split-half reliability estimate?

Accepted Answer

A)  fatigue 
B)  anxiety 
C)  item difficulty 
D)  All of these 
A)  fatigue 
B)  anxiety 
C)  item difficulty 
D)  All of these

Question 20

Which of the following is TRUE about systematic and unsystematic error in the assessment of physical and psychological abuse?

Accepted Answer

A)  Few sources of unsystematic error exist, due to the nature of what is being assessed. 
B)  Few sources of systematic error exist. 
C)  Gender represents a source of systematic error. 
D)  None of these 
A)  Few sources of unsystematic error exist, due to the nature of what is being assessed. 
B)  Few sources of systematic error exist. 
C)  Gender represents a source of systematic error. 
D)  None of these

Generalizability theory is most closely related to

Which of the following is TRUE for parallel forms of a test?

When more than two scorers are used to determine inter-scorer reliability,the statistic of choice is

The more homogeneous a test is,the

A score earned by a testtaker on a psychological test may BEST be viewed as equal to

Which of the following statements is TRUE regarding the differences between a power test and a speed test?

For criterion-referenced tests,which of the following reliability estimates is recommended?

Which source of error variance affects parallel- or alternate-form reliability estimates but does not affect test-retest estimates?

Why might ability test scores among testtakers most typically vary?

Which of the following statements is TRUE about coefficient alpha?

Different types of reliability coefficients

Item response theory (IRT)focuses on the

If items on a test are measuring very different traits,estimates of reliability yielded from split-half methods will typically be ________ as compared with estimates from KR-20.

The term coefficient of generalizability refers to

The standard error of the difference between two scores is larger than the standard error of measurement for either score because the standard error of the difference between the two scores is affected by

If a student received a score of 50 on a math test with a standard error of measurement of 3,which of the following statements would be TRUE of the "true score"?

The fact that cultural factors may be operating to weaken an item's ability to discriminate between groups is evident from

In classical test theory,there exists only one true score.In Cronbach generalizability theory,how many "true scores" exist?

Which of the following factors may influence a split-half reliability estimate?

Which of the following is TRUE about systematic and unsystematic error in the assessment of physical and psychological abuse?

Psychological Testing and Assessment

Historical, Cultural, and Legalethical Considerations

A Statistics Refresher

Of Tests and Testing

Validity

Utility

Test Development

Intelligence and Its Measurement

Assessment for Education

Personality Assessment: an Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment,Careers,and Business

Filters

Exam 5: Reliability

Generalizability theory is most closely related to

Which of the following is TRUE for parallel forms of a test?

When more than two scorers are used to determine inter-scorer reliability,the statistic of choice is

The more homogeneous a test is,the

A score earned by a testtaker on a psychological test may BEST be viewed as equal to

Which of the following statements is TRUE regarding the differences between a power test and a speed test?

For criterion-referenced tests,which of the following reliability estimates is recommended?

Which source of error variance affects parallel- or alternate-form reliability estimates but does not affect test-retest estimates?

Why might ability test scores among testtakers most typically vary?

Which of the following statements is TRUE about coefficient alpha?

Different types of reliability coefficients

Item response theory (IRT)focuses on the

If items on a test are measuring very different traits,estimates of reliability yielded from split-half methods will typically be ________ as compared with estimates from KR-20.

The term coefficient of generalizability refers to

The standard error of the difference between two scores is larger than the standard error of measurement for either score because the standard error of the difference between the two scores is affected by

If a student received a score of 50 on a math test with a standard error of measurement of 3,which of the following statements would be TRUE of the "true score"?

The fact that cultural factors may be operating to weaken an item's ability to discriminate between groups is evident from

In classical test theory,there exists only one true score.In Cronbach generalizability theory,how many "true scores" exist?

Which of the following factors may influence a split-half reliability estimate?

Which of the following is TRUE about systematic and unsystematic error in the assessment of physical and psychological abuse?

Psychological Testing and Assessment

Historical, Cultural, and Legalethical Considerations

A Statistics Refresher

Of Tests and Testing

Validity

Utility

Test Development

Intelligence and Its Measurement

Assessment for Education

Personality Assessment: an Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment,Careers,and Business

Filters