Question 1

If the same test, given at different points in time to the same test takers, yields different scores, then the method typically used to assess this source of error is

Accepted Answer

A) test-retest. 
B) alternate forms/parallel forms. 
C) split-half. 
D) KR 20. 
A) test-retest. 
B) alternate forms/parallel forms. 
C) split-half. 
D) KR 20.

Question 2

The intercorrelations among items within the same test is referred to as

Accepted Answer

A) interrater reliability. 
B) discriminability. 
C) standard errors of measurement. 
D) internal consistency. 
A) interrater reliability. 
B) discriminability. 
C) standard errors of measurement. 
D) internal consistency.

Question 3

In the domain sampling model, the reliability of a test increases as

Accepted Answer

A) the number of items increases. 
B) the number of items decreases. 
C) the number of test administrations increases. 
D) the number of test administrations decreases. 
A) the number of items increases. 
B) the number of items decreases. 
C) the number of test administrations increases. 
D) the number of test administrations decreases.

Question 4

Dr. Smith is trying to determine the reliability of a new personality test. Two randomly parallel tests, A and B, have a correlation of .81. What is the estimated reliability of the new personality test?

Accepted Answer

A) .81 
B) -.9 
C) .9 
D) .81/ t 
A) .81 
B) -.9 
C) .9 
D) .81/ t

Question 5

Difference scores are created by

Accepted Answer

A) subtracting one test score from another. 
B) subtracting the true score from a predicted score. 
C) eliminating error from true scores. 
D) giving a test to two different individuals. 
A) subtracting one test score from another. 
B) subtracting the true score from a predicted score. 
C) eliminating error from true scores. 
D) giving a test to two different individuals.

Question 6

The reliability coefficient is

Accepted Answer

A) the mean of the observed scores. 
B) the variance of the observed scores. 
C) the ratio of the mean of the true scores on a test to the mean of the observed scores. 
D) the ratio of the variance of the true scores on a test to the variance of the observed scores. 
A) the mean of the observed scores. 
B) the variance of the observed scores. 
C) the ratio of the mean of the true scores on a test to the mean of the observed scores. 
D) the ratio of the variance of the true scores on a test to the variance of the observed scores.

Question 7

Sources of error associated with time sampling are measured using

Accepted Answer

A) the test-retest method. 
B) the split half method. 
C) KR 20. 
D) the alpha method. 
A) the test-retest method. 
B) the split half method. 
C) KR 20. 
D) the alpha method.

Question 8

Theoretically, if Susie repeatedly took the 6th grade achievement test, you would be able to find her true score by finding the ____ of the distribution of her scores.

Accepted Answer

A) mean 
B) standard deviation 
C) variance 
D) standard error of measurement 
A) mean 
B) standard deviation 
C) variance 
D) standard error of measurement

Question 9

Discuss the challenges to the use of difference scores.

Accepted Answer

Difference scores, which are calculated

Question 10

The method for estimating the internal consistency of a test that simultaneously considers all possible ways of splitting the items is the

Accepted Answer

A) Spearman Brown formula. 
B) Kuder-Richardson formula. 
C) Cronbach's alpha. 
D) the odd-even method. 
A) Spearman Brown formula. 
B) Kuder-Richardson formula. 
C) Cronbach's alpha. 
D) the odd-even method.

Question 11

If we repeatedly administered the same test to the same individual, the standard deviation of the person's score would be the

Accepted Answer

A) standard error of the mean. 
B) variance. 
C) reliability of the test. 
D) standard error of measurement. 
A) standard error of the mean. 
B) variance. 
C) reliability of the test. 
D) standard error of measurement.

Question 12

When creating a test, one generally uses a subset of items to represent a larger construct. This is known as

Accepted Answer

A) a population parameter. 
B) a domain sampling. 
C) a sampling error. 
D) descriptive statistics. 
A) a population parameter. 
B) a domain sampling. 
C) a sampling error. 
D) descriptive statistics.

Question 13

Suppose you were trying to estimate the reliability of a whole test on the basis of the correlation between scores on the two halves of the test. In order to correct for using scores based on the halves, you might use the

Accepted Answer

A) KR 20. 
B) alpha method. 
C) Spearman-Brown formula. 
D) split half method. 
A) KR 20. 
B) alpha method. 
C) Spearman-Brown formula. 
D) split half method.

Question 14

Which of the following would tend to provide the most conservative estimate of split-half reliability?

Accepted Answer

A) the Phillips method 
B) the Spearman-Brown formula 
C) coefficient alpha 
D) the odd-even reliability coefficient 
A) the Phillips method 
B) the Spearman-Brown formula 
C) coefficient alpha 
D) the odd-even reliability coefficient

Question 15

The standard error of measurement allows us to

Accepted Answer

A) estimate the degree to which a test provides inaccurate readings. 
B) have an acceptable margin of error. 
C) determine the source of error. 
D) avoid any measurement error. 
A) estimate the degree to which a test provides inaccurate readings. 
B) have an acceptable margin of error. 
C) determine the source of error. 
D) avoid any measurement error.

Question 16

In the domain sampling model, the error that is being considered is the error caused by

Accepted Answer

A) choosing the wrong domain. 
B) systematic error. 
C) using a limited sample of items. 
D) random error. 
A) choosing the wrong domain. 
B) systematic error. 
C) using a limited sample of items. 
D) random error.

Question 17

Correction for attenuation is used

Accepted Answer

A) to estimate the validity of a test. 
B) to correct for tests that are short. 
C) to correct for tests that are long. 
D) to estimate the true correlation between variables that have been measured with error. 
A) to estimate the validity of a test. 
B) to correct for tests that are short. 
C) to correct for tests that are long. 
D) to estimate the true correlation between variables that have been measured with error.

Question 18

Professor Pine constructed five different short history tests by randomly drawing questions from the huge pool of all possible questions about the current material. He has created

Accepted Answer

A) randomly parallel tests. 
B) a large sample size. 
C) systematic errors. 
D) attenuation effects. 
A) randomly parallel tests. 
B) a large sample size. 
C) systematic errors. 
D) attenuation effects.

Question 19

Jennifer read a report in which the agreement between raters of children's aggressive behavior was .50, indicating

Accepted Answer

A) the raters agreed at chance levels. 
B) agreement was poor. 
C) agreement was excellent. 
D) agreement was moderate. 
A) the raters agreed at chance levels. 
B) agreement was poor. 
C) agreement was excellent. 
D) agreement was moderate.

Question 20

How does the domain sampling model conceptualize reliability?

Accepted Answer

A) The absolute value of the difference between the standard error of measurement and the variance 
B) The ratio of variance of the observed scores on the short version of a test and the variance of the long-run true scores 
C) The sum of squares of the difference between the observed and true scores 
D) The ratio of the number of sample items to the number of domain items, multiplied by the mean of the sample distribution 
A) The absolute value of the difference between the standard error of measurement and the variance 
B) The ratio of variance of the observed scores on the short version of a test and the variance of the long-run true scores 
C) The sum of squares of the difference between the observed and true scores 
D) The ratio of the number of sample items to the number of domain items, multiplied by the mean of the sample distribution

Exam 4: Reliability

If the same test, given at different points in time to the same test takers, yields different scores, then the method typically used to assess this source of error is

The intercorrelations among items within the same test is referred to as

In the domain sampling model, the reliability of a test increases as

Dr. Smith is trying to determine the reliability of a new personality test. Two randomly parallel tests, A and B, have a correlation of .81. What is the estimated reliability of the new personality test?

Difference scores are created by

The reliability coefficient is

Sources of error associated with time sampling are measured using

Theoretically, if Susie repeatedly took the 6th grade achievement test, you would be able to find her true score by finding the ____ of the distribution of her scores.

Discuss the challenges to the use of difference scores.

The method for estimating the internal consistency of a test that simultaneously considers all possible ways of splitting the items is the

If we repeatedly administered the same test to the same individual, the standard deviation of the person's score would be the

When creating a test, one generally uses a subset of items to represent a larger construct. This is known as

Suppose you were trying to estimate the reliability of a whole test on the basis of the correlation between scores on the two halves of the test. In order to correct for using scores based on the halves, you might use the

Which of the following would tend to provide the most conservative estimate of split-half reliability?

The standard error of measurement allows us to

In the domain sampling model, the error that is being considered is the error caused by

Correction for attenuation is used

Professor Pine constructed five different short history tests by randomly drawing questions from the huge pool of all possible questions about the current material. He has created

Jennifer read a report in which the agreement between raters of children's aggressive behavior was .50, indicating

How does the domain sampling model conceptualize reliability?

Introduction

Norms and Basic Statistics for Testing

Correlation and Regression

Validity

Writing and Evaluating Test Items

Test Administration

Interviewing Techniques

Theories of Intelligence and the Binet Scales

The Wechsler Intelligence Scales: Wais-Iv, Wisc-Iv, and Wppsi-III

Testing in Education: Tests of Ability in Education and Special Education

Standardized Tests in Education, Civil Service, and the Military

Applications in Clinical and Counseling Settings

Projective Personality Tests

Computers and Basic Psychological Science in Testing

Testing in Counseling Psychology

Testing in Health Psychology and Health Care

Testing in Industrial and Business Settings

Test Bias

Testing and the Law

The Future of Psychological Testing

Filters

Theoretically, if Susie repeatedly took the 6^th grade achievement test, you would be able to find her true score by finding the ____ of the distribution of her scores.