Question 1

The basic theory of reliability was first worked out by

Accepted Answer

A)  Karl Pearson. 
B)  Charles Spearman. 
C)  Julian Stanley. 
D)  Lee Cronbach. 
A)  Karl Pearson. 
B)  Charles Spearman. 
C)  Julian Stanley. 
D)  Lee Cronbach.

Question 2

What is the impact of carryover effects on test-retest reliability?

Accepted Answer

A)  Test-retest reliability is not influenced by carryover effects. 
B)  Carryover effects result in an overestimation of reliability. 
C)  Carryover effects result in an underestimation of reliability. 
D)  Test-retest reliability increases carryover effects. 
A)  Test-retest reliability is not influenced by carryover effects. 
B)  Carryover effects result in an overestimation of reliability. 
C)  Carryover effects result in an underestimation of reliability. 
D)  Test-retest reliability increases carryover effects.

Question 3

A reliability coefficient of .60 suggests that

Accepted Answer

A)  64% of the variance on the test is error. 
B)  40% of the variance on the test is error. 
C)  78% of the variance on the test is error. 
D)  the test can be used for clinical purposes but not for research. 
A)  64% of the variance on the test is error. 
B)  40% of the variance on the test is error. 
C)  78% of the variance on the test is error. 
D)  the test can be used for clinical purposes but not for research.

Question 4

What is the most useful indicator of reliability for the interpretation of individual scores?

Accepted Answer

A)  split-half variance 
B)  test-retest 
C)  item sampling 
D)  standard error of measurement 
A)  split-half variance 
B)  test-retest 
C)  item sampling 
D)  standard error of measurement

Question 5

Tests designed according to item response theory

Accepted Answer

A)  are no longer considered useful. 
B)  can only be used with non-objective material 
C)  yield more reliable results with fewer items 
D)  provide low-tech methods for field use. 
A)  are no longer considered useful. 
B)  can only be used with non-objective material 
C)  yield more reliable results with fewer items 
D)  provide low-tech methods for field use.

Question 6

Dr.Smith is trying to determine the reliability of a new personality test.Two randomly parallel tests,A and B,have a correlation of .81.What is the estimated reliability of the new personality test?

Accepted Answer

A)  .81 
B)  -.9 
C)  .9 
D)  .81/t 
A)  .81 
B)  -.9 
C)  .9 
D)  .81/t

Question 7

We can get an idea of how much measurement error is present in a score through the

Accepted Answer

A)  true score. 
B)  observed score. 
C)  standard error of the mean. 
D)  standard error of measurement. 
A)  true score. 
B)  observed score. 
C)  standard error of the mean. 
D)  standard error of measurement.

Question 8

Tests will be most reliable if they are

Accepted Answer

A)  multidimensional. 
B)  unidimensional. 
C)  brief. 
D)  criterion-referenced. 
A)  multidimensional. 
B)  unidimensional. 
C)  brief. 
D)  criterion-referenced.

Question 9

The problems created by using a limited number of items to represent a larger and more complicated construct are explicitly considered in the ____ model.

Accepted Answer

A)  multivariate 
B)  random sampling 
C)  domain sampling 
D)  standard error of measurement 
A)  multivariate 
B)  random sampling 
C)  domain sampling 
D)  standard error of measurement

Question 10

Professor Pine constructed five different short history tests by randomly drawing questions from the huge pool of all possible questions about the current material.He has created

Accepted Answer

A)  randomly parallel tests. 
B)  a large sample size. 
C)  systematic errors. 
D)  attenuation effects. 
A)  randomly parallel tests. 
B)  a large sample size. 
C)  systematic errors. 
D)  attenuation effects.

Question 11

In the domain sampling model,the error that is being considered is the error caused by

Accepted Answer

A)  choosing the wrong domain. 
B)  systematic error. 
C)  using a limited sample of items. 
D)  random error. 
A)  choosing the wrong domain. 
B)  systematic error. 
C)  using a limited sample of items. 
D)  random error.

Question 12

Which of the following is true of the parallel forms method?

Accepted Answer

A)  It is the most often used method for estimating reliability. 
B)  It provides one of the most rigorous methods for estimating reliability. 
C)  It is largely ineffective with psychological tests. 
D)  Sophisticated computer programs have made it unnecessary. 
A)  It is the most often used method for estimating reliability. 
B)  It provides one of the most rigorous methods for estimating reliability. 
C)  It is largely ineffective with psychological tests. 
D)  Sophisticated computer programs have made it unnecessary.

Question 13

Which of the following is an important distinction between systematic errors and random errors?

Accepted Answer

A)  Random errors are more likely than systematic errors to cause errors in conclusions. 
B)  Systematic errors occur only in objective measures and random errors occur only in subjective measures. 
C)  Random errors can be eliminated by careful wording of test items. 
D)  Systematic errors are extremely rare among psychological tests. 
A)  Random errors are more likely than systematic errors to cause errors in conclusions. 
B)  Systematic errors occur only in objective measures and random errors occur only in subjective measures. 
C)  Random errors can be eliminated by careful wording of test items. 
D)  Systematic errors are extremely rare among psychological tests.

Question 14

How does the domain sampling model conceptualize reliability?

Accepted Answer

A)  The absolute value of the difference between the standard error of measurement and the variance 
B)  The ratio of variance of the observed scores on the short version of a test and the variance of the long-run true scores 
C)  The sum of squares of the difference between the observed and true scores 
D)  The ratio of the number of sample items to the number of domain items,multiplied by the mean of the sample distribution 
A)  The absolute value of the difference between the standard error of measurement and the variance 
B)  The ratio of variance of the observed scores on the short version of a test and the variance of the long-run true scores 
C)  The sum of squares of the difference between the observed and true scores 
D)  The ratio of the number of sample items to the number of domain items,multiplied by the mean of the sample distribution

Question 15

Standard errors of measurement are used to

Accepted Answer

A)  determine whether an observed score is the "true" score. 
B)  determine the standard deviation of the scores. 
C)  calculate the exact true score. 
D)  create confidence intervals around specific observed test scores. 
A)  determine whether an observed score is the "true" score. 
B)  determine the standard deviation of the scores. 
C)  calculate the exact true score. 
D)  create confidence intervals around specific observed test scores.

Question 16

Suppose you were trying to estimate the reliability of a whole test on the basis of the correlation between scores on the two halves of the test.In order to correct for using scores based on the halves,you might use the

Accepted Answer

A)  KR 20. 
B)  alpha method. 
C)  Spearman-Brown formula. 
D)  split half method. 
A)  KR 20. 
B)  alpha method. 
C)  Spearman-Brown formula. 
D)  split half method.

Question 17

If you have three clocks in your house,and every clock is 10 minutes fast,this is an example of

Accepted Answer

A)  systematic error. 
B)  random error. 
C)  measurement error. 
D)  a rubber yardstick. 
A)  systematic error. 
B)  random error. 
C)  measurement error. 
D)  a rubber yardstick.

Question 18

The preferred method for assessing the level of agreement between observers is the

Accepted Answer

A)  kappa statistic 
B)  Spearman coefficient 
C)  coefficient alpha 
D)  rank-order statistic 
A)  kappa statistic 
B)  Spearman coefficient 
C)  coefficient alpha 
D)  rank-order statistic

Question 19

What is Cronbach known for?

Accepted Answer

A)  Developing measures to evaluate sources of error 
B)  Creating the basics of multivariate analysis 
C)  Developed the basics of contemporary measurement theory 
D)  Distinguished between objective and subjective measures 
A)  Developing measures to evaluate sources of error 
B)  Creating the basics of multivariate analysis 
C)  Developed the basics of contemporary measurement theory 
D)  Distinguished between objective and subjective measures

Question 20

Sources of error associated with time sampling are measured using

Accepted Answer

A)  the test-retest method. 
B)  the split half method. 
C)  KR 20. 
D)  the alpha method. 
A)  the test-retest method. 
B)  the split half method. 
C)  KR 20. 
D)  the alpha method.

Exam 4: Reliability

The basic theory of reliability was first worked out by

What is the impact of carryover effects on test-retest reliability?

A reliability coefficient of .60 suggests that

What is the most useful indicator of reliability for the interpretation of individual scores?

Tests designed according to item response theory

Dr.Smith is trying to determine the reliability of a new personality test.Two randomly parallel tests,A and B,have a correlation of .81.What is the estimated reliability of the new personality test?

We can get an idea of how much measurement error is present in a score through the

Tests will be most reliable if they are

The problems created by using a limited number of items to represent a larger and more complicated construct are explicitly considered in the ____ model.

Professor Pine constructed five different short history tests by randomly drawing questions from the huge pool of all possible questions about the current material.He has created

In the domain sampling model,the error that is being considered is the error caused by

Which of the following is true of the parallel forms method?

Which of the following is an important distinction between systematic errors and random errors?

How does the domain sampling model conceptualize reliability?

Standard errors of measurement are used to

Suppose you were trying to estimate the reliability of a whole test on the basis of the correlation between scores on the two halves of the test.In order to correct for using scores based on the halves,you might use the

If you have three clocks in your house,and every clock is 10 minutes fast,this is an example of

The preferred method for assessing the level of agreement between observers is the

What is Cronbach known for?

Sources of error associated with time sampling are measured using

Introduction

Norms and Basic Statistics for Testing

Correlation and Regression

Validity

Writing and Evaluating Test Items

Test Administration

Interviewing Techniques

Theories of Intelligence and the Binet Scales

The Wechsler Intelligence Scales: Wais-Iv, wisc-Iv, and Wppsi-Iii

Other Individual Tests of Ability in Education and Special Education

Standardized Tests in Education, civil Service, and the Military

Applications in Clinical and Counseling Settings

Projective Personality Tests

Computers and Basic Psychological Science in Testing

Testing in Counseling Psychology

Testing in Health Psychology and Health Care

Testing in Industrial and Business Settings

Test Bias

Testing and the Law

Ethics and the Future of Psychological Testing

Filters