Question 1

In 2015,a group of researchers attempted to replicate 100 peer-reviewed,published psychological studies.This group of researchers was called the

Accepted Answer

A)  Society for the Replication of Psychological Studies. 
B)  Scientists for the Abolition of Irreproducible Results. 
C)  Open Science Collaboration. 
D)  Coalition for Responsible Science. 
A)  Society for the Replication of Psychological Studies. 
B)  Scientists for the Abolition of Irreproducible Results. 
C)  Open Science Collaboration. 
D)  Coalition for Responsible Science.

Question 2

The KR-21 reliability estimate was developed

Accepted Answer

A)  to yield greater consistency in reliability coefficients. 
B)  to facilitate computation by hand. 
C)  for use with less homogeneous items. 
D)  because Kuder wanted to "one-up" Richardson's 20. 
A)  to yield greater consistency in reliability coefficients. 
B)  to facilitate computation by hand. 
C)  for use with less homogeneous items. 
D)  because Kuder wanted to "one-up" Richardson's 20.

Question 3

Typically,speed tests

Accepted Answer

A)  contain items of a uniform difficulty level. 
B)  are completed by fewer than 1% of all test-takers. 
C)  have low validity coefficients. 
D)  yield high rates of false positives. 
A)  contain items of a uniform difficulty level. 
B)  are completed by fewer than 1% of all test-takers. 
C)  have low validity coefficients. 
D)  yield high rates of false positives.

Question 4

In an illustrative scenario described in Chapter 5 of your text,a group of 12th grade "whiz kids" in math,newly arrived to the United States from China,perform poorly on a test of 12th grade math.According to the text,what probably accounted for this?

Accepted Answer

A)  lower standards in China as compared to the US for measuring math ability. 
B)  higher standards in the US as compared to China for earning high grades. 
C)  the ability of the Chinese students to read what was required in English. 
D)  the reliability of the instrument used to test 12th grade math skills. 
A)  lower standards in China as compared to the US for measuring math ability. 
B)  higher standards in the US as compared to China for earning high grades. 
C)  the ability of the Chinese students to read what was required in English. 
D)  the reliability of the instrument used to test 12th grade math skills.

Question 5

Interpretations of criterion-referenced tests are typically made with respect to

Accepted Answer

A)  the total number of items the examinee responded to. 
B)  the material that the examinee evidenced mastery of. 
C)  a comparison of the examinee's performance with that of others who took the test. 
D)  a formula that takes into account the total number of items for which no response was scorable. 
A)  the total number of items the examinee responded to. 
B)  the material that the examinee evidenced mastery of. 
C)  a comparison of the examinee's performance with that of others who took the test. 
D)  a formula that takes into account the total number of items for which no response was scorable.

Question 6

Which of the following is,generally speaking,the preferred statistic for obtaining a measure of internal-consistency reliability?

Accepted Answer

A)  KR-20 
B)  KR-21 
C)  Kendall's Tau 
D)  coefficient alpha 
A)  KR-20 
B)  KR-21 
C)  Kendall's Tau 
D)  coefficient alpha

Question 7

The term test heterogeneity BEST refers to the extent to which test items measure

Accepted Answer

A)  different factors. 
B)  the same factor. 
C)  a unifactorial trait. 
D)  a nonhomogeneous trait. 
A)  different factors. 
B)  the same factor. 
C)  a unifactorial trait. 
D)  a nonhomogeneous trait.

Question 8

According to Chin,it is common for research findings to be

Accepted Answer

A)  rejected for not having met the general acceptance standard. 
B)  accepted as having met the general acceptance standard. 
C)  accepted by a judge but then rejected by an expert witness. 
D)  accepted by an expert witness but then rejected by a judge. 
A)  rejected for not having met the general acceptance standard. 
B)  accepted as having met the general acceptance standard. 
C)  accepted by a judge but then rejected by an expert witness. 
D)  accepted by an expert witness but then rejected by a judge.

Question 9

Computer-scorable items have tended to eliminate error variance due to

Accepted Answer

A)  item sampling. 
B)  scorer differences. 
C)  content sampling. 
D)  testtakers' reactions to environmental variables. 
A)  item sampling. 
B)  scorer differences. 
C)  content sampling. 
D)  testtakers' reactions to environmental variables.

Question 10

As compared to what was business as usual in the past,more researchers are coming to the realization that replication is

Accepted Answer

A)  really not as necessary as what researchers once thought. 
B)  not something that can ever completely "right" past wrongs. 
C)  mandatory given the influence of social media. 
D)  needed if published findings are to be relied on. 
A)  really not as necessary as what researchers once thought. 
B)  not something that can ever completely "right" past wrongs. 
C)  mandatory given the influence of social media. 
D)  needed if published findings are to be relied on.

Question 11

Which type of reliability estimate would be appropriate only when evaluating the reliability of a test that measures a trait that is presumed to be relatively stable over time?

Accepted Answer

A)  parallel-forms 
B)  alternate-forms 
C)  test-retest 
D)  split-half 
A)  parallel-forms 
B)  alternate-forms 
C)  test-retest 
D)  split-half

Question 12

What has been called a "replicability crisis" in psychology emerged as a result of a number of factors.Which is not one of those factors?

Accepted Answer

A)  a general lack of published attempts to replicate research 
B)  editorial preferences for papers with positive findings 
C)  questionable research practices on the part of study authors 
D)  unwillingness or inability of original study authors to share data 
A)  a general lack of published attempts to replicate research 
B)  editorial preferences for papers with positive findings 
C)  questionable research practices on the part of study authors 
D)  unwillingness or inability of original study authors to share data

Question 13

The standard error of measurement of a particular test of anxiety is 8.A student earns a score of 60.What is the confidence interval for this test score at the 95% level?

Accepted Answer

A)  52-68 
B)  40-68 
C)  44-76 
D)  36-84 
A)  52-68 
B)  40-68 
C)  44-76 
D)  36-84

Question 14

Which of the following is TRUE of the standard error of measurement?

Accepted Answer

A)  The larger the standard error of measurement, the better. 
B)  The standard error of measurement is inversely related to the standard deviation (that is, when one goes up, the other goes down). 
C)  The standard error of measurement is inversely related to reliability (that is, when one goes up, the other goes down). 
D)  A low standard error of measurement is indicative of low validity. 
A)  The larger the standard error of measurement, the better. 
B)  The standard error of measurement is inversely related to the standard deviation (that is, when one goes up, the other goes down). 
C)  The standard error of measurement is inversely related to reliability (that is, when one goes up, the other goes down). 
D)  A low standard error of measurement is indicative of low validity.

Question 15

Test items with little discriminative ability prompt the test developer to consider the possibility that

Accepted Answer

A)  the content of the item does not match the construct measured by the other items in the scale. 
B)  the item is poorly worded and needs to be rewritten. 
C)  the item is too complex for the educational level of the population. 
D)  All of these 
A)  the content of the item does not match the construct measured by the other items in the scale. 
B)  the item is poorly worded and needs to be rewritten. 
C)  the item is too complex for the educational level of the population. 
D)  All of these

Question 16

What type of reliability estimate is obtained by correlating pairs of scores from the same person on two different administrations of the same test?

Accepted Answer

A)  parallel-forms 
B)  split-half 
C)  interrater 
D)  test-retest 
A)  parallel-forms 
B)  split-half 
C)  interrater 
D)  test-retest

Question 17

Cronbach's alpha is to similarity of scores on test items as average proportional distance is to

Accepted Answer

A)  difference in scores on test items. 
B)  inter-item consistency. 
C)  test-retest reliability. 
D)  parallel forms reliability. 
A)  difference in scores on test items. 
B)  inter-item consistency. 
C)  test-retest reliability. 
D)  parallel forms reliability.

Question 18

In the language of psychological testing and assessment,reliability BEST refers to

Accepted Answer

A)  how well a test measures what it was originally designed to measure. 
B)  the complete lack of any systematic error. 
C)  the proportion of total variance that can be attributed to true variance. 
D)  whether or not a test publisher consistently publishes high quality instruments. 
A)  how well a test measures what it was originally designed to measure. 
B)  the complete lack of any systematic error. 
C)  the proportion of total variance that can be attributed to true variance. 
D)  whether or not a test publisher consistently publishes high quality instruments.

Question 19

Why isn't IRT used more by "mom-and-pop" test developers such as classroom teachers?

Accepted Answer

A)  most classroom teachers were trained in generalizability theory 
B)  IRT has no application in classroom tests 
C)  applying IRT requires statistical sophistication 
D)  All of these 
A)  most classroom teachers were trained in generalizability theory 
B)  IRT has no application in classroom tests 
C)  applying IRT requires statistical sophistication 
D)  All of these

Question 20

A confidence interval is a range or band of test scores that

Accepted Answer

A)  has proven test-retest reliability. 
B)  is calculated using the standard error of the difference. 
C)  is likely to contain the true score. 
D)  None of these 
A)  has proven test-retest reliability. 
B)  is calculated using the standard error of the difference. 
C)  is likely to contain the true score. 
D)  None of these

In 2015,a group of researchers attempted to replicate 100 peer-reviewed,published psychological studies.This group of researchers was called the

The KR-21 reliability estimate was developed

Typically,speed tests

In an illustrative scenario described in Chapter 5 of your text,a group of 12^th grade "whiz kids" in math,newly arrived to the United States from China,perform poorly on a test of 12^th grade math.According to the text,what probably accounted for this?

Interpretations of criterion-referenced tests are typically made with respect to

Which of the following is,generally speaking,the preferred statistic for obtaining a measure of internal-consistency reliability?

The term test heterogeneity BEST refers to the extent to which test items measure

According to Chin,it is common for research findings to be

Computer-scorable items have tended to eliminate error variance due to

As compared to what was business as usual in the past,more researchers are coming to the realization that replication is

Which type of reliability estimate would be appropriate only when evaluating the reliability of a test that measures a trait that is presumed to be relatively stable over time?

What has been called a "replicability crisis" in psychology emerged as a result of a number of factors.Which is not one of those factors?

The standard error of measurement of a particular test of anxiety is 8.A student earns a score of 60.What is the confidence interval for this test score at the 95% level?

Which of the following is TRUE of the standard error of measurement?

Test items with little discriminative ability prompt the test developer to consider the possibility that

What type of reliability estimate is obtained by correlating pairs of scores from the same person on two different administrations of the same test?

Cronbach's alpha is to similarity of scores on test items as average proportional distance is to

In the language of psychological testing and assessment,reliability BEST refers to

Why isn't IRT used more by "mom-and-pop" test developers such as classroom teachers?

A confidence interval is a range or band of test scores that

Psychological Testing and Assessment

Historical, Cultural, and Legalethical Considerations

A Statistics Refresher

Of Tests and Testing

Validity

Utility

Test Development

Intelligence and Its Measurement

Assessment for Education

Personality Assessment: an Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment,Careers,and Business

Filters

Exam 5: Reliability

In 2015,a group of researchers attempted to replicate 100 peer-reviewed,published psychological studies.This group of researchers was called the

The KR-21 reliability estimate was developed

Typically,speed tests

In an illustrative scenario described in Chapter 5 of your text,a group of 12th grade "whiz kids" in math,newly arrived to the United States from China,perform poorly on a test of 12th grade math.According to the text,what probably accounted for this?

Interpretations of criterion-referenced tests are typically made with respect to

Which of the following is,generally speaking,the preferred statistic for obtaining a measure of internal-consistency reliability?

The term test heterogeneity BEST refers to the extent to which test items measure

According to Chin,it is common for research findings to be

Computer-scorable items have tended to eliminate error variance due to

As compared to what was business as usual in the past,more researchers are coming to the realization that replication is

Which type of reliability estimate would be appropriate only when evaluating the reliability of a test that measures a trait that is presumed to be relatively stable over time?

What has been called a "replicability crisis" in psychology emerged as a result of a number of factors.Which is not one of those factors?

The standard error of measurement of a particular test of anxiety is 8.A student earns a score of 60.What is the confidence interval for this test score at the 95% level?

Which of the following is TRUE of the standard error of measurement?

Test items with little discriminative ability prompt the test developer to consider the possibility that

What type of reliability estimate is obtained by correlating pairs of scores from the same person on two different administrations of the same test?

Cronbach's alpha is to similarity of scores on test items as average proportional distance is to

In the language of psychological testing and assessment,reliability BEST refers to

Why isn't IRT used more by "mom-and-pop" test developers such as classroom teachers?

A confidence interval is a range or band of test scores that

Psychological Testing and Assessment

Historical, Cultural, and Legalethical Considerations

A Statistics Refresher

Of Tests and Testing

Validity

Utility

Test Development

Intelligence and Its Measurement

Assessment for Education

Personality Assessment: an Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment,Careers,and Business

Filters

In an illustrative scenario described in Chapter 5 of your text,a group of 12^th grade "whiz kids" in math,newly arrived to the United States from China,perform poorly on a test of 12^th grade math.According to the text,what probably accounted for this?