Question 1

Which of the following is true of test-retest reliability?

Accepted Answer

A)  r is established during the study 
B)  An investigator should always collect test-retest data during a study 
C)  As the length of time increases between test administrations, r decreases 
D)  b and c 
E)  All of the above 
A)  r is established during the study 
B)  An investigator should always collect test-retest data during a study 
C)  As the length of time increases between test administrations, r decreases 
D)  b and c 
E)  All of the above C

Question 2

Parallel forms reliability is also known as the coefficient of stability.

Accepted Answer

A) True 
 B)False  False

Question 3

Which of the following is true of parallel forms reliability?

Accepted Answer

A)  A relation (r) is established between two forms of the same test 
B)  At least three weeks should elapse between administration of the two test forms 
C)  Different populations of people (similar to the target population) should receive the two different test forms 
D)  b and c 
E)  All of the above 
A)  A relation (r) is established between two forms of the same test 
B)  At least three weeks should elapse between administration of the two test forms 
C)  Different populations of people (similar to the target population) should receive the two different test forms 
D)  b and c 
E)  All of the above A

Question 4

If a measurement tool has high reliability, it must have high validity as well.

Accepted Answer

A) True 
 B)False

Question 5

Interitem reliability can only be used when there are several test items combined to make a composite score.

Accepted Answer

A) True 
 B)False

Question 6

Can a reliability coefficient be negative? Why or why not?

Accepted Answer

The variance of the observed scores is m

Question 7

The Spearman Brown formula must be used to adjust r when determining split-half reliability.

Accepted Answer

A) True 
 B)False

Question 8

Measurement reliability refers to consistency throughout a series of measurements.

Accepted Answer

A) True 
 B)False

Question 9

Dr. Dread has collected data on aggression using a measure with true/false items. She wants to determine the instrument's internal consistency. Which statistic should be used?

Accepted Answer

A)  Spearman-Brown formula 
B)  Kuder-Richardson 20 
C)  Cronbach's alpha 
D)  Either b or c 
A)  Spearman-Brown formula 
B)  Kuder-Richardson 20 
C)  Cronbach's alpha 
D)  Either b or c

Question 10

What factors affect the size of a reliability coefficient? Cronbach's alpha?

Accepted Answer

For Cronbach's alpha: length of the test

Question 11

Dr. Feelgood is developing an instrument on tender loving care. She obtains a reliability coefficient of .85. The standard error of measurement is 6.2. A nursing student takes the test and has a score of 80 (on a 0 to 100 scale). Which of the following is true?

Accepted Answer

A)  With a confidence interval of 95%, the true score falls between approximately 68 and 92 
B)  With a confidence interval of 95%, the true score falls between 73.8 and 86.2 
C)  The precision with which the true score is estimated is decreased due to a low reliability coefficient 
D)  b and c 
A)  With a confidence interval of 95%, the true score falls between approximately 68 and 92 
B)  With a confidence interval of 95%, the true score falls between 73.8 and 86.2 
C)  The precision with which the true score is estimated is decreased due to a low reliability coefficient 
D)  b and c

Question 12

Dr. Feelgood reports a Cronbach's alpha of .95 for a scale of 6 Likert items that measures compassion. She may legitimately make which of the assumptions or conclusions?

Accepted Answer

A)  Overall item intercorrelations are high 
B)  The items may be measuring more than one construct 
C)  Another index of reliability should be provided 
D)  All of the above. 
A)  Overall item intercorrelations are high 
B)  The items may be measuring more than one construct 
C)  Another index of reliability should be provided 
D)  All of the above.

Question 13

Cronbach's alpha is the most common means of establishing internal consistency in educational and psychological research.

Accepted Answer

A) True 
 B)False

Question 14

Carryover effects are a problem when establishing test-retest reliability for a measurement tool.

Accepted Answer

A) True 
 B)False

Question 15

When r is close to -1.00 or to +1.00, there is evidence for an instrument's reliability.

Accepted Answer

A) True 
 B)False

Question 16

Dr. Morgan wants to use the intraclass correlation coefficient (ICC) to assess interrater reliability in rating mastery motivation. Which of the following is true?

Accepted Answer

A)  There can only be two observers' scores to correlate 
B)  The Kappa statistic should be used to correlate observer's scores 
C)  The mastery ratings should use an interval scale 
D)  a and c 
A)  There can only be two observers' scores to correlate 
B)  The Kappa statistic should be used to correlate observer's scores 
C)  The mastery ratings should use an interval scale 
D)  a and c

Question 17

Dr. Dread is developing a measure of aggression that uses Likert scales. She wants to determine the instrument's internal consistency. Which statistic should be used?

Accepted Answer

A)  Spearman-Brown formula 
B)  Kuder-Richardson 20 
C)  Cronbach's alpha 
D)  Standard error of measurement 
A)  Spearman-Brown formula 
B)  Kuder-Richardson 20 
C)  Cronbach's alpha 
D)  Standard error of measurement

Question 18

Dr. Allport wants to establish test-retest reliability for a new measurement tool on personality. Which of the following is true?

Accepted Answer

A)  Dr. Allport should use a group of people similar to his target population to test the instrument 
B)  Dr. Allport should split the participants into two groups. He gives the test to one group, waits two weeks, and gives the test to the second group 
C)  An r of .55 is acceptable for a personality measurement tool 
D)  Dr. Allport should divide the high item pool in half and give these two different measures to the same people a week apart 
E)  None of the above 
A)  Dr. Allport should use a group of people similar to his target population to test the instrument 
B)  Dr. Allport should split the participants into two groups. He gives the test to one group, waits two weeks, and gives the test to the second group 
C)  An r of .55 is acceptable for a personality measurement tool 
D)  Dr. Allport should divide the high item pool in half and give these two different measures to the same people a week apart 
E)  None of the above

Question 19

In studies, what two reliability coefficients need to be reported?

Accepted Answer

The two reliability coefficients that ne

Question 20

Which of the following is true about measurement reliability?

Accepted Answer

A)  An r of +.90 indicates a strong relation between two scores 
B)  An r of .65 is not acceptable for measures used to make personnel decisions 
C)  A high negative correlation is not acceptable 
D)  All of the above are true 
A)  An r of +.90 indicates a strong relation between two scores 
B)  An r of .65 is not acceptable for measures used to make personnel decisions 
C)  A high negative correlation is not acceptable 
D)  All of the above are true

Exam 11: Measurement Reliability

Which of the following is true of test-retest reliability?

Parallel forms reliability is also known as the coefficient of stability.

Which of the following is true of parallel forms reliability?

If a measurement tool has high reliability, it must have high validity as well.

Interitem reliability can only be used when there are several test items combined to make a composite score.

Can a reliability coefficient be negative? Why or why not?

The Spearman Brown formula must be used to adjust r when determining split-half reliability.

Measurement reliability refers to consistency throughout a series of measurements.

Dr. Dread has collected data on aggression using a measure with true/false items. She wants to determine the instrument's internal consistency. Which statistic should be used?

What factors affect the size of a reliability coefficient? Cronbach's alpha?

Dr. Feelgood is developing an instrument on tender loving care. She obtains a reliability coefficient of .85. The standard error of measurement is 6.2. A nursing student takes the test and has a score of 80 (on a 0 to 100 scale). Which of the following is true?

Dr. Feelgood reports a Cronbach's alpha of .95 for a scale of 6 Likert items that measures compassion. She may legitimately make which of the assumptions or conclusions?

Cronbach's alpha is the most common means of establishing internal consistency in educational and psychological research.

Carryover effects are a problem when establishing test-retest reliability for a measurement tool.

When r is close to -1.00 or to +1.00, there is evidence for an instrument's reliability.

Dr. Morgan wants to use the intraclass correlation coefficient (ICC) to assess interrater reliability in rating mastery motivation. Which of the following is true?

Dr. Dread is developing a measure of aggression that uses Likert scales. She wants to determine the instrument's internal consistency. Which statistic should be used?

Dr. Allport wants to establish test-retest reliability for a new measurement tool on personality. Which of the following is true?

In studies, what two reliability coefficients need to be reported?

Which of the following is true about measurement reliability?

Definitions, Purposes, and Dimensions of Research

Planning a Quantitative Research Project

Variables, Research Questions, and Hypotheses

Research Approaches

Randomized Experimental and Quasi-Experimental Designs

Single-Subject Designs

Nonexperimental Approachesdesigns

Internal Validity

Sampling and Introduction to External Validity

Measurement and Descriptive Statistics

Measurement Validity

Types of Data Collection Techniques

Ethical Issues in Conducting the Study

Practical Issues in Data Collection and Coding

Making Inferences From Sample Data I: The Null Hypothesis Significance Testing Approach

Making Inferences From Sample Data II: the Evidence-Based Approach

General Design Classifications for Selection of Difference Statistical Methods

Selection of Appropriate Statistical Methods: Integration of Design and Analysis

Data Analysis and Interpretation: Basic Difference Questions

Analysis and Interpretation of Basic Associational Research Questions

Analysis and Interpretation of Complex Research Questions

Evaluating Research Validity: Part I

Evaluating Research Validity: Part II

Evaluating Research for Evidence-Based Practice

Writing the Research Report

Filters