Question 1

A test has a score reliability of .70.This means

Accepted Answer

A)  if the test were administered again, at least .70 percent of the subjects would obtain the same score. 
B)  the test is 70 percent effective in measuring whatever it does measure. 
C)  70 percent of the variance in the observed scores is free of error. 
D)  70 percent of the variance in the observed scores is error variance. 
A)  if the test were administered again, at least .70 percent of the subjects would obtain the same score. 
B)  the test is 70 percent effective in measuring whatever it does measure. 
C)  70 percent of the variance in the observed scores is free of error. 
D)  70 percent of the variance in the observed scores is error variance.

Question 2

The most appropriate reliability index to use for a comprehensive multiple-choice final examination in an introductory college course is

Accepted Answer

A)  Kuder-Richardson 20. 
B)  Kuder-Richardson 21. 
C)  coefficient of equivalence. 
D)  Spearman-Brown. 
E)  coefficient of stability. 
A)  Kuder-Richardson 20. 
B)  Kuder-Richardson 21. 
C)  coefficient of equivalence. 
D)  Spearman-Brown. 
E)  coefficient of stability.

Question 3

In gathering discriminant evidence in a validity study, one determines the correlation between measures of ____ constructs obtained from ____ methods.

Accepted Answer

A)  same, same 
B)  same, different 
C)  different, same 
D)  different, different 
A)  same, same 
B)  same, different 
C)  different, same 
D)  different, different

Question 4

A researcher has constructed an attitude scale in which each item is scored from 1 to 5 depending on the extent of agreement or disagreement.The estimate of score reliability that would be recommended for this scale is

Accepted Answer

A)  Kuder-Richardson formula 20. 
B)  Kuder-Richardson formula 21. 
C)  Cronbach's coefficient alpha. 
D)  biserial correlation coefficient. 
E)  phi coefficient. 
A)  Kuder-Richardson formula 20. 
B)  Kuder-Richardson formula 21. 
C)  Cronbach's coefficient alpha. 
D)  biserial correlation coefficient. 
E)  phi coefficient.

Question 5

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples.
-Refer to Exhibit 9-13.Subjects may be asked to "think aloud" as they take the test.

Accepted Answer

A)  Content 
B)  Response processes 
C)  Internal structure 
D)  Relationship with other variables 
A)  Content 
B)  Response processes 
C)  Internal structure 
D)  Relationship with other variables

Question 6

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions.
-Refer to Exhibit 9-1.The test analysis shows that the test is measuring a single trait.

Accepted Answer

A)  evidence based on content 
B)  evidence based on internal structure 
C)  evidence based on relationship to other variables 
A)  evidence based on content 
B)  evidence based on internal structure 
C)  evidence based on relationship to other variables

Question 7

High score reliability for a test indicates that

Accepted Answer

A)  the test has validity. 
B)  random errors of measurement are not a serious problem. 
C)  the test is measuring what it is supposed to be measuring. 
D)  the proportion of error variance to true variance is very high. 
A)  the test has validity. 
B)  random errors of measurement are not a serious problem. 
C)  the test is measuring what it is supposed to be measuring. 
D)  the proportion of error variance to true variance is very high.

Question 8

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples.
-Refer to Exhibit 9-13.The intercorrelations among the test items.

Accepted Answer

A)  Content 
B)  Response processes 
C)  Internal structure 
D)  Relationship with other variables 
A)  Content 
B)  Response processes 
C)  Internal structure 
D)  Relationship with other variables

Question 9

The major disadvantage of the coefficient of stability and equivalence as a measure of reliability is

Accepted Answer

A)  getting the cooperation of the subjects. 
B)  obtaining the two forms of the test. 
C)  finding a suitable criterion. 
D)  establishing the appropriate time interval. 
E)  the statistics involved in calculating the coefficient. 
A)  getting the cooperation of the subjects. 
B)  obtaining the two forms of the test. 
C)  finding a suitable criterion. 
D)  establishing the appropriate time interval. 
E)  the statistics involved in calculating the coefficient.

Question 10

A researcher has a highly speeded test.The recommended way to estimate the score reliability of this test is to use

Accepted Answer

A)  Cronbach alpha. 
B)  Kuder-Richardson 21. 
C)  test-retest or equivalent forms. 
D)  the split-half procedure. 
A)  Cronbach alpha. 
B)  Kuder-Richardson 21. 
C)  test-retest or equivalent forms. 
D)  the split-half procedure.

Question 11

Which of the following summarizes the relationship between the standard error measurement and a test's score reliability?

Accepted Answer

A)  The higher the test's reliability, the larger the standard error of measurement. 
B)  The higher the test's reliability, the smaller the standard error of measurement. 
C)  The standard error of measurement also provides an estimate of the correlation between true scores and error scores. 
D)  There is no direct relationship between standard error of measurement and reliability. 
A)  The higher the test's reliability, the larger the standard error of measurement. 
B)  The higher the test's reliability, the smaller the standard error of measurement. 
C)  The standard error of measurement also provides an estimate of the correlation between true scores and error scores. 
D)  There is no direct relationship between standard error of measurement and reliability.

Question 12

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below.
-Refer to Exhibit 9-10.Direct comparison of item scores by formula.

Accepted Answer

A)  test-retest 
B)  alternate form 
C)  split-half 
D)  Kuder-Richardson 
A)  test-retest 
B)  alternate form 
C)  split-half 
D)  Kuder-Richardson

Question 13

Miss Jones has constructed a mastery test to give after a unit on fractions.All students must have at least 85 percent of the items correct.Which of the following reliability coefficients would you recommend as being most appropriate for Miss Jones to use?

Accepted Answer

A)  Test-retest 
B)  Kuder-Richardson 20 
C)  Agreement coefficient 
D)  Coefficient alpha 
A)  Test-retest 
B)  Kuder-Richardson 20 
C)  Agreement coefficient 
D)  Coefficient alpha

Question 14

An insignificant correlation between a mathematics reasoning test and a reading test would be desirable to show that the math test

Accepted Answer

A)  is relatively free from irrelevant variance. 
B)  has little validity. 
C)  is unreliable. 
D)  has the desired reliability. 
A)  is relatively free from irrelevant variance. 
B)  has little validity. 
C)  is unreliable. 
D)  has the desired reliability.

Question 15

Which of the following score reliability procedures requires that the items all have the same level of difficulty?

Accepted Answer

A)  Kuder-Richardson 20 
B)  Kuder-Richardson 21 
C)  Split-half 
D)  Cronbach alpha 
A)  Kuder-Richardson 20 
B)  Kuder-Richardson 21 
C)  Split-half 
D)  Cronbach alpha

Question 16

Determine the standard error of measurement for a test with a standard deviation of 15 and a score reliability coefficient of .91.

Accepted Answer

Standard e

Question 17

Exhibit 9-3: Choose the type of evidence (a-c) that would be of primary importance for the validity of the following tests.
-Refer to Exhibit 9-3.An employment test for selecting data processors

Accepted Answer

A)  evidence based on content 
B)  evidence supporting construct 
C)  evidence based on relationship to other variables 
A)  evidence based on content 
B)  evidence supporting construct 
C)  evidence based on relationship to other variables

Question 18

Exhibit 9-9: Indicate the type of validity evidence that is represented in the following situations.
-Refer to Exhibit 9-9.In validating a teacher-constructed test of writing ability, a researcher correlates the test scores with the grades the students are receiving on their writing exercises in class.

Accepted Answer

A)  content 
B)  construct 
C)  concurrent 
D)  predictive 
A)  content 
B)  construct 
C)  concurrent 
D)  predictive

Question 19

Exhibit 9-9: Indicate the type of validity evidence that is represented in the following situations.
-Refer to Exhibit 9-9.Freshman college students who take a German placement test during orientation perform well in the German class in which they are placed by the test.

Accepted Answer

A)  content 
B)  construct 
C)  concurrent 
D)  predictive 
A)  content 
B)  construct 
C)  concurrent 
D)  predictive

Question 20

Which of the following represents the most direct evidence that a test is a valid measure of a construct?

Accepted Answer

A)  The test predicts success in college. 
B)  The test scores correlate highly with teachers' ratings. 
C)  The test includes a representative sample of the skills taught in the course. 
D)  The test of trait Y places individuals into categories that were predicted from the theory of trait Y. 
A)  The test predicts success in college. 
B)  The test scores correlate highly with teachers' ratings. 
C)  The test includes a representative sample of the skills taught in the course. 
D)  The test of trait Y places individuals into categories that were predicted from the theory of trait Y.

A test has a score reliability of .70.This means

The most appropriate reliability index to use for a comprehensive multiple-choice final examination in an introductory college course is

In gathering discriminant evidence in a validity study, one determines the correlation between measures of constructs obtained from methods.

A researcher has constructed an attitude scale in which each item is scored from 1 to 5 depending on the extent of agreement or disagreement.The estimate of score reliability that would be recommended for this scale is

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.Subjects may be asked to "think aloud" as they take the test.

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions. -Refer to Exhibit 9-1.The test analysis shows that the test is measuring a single trait.

High score reliability for a test indicates that

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.The intercorrelations among the test items.

The major disadvantage of the coefficient of stability and equivalence as a measure of reliability is

A researcher has a highly speeded test.The recommended way to estimate the score reliability of this test is to use

Which of the following summarizes the relationship between the standard error measurement and a test's score reliability?

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below. -Refer to Exhibit 9-10.Direct comparison of item scores by formula.

Miss Jones has constructed a mastery test to give after a unit on fractions.All students must have at least 85 percent of the items correct.Which of the following reliability coefficients would you recommend as being most appropriate for Miss Jones to use?

An insignificant correlation between a mathematics reasoning test and a reading test would be desirable to show that the math test

Which of the following score reliability procedures requires that the items all have the same level of difficulty?

Determine the standard error of measurement for a test with a standard deviation of 15 and a score reliability coefficient of .91.

Exhibit 9-3: Choose the type of evidence (a-c) that would be of primary importance for the validity of the following tests. -Refer to Exhibit 9-3.An employment test for selecting data processors

Exhibit 9-9: Indicate the type of validity evidence that is represented in the following situations. -Refer to Exhibit 9-9.Freshman college students who take a German placement test during orientation perform well in the German class in which they are placed by the test.

Which of the following represents the most direct evidence that a test is a valid measure of a construct?

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Experimental Research

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters

Exam 9: Validity and Reliability

A test has a score reliability of .70.This means

The most appropriate reliability index to use for a comprehensive multiple-choice final examination in an introductory college course is

In gathering discriminant evidence in a validity study, one determines the correlation between measures of ____ constructs obtained from ____ methods.

A researcher has constructed an attitude scale in which each item is scored from 1 to 5 depending on the extent of agreement or disagreement.The estimate of score reliability that would be recommended for this scale is

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.Subjects may be asked to "think aloud" as they take the test.

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions. -Refer to Exhibit 9-1.The test analysis shows that the test is measuring a single trait.

High score reliability for a test indicates that

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.The intercorrelations among the test items.

The major disadvantage of the coefficient of stability and equivalence as a measure of reliability is

A researcher has a highly speeded test.The recommended way to estimate the score reliability of this test is to use

Which of the following summarizes the relationship between the standard error measurement and a test's score reliability?

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below. -Refer to Exhibit 9-10.Direct comparison of item scores by formula.

Miss Jones has constructed a mastery test to give after a unit on fractions.All students must have at least 85 percent of the items correct.Which of the following reliability coefficients would you recommend as being most appropriate for Miss Jones to use?

An insignificant correlation between a mathematics reasoning test and a reading test would be desirable to show that the math test

Which of the following score reliability procedures requires that the items all have the same level of difficulty?

Determine the standard error of measurement for a test with a standard deviation of 15 and a score reliability coefficient of .91.

Exhibit 9-3: Choose the type of evidence (a-c) that would be of primary importance for the validity of the following tests. -Refer to Exhibit 9-3.An employment test for selecting data processors

Exhibit 9-9: Indicate the type of validity evidence that is represented in the following situations. -Refer to Exhibit 9-9.Freshman college students who take a German placement test during orientation perform well in the German class in which they are placed by the test.

Which of the following represents the most direct evidence that a test is a valid measure of a construct?

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Experimental Research

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters

In gathering discriminant evidence in a validity study, one determines the correlation between measures of constructs obtained from methods.