Question 1

A researcher who wants to establish score reliability in an observational study typically determines

Accepted Answer

A)  how well observer-assigned scores correlate with an external criterion. 
B)  the extent of agreement among observers. 
C)  how well the observation predicts other events. 
A)  how well observer-assigned scores correlate with an external criterion. 
B)  the extent of agreement among observers. 
C)  how well the observation predicts other events.

Question 2

The most meaningful way to consider test validity is

Accepted Answer

A)  across parallel forms. 
B)  as a subtype of reliability. 
C)  for a specific purpose. 
D)  in terms of errors of measurement. 
A)  across parallel forms. 
B)  as a subtype of reliability. 
C)  for a specific purpose. 
D)  in terms of errors of measurement.

Question 3

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below.
-Refer to Exhibit 9-10.Scores on Form A correlated with scores on Form B.

Accepted Answer

A)  test-retest 
B)  alternate form 
C)  split-half 
D)  Kuder-Richardson 
A)  test-retest 
B)  alternate form 
C)  split-half 
D)  Kuder-Richardson

Question 4

The internal consistency of a test can be measured using

Accepted Answer

A)  split-half procedure. 
B)  item-total correlations. 
C)  inter-item correlations 
D)  All of these are true. 
A)  split-half procedure. 
B)  item-total correlations. 
C)  inter-item correlations 
D)  All of these are true.

Question 5

Form A of a standardized reading test is administered and then Form B of the same test is administered one month later.The coefficient of correlation between the two test scores for a group of students would be known as a

Accepted Answer

A)  coefficient alpha. 
B)  coefficient of stability. 
C)  coefficient of equivalence. 
D)  coefficient of internal consistency. 
E)  coefficient of stability and equivalence. 
A)  coefficient alpha. 
B)  coefficient of stability. 
C)  coefficient of equivalence. 
D)  coefficient of internal consistency. 
E)  coefficient of stability and equivalence.

Question 6

Exhibit 9-2: An achievement test for advanced math was developed for high school students.In the process of preparing the test, a number of steps were carried out.Choose the option that most directly relates to each of the following steps.
-Refer to Exhibit 9-2.For 5,000 cases, two forms of the test were given and scores on Form A were correlated with scores on Form B.This step is concerned with

Accepted Answer

A)  reliability. 
B)  validity evidence based on content. 
C)  validity evidence based on relationship to the other variables. 
D)  validity evidence based on response processes. 
A)  reliability. 
B)  validity evidence based on content. 
C)  validity evidence based on relationship to the other variables. 
D)  validity evidence based on response processes.

Question 7

Exhibit 9-11: Choose the type of validity evidence that a researcher would need to determine the score validity of the following kinds of instruments.
-Refer to Exhibit 9-11.A math test designed to predict achievement in mathematics.

Accepted Answer

A)  evidence based on content. 
B)  evidence based on relationship to other variables 
C)  evidence based on construct measured 
A)  evidence based on content. 
B)  evidence based on relationship to other variables 
C)  evidence based on construct measured

Question 8

What are the three sources of error in a measuring instrument?

Accepted Answer

The instrument itsel

Question 9

Criterion contamination occurs when

Accepted Answer

A)  a test is lacking in construct validity. 
B)  the criterion measurement is found to be invalid. 
C)  knowledge of predictor test scores influences decision-making. 
D)  errors are made in predicting criterion performance. 
A)  a test is lacking in construct validity. 
B)  the criterion measurement is found to be invalid. 
C)  knowledge of predictor test scores influences decision-making. 
D)  errors are made in predicting criterion performance.

Question 10

A test designed to measure achievement motivation proved to be very consistent but to have no relation to other measures of motivation or teachers' ratings of motivation.The test is

Accepted Answer

A)  valid and reliable. 
B)  reliable but not valid. 
C)  valid but not reliable. 
D)  neither valid nor reliable. 
A)  valid and reliable. 
B)  reliable but not valid. 
C)  valid but not reliable. 
D)  neither valid nor reliable.

Question 11

The coefficient of correlation between a scholastic aptitude test and GPA was found to be 1.05.This coefficient indicates that

Accepted Answer

A)  the scholastic aptitude test has good reliability. 
B)  the scholastic aptitude test has high validity. 
C)  the scholastic aptitude test is useful as a predictor of school achievement. 
D)  there is an error in the computation. 
E)  None of these are true. 
A)  the scholastic aptitude test has good reliability. 
B)  the scholastic aptitude test has high validity. 
C)  the scholastic aptitude test is useful as a predictor of school achievement. 
D)  there is an error in the computation. 
E)  None of these are true.

Question 12

If the score reliability of a test decreases, the standard error of measurement will

Accepted Answer

A)  decrease. 
B)  increase. 
C)  stay the same. 
D)  decrease only if the standard deviation decreases. 
A)  decrease. 
B)  increase. 
C)  stay the same. 
D)  decrease only if the standard deviation decreases.

Question 13

Exhibit 9-3: Choose the type of evidence (a-c) that would be of primary importance for the validity of the following tests.
-Refer to Exhibit 9-3.A quantitative aptitude test used for screening applicants for admission to the School of Engineering.

Accepted Answer

A)  evidence based on content 
B)  evidence supporting construct 
C)  evidence based on relationship to other variables 
A)  evidence based on content 
B)  evidence supporting construct 
C)  evidence based on relationship to other variables

Question 14

Cronbach's coefficient alpha is preferred to the Kuder-Richardson 21 when

Accepted Answer

A)  the items are all of the same level of difficulty. 
B)  the items are scored right or wrong (dichotomously). 
C)  the responses may receive a varying number of points. 
D)  a and c 
A)  the items are all of the same level of difficulty. 
B)  the items are scored right or wrong (dichotomously). 
C)  the responses may receive a varying number of points. 
D)  a and c

Question 15

Exhibit 9-9: Indicate the type of validity evidence that is represented in the following situations.
-Refer to Exhibit 9-9.A respected university professor of American literature examines a test designed to measure student knowledge of American literature of the 19th century and states that, in his opinion, the test measures such knowledge.

Accepted Answer

A)  content 
B)  construct 
C)  concurrent 
D)  predictive 
A)  content 
B)  construct 
C)  concurrent 
D)  predictive

Question 16

The greatest difficulty for one doing research on teacher effectiveness is most likely to be

Accepted Answer

A)  formulating the research question. 
B)  obtaining subjects to participate in the study. 
C)  operationally defining teacher effectiveness. 
D)  developing statistical procedures for analyzing the data. 
A)  formulating the research question. 
B)  obtaining subjects to participate in the study. 
C)  operationally defining teacher effectiveness. 
D)  developing statistical procedures for analyzing the data.

Question 17

A student received a score of 85 on a classroom test where the mean was 70 and the standard deviation was 10.The test was found to have a reliability coefficient of .64.Which of the following statements would correctly express the accuracy of the student's obtained score? There are

Accepted Answer

A)  50 chances out of 100 that the true score is included by the range of scores from 72 to 78. 
B)  68 chances out of 100 that the true score is included by the range of scores from 75 to 95. 
C)  68 chances out of 100 that the true score is included by the range of scores from 79 to 91. 
D)  75 chances out of 100 that the true score is included by the range of scores from 79 to 91. 
E)  95 chances out of 100 that the true score is included by the range of scores from 79 to 91. 
A)  50 chances out of 100 that the true score is included by the range of scores from 72 to 78. 
B)  68 chances out of 100 that the true score is included by the range of scores from 75 to 95. 
C)  68 chances out of 100 that the true score is included by the range of scores from 79 to 91. 
D)  75 chances out of 100 that the true score is included by the range of scores from 79 to 91. 
E)  95 chances out of 100 that the true score is included by the range of scores from 79 to 91.

Question 18

Exhibit 9-2: An achievement test for advanced math was developed for high school students.In the process of preparing the test, a number of steps were carried out.Choose the option that most directly relates to each of the following steps.
-Refer to Exhibit 9-2.The test outline was prepared by a committee of experts in the high school math curriculum.This step is concerned with

Accepted Answer

A)  reliability. 
B)  validity evidence based on content. 
C)  validity evidence based on relationship to the other variables. 
D)  validity evidence based on response processes. 
A)  reliability. 
B)  validity evidence based on content. 
C)  validity evidence based on relationship to the other variables. 
D)  validity evidence based on response processes.

Question 19

A test has a reliability coefficient of .75 and a standard deviation of 10.What is the standard error of measurement of this test?

Accepted Answer

A)  5.00 
B)  8.00 
C)  10.00 
D)  20.00 
E)  32.00 
A)  5.00 
B)  8.00 
C)  10.00 
D)  20.00 
E)  32.00

A researcher who wants to establish score reliability in an observational study typically determines

The most meaningful way to consider test validity is

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below. -Refer to Exhibit 9-10.Scores on Form A correlated with scores on Form B.

The internal consistency of a test can be measured using

Form A of a standardized reading test is administered and then Form B of the same test is administered one month later.The coefficient of correlation between the two test scores for a group of students would be known as a

Exhibit 9-11: Choose the type of validity evidence that a researcher would need to determine the score validity of the following kinds of instruments. -Refer to Exhibit 9-11.A math test designed to predict achievement in mathematics.

What are the three sources of error in a measuring instrument?

Criterion contamination occurs when

A test designed to measure achievement motivation proved to be very consistent but to have no relation to other measures of motivation or teachers' ratings of motivation.The test is

The coefficient of correlation between a scholastic aptitude test and GPA was found to be 1.05.This coefficient indicates that

If the score reliability of a test decreases, the standard error of measurement will

Exhibit 9-3: Choose the type of evidence (a-c) that would be of primary importance for the validity of the following tests. -Refer to Exhibit 9-3.A quantitative aptitude test used for screening applicants for admission to the School of Engineering.

Cronbach's coefficient alpha is preferred to the Kuder-Richardson 21 when

The greatest difficulty for one doing research on teacher effectiveness is most likely to be

A student received a score of 85 on a classroom test where the mean was 70 and the standard deviation was 10.The test was found to have a reliability coefficient of .64.Which of the following statements would correctly express the accuracy of the student's obtained score? There are

A test has a reliability coefficient of .75 and a standard deviation of 10.What is the standard error of measurement of this test?

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Experimental Research

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters

Exam 9: Validity and Reliability

A researcher who wants to establish score reliability in an observational study typically determines

The most meaningful way to consider test validity is

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below. -Refer to Exhibit 9-10.Scores on Form A correlated with scores on Form B.

The internal consistency of a test can be measured using

Form A of a standardized reading test is administered and then Form B of the same test is administered one month later.The coefficient of correlation between the two test scores for a group of students would be known as a

Exhibit 9-11: Choose the type of validity evidence that a researcher would need to determine the score validity of the following kinds of instruments. -Refer to Exhibit 9-11.A math test designed to predict achievement in mathematics.

What are the three sources of error in a measuring instrument?

Criterion contamination occurs when

A test designed to measure achievement motivation proved to be very consistent but to have no relation to other measures of motivation or teachers' ratings of motivation.The test is

The coefficient of correlation between a scholastic aptitude test and GPA was found to be 1.05.This coefficient indicates that

If the score reliability of a test decreases, the standard error of measurement will

Exhibit 9-3: Choose the type of evidence (a-c) that would be of primary importance for the validity of the following tests. -Refer to Exhibit 9-3.A quantitative aptitude test used for screening applicants for admission to the School of Engineering.

Cronbach's coefficient alpha is preferred to the Kuder-Richardson 21 when

The greatest difficulty for one doing research on teacher effectiveness is most likely to be

A student received a score of 85 on a classroom test where the mean was 70 and the standard deviation was 10.The test was found to have a reliability coefficient of .64.Which of the following statements would correctly express the accuracy of the student's obtained score? There are

A test has a reliability coefficient of .75 and a standard deviation of 10.What is the standard error of measurement of this test?

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Experimental Research

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters