Question 1

What are the traditional types of validity evidence?

Accepted Answer

Content, criterion (

Question 2

What would the interrater reliability be for a 50-item measure in which the number of agreements between Rater 1 and Rater 2 was 45?

Accepted Answer

A)  0.45 
B)  80% 
C)  0.90 
D)  95% 
A)  0.45 
B)  80% 
C)  0.90 
D)  95%

Question 3

Name four types of reliability and what each type measures.

Accepted Answer

\[\begin{array} { | c | c | } 
\hline \t

Question 4

If you correlate scores from your test with some other valid measure that assesses the same set of abilities, what type of validity evidence are you collecting?

Accepted Answer

A)  Criterion validity 
B)  Content validity 
C)  Construct validity 
D)  Internal consistency 
A)  Criterion validity 
B)  Content validity 
C)  Construct validity 
D)  Internal consistency

Question 5

Which level of measurement is concerned only with the characteristics of an outcome that fits into a category?

Accepted Answer

The nominal level of measureme

Question 6

If you were interested in describing the order of variables along a continuum, what level of measurement would you use?

Accepted Answer

The ordinal level of measureme

Question 7

When we calculate reliability, we know the observed score. What are the two unknown components of the reliability equation?

Accepted Answer

A)  Method and error scores 
B)  Means and standard deviations 
C)  Test-retest and interrater scores 
D)  True and error scores 
A)  Method and error scores 
B)  Means and standard deviations 
C)  Test-retest and interrater scores 
D)  True and error scores

Question 8

Which of the following is the Greek letter associated with Cronbach's alpha, sometimes known as coefficient alpha?

Accepted Answer

A)  $\lambda$ 
B)  $\alpha$ 
C)  $\varepsilon$ 
D)  $\sigma$ 
A)  $\lambda$ 
B)  $\alpha$ 
C)  $\varepsilon$ 
D)  $\sigma$

Question 9

Test-retest reliability is an example of which of the following?

Accepted Answer

A)  Measure of consistency 
B)  Measure of stability 
C)  Measure of agreement 
D)  Measure of equivalence 
A)  Measure of consistency 
B)  Measure of stability 
C)  Measure of agreement 
D)  Measure of equivalence

Question 10

How does error affect reliability? Write the general equation for reliability that demonstrates this concept.

Accepted Answer

An increase in error results i

What are the traditional types of validity evidence?

What would the interrater reliability be for a 50-item measure in which the number of agreements between Rater 1 and Rater 2 was 45?

Name four types of reliability and what each type measures.

If you correlate scores from your test with some other valid measure that assesses the same set of abilities, what type of validity evidence are you collecting?

Which level of measurement is concerned only with the characteristics of an outcome that fits into a category?

If you were interested in describing the order of variables along a continuum, what level of measurement would you use?

When we calculate reliability, we know the observed score. What are the two unknown components of the reliability equation?

Which of the following is the Greek letter associated with Cronbach's alpha, sometimes known as coefficient alpha?

Test-retest reliability is an example of which of the following?

How does error affect reliability? Write the general equation for reliability that demonstrates this concept.

Statistics or Sadistics? It’s Up to You

Means to an End: Computing and Understanding Averages

Vive La Différence: Understanding Variability

A Picture Really Is Worth a Thousand Words

Ice Cream and Crime: Computing Correlation Coefficients

Hypotheticals and You: Testing Your Questions

Are Your Curves Normal? Probability and Why It Counts

Significantly Significant: What It Means for You and Me

Only the Lonely

t(ea) for Two (Again): Tests Between the Means of Related Groups

t(ea) for Two (Again): Tests Between the Means of Related Groups

Two Groups Too Many? Try Analysis of Variance

Two Too Many Factors: Factorial Analysis of Variance

Cousins or Just Good Friends? Testing Relationships Using the Correlation Coefficient

Predicting Who’ll Win the Super Bowl: Using Linear Regression

What to Do When You’re Not Normal: Chi-Square and Some Other Nonparametric Tests

Some Other (Important) Statistical Procedures You Should Know About

Filters

Exam 6: Just the Truth: An Introduction to Understanding Reliability and Validity

What are the traditional types of validity evidence?

What would the interrater reliability be for a 50-item measure in which the number of agreements between Rater 1 and Rater 2 was 45?

Name four types of reliability and what each type measures.

If you correlate scores from your test with some other valid measure that assesses the same set of abilities, what type of validity evidence are you collecting?

Which level of measurement is concerned only with the characteristics of an outcome that fits into a category?

If you were interested in describing the order of variables along a continuum, what level of measurement would you use?

When we calculate reliability, we know the observed score. What are the two unknown components of the reliability equation?

Which of the following is the Greek letter associated with Cronbach's alpha, sometimes known as coefficient alpha?

Test-retest reliability is an example of which of the following?

How does error affect reliability? Write the general equation for reliability that demonstrates this concept.

Statistics or Sadistics? It’s Up to You

Means to an End: Computing and Understanding Averages

Vive La Différence: Understanding Variability

A Picture Really Is Worth a Thousand Words

Ice Cream and Crime: Computing Correlation Coefficients

Hypotheticals and You: Testing Your Questions

Are Your Curves Normal? Probability and Why It Counts

Significantly Significant: What It Means for You and Me

Only the Lonely

t(ea) for Two (Again): Tests Between the Means of Related Groups

t(ea) for Two (Again): Tests Between the Means of Related Groups

Two Groups Too Many? Try Analysis of Variance

Two Too Many Factors: Factorial Analysis of Variance

Cousins or Just Good Friends? Testing Relationships Using the Correlation Coefficient

Predicting Who’ll Win the Super Bowl: Using Linear Regression

What to Do When You’re Not Normal: Chi-Square and Some Other Nonparametric Tests

Some Other (Important) Statistical Procedures You Should Know About

Filters