Exam 5: Identifying Good Measurement

Asking many similar questions when trying to measure a concept is done to:

Establishing construct validity would probably be most important for which of the following?

If a measurement looks like it is a plausible operationalization of a conceptual variable, then it has:

A correlation-based statistic called is commonly used to determine internal reliability.

Which of the following is NOT possible?

Dr. Li is interested in creating a measurement of religiosity. According to the dictionary, religiosity is "the quality of being religious; piety; devoutness." He creates a measure comprising 10 statements. People respond to each statement using the following scale (1 = strongly disagree, 3 = neither agree nor disagree, 5 = strongly agree). Some of the statements are below. Statement 1: "I believe in a religion." Statement 2: "Part of who I am stems from my religious beliefs." Statement 3: "I believe that religion is unnecessary." Name two types of reliability that apply to Dr. Li's measure and how each one could be established, given the above scenario.

Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete. Dr) Sheffield has decided to test the discriminant validity of his new measure. He has a group of first-time Gamblers Anonymous (GA) attendants complete his measure and finds that they score higher than a group of people who do not attend the group. Which of the following results would provide evidence for discriminant validity?

Explain why many people feel that physiological measurements are the best way to operationalize a variable but why they may not, in fact, be the best.

Dr. Li is interested in creating a measurement of religiosity. According to the dictionary, religiosity is "the quality of being religious; piety; devoutness." He creates a measure comprising 10 statements. People respond to each statement using the following scale (1 = strongly disagree, 3 = neither agree nor disagree, 5 = strongly agree). Some of the statements are below. Statement 1: "I believe in a religion." Statement 2: "Part of who I am stems from my religious beliefs." Statement 3: "I believe that religion is unnecessary." Provide a suggestion for how Dr. Li could establish the face validity of his measure and a suggestion for how he could establish the content validity of his measure.

What is the difference between a ratio scale of measurement and an interval scale of measurement?

Asking an expert or experts to evaluate a measure is used to establish validity.

Name the three types of internal reliability and the four types of validity.

Lauren, Sarah, and Jennifer are students in Dr. Shaffer's Research Methods class. For a class assignment, they are asked to devise an operational definition for romantic attachment, or love. Lauren decides to ask a group of married couples to report if they are in love with their spouse (1 indicates "Yes, I am in love" and 2 indicates "No, I am not in love"). Sarah decides to watch couples sitting on campus and measure how close they sit together, assuming that people who sit closer together are more in love. Jennifer decides to recruit a group of newlyweds and measure the change in heart rate that occurs between the start of the study (when the person is alone) and the moment they see their spouse walk into the room. For each student described above, indicate whether the operational definition of her variable is categorical or quantitative. If a student's operational variable is categorical, explain whether it could or could not be made quantitative and how you would do that.

Dr. Rodriquez is considering conducting a study examining whether narcissistic people have poorer romantic relationships than those who are not narcissistic. One of her first tasks is to determine which of her participants are narcissistic and which are not. She decides to use the scale created by a colleague, the Donal scale. Question 1 reads, "I tend not to think about other people as much as I think about myself." Question 2 reads, "I do not have a high opinion of myself." Question 3 reads, "I think other people think I am really special." Before using the measure in her study, Dr. Rodriquez gives the measure to a group of participants on the first day of the semester and again on the last day of the semester. Dr. Rodriquez is examining the scatterplot of the data she collected on the first day of the semester and the last day of the semester. On the scatterplot, she sees that the dots are very close to forming a diagonal line. This indicates which of the following?

For his research methods class, Felipe plans to watch how students treat other children in their classrooms who have attention-deficit/hyperactivity disorder (ADHD). He will evaluate how positively or negatively the children are treated by their classmates. This is an example of what type of measurement?

When using correlation coefficients to evaluate reliability, which of the following is undesirable?

In looking at a scatterplot of interrater reliability, why would a researcher want to see all the dots close to the line of agreement?

Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete. If Dr. Sheffield's measure does not actually measure pathological gambling, his measure is said to lack which of the following?

What is the term for a researcher's definition of the variable in question at a theoretical level?

Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete. Dr) Sheffield decides to test the criterion validity of his measure. Dr. Sheffield gives his measure to a group of people that includes suspected problem gamblers and non-gamblers. Which of the following options below could he also do to get evidence for criterion validity?