Sampling Methods and Types of Bias

Disneyland often surveys its guests as they exit a restaurant during their visit. The surveyor stands at the restaurant exit, counts the number of people leaving, and surveys every 25th guest.
This is a form of:

• Simple Random Sample

• Stratified Random Sample

• Voluntary Response

• Systematic Random Sampling

Identify the type of sampling used:

A teacher splits her classes up by period. She then uses a RNG to select 10 students from each period to participate in a survey.

• Stratified Random Sample

• Systematic Random Sample

• Cluster Random Sample

• Biased Sample

16 out of the 20 people who called into a radio station said that they enjoy the station's morning programming. What type of bias is demonstrated here?

• Voluntary Response Bias

• Nonresponse Bias

• Undercoverage Bias

Identify the type of sampling used:

Marianne wanted to know students' opinion on the new schedule at school. She survey's the first 30 students who come into her class.

• Convenience Sampling

• Systematic Random Sampling

• Simple Random Sampling

• Volunteer response

In a certain school, students can choose whether to eat in the school’s cafeteria. A reporter working for the school’s newspaper polled students on their reactions to changes in the menu at the cafeteria. For each student leaving the cafeteria in one 20-minute time period, the reporter used a die to determine whether to stop the student and ask how he or she felt about the new menu. In the reporter’s article it was stated that a random sample of the students showed that 23% of the school’s student population was happy with the new menu. Which of the following statements is true?

• Because each student leaving the cafeteria was randomly selected and could choose to answer or not, this is a random sample of the student population, and the 23% is an accurate measurement of the school population’s view of the new menu.

• Because students self-selected whether to eat in the cafeteria, the sampling method might be biased and the sample might not be representative of all students in the school.

• The survey would have been more effective if the reporter had collected the data in one 10-minute time period rather than in one 20-minute time period.

• The survey would have been more effective if students who cared about the food could have called the reporter to tell how they felt about the new menu, so that only students with opinions on the subject would have been surveyed.

• Because no treatment was imposed on the students eating in the cafeteria, one cannot make any conclusions about the new menu.

A radio station is discussing a controversial policy enacted by the local police department. They poll listeners by having them call in to the radio station. Which of the following is the most significant source of bias?

• Leading questions on the survey

• Voluntary Response Bias

• Survivorship Bias

• Undercoverage

Tanya wants to know the percent of people likely to attend the upcoming musical at school. She asks each person in the musical how many people they know who are coming to make a prediction. Why is this sample biased?

• Drama students are more likely to lie.

• Musicals are better attended than plays.

• The drama teacher was not asked.

• The sample is not random and not representative of the entire school population.

Answer explanation

The sample is not random and not representative of the entire school population, as it only includes people involved in the musical, leading to bias.

A student wants to know which type of pizza the students at his high school prefer. Which option would give an unbiased sample?

• Asking all the students in the hot lunch line.

• Asking 10 students from each homeroom

• Asking 100 random students, chosen by drawing names from a hat

• Asking all the 10th graders

A tax preparation company wants to see how satisfied its customers are with their services. Which of the following would give them the best unbiased sample?

• looking at customer reviews on their social media page

• questioning the first 25 people that call the company

• asking the last 25 people on an alphabetical list of all of their current customers

• surveying a random sample of customers from a list of all of their current and previous customers

In order to estimate the proportion of students that text while driving, a school administrator selects a simple random sample of students from a list of all students at the school who have parking permits. The students are called to the office, one at a time. The administrator asks each student, “Do you text while driving, even though you are not supposed to?” Based on the survey, the administrator estimates that only 2% of students with parking passes text while driving. What potential bias is present in the design of this survey and what is the likely direction of the bias?

• The sample proportion is likely an underestimate of the population proportion due to response bias.

• The sample proportion is likely an underestimate of the population proportion due to undercoverage.

• The sample proportion is likely an underestimate of the population proportion due to nonresponse.

• The sample proportion is likely an overestimate of the population proportion due to response bias.

• The sample proportion is likely an overestimate of the population proportion due to undercoverage.