Sample Bias and Methods

Identify the type of sampling used:

A teacher splits her classes up by period. She then uses a RNG to select 10 students from each period to participate in a survey.

• Stratified Random Sample

• Systematic Random Sample

• Cluster Random Sample

• Biased Sample

Why do we randomly select our samples?

• for control

• reduce bias

• so we don't get the same answers from everyone

• to eliminate confounding results

Which of the following is TRUE?

• In a multi-stage random sample, all individuals and all subsets of the sample size have an equal chance of being selected.

• In a stratified random sample, all individuals and all subsets of the sample size have an equal chance of being selected.

• In a cluster random sample, all individuals and all subsets of the sample size have an equal chance of being selected.

• In a simple random sample, all individuals and all subsets of the sample size have an equal chance of being selected.

An employer wants to know how their 500 employees like working for them. Which is the most representative sample?

• Ask the first 75 people to show up for work

• Randomly select the names of 10 employees

• Poll the Employees of the Month for the past year

• Randomly select the names of 75 employees

In a certain school, students can choose whether to eat in the school’s cafeteria. A reporter working for the school’s newspaper polled students on their reactions to changes in the menu at the cafeteria. For each student leaving the cafeteria in one 20-minute time period, the reporter used a die to determine whether to stop the student and ask how he or she felt about the new menu. In the reporter’s article it was stated that a random sample of the students showed that 23% of the school’s student population was happy with the new menu. Which of the following statements is true?

• Because each student leaving the cafeteria was randomly selected and could choose to answer or not, this is a random sample of the student population, and the 23% is an accurate measurement of the school population’s view of the new menu.

• Because students self-selected whether to eat in the cafeteria, the sampling method might be biased and the sample might not be representative of all students in the school.

• The survey would have been more effective if the reporter had collected the data in one 10-minute time period rather than in one 20-minute time period.

• The survey would have been more effective if students who cared about the food could have called the reporter to tell how they felt about the new menu, so that only students with opinions on the subject would have been surveyed.

• Because no treatment was imposed on the students eating in the cafeteria, one cannot make any conclusions about the new menu.

In order to estimate the proportion of students that text while driving, a school administrator selects a simple random sample of students from a list of all students at the school who have parking permits. The students are called to the office, one at a time. The administrator asks each student, “Do you text while driving, even though you are not supposed to?” Based on the survey, the administrator estimates that only 2% of students with parking passes text while driving. What potential bias is present in the design of this survey and what is the likely direction of the bias?

• The sample proportion is likely an underestimate of the population proportion due to response bias.

• The sample proportion is likely an underestimate of the population proportion due to undercoverage.

• The sample proportion is likely an underestimate of the population proportion due to nonresponse.

• The sample proportion is likely an overestimate of the population proportion due to response bias.

• The sample proportion is likely an overestimate of the population proportion due to undercoverage.

Tanya wants to know the percent of people likely to attend the upcoming musical at school. She asks each person in the musical how many people they know who are coming to make a prediction. Why is this sample biased?

• Drama students are more likely to lie.

• Musicals are better attended than plays.

• The drama teacher was not asked.

• The sample is not random and not representative of the entire school population.

Answer explanation

The sample is not random and not representative of the entire school population, as it only includes people involved in the musical, leading to bias.

The School Dance Committee conducts a survey to find what type of music students would like to hear at the next dance. Which sampling method is least likely to result in a biased sample?

• Call the top 20% of the senior class. 

• Interview every 10^th student as they enter the school.

• Ask every 5^th person leaving a school jazz band concert.

• Set up a hip-hop only website where students can list their 3 favorite songs if they open up the link.

A tax preparation company wants to see how satisfied its customers are with their services. Which of the following would give them the best unbiased sample?

• looking at customer reviews on their social media page

• questioning the first 25 people that call the company

• asking the last 25 people on an alphabetical list of all of their current customers

• surveying a random sample of customers from a list of all of their current and previous customers

A sample that is not representative of the population is considered __________________.

• Systematic

• Equally likely

• Stratified

• Biased