Understanding Regression and Bayes Theorem

What is the primary purpose of regression analysis?

• To calculate the mean of a dataset.

• To understand relationships and predict outcomes.

• To create visualizations of data distributions.

• To determine the mode of a variable.

Explain the difference between linear and logistic regression.

• Linear regression can only handle two classes; logistic regression can handle multiple classes.

• Linear regression predicts continuous values; logistic regression predicts binary outcomes.

• Linear regression uses a logistic function; logistic regression uses a linear function.

• Linear regression is used for classification tasks; logistic regression is for regression tasks.

What does the term 'dependent variable' refer to in regression?

• The dependent variable is the initial condition set before the experiment.

• The dependent variable is the outcome variable that is being predicted or explained in regression.

• The dependent variable is the variable that remains constant throughout the study.

• The dependent variable is the variable that is manipulated in the experiment.

How does Bayes' theorem relate to conditional probability?

• Bayes' theorem is a formula that relates conditional probabilities, allowing for the updating of beliefs based on new evidence.

• Bayes' theorem is a method for calculating averages.

• Bayes' theorem only applies to independent events.

• Bayes' theorem is unrelated to conditional probability.

Provide a real-world example where regression analysis can be applied.

• Calculating the average temperature in a city over a year.

• Analyzing the frequency of words in a book to find the most common themes.

• Predicting house prices in real estate based on features like size and location.

• Determining the number of students enrolled in a school based on the number of teachers.

What is the significance of the coefficient of determination (R²) in regression?

• R² is used to determine the sample size needed for a study.

• R² measures the accuracy of predictions made by the model.

• R² indicates the proportion of variance explained by the regression model.

• R² indicates the strength of the relationship between independent variables.

How can Bayes' theorem be used in decision-making processes?

• Bayes' theorem eliminates uncertainty in decision-making processes.

• Bayes' theorem is used to calculate fixed probabilities without new evidence.

• Bayes' theorem only applies to statistical analysis, not decision-making.

• Bayes' theorem can be used to update probabilities in decision-making processes based on new evidence.

What assumptions must be met for linear regression to be valid?

• Linearity, Independence, Homoscedasticity, Normality, No multicollinearity.

• Dependence of residuals

• High multicollinearity

• Non-linearity

Define prior probability in the context of Bayes' theorem.

• Prior probability is the probability of an event occurring after new evidence is considered.

• Prior probability is the probability of a hypothesis being true given new evidence.

• Prior probability is the likelihood of a hypothesis based on past outcomes.

• Prior probability is the initial probability of a hypothesis before new evidence is taken into account.

What role does the likelihood function play in Bayes' theorem?

• The likelihood function determines the prior probabilities of hypotheses.

• The likelihood function is used to calculate the posterior distribution directly.

• The likelihood function represents the overall uncertainty in the model.

• The likelihood function measures the probability of the observed data under different hypotheses.