Free Master of Data Science: Statistical Inference & Regression Models Questions and Answers — Questions and Answers

Question 1: Given that beliefs adhere to specific laws, which of the following best describes the probability calculus of beliefs?

Bayesian inference
Frequency inference
Frequency probability
Bayesian probability (Correct answer)

Correct answer: Bayesian probability

Bayesian probability is a framework where probability is interpreted as a degree of belief or subjective confidence in an event. It provides a mathematical system for representing and updating these beliefs based on new evidence, adhering to specific laws of probability calculus. This approach contrasts with frequentist probability, which defines probability based on the long-run frequency of events.

Question 2: Identify the accurate statement.

Frequency inference is the use of Bayesian probability representation of beliefs to perform inference
NULL is the standard missing data marker used in S
Bayesian inference is the use of Bayesian probability representation of beliefs to perform inference (Correct answer)
None of the above

Correct answer: Bayesian inference is the use of Bayesian probability representation of beliefs to perform inference

Bayesian inference is a statistical method that uses Bayes' theorem to update the probability for a hypothesis as more evidence or information becomes available. It fundamentally relies on the Bayesian interpretation of probability, where probabilities represent degrees of belief. This allows for a coherent framework to reason about uncertainty and make decisions based on updated beliefs.

Question 3: Which of the aforementioned is a random variable?

The outcome of exam
The outcome of flip of a coin
The outcome from the roll of a die
All of the above (Correct answer)

Correct answer: All of the above

A random variable is a variable whose value is a numerical outcome of a random phenomenon. The outcome of an exam (e.g., a score), the outcome of a coin flip (e.g., heads/tails mapped to 0/1), and the outcome of a die roll (e.g., numbers 1-6) are all examples where the result is uncertain and determined by chance. Therefore, all listed options qualify as random variables.

Question 4: Which one of the following random variables has a finite number of possible outcomes?

Continuous
Non Discrete
Discrete (Correct answer)
All of the above

Correct answer: Discrete

A discrete random variable is one that can take on a finite or countably infinite number of distinct values. For instance, the number of heads in a series of coin flips or the outcome of a die roll are discrete. In contrast, a continuous random variable can take any value within a given range, having an uncountably infinite number of possible outcomes.

Question 5: The center of the distribution of a random variable is its anticipated value, or .

median
mode
bayesian inference
mean (Correct answer)

Correct answer: mean

The anticipated value, or expected value, of a random variable is its mean. It represents the long-run average value of the variable if the experiment were repeated many times. The mean serves as a central measure of the distribution, indicating where the values tend to cluster.

Question 6: Identify the accurate statement.

Every cumulative distribution function F is increasing and left-continuous
Every cumulative distribution function F is decreasing and right-continuous
Some cumulative distribution function F is non-decreasing and right-continuous
None of the above (Correct answer)

Correct answer: None of the above

A cumulative distribution function (CDF), F(x), for a random variable X, must satisfy specific properties. It must be non-decreasing, meaning F(x1) <= F(x2) for x1 < x2, and it must be right-continuous. It is not necessarily left-continuous and cannot be decreasing. Therefore, none of the provided statements accurately describe all the necessary properties of a CDF.

Question 7: Which of the following describes a random variable's spread?

empirical mean
standard deviation
variance (Correct answer)
All of the above

Correct answer: variance

Variance is a key measure of the spread or dispersion of a random variable's distribution. It quantifies how far, on average, the values of a random variable are from its expected value (mean). A higher variance indicates that data points are generally spread out further from the mean, while a lower variance indicates they are clustered closer to the mean.

Question 8: The term "_______ deviation" refers to the square root of variance.

standard (Correct answer)
continuous
mean
empirical

Correct answer: standard

The standard deviation is defined as the square root of the variance. It is a widely used measure of the spread of data around the mean. Unlike variance, standard deviation is expressed in the same units as the data itself, making it more interpretable and easier to understand in practical contexts.

Question 9: The degrees of freedom in the Chi-squared distribution are twice as many.

mode
variance (Correct answer)
standard deviation
None of the above

Correct answer: variance

For a Chi-squared distribution, the degrees of freedom (often denoted as 'k') define its shape and properties. The mean of a Chi-squared distribution is equal to its degrees of freedom (k), and its variance is equal to twice its degrees of freedom (2k). Therefore, the degrees of freedom are directly related to, and half of, the variance.

Question 10: Identify the accurate statement.

An estimator is consistent if it converges to what you want to estimate
Asymptotics often lead to nice understanding of procedures
Asymptotics are incredibly useful for simple statistical inference and approximations
All of the above (Correct answer)

Correct answer: All of the above

An estimator is considered consistent if, as the sample size increases, it converges in probability to the true parameter value it is estimating. Asymptotics, which study the behavior of statistical procedures as sample size approaches infinity, are incredibly useful for understanding estimator properties, simplifying statistical inference, and providing robust approximations. All the statements accurately describe important aspects of statistical theory and practice.

Question 11: Who among the following scientists created the Gosset's distribution?

William Gosling
Gosling Gosset
William Gosset (Correct answer)
All of the above

Correct answer: William Gosset

The Gosset's distribution, more commonly known as the Student's t-distribution, was developed by William Sealy Gosset. He published his work under the pseudonym 'Student' while working at Guinness brewery, as the company had a policy against employees publishing research under their own names.

Question 12: Identify the accurate statement.

The empirical standard deviation is a measure of spread
The mean is a measure of central tendency of the data
Empirical mean is related to “centering” the random variables
All of the above (Correct answer)

Correct answer: All of the above

The empirical standard deviation measures the spread of observed data points around their mean, quantifying variability. The mean itself is a fundamental measure of central tendency, indicating the average value of a dataset. The empirical mean (sample mean) is directly used to 'center' random variables by subtracting it, resulting in data centered at zero. All these statements are accurate descriptions of basic statistical concepts.

Question 13: Which of the following suggests there is no association between any of the relationships?

Cor(X, Y) = 0 (Correct answer)
Cor(X, Y) = 2
Cor(X, Y) = 1
Cor(X, Y) = 3

Correct answer: Cor(X, Y) = 0

The correlation coefficient, Cor(X, Y), measures the strength and direction of the linear relationship between two random variables X and Y. A value of 0 indicates that there is no linear association between the variables. It's important to note that a correlation of 0 does not necessarily imply independence, as non-linear relationships might still exist.

Question 14: Centered at ___, normalized data have units equal to the standard deviations of the original data.

10
1
5
0 (Correct answer)

Correct answer: 0

Normalized data, typically achieved through standardization (e.g., z-score transformation), involves subtracting the mean and dividing by the standard deviation. This process results in data with a mean of 0 and a standard deviation of 1. Therefore, normalized data are always centered at 0.

Question 15: Identify the error in the statement.

Adding squared terms makes it continuously differentiable at the knot points
Adding squared terms makes it twice continuously differentiable at the knot points (Correct answer)
Asymptotics are used for inference usually
None of the above

Correct answer: Adding squared terms makes it twice continuously differentiable at the knot points

In the context of splines, adding squared terms (as in a quadratic spline) makes the function continuously differentiable (C1) at the knot points. To achieve twice continuous differentiability (C2) at the knot points, which ensures even smoother transitions, cubic splines (involving cubed terms) are typically required. Therefore, stating that adding *only* squared terms makes it twice continuously differentiable is an error, as it generally only guarantees C1.

Question 16: Which of the following is an illustration of Poisson distribution use?

Incidence rates
Modeling web traffic hits
Analyzing contingency table data
All of the above (Correct answer)

Correct answer: All of the above

The Poisson distribution is a discrete probability distribution that models the number of events occurring in a fixed interval of time or space, given a constant average rate. It is widely applicable for various scenarios involving count data, such as modeling disease incidence rates, the number of web traffic hits on a server, or analyzing counts in contingency tables. All the listed options are valid applications.

Free Master of Data Science: Statistical Inference & Regression Models Questions and Answers

Given that beliefs adhere to specific laws, which of the following best describes the probability calculus of beliefs?