{"id":1918,"date":"2019-05-17T12:00:00","date_gmt":"2019-05-17T10:00:00","guid":{"rendered":"https:\/\/kindsonthegenius.com\/blog\/statistics-questions-and-answers\/"},"modified":"2026-07-05T03:23:20","modified_gmt":"2026-07-05T01:23:20","slug":"statistics-questions-and-answers","status":"publish","type":"post","link":"https:\/\/kindsonthegenius.com\/blog\/statistics-questions-and-answers\/","title":{"rendered":"Statistics Questions and Answers"},"content":{"rendered":"<p>This is a list of some statistics questions and answers. The answers and brief and clear.<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>What is Biased and Unbiased Statistic?<\/strong><\/h4>\n<p>We actually talk about unbiased estimate. A sample statistic is considered and unbiased estimate of\u00a0 the population parameter if the mean of the sampling distribution of that statistic equals the parameter being estimated.<\/p>\n<p>For instance, if we draw a sample from population, then the mean of this sample (sample mean) would be an unbiased estimate if it is equal to the mean of the population from which the sample was taken.<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>What is Consistent Estimate<\/strong><\/h4>\n<p>A statistic on a sample size of n is said to be consistent if the if as the n increases,the estimated converges to the actual value of the parameter.<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>What is Efficiency in Statistics?<\/strong><\/h4>\n<p>Efficiency is a measure of the quality of an estimate. Generally, a more efficient efficient estimate would require fewer sample size(observations) than a less efficient estimate for a particular performance.<\/p>\n<p>For example, let&#8217;s take two unbiased estimators T<sub>1<\/sub> and T<sub>2<\/sub>.<\/p>\n<p>T<sub>1<\/sub> is considered more efficient than T<sub>2<\/sub>, if for n number of observations<\/p>\n<p>\u03c3<sup>2<\/sup>T<sub>1<\/sub> &lt;\u00a0\u03c3<sup>2<\/sup>T<sub>2<\/sub><\/p>\n<p>for any parameter\u00a0\u03b8<\/p>\n<p>&nbsp;<\/p>\n<h4>What is Sufficient Statistic?<\/h4>\n<p>Sufficient statistics is a statistic that contains the summary of all the information about the parameter being estimated.<\/p>\n<p>For example, we want to estimate the population parameter\u00a0\u00b5, take a sample of size n = 4. The realization of this sample is (2, 3,4,7). This means that we would have a sample mean of (2+3+4+7)\/4 = 4. So four is our estimate. Also, if the sample was (1, 4, 5,6), it would also give us a sample mean of 4.<\/p>\n<p>Therefore the sample mean could cover a combination of observations that is well covered by the parameter being estimated. In this case, we say that the estimate is sufficient.<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>Cramer-Rao Inequality<\/strong><\/h4>\n<p>The Cramer-Rao inequality gives a measure of the lower bound for the variance of an unbiased estimator of a given parameter. We can used it to determine that an estimator is a minimum variance unbiased estimator(MVUE).<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>Differentiate Between Point Estimate and Interval Estimate<\/strong><\/h4>\n<p>A point estimate provide an estimated value of a single number while an interval estimate provides a range of values within which the estimated parameter is likely to lie.<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>What is Confidence Interval?<\/strong><\/h4>\n<p>This is an interval or range of values provided by the estimation process. It provides us with the possibility or confidence that the value of the unknown parameter lies within this range.<\/p>\n<p>The figure below shows the difference between point estimate, interval estimate and confidence interval<\/p>\n<figure id=\"attachment_857\" aria-describedby=\"caption-attachment-857\" style=\"width: 691px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-857 \" src=\"https:\/\/www.kindsonthegenius.com\/wp-content\/uploads\/2020\/09\/Point-estimate-interval-estimate-and-confidence-interval.jpg\" alt=\"Point estimate, interval estimate and confidence interval\" width=\"691\" height=\"224\" \/><figcaption id=\"caption-attachment-857\" class=\"wp-caption-text\">Explaining Point estimate, interval estimate and confidence interval<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<h4><strong>What is difference between Parametric and Non-parametric Test?<\/strong><\/h4>\n<p><a href=\"https:\/\/kindsonthegenius.com\/blog\/parametric-tests-in-statistics-when-to-use-which\">Parametric tests<\/a> are statistical tests that makes assumption about the distribution of the data. It assumes that the data follows a normal distribution. Examples of parametric tests includes:<\/p>\n<ul>\n<li>One-sample z-test<\/li>\n<li>Two Independent-Samples z-test<\/li>\n<li>One-sample t-test<\/li>\n<li>Independent-samples t-test<\/li>\n<li>Paired-samples t-test<\/li>\n<li>F-Test<\/li>\n<li>Welch Test<\/li>\n<li>One-way ANOVA<\/li>\n<li>Bartlett test<\/li>\n<\/ul>\n<p><a href=\"https:\/\/kindsonthegenius.com\/blog\/parametric-tests-in-statistics-when-to-use-which\">Read more about Parametric Tests<\/a><\/p>\n<p><a href=\"https:\/\/kindsonthegenius.com\/blog\/what-are-non-parametric-tests\">Non-parametric tests<\/a> on the other hand makes no assumption about the distribution of the data. Therefore, they are sometimes called distribution free test. Read more about <a href=\"https:\/\/kindsonthegenius.com\/blog\/what-are-non-parametric-tests\">Non-Parametric Test<\/a>. Some of the non-parametric tests include:<\/p>\n<ul>\n<li>Kolmogorov-Smirnov Test (KS test)<\/li>\n<li>Mann-Withney U test<\/li>\n<li>Wilcoxon Signed Rank<\/li>\n<li>Sign Test<\/li>\n<li>Kruskal-Wallis<\/li>\n<li>Chi-Square Test<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h4><strong>What is z-Test? When is it Used?<\/strong><\/h4>\n<p>z-Test is a parametric test used to test the mean of a sample against an existing value. It is used when the sample size is large (\u00a0\u2265 30 ) and the variance of the population is known.<\/p>\n<p>&nbsp;<\/p>\n<h4>What t-Test? When is it Used?<\/h4>\n<p>t-Test is similar to the t-test, but in the case of t-test, the sample size may be fairly small and the variable of the population is not known.<\/p>\n<p>Formula for calculating the t-test statistic is given below:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-850 aligncenter\" src=\"https:\/\/www.kindsonthegenius.com\/wp-content\/uploads\/2020\/09\/Formular-for-t-test-Statistic-300x113.jpg\" alt=\"Formula for t-test Statistic\" width=\"239\" height=\"90\" \/><\/p>\n<p>Watch the video to know what the variables are. Also see a solved example.<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>What is F-Test? When is it Used?<\/strong><\/h4>\n<p>F-Test is used to compare the variances to two samples.\u00a0 It is a 2-sample test<\/p>\n<p>You use it to test if the samples are drawn from the same population.<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>What is Welch&#8217;s Test? When is it Used?<\/strong><\/h4>\n<p>This is also called Wech&#8217;s t-test or unequal variance t-test.<\/p>\n<p>You use this test to test if\u00a0 two populations have the same mean. It is a two-sample test. The formula for calculating the t-Statistic for the Welch&#8217;s test is given below:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-852 aligncenter\" src=\"https:\/\/www.kindsonthegenius.com\/wp-content\/uploads\/2020\/09\/Welchs-Test-Formular-300x136.jpg\" alt=\"Welch's Test Formula\" width=\"300\" height=\"136\" \/><\/p>\n<p>&nbsp;<\/p>\n<h4><strong>Explain ANOVA test<\/strong><\/h4>\n<p>ANOVA stands for Analysis of Variance.\u00a0 It is used for comparing means. One-way ANOVA is applied is used to determine if there is any significant difference between the means of two or more independent or unrelated samples.<\/p>\n<p>To perform 1-way ANOVA, you need to calculate the following:<\/p>\n<ul>\n<li>Total sum-of-squares, SST<\/li>\n<li>Sum-of-squares between, SSB<\/li>\n<li>Sum-of-squares within, SSW (or SSE) where<\/li>\n<li>SST = SSB + SSE<\/li>\n<\/ul>\n<p>An example is given in the video lesson. <a href=\"https:\/\/www.youtube.com\/watch?v=7CVOXGFJkf4&amp;list=PLMz1vLpcJgGCOzs-vWZHTeCOlzyBhq1DN&amp;index=4&amp;t=0s\" target=\"_blank\" rel=\"noopener\">View step by step solved problem on One-Way-ANOVA<\/a><\/p>\n<p>&nbsp;<\/p>\n<h4><strong>Explain Bartlett Test<\/strong><\/h4>\n<p>The Bartlett test is used to test for homogeneity of variance among m samples. Homogeneity of variance means equal variance. In this case, he null hypothesis H<sub>0<\/sub> would be that the variances are equal. The alternative hypothesis would be that there is at least two groups that has unequal variances.<\/p>\n<p>The test is setup as follows:<\/p>\n<p>H<sub>0<\/sub>:\u00a0\u03c3<sub>1<\/sub> =\u00a0\u03c3<sub>2<\/sub>\u00a0= \u03c3<sub>3<\/sub>\u00a0= &#8230; \u00a0= \u03c3<sub>n<\/sub><\/p>\n<p>H<sub>1<\/sub>:\u00a0\u2203i \u2260 j:\u00a0\u00a0\u03c3<sub>i<\/sub>\u00a0\u2260\u00a0\u03c3<sub>j<\/sub><\/p>\n<p>&nbsp;<\/p>\n<h4><strong>Explain the Chi-Square Test<\/strong><\/h4>\n<p>Chi-square test is a non-parametric hypothesis test for testing the frequencies of data.\u00a0 It is used to determine if there is any significant difference between the expected frequencies\u00a0 and the observed frequencies in the data for one or more categories.<\/p>\n<p><a href=\"https:\/\/www.youtube.com\/watch?v=pXny5vZwoaI\" target=\"_blank\" rel=\"noopener\">Step-by-step Chi Square Video tutorial<\/a><\/p>\n<p>&nbsp;<\/p>\n<h4><strong>Explain the Kolmogorov-Smirnov Test<\/strong><\/h4>\n<p>This\u00a0 test is used for comparing two samples in terms of probability distribution.<\/p>\n<p>It proceeds by comparing the cumulative probabilities\u00a0 of the values in the data with cumulative probabilities in a normal distribution. When two samples are involved, it test whether both samples are drawn from the same distribution<\/p>\n<p>So the null hypothesis is: &#8216;the sample is taken from a normal distribution&#8217;<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>Explain the Mann-Withney u test<\/strong><\/h4>\n<p>An alternative to the Kolmogorov-Smirnov test.\u00a0 It is the same as Wilcoxon rank sum test. It is used to compare two independent samples to test whether they are both drawn from a population with the same distribution.<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>Explain the Wilcoxon test<\/strong><\/h4>\n<p>Remember that there are two &#8216;Wilcoxon&#8217; test.<\/p>\n<ul>\n<li>One is Wilcoxon rank-sum test which is same as Mann-Withney u test<\/li>\n<li>And Wilcoxon signed-rank test<\/li>\n<\/ul>\n<p>Here we are talking about the Wilcoxon signed rank test. This is a non-parametric test also used to compare two matched(or related) samples. It also test whether both samples came from the same distribution<\/p>\n<p>&nbsp;<\/p>\n<h4><strong>Kruskal-Wallis Test<\/strong><\/h4>\n<p>This is also called One-Way ANOVA on ranks.<\/p>\n<p>This is a non-parametric test used to test whether two samples are drawn from a population with the common distribution<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This is a list of some statistics questions and answers. The answers and brief and clear. &nbsp; What is Biased and Unbiased Statistic? We actually &hellip; <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"pagelayer_contact_templates":[],"_pagelayer_content":"","footnotes":""},"categories":[552],"tags":[],"class_list":["post-1918","post","type-post","status-publish","format-standard","hentry","category-statistics-tutorial"],"_links":{"self":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/1918","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/comments?post=1918"}],"version-history":[{"count":1,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/1918\/revisions"}],"predecessor-version":[{"id":2086,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/1918\/revisions\/2086"}],"wp:attachment":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/media?parent=1918"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/categories?post=1918"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/tags?post=1918"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}