{"id":67,"date":"2018-06-18T10:48:00","date_gmt":"2018-06-18T08:48:00","guid":{"rendered":"https:\/\/kindsonthegenius.com\/blog\/2018\/06\/18\/what-is-coefficient-of-determination-in-linear-regression\/"},"modified":"2020-08-22T10:14:31","modified_gmt":"2020-08-22T08:14:31","slug":"what-is-coefficient-of-determination-in-linear-regression","status":"publish","type":"post","link":"https:\/\/kindsonthegenius.com\/blog\/what-is-coefficient-of-determination-in-linear-regression\/","title":{"rendered":"What is Coefficient of Determination in Linear Regression"},"content":{"rendered":"

If you are learning linear regression, then you need to clearly understand the concept of Coefficient of Determination R2<\/sup> and the Adjusted Coefficient of Determination R2<\/sup>adj<\/sub>.<\/p>\n

I am going to explain these concepts in a very easy way.<\/p>\n

We are going to cover the following:<\/p>\n

 <\/p>\n

    \n
  1. What is Coefficient of Determination<\/a><\/li>\n
  2. Properties of Coefficient of Determination<\/a><\/li>\n
  3. Adjusted Coefficient of Determination<\/a><\/li>\n
  4. Final Notes<\/a><\/li>\n<\/ol>\n

     <\/p>\n

    1. What is Coefficient<\/span>\u00a0of Determination?<\/h3>\n

    The coefficient of determination, is used to determine the proportion of the variation of one of the variables\u00a0 that is predictable from the other variable.<\/p>\n

    Look at the table below. What do you think is the relationship between X and Y?
    \nIt seems that Y equal X\/2. But carefully looking at the table we see that this is not exactly true for two of the data points.<\/p>\n

    But we can say that 80% of the time, Y is X\/2. This means that the coefficient of determination is 0.8 (or 80%)<\/p>\n

     <\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n\n
    Y<\/b><\/td>\nX<\/b><\/td>\n<\/tr>\n
    1.0<\/td>\n2.0<\/td>\n<\/tr>\n
    2.0<\/td>\n4.0<\/td>\n<\/tr>\n
    3.0<\/td>\n7.0<\/td>\n<\/tr>\n
    4.0<\/td>\n8.0<\/td>\n<\/tr>\n
    5.0<\/td>\n10.0<\/td>\n<\/tr>\n
    6.0<\/td>\n12.3<\/td>\n<\/tr>\n
    7.0<\/td>\n14.0<\/td>\n<\/tr>\n
    8.0<\/td>\n16.0<\/td>\n<\/tr>\n
    9.0<\/td>\n18.0<\/td>\n<\/tr>\n
    10.0<\/td>\n20.0<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

    Table 1:<\/b> For 8 out of the 10 points, y=x\/2<\/p>\n

     <\/p>\n

    The coefficient of determination is a measure of how certain we are in making predictions from a certain model.<\/p>\n

    It determines the ratio of the explained variation to the total variation.<\/p>\n

    The value of R2<\/sup>\u00a0ranges from 0 to 1, that it:
    \n0 < R2<\/sup>\u00a0< 1<\/p>\n

    It denotes the strength of the linear association between x and y. When we are using a line of best fit, then the coefficient of determination represents the percent of the data that is closest to the line of best fit.<\/p>\n

    For example, if R = 0.89 then R2<\/sup>\u00a0= 0.792 which means that 79.2% of the total variation in y can be explained bz the linear relationship between y and x (as described by the regression equation, in our case it is y = x\/2.<\/p>\n

    The other 20.8% of the variation remains unexplained.<\/p>\n

    So we can say that the coefficient of determination is a measure of how well the regression line represents the data.<\/p>\n

     <\/p>\n

    Formula for R2<\/sup>\u00a0is given by:<\/b><\/p>\n

    <\/a><\/div>\n

     <\/p>\n

     <\/p>\n

    2. Properties of Coefficient of Determination<\/b><\/h3>\n

    Let’s now outline some of the properties of R2<\/sup>\u00a0\u00a0that you need to know. To get used to these properties, take some time to write then out in your note.<\/p>\n

    0 \u2264 R2<\/sup>\u00a0 \u2264\u00a0 1\u00a0 if\u00a0 f(X) = r(X) = E(Y | X)
    \nif X and Y are independent, then R2<\/sup>\u00a0= 0
    \nif Y = f(X) then R2<\/sup>\u00a0= 1
    \nif f(X) = a*X + b* then the theoretical linear regression is given by R2<\/sup>\u00a0= (R(X,Y))2<\/sup>
    \nif the joint distribution of X and Z is normal, then R2<\/sup>\u00a0= (R(X,Y))2<\/sup><\/p>\n

     <\/p>\n

    3. Adjusted Coefficient of Determination\u00a0R2<\/sup>adj<\/sub><\/b><\/h3>\n

    Just like the Coefficient of determination, the adjusted Coefficient of Determination R2<\/sup>adj<\/sub>\u00a0is used to determine how well a multiple regression equation fits the sample data.<\/p>\n

    The difference between R2<\/sup> and R2<\/sup>adj<\/sub>\u00a0is that R2<\/sup> increases automatically as new independent variables are added to the regression equation even if they don’t contribute to any new explanatory power to the equation.
    \nHowever the R2<\/sup>adj<\/sub>\u00a0increases ONLY IF the new independent variables added, increases the explanatory power of the regression equation. This makes the R2<\/sup>adj\u00a0<\/sub>more reliable in measuring how well a multiple regression equation fits the sample data.<\/p>\n

     <\/p>\n

    4. Final Notes<\/b><\/h3>\n

    I hope this brief discussion have helped you understand the concept of Coefficient of Determination and Adjusted Coefficient of Determination as it applies to Regression Analysis. Especially take not of the difference between the two as this always appears in statistics quiz and exams.<\/p>\n

    Thank you for reading and remember to leave a comment below if you have any challenges following the explanation.<\/p>\n","protected":false},"excerpt":{"rendered":"

    If you are learning linear regression, then you need to clearly understand the concept of Coefficient of Determination R2 and the Adjusted Coefficient of Determination … <\/p>\n","protected":false},"author":2,"featured_media":581,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"categories":[15,552],"tags":[],"_links":{"self":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/67"}],"collection":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/comments?post=67"}],"version-history":[{"count":8,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/67\/revisions"}],"predecessor-version":[{"id":1182,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/67\/revisions\/1182"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/media\/581"}],"wp:attachment":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/media?parent=67"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/categories?post=67"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/tags?post=67"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}