{"id":1912,"date":"2019-04-25T12:00:00","date_gmt":"2019-04-25T10:00:00","guid":{"rendered":"https:\/\/kindsonthegenius.com\/blog\/lecture-17-multiple-linear-regression\/"},"modified":"2026-07-05T03:23:07","modified_gmt":"2026-07-05T01:23:07","slug":"lecture-17-multiple-linear-regression","status":"publish","type":"post","link":"https:\/\/kindsonthegenius.com\/blog\/lecture-17-multiple-linear-regression\/","title":{"rendered":"Machine Learning 101 \u2013 Multiple Linear Regression"},"content":{"rendered":"

You already know of Simple Linear Regression<\/a>. You also know of Logistic Regression<\/a>. Now we would discuss Multiple Linear Regression.<\/p>\n

This is a case where we have more than one predictor(independent) variables.<\/p>\n

Let’s illustrate using the advertising dataset. You can get this dataset from this link.<\/a>\u00a0I’ts a csv file.\u00a0 Just download it, so you can use it for this lesson.<\/p>\n

A cross-section of the dataset is shown below<\/p>\n

\"Advertising<\/p>\n

Meanwhile to view the dataset: first download the advertising dataset to your computer(I saved mine in D:\/data\/Advertising.csv).<\/p>\n

Then use the code below to load it into Jupyter Notebook.<\/p>\n

\"\"<\/p>\n

 <\/p>\n

In this dataset, we can see that there are three predictor variables: TV, radio and newspaper. Then we have one response variable: sales. We are interested in knowing how\u00a0 the three predictor variables affect the response variable.<\/p>\n

One way to do this is by running three separate linear regression lines, one for each of the 3 predictor variables.<\/p>\n

So we can find how TV affects sales. In the case of TV we have<\/p>\n

sales = 703.3 + 4.7TV<\/strong><\/p>\n

From the equation, we see that $1,000 increase in spending on TV ads would result in $4.57 units increase in sales.<\/p>\n

Similarly, for radio and newspaper, we have:<\/p>\n

sales = 931.2 + 202.5radio\u00a0<\/strong><\/p>\n

sales = 1235.1 + 5.47newspaper<\/strong><\/p>\n

You can watch the video lesson to see how these is obtained.<\/p>\n

 <\/p>\n

The problem with Linear Regression<\/strong><\/p>\n

The challenge with this approach is that each of these equations ignores the effect of the other variables. Also, we don’t know how each of the variables affect the other. So in real scenario, we want to see how the three variables together affect sales. We can achieve this using multiple linear regression.<\/p>\n

 <\/p>\n

How Multiple Linear Regression Works<\/strong><\/p>\n

Multiple linear regression is an extension of linear regression. It simply has to now be adjusted to include multiple\u00a0 predictor variables. Hence, in multiple linear regression, each predictor variable has its own coefficient all in a single model.<\/p>\n

Assuming we have p predictor variables, then the multiple regression model will take the form:<\/p>\n

Y =\u00a0\u03b20<\/sub> +\u00a0\u03b21<\/sub>X1<\/sub> +\u00a0\u00a0\u03b22<\/sub>X2<\/sub> + . . . +\u00a0\u03b2p<\/sub>Xp<\/sub>\u00a0 +\u00a0\ud835\udf16<\/strong><\/p>\n

Here,\u00a0 Xj<\/sub> represents the jth predictor variable and\u00a0\u03b2j<\/sub> indicates the relationship between that variable and the response.<\/p>\n

Also, \u03b2j<\/sub> is interpreted as the average effect a unit increase in Xj<\/sub> will have on Y, while holding all other predictor variables fixed.<\/p>\n

Now we can rewrite this model using TV, radio and newspaper as the predictor variables. So we have:<\/p>\n

sales = \u03b20<\/sub> + \u03b21<\/sub> \u00d7 TV + \u03b22<\/sub> \u00d7 radio + \u03b23<\/sub> \u00d7 newspaper +\u00a0\ud835\udf16<\/strong><\/p>\n

Now the question is:<\/p>\n

How do we determine the regression coefficients for multiple regression? We would examine this in the next Lecture.<\/p>\n

 <\/p>\n

Python Practicals<\/strong><\/h4>\n

In this practical, we would import the advertising data to Jupyter notebook.<\/p>\n

Next, we would do a subplot of:<\/p>\n

    \n
  • TV vs sales<\/li>\n
  • radio vs sales<\/li>\n
  • newspaper vs sales<\/li>\n<\/ul>\n

    Then we would perform separate linear regression for each of them.<\/p>\n

    Finally we fit a regression line through each of the plots and determine the effect each of the predictor variables have on the value of sales.<\/p>\n

    You can find the screenshot of this practical below.<\/p>\n

     <\/p>\n

    1. Import dataset<\/strong><\/p>\n

    \"\"<\/p>\n

     <\/p>\n

    2. Do a scatter plot<\/strong><\/p>\n

    \"\"<\/p>\n

     <\/p>\n

    3. Perform separate linear regression<\/strong><\/p>\n

    \"\"<\/p>\n","protected":false},"excerpt":{"rendered":"

    You already know of Simple Linear Regression. You also know of Logistic Regression. Now we would discuss Multiple Linear Regression. This is a case where … <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"pagelayer_contact_templates":[],"_pagelayer_content":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-1912","post","type-post","status-publish","format-standard","hentry","category-machine-learning"],"_links":{"self":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/1912","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/comments?post=1912"}],"version-history":[{"count":1,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/1912\/revisions"}],"predecessor-version":[{"id":2080,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/1912\/revisions\/2080"}],"wp:attachment":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/media?parent=1912"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/categories?post=1912"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/tags?post=1912"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}