{"id":225,"date":"2017-12-17T21:33:00","date_gmt":"2017-12-17T21:33:00","guid":{"rendered":"https:\/\/kindsonthegenius.com\/blog\/2017\/12\/17\/basics-of-neural-networks-in-ai-artificial-intelligence\/"},"modified":"2020-08-22T09:58:27","modified_gmt":"2020-08-22T07:58:27","slug":"basics-of-neural-networks-in-ai-artificial-intelligence","status":"publish","type":"post","link":"https:\/\/kindsonthegenius.com\/blog\/basics-of-neural-networks-in-ai-artificial-intelligence\/","title":{"rendered":"Basics of Neural Networks in AI Artificial Intelligence"},"content":{"rendered":"

Watch the Video Lesson Here: Basic of Neural Networks, clearly explained. <\/a>
\nConcept of Neural Networks is not that difficult to understand by an average person irrespective of your area of specialization. In this lesson, we would explain the concept of Neural Networks(NN) or Artificial Neural Networks and then give a formal definition of it. Then we would look at an application of Neural Networks.
\n<\/a>
\nJust as you know, we would try to keep it simple and clear so that you will not find it difficult to understand and appreciate the concept. We would cover the following:<\/p>\n

    \n
  1. What is Neural Networks<\/a><\/li>\n
  2. Application of Neural Networks<\/a><\/li>\n
  3. Neural Network Implementation<\/a><\/li>\n
  4. Simple Model of Neural Networks – The Perceptron<\/a><\/li>\n
  5. Bias and Sidmoid Function<\/a><\/li>\n
  6. Final Notes<\/a><\/li>\n
  7. A More Detailed Mathematical Model (Next Lesson)<\/li>\n<\/ol>\n

     <\/p>\n

    1. What is a Neural Network<\/b><\/h4>\n

    An Neural Network is a computing system that is based on the biological neural network that make up the human brain. Neural networks are not based on any specific computer program written for it, but it can progressively learn and improve its performance over time.
    \nA neural network is made up of a collection of units or nodes called neurons. These neurons are\u00a0 connected one to the other by means of a connection called synapse. By means of the synapse, a neuron can transmit signal or information to another neuron nearby. The receiving neuron can receive the signal, process it and signal the next one. The process continues, until an output signal is produced.<\/p>\n

     <\/p>\n

    2. Application of Neural Networks<\/b><\/h4>\n

    Note that Neural Networks are a branch of Artificial Intelligence.So the application areas has to do with systems that that try to mimic human way of doing things.\u00a0 There are many modern application areas of neural networks which includes:
    \nComputer Vision<\/i>: Since no program can be written to make the computer recognize all the object in existence, the only way is to use neural networks such that as time goes, computer could on its own recognize new things bases on what it has previously learnt.
    \nPatter Recognition\/Matching<\/i>: This could be applied in searching a repository of images to match say, a face with a known face. Used in Criminal investigation
    \nNatural Language Processing<\/i>: System that allows the computer to recognize spoken human language by learning and listening progressively with time.<\/p>\n

     <\/p>\n

    3. Neural Network Implementation<\/b><\/h4>\n

    So how can we implement an artificial neural network in a real system? The first step would be to have a network of nodes which would represent the neurons. The we assign a real number to each of the neurons. This real numbers would represent the signal held by that neuron.<\/p>\n

    The output of each neuron is calculated by non-linear function. This function would take the sum of all the inputs of that neuron.<\/p>\n

    Now, both neurons and synapses usually have a weight that continually adjusts as the learning progresses. This weight controls the strength of the signal the neuron send out across the synapse to the next neuron. Neurons are normally arranged in layers. Different layers may perform different kind of transformation on its input. Signals move through different layers including hidden layers all the way to the output.<\/p>\n

     <\/p>\n

    4. Simple Model of Neural Networks – The Perceptron<\/b><\/h4>\n

    The perceptron is the simplest model of a neuron that illustrates how a neural network works. The perceptron is a machine learning algorithm developed in 1957 by Frank Rosenblatt and first implemented in IBM 704.<\/p>\n\n\n\n\n
    <\/a><\/td>\n<\/tr>\n
    Figure 1: How the Perceptron Works<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n


    \n<\/b>How it Works<\/i><\/b>
    \nHow the perceptron works is illustrated in Figure 1.\u00a0 In the example, the perceptron has three inputs x1<\/sub>, x2<\/sub><\/i> and x3<\/sub><\/i> and one output.
    \nThe importance of this inputs is determined by the corresponding weights w1<\/sub>, w2<\/sub><\/i> and w3<\/sub><\/i> assigned to this inputs. The output could be a 0 or a 1 depending on the weighted sum of the inputs.<\/p>\n

    Output =<\/b> w1<\/sub>x1<\/sub>\u00a0+ w2<\/sub>x2<\/sub> + w3<\/sub>x3\u00a0<\/sub><\/i><\/span><\/span><\/div>\n

    Output is 0 if the sum is below certain threshold or 1 if the output is above certain threshold. This threshold could be a real number and a parameter of the neuron.<\/p>\n

    This is shown below in Equation 1.<\/p>\n\n\n\n\n
    <\/a><\/td>\n<\/tr>\n
    Equation 1:\u00a0 output of a perceptron<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

    This operation of the perceptron clearly explains the basics of Neural Networks and would serve as a good introduction to learning neural network.
    \nNow we would examine a more detailed model of a neural network, but that would be in part 2 because I need to keep this lesson as simple as possible.<\/p>\n

     <\/p>\n

    5. Introducing a Bias and Sigmoid Function<\/b><\/h4>\n

    Lets not consider a general example, this time we have not just 3 inputs but n inputs. Just as you know, the formula now becomes:<\/p>\n

    Output =<\/b> w1<\/sub>x1<\/sub>\u00a0+ w2<\/sub>x2<\/sub> + w3<\/sub>x3<\/sub> + ,,, + wn<\/sub>xn<\/sub><\/span> <\/i><\/span><\/div>\n

    which is not much different from the one we previously had. But if we use a function like this one, the output could be any number. However, we want the output to be a number between 0 and 1.
    \nSo what we would do is to\u00a0 pass this weighted sum into a function that would act on the data to produce values between 0 and 1. What function would that be? Yes, that is the sigmoid function<\/i>! which is also know as a logistic curve.<\/i><\/p>\n

    <\/a><\/div>\n

    For the sigmoid function, very negative inputs gets close to zero and very positive inputs gets close to 1 and it sharply increases at the zero point.<\/p>\n

    So if we use the symbol \u03c3<\/span><\/b>, we would have:<\/span><\/span>
    \n<\/span><\/b><\/div>\n


    \n<\/p>\n

    \u03c3(<\/span><\/span>w1<\/sub>x1<\/sub>\u00a0+ w2<\/sub>x2<\/sub> + w3<\/sub>x3<\/sub> + ,,, + wn<\/sub>xn)<\/sub><\/i><\/span><\/span><\/span><\/span><\/div>\n

    Now, suppose, we want the neuron to activate when the value of this output is greater than some threshold, that is, below this threshold, the neuron does not activate, above the threshold, it activates. Then we call this threshold, bias and include it in the function.
    \nWe would then have<\/p>\n

    \u03c3(<\/span><\/span>w1<\/sub>x1<\/sub>\u00a0+ w2<\/sub>x2<\/sub> + w3<\/sub>x3<\/sub> + ,,, + wn<\/sub>xn+\u00a0 bias)<\/sub><\/i><\/span><\/span><\/span><\/span><\/span><\/div>\n

    The bias is a measure of how high the weighted sum needs to be before the neuron activates.<\/p>\n

    \u00a0Only activate when weighted sum > bias<\/span><\/div>\n

     <\/p>\n

    <\/a><\/div>\n

    What we have considered is something like shown above, with just two layers. But Neural networks actually could contain several layers and that is what we are going to consider in subsequent lessons on AI Artificial Intelligence<\/p>\n

    6. Final Notes<\/b><\/h4>\n
      \n
    • However complex the Neural Network concept appears, you now have the underlying principle:<\/li>\n
    • set of inputs combined with weights (plus a bias or error to be discussed in the next lesson) to provide an output.<\/li>\n
    • Neurons are connected to each other by means of synapses<\/li>\n
    • Neurons sends signal(output) to the next neuron<\/li>\n
    • The network undergoes a learning process over time to become more efficient.<\/li>\n<\/ul>\n

      In the next lesson, we would look at more details of how the Neural Network works.<\/p>\n","protected":false},"excerpt":{"rendered":"

      Watch the Video Lesson Here: Basic of Neural Networks, clearly explained. Concept of Neural Networks is not that difficult to understand by an average person … <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"categories":[14],"tags":[],"_links":{"self":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/225"}],"collection":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/comments?post=225"}],"version-history":[{"count":3,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/225\/revisions"}],"predecessor-version":[{"id":1450,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/posts\/225\/revisions\/1450"}],"wp:attachment":[{"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/media?parent=225"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/categories?post=225"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kindsonthegenius.com\/blog\/wp-json\/wp\/v2\/tags?post=225"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}