Upgrade to Pro — share decks privately, control downloads, hide ads and more …

JGS594 Lecture 05

JGS594 Lecture 05

Software Engineering for Machine Learning
Coding
(202201)

B546a9b97d993392e4b22b74b99b91fe?s=128

Javier Gonzalez
PRO

January 27, 2022
Tweet

More Decks by Javier Gonzalez

Other Decks in Programming

Transcript

  1. jgs SER 594 Software Engineering for Machine Learning Lecture 05:

    Assignment 01 Dr. Javier Gonzalez-Sanchez javiergs@asu.edu javiergs.engineering.asu.edu | javiergs.com PERALTA 230U Office Hours: By appointment
  2. jgs Previously …

  3. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 3

    jgs Next From Scratch
  4. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 4

    jgs Neural Network
  5. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 5

    jgs Code https://github.com/javiergs/Medium/blob/main/NeuralNetwork/BasicNeuralNetwork.java
  6. jgs Javier Gonzalez-Sanchez | SER332 | Spring 2018 | 6

    … Go for a value < 0.05
  7. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 7

    jgs Constructor
  8. jgs Javier Gonzalez-Sanchez | SER332 | Spring 2018 | 8

  9. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 9

    jgs Main 10,000 4 1
  10. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 10

    jgs Backward Forward Propagation Error Forward Propagation Error Forward Propagation Error Main Forward Propagation Error MSE 10,000 times Backward Backward Backward Propagation
  11. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 11

    jgs Forward Propagation
  12. jgs Javier Gonzalez-Sanchez | SER332 | Spring 2018 | 12

  13. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 13

    jgs Backward Propagation (Part 1 of 2)
  14. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 14

    jgs Backward Propagation (Part 2 of 2)
  15. jgs Assignment 01

  16. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 16

    jgs Instructions § Use the code from https://github.com/javiergs/Medium/blob/main/NeuralNetwork/BasicNeuralNetwork.java § Write a paper addressing the following questions
  17. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 17

    jgs Questions 1. Can you reuse that code and train a neural network for identifying AND operator? What is the Error after 10,000 iterations of training? 2. Can you reuse that code and train a neural network for identifying OR operator? What is the Error after 10,000 iterations of training? 3. Compare with the provided error for XOR. Explain the difference or similarities
  18. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 18

    jgs Questions For the error calculation. You will notice this code meanSquareError += Math.pow (err, 2)/2; double err1 = meanSquareError / (network.nodesOutputLayer+network.nodesHiddenLayer-1); 4. Is there a problem there? 5. Could you identify and explain or fix?
  19. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 19

    jgs Questions 6. What is the size of the array arrayBias? Is that, OK? Should it or Could it Be smaller? If so, can you fix the code? It is worthy to make it smaller.
  20. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 20

    jgs Questions 7. Plot the values of the eight W values Describe/notice how they change.
  21. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 21

    jgs Questions 8. Express the source code from lines 64 to 75 as an equation using the names on the picture 9. Express the source code from lines 77 to 88 as equations using the names on the picture 10. Express the source code from lines 90 to 93 as equations using the names on the picture
  22. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 22

    jgs Extra If you are familiar with derivatives, § Can you explain the equations from the previous question (where they come from) Hints: o derivative of sigmoid function; o partial derivative of error function with respect to Wi o Derivative of a constant o Derivative of (Ax + Bx + Cx + …)
  23. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 23

    jgs Picture
  24. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 24

    jgs Questions
  25. jgs Summary

  26. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 26

    jgs Data Scientist vs Engineers
  27. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 27

    jgs Roles
  28. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 28

    jgs Use
  29. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 29

    jgs Use
  30. Javier Gonzalez-Sanchez | SER 594 | Spring 2022 | 30

    jgs Use
  31. jgs SER 594 Software Engineering for Machine Learning Javier Gonzalez-Sanchez,

    Ph.D. javiergs@asu.edu Spring 2022 Copyright. These slides can only be used as study material for the class CSE205 at Arizona State University. They cannot be distributed or used for another purpose.