Labels

ACO (3) AdaBoost (2) Ant Colony Optimization (2) Backpropagation (2) binary constraint graph (1) blockchain (2) brute force (1) brute force algorithm (1) Class Scheduling (12) conditional independence (1) conference cheduling (1) conference scheduling (2) constraint satisfaction problem (3) cryptocurrency (3) csp (3) cyclic group (1) data mining (3) decision trees (12) derive equations (1) DHKE (6) Diffie Hellman Problem (1) Diffie-Hellman Key Exchange (2) Digital Signature Algorithm (1) Discrete Logarithm Problem (1) double and add algorithm (1) download source code (1) DSA (1) ecc (1) ECDH (1) ECDSA (1) Elgamal (1) Elgamal Digital Signature (1) Elliptic Curve (1) Elliptic Curve Diffie–Hellman key exchange (1) Elliptic Curve Cryptography (1) Elliptic Curve Digital Signature Algorithm (1) Encryption (1) euler phi function (1) extended euclidean algorithm (1) generalized discrete logarithm problem (1) generate rules (3) Genetic Algorithm (5) Genetic Algorithms (19) gradient descent (2) group (1) group generator (1) grow xml tree (1) Handle Underflow (1) hashing (1) hill climbing (7) hopfield network (2) independence (1) info gain (1) information gain (2) java (84) javafx (1) k-nearest neighbors (2) Laplace Smoothing (2) linear algebra (3) Linear Regression (2) logical operators (1) logistic regression (4) map coloring (1) message authenticity (1) message confidentiality (1) message integrity (1) multi-party Diffie-Hellman Key Exchange (1) Naive Bayes (6) nearest neighbor (1) nearest neighbors (1) Neural Networks (10) node splitting (1) Normal Equation (2) numpy (1) P2P (10) Peer to Peer (5) peer-to-peer (2) point addition (1) point doubling (1) pow (3) probability (2) proof of work (3) proof-of-work (1) public key cryptography (9) Public Key Cryptography + DHKE w/ Encryption + JAVA (1) Python (18) random restart hill climbing (2) robotics (1) rsa (1) RSA Digital Signature (1) Scala (1) Sentiment Classification (4) Sequential Minimal Optimization (2) sha-256 (1) simulated annealing (2) SMO (2) sqlite (21) stochastic gradient descent (2) Support Vector Machines (2) SVM (2) Traveling Salesman Problem (1) TSP (13) underflow handling (1) use rules (3) workshops scheduling (2)
Showing posts with label Neural Networks. Show all posts
Showing posts with label Neural Networks. Show all posts

Sunday, September 20, 2020

Neural Networks w/ JAVA - Tutorial 05

00:06 step #0 randomly initialize weights for n inputs
00:28 objective is to determine what weights would lead to
'Target Result = Result' for all vectors in training data
00:42 step#1 calculate weighted sum, step#2 apply
activation function, step#3 determine error, step#4 adjust weights


01:17 demo app. with various number of inputs

-----------------------------------------------------------------------------------------------------------
quickly download, import into Eclipse, and run zip file for
'Neural Networks w/ JAVA - Tutorial 05'
-----------------------------------------------------------------------------------------------------------





-----------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------

Neural Networks w/ JAVA - Tutorial 04

00:06 have 3 inputs + a bias and need to obtain equation of a plane separating the 0s and 1s
00:35 step #0 randomly initialize weights w0, w1, w2, and w3
00:45 step #1 calculate weighted sum
01:00 step #2 apply activation function
01:18 step #3 determine error
01:54 'learning rate' is the rate at which the neural network learns (ranges from 0 to 1)
01:27 step #4 adjust weights
02:31 objective here is to determine what weights would
lead to 'Target Result' = 'Result' for all vectors in training data
02:02 repeat steps 1 to 4 until error = 0

03:32 demo prebuilt version of the app.

05:09 code the application

10:46 test run completed application

-------------------------------------------------------------------------------------------------------------
quickly download, import into Eclipse, and run zip file for
'Neural Networks w/ JAVA - Tutorial 04'
-------------------------------------------------------------------------------------------------------------





-----------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------

Neural Networks w/ JAVA - Tutorial 03

 


00:06 change THRESHOLD to 0.0 + run neural networks tutorial 02

00:24 unsuccessfull in looping through additional epochs
until error = 0 for all training vectors in final epoch

02:20 explain adding a bias
02:50 objective here is to determine what weights would
lead to 'Target Result' = 'Result' for all vectors in training data


03:40 code the application
14:45 test run completed application

-------------------------------------------------------------------------------------------------------
quickly download, import into Eclipse, and run zip file for
'Neural Networks w/ JAVA - Tutorial 03'
-------------------------------------------------------------------------------------------------------





-----------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------

Neural Networks w/ JAVA - Tutorial 02

 

00:06 obtain equation of line separating the 0s and 1s
00:32 step #0 randomly initialize weights
00:39 step #1 calculate weighted sum
00:50 step #2 apply activation function
01:10 step #3 determine error
01:19 step #4 adjust weights
01:39 repeat steps 1 to 4 until error = 0
01:57 objective here is to determine what weights would
lead to 'Target Result' = 'Result' for all vectors in training data
02:13 set weighted sum equal to the threshold

02:47 demo a prebuilt version of the app.

03:25 code the application


16:00 test run completed application

-------------------------------------------------------------------------------------------------------
quickly download, import into Eclipse, and run zip file for
'Neural Networks w/ JAVA - Tutorial 02'
-------------------------------------------------------------------------------------------------------





-----------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------

Tuesday, September 15, 2020

Neural Networks w/ JAVA (Tutorial 06) - Solve XOR w/ Hill Climbing

 


00:06 try running 'neural network tutorial 03'
w/ XOR training data
00:56 not possible to have one line separating
the 0s and 1s for XOR trainig data

01:33 demo prebuilt version of the application
02:32 use a neural network with 5 neurons
(2 in input layer, 2 in hidden layer, and 1 in output layer),
and where each neuron has 2 inputs and a threshold
03:16 proceed when 'adjusted error' is smaller or equal to current error

04:38 code the application
22:38 test run completed application

-------------------------------------------------------------------------------------------------------
quickly download, import into Eclipse, and run zip file for
'Neural Networks w/ JAVA (Tutorial 06) - Solve XOR w/ Hill Climbing'
-------------------------------------------------------------------------------------------------------





-----------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------

Neural Networks w/ JAVA (Solve XOR w/ Simulated Annealing) - Tutorial 07

 




00:06 demo prebuilt version of the application
00:42 use a neural network with 5 neurons
(2 in input layer, 2 in hidden layer, and 1 in output layer),
and where each neuron has 2 inputs and a threshold
01:20 proceed when 'adjusted error' is smaller or equal to 'current error'
01:39 proceed if prob bigger than 'random #' when 'adjusted error'
is bigger than 'current error'
03:00 as the temperature gets lower and lower we proceed less and less often

03:44 code the application

24:00 test run completed application

----------------------------------------------------------------------------------------------------
quickly download, import into Eclipse, and run zip file for
'Neural Networks w/ JAVA
(Solve XOR w/ Simulated Annealing) - Tutorial 07'
-----------------------------------------------------------------------------------------------------





-----------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------