Educative – Make Your Own Neural Network in Python

The Search for Intelligent MachinesPreview Also

A Nature Inspired New Golden AgePreview

Who is this course for?Preview Also

What will we do?Preview

How will we do it?Preview Also

Author’s NotePreview

Easy for Me, Hard for YouPreview Also

A Simple Predicting MachinePreview

Estimating the Constant “c” Iteratively Also

Classifying vs. Predicting

Building a Simple Classifier Also

Error in the Training Classifier

Refining the Parameters of Training Classifier Also

Setting up Learning Rate in Training Classifier

Limitations of Linear Classifiers Also

Representing Boolean Functions with Linear Classification

Neurons, Nature’s Computing MachinesPreview Also

How Neurons Really Work?

What is an Activation Function? Also

Replicating Neuron to an Artificial Model

Following Signals Through A Simpler Network Also

Calculating Neural Network Output

Matrix Multiplication is Useful .. Honest! Also

Calculating Inputs for Internal Layers

A Three Layer Example: Working on Input Layer Also

And A Three Layer Example: Working on Hidden Layer

A Three Layer Example: Working on Output Layer Also

Learning Weights From More Than One Node

Backpropagating Errors From More Output Nodes

Backpropagation: Splitting the Error

Backpropagation: Recombining the Error

Backpropagating Errors with Matrix Multiplication

How Do We Actually Update Weights?

Embrace Pessimism

Understanding the Gradient Descent Algorithm

How to Transform the Output into Error Function?

Using Gradient Descent to Update Weights

Choosing the Right Weights…Iteratively!

One Last Thing…

Weight Update Worked Example

Preparing Data: Inputs & Outputs

Preparing Data: Random Initial Weights

Getting Started

Loops

Functions

Arrays

Plotting Arrays

Objects

Methods

Building the Neural Network Class

Initializing the Network

Weights – The Heart of the Network

Optional: More Sophisticated Weights

Querying the Network

Applying Sigmoid Function

The Code Thus Far..

Testing Our Code Thus Far

Training the Network

Refining the Weights

The Complete Neural Network Code

The MNIST Dataset of Handwritten Numbers

A Quick Look at the Data Files

Getting the Dataset Ready

Plotting the Data Points

Preparing the MNIST Training Data

The Need to Rescale the Target Output

Python Code to Create and Rescale the Output Array

Updating Neural Network Code Also

Testing the Network on a Subset

Testing the Network Against the Whole Dataset! Also

Updating the Neural Network Code…Again

Tweaking the Learning Rate Also

Doing Multiple Runs

Change Network Shape Also

Your Own Handwriting

Inside the Mind of a Neural Network Also

Backward Query

More Brain Scans Also

Creating New Training Data by Rotations

Epilogue Also

A Gentle Introduction

A Flat Line Also

A Sloped Straight Line

A Curved Line Also

Calculus By Hand

And calculus Not By Hand Also

Calculus without Plotting Graphs

Patterns Also

Functions of Functions

Handling Independent Variables Also