Difference between revisions of "Neural Networks (Geoffrey Hinton Course)"
Jump to navigation
Jump to search
| Line 1: | Line 1: | ||
== Some Simple Models or Neurons == | == Some Simple Models or Neurons == | ||
| − | $y$ output | + | $y$ output, $x_i$ input, $w_i$ weights. |
=== Linear Neurons === | === Linear Neurons === | ||
$y = b + \sum_{i} x_i w_i$ | $y = b + \sum_{i} x_i w_i$ | ||
| + | |||
| + | $b$ bias | ||
=== Binary Threshold Neurons === | === Binary Threshold Neurons === | ||
Revision as of 17:26, 30 October 2016
Some Simple Models or Neurons
$y$ output, $x_i$ input, $w_i$ weights.
Linear Neurons
$y = b + \sum_{i} x_i w_i$
$b$ bias
Binary Threshold Neurons
$z = \sum_{i} x_i w_i$
$y = 1$ if $z \geq \theta$, $0$ otherwise.
Or, equivalently,
$z = b + \sum_{i} x_i w_i$
$y = 1$ if $z \geq 0$, $0$ otherwise.