AI → ML → NN
Machine learning - get better with each input
Neural - neuron, basic building block in our brains
Cell has nucleus, where some processes might happen
Links:
- Axon
- Dendrites
When to fire:
- how many dendrites are activate
- how strong is the impulse
First model
Use of Sigmoid function bc that OG one is not derivable
Backpropagation
CNN
RNN - recurrent NN
Time Series
RNNs can be used for generation too.
LSTM - long-short term memory Used in trasnformers