Hi,
Geoffrey E. Hinton, the Nobel Prize winner
for AI. He was already beating the drums
for ReLU in 2010:
HRectified Linear Units Improve Restricted Boltzmann Machines
Geoffrey E. Hinton & Vinod Nair - 2010 https://www.cs.toronto.edu/~fritz/absps/reluICML.pdf
Because ANNs (Artificial Neural Networks) were originally
designed with other functions, e.g. with Logistic function:
An artificial neuron is a mathematical function conceived
as a model of a biological neuron in a neural network. https://en.wikipedia.org/wiki/Artificial_neuron
If you populate additive factor graphs with log P,
you basically get multiplicative factor graphs.
So an ANN can express belief networks, right?
Bye
P.S.: What is all the hype about Causal AI, and
the Ladder of Causation |a la Judea Pearl?
Causal AI rCo the next gen AI
Prof. Sotirios A. Tsaftaris - 2025 https://www.youtube.com/watch?v=IelslFzdsYw
| Sysop: | Amessyroom |
|---|---|
| Location: | Fayetteville, NC |
| Users: | 59 |
| Nodes: | 6 (0 / 6) |
| Uptime: | 03:48:09 |
| Calls: | 810 |
| Files: | 1,287 |
| D/L today: |
4 files (10,048K bytes) |
| Messages: | 203,128 |