Commit
•
5a9a434
1
Parent(s):
9ae55c9
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,7 @@ In this interview, Schmidhuber stated that LLMs cannot compute "parity" of bits
|
|
| 11 |
So, I wanted to know whether a simple feed forward NNs can compute "parity". (If so, perhaps LLMs actually can compute "parity" if specifically trained to do so) By buidling an NN that can compute parity, we establish roughly the minimum amount of parameters that are reqired for such a task, and then we try to reproduce the ability within a Small Toy Transformer on the same scale, or scale up until the ability is restored. This vertical method of experimentation-in-evolution of AI can become a chapter test in a college course in Artificial Intelligence.
|
| 12 |
|
| 13 |
Method of the python script informed by:
|
|
|
|
| 14 |
Create a Basic Neural Network Model - Deep Learning with PyTorch 5 - YouTube =JHWqWIoac2I (2023-06-05)
|
| 15 |
and
|
| 16 |
Building a Neural Network with PyTorch in 15 Minutes youtube =mozBidd58VQ
|
|
|
|
| 11 |
So, I wanted to know whether a simple feed forward NNs can compute "parity". (If so, perhaps LLMs actually can compute "parity" if specifically trained to do so) By buidling an NN that can compute parity, we establish roughly the minimum amount of parameters that are reqired for such a task, and then we try to reproduce the ability within a Small Toy Transformer on the same scale, or scale up until the ability is restored. This vertical method of experimentation-in-evolution of AI can become a chapter test in a college course in Artificial Intelligence.
|
| 12 |
|
| 13 |
Method of the python script informed by:
|
| 14 |
+
|
| 15 |
Create a Basic Neural Network Model - Deep Learning with PyTorch 5 - YouTube =JHWqWIoac2I (2023-06-05)
|
| 16 |
and
|
| 17 |
Building a Neural Network with PyTorch in 15 Minutes youtube =mozBidd58VQ
|