Available at: https://digitalcommons.calpoly.edu/theses/2782
Date of Award
6-2023
Degree Name
MS in Computer Science
Department/Program
Computer Science
College
College of Engineering
Advisor
Mugizi Rwebangira
Advisor Department
Computer Science
Advisor College
College of Engineering
Abstract
Understanding how neural systems perform memorization and inductive learning tasks are of key interest in the field of computational neuroscience. Similarly, inductive learning tasks are the focus within the field of machine learning, which has seen rapid growth and innovation utilizing feedforward neural networks. However, there have also been concerns regarding the precipitous nature of such efforts, specifically in the area of deep learning. As a result, we revisit the foundation of the artificial neural network to better incorporate current knowledge of the brain from computational neuroscience. More specifically, a random graph was chosen to model a neural system. This random graph structure was implemented along with an algorithm for storing information, allowing the network to create memories by creating subgraphs of the network. This implementation was derived from a proposed neural computation system, the Neural Tabula Rasa, by Leslie Valiant. Contributions of this work include a new approximation of memory size, several algorithms for implementing aspects of the Neural Tabula Rasa, and empirical evidence of the functional form for memory capacity of the system. This thesis intends to benefit the foundations of learning systems, as the ability to form memories is required for a system to inductively learn.
Award received:
P. Perrine and T. Kirkby. KP-RNN: A Deep Learning Pipeline for Human Motion Prediction and Synthesis of Performance Art. In 7th International Conference on Artificial Intelligence and Virtual Reality (AIVR), Kumamoto, Japan, July 2023. Springer-Verlag.
Included in
Artificial Intelligence and Robotics Commons, Computational Neuroscience Commons, Theory and Algorithms Commons