Fractal Learning: A Better Approach to Neural Networks?
CSEF · 2016 Mathematics & Computer Science
Overview
Objectives/Goals Are Fractal Neural Networks more efficient than Feed-Forward Neural Networks in their accuracy of outputs, RMS error values, and overall learning growth and progression? My hypothesis is that #Fractal# Neural Networks are more efficient because of their sub-network properties and changing of weighted links. I think this is because the weighted links adjust to the output values of the sub-networks and make the net learn more efficiently. Methods/Materials For my experiments, I started with a pre-existing Feed-Forward Neural Net as a Control group, and then modified it to become a Fractal Neural Net. The nets were written in C++. To test the nets, I prepared nine different data sets to train the neural nets. The data sets ranged in difficulty and topic and were downloaded from the UCI Machine Learning Repository. Results After learning each data set, the Fractal Neural Net showed similar learning growth to that of the Control, and also had similar output and RMS error values as well. Even though these values were similar, the Control had values that were more efficient more often. Overall, the Control beat the Fractal Net four times, tied with the Fractal Net four times, and lost to the Fractal Neural Net once. Conclusions/Discussion My final conclusion is that the Fractal Neural Network is less efficient than Feed-Forward Neural Network.
Summary statement
I compared two types of neural networks, a Fractal Net, and a Feed-Forward Net, at a variety of datasets to determine which was more efficient.
Help received
None received. I made the Networks off of a code-base online, and based off of a paper done by Roderick Murray Smith, a professor at the University of Glasgow
Competition history
- CSEF 2016
Resources
Related projects
ISEF · 2015
Functional Neural Networks Evaluated by Weierstrass Polynomials
ISEF · 2020
Testing a Variety of Methods for Training a Neural Network to Determine Which One Achieves the Lowest Error Rate Fastest?
ISEF · 2020
A Fourier Series-Based Neural Network Model to Predict Especially Fluctuating Data
CSEF · 2017
Neural Networks for Handwritten Letter Recognition
ISEF · 2018
Comparison Between Gradient Descent and Newton Method Optimization Algorithms Resulting in the Creation of a Unique Algorithm
ISEF · 2018
Fractals
CSEF · 2004
Neurotic About Hidden Neurons
CSEF · 2009
Choice Based on Past Knowledge using Multi-Layered Neural Networks in Tic-Tac-Toe
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: California Science & Engineering Fair public projects