Please use this identifier to cite or link to this item:
http://hdl.handle.net/20.500.12188/22842
Title: | Parallelization of a Neural Network Algorithm for Handwriting Recognition: Can we Increase the Speed, Keeping the Same Accuracy | Authors: | Todorov, D. Zdraveski, Vladimir Kostoska, Magdalena Gushev, Marjan |
Keywords: | message passing interface, neural network, handwriting recognition, multilayer perceptron, parallel processing, distributed processing | Issue Date: | 2021 | Publisher: | IEEE | Conference: | 44th International Convention on Information, Communication and Electronic Technology (MIPRO) | Abstract: | This paper examines the problem of parallelizing neural network training. For our solution we use the backpropagation neural network, as a breakthrough example in the field of deep learning. The challenge of our solution is to twist the algorithm in such a way so it can be executed in parallel, rather than sequentially. In this paper we would like to test validity of a research hypothesis if we can increase the speed by parallelizing the back-propagation algorithm and keep the same accuracy. For this purpose we will develop a use-case of a handwriting recognition algorithm and run several experiments to test the performance, both in execution speed and accuracy. At the end we are going to examine just how much it benefits us to try and write a parallel program for a neural network, with regards to the time it takes to train the neural network and the accuracy of the predictions. Our handwriting problem is that of classification, and in order to implement any sort of solution, we must have data. The MNIST dataset of handwritten digits will provide our necessary data to solve the problem. | URI: | http://hdl.handle.net/20.500.12188/22842 |
Appears in Collections: | Faculty of Computer Science and Engineering: Conference papers |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
MIPRO2021_Parallelization_of_a_neural_network_algorithm_for_use_in_handwriting_recognition.pdf | 576.64 kB | Adobe PDF | View/Open |
Page view(s)
65
checked on Oct 11, 2024
Download(s)
63
checked on Oct 11, 2024
Google ScholarTM
Check
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.