University of Twente Student Theses

Login

Design and Impact of Activation Functions for Sparse Neural Networks

Zhang, xuhao (2023) Design and Impact of Activation Functions for Sparse Neural Networks.

This is the latest version of this item.

[img] PDF
2MB
Abstract:Currently, the optimizer, activation function, and regularizer of Dense Neural Networks (DNN) are most commonly utilized in the training process of Sparse Neural Networks (SNN), but it has been demonstrated that the default activation functions used for DNN can disadvantage SNN. For SNN, structural design and training should be revisited. % Our goal is to fully comprehend the SNN's nature, assess its activation function, and build a more suitable activation function for the SNN.
Item Type:Essay (Master)
Faculty:EEMCS: Electrical Engineering, Mathematics and Computer Science
Subject:54 computer science
Programme:Computer Science MSc (60300)
Link to this item:https://purl.utwente.nl/essays/94061
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page