Inicio  /  Applied Sciences  /  Vol: 12 Par: 10 (2022)  /  Artículo
ARTÍCULO
TITULO

Sigmoid Activation Implementation for Neural Networks Hardware Accelerators Based on Reconfigurable Computing Environments for Low-Power Intelligent Systems

Vladislav Shatravin    
Dmitriy Shashev and Stanislav Shidlovskiy    

Resumen

The remarkable results of applying machine learning algorithms to complex tasks are well known. They open wide opportunities in natural language processing, image recognition, and predictive analysis. However, their use in low-power intelligent systems is restricted because of high computational complexity and memory requirements. This group includes a wide variety of devices, from smartphones and Internet of Things (IoT)smart sensors to unmanned aerial vehicles (UAVs), self-driving cars, and nodes of Edge Computing systems. All of these devices have severe limitations to their weight and power consumption. To apply neural networks in these systems efficiently, specialized hardware accelerators are used. However, hardware implementation of some neural network operations is a challenging task. Sigmoid activation is popular in the classification problem and is a notable example of such a complex operation because it uses division and exponentiation. The paper proposes efficient implementations of this activation for dynamically reconfigurable accelerators. Reconfigurable computing environments (RCE) allow achieving reconfigurability of accelerators. The paper shows the advantages of applying such accelerators in low-power systems, proposes the centralized and distributed hardware implementations of the sigmoid, presents comparisons with the results of other studies, and describes application of the proposed approaches to other activation functions. Timing simulations of the developed Verilog modules show low delay (14?18.5 ns) with acceptable accuracy (average absolute error is 4 × 10-3).

 Artículos similares

       
 
Edvaldo Domingos, Blessing Ojeme and Olawande Daramola    
Until recently, traditional machine learning techniques (TMLTs) such as multilayer perceptrons (MLPs) and support vector machines (SVMs) have been used successfully for churn prediction, but with significant efforts expended on the configuration of the t... ver más
Revista: Computation

 
Yingying Wang, Yibin Li, Yong Song and Xuewen Rong    
The convolutional neural network (CNN) has been widely used in image recognition field due to its good performance. This paper proposes a facial expression recognition method based on the CNN model. Regarding the complexity of the hierarchic structure of... ver más
Revista: Applied Sciences

 
Do-Soo Kwon, Chungkuk Jin, MooHyun Kim and Weoncheol Koo    
This paper presents a machine learning method for detecting the mooring failures of SFT (submerged floating tunnel) based on DNN (deep neural network). The floater-mooring-coupled hydro-elastic time-domain numerical simulations are conducted under variou... ver más
Revista: Applied Sciences

 
Kunal Banerjee,Evangelos Georganas,Dhiraj D. Kalamkar,Barukh Ziv,Eden Segal,Cristina Anderson,Alexander Heinecke     Pág. 64 - 85
Recurrent neural network (RNN) models have been found to be well suited for processing temporal data. In this work, we present an optimized implementation of vanilla RNN cell and its two popular variants: LSTM and GRU for Intel Xeon architecture. Typical... ver más

 
Delia Putri Fardani,Eto Wuryanto,Indah Werdiningsih     Pág. 33 - 40
Abstrak? Penelitian ini bertujuan merancang dan membangun sistem pendukung keputusan untuk meramalkan jumlah kunjungan pasien RSU Dr. Wahidin Sudiro Husodo Kota Mojokerto dengan menggunakan metode Extreme Learning Machine (ELM). Dengan adanya  siste... ver más