A Comparative Study on ReLU Implementation Using TMDFETs

Sanket Hanamashetti,Venkatesh Vadde,Bhaskaran Muralidharan
DOI: https://doi.org/10.1088/1402-4896/ad5083
2024-05-25
Physica Scripta
Abstract:In this study, we compare the implementation of the rectified linear (ReLU) activation function using transition metal dichalcogenide field-effect transistors (TMDFETs) and metal-oxide-semiconductor FETs (MOSFETs). Five TMDs - , , , , along with three variants (low-power, high-performance, and multi-gate) of the MOSFETs are simulated. Three ReLU circuits utilizing these FETs are employed for the comparison. The power consumption, speed, and accuracy of the ReLU implementation are measured and compared for each circuit and each FET. Our simulation results show that the MOSFETs consume much less power than the TMDFETs and deliver more accurate ReLU functionality. However, the TMDFETs are much faster than the MOSFETs. Among the TMDFETs, the FET stands out, as it has higher accuracy, consumes the least power and its power consumption is comparable to the MOSFETs. Additionally, is faster compared to MOSFETs, resulting in a trade-off between power efficiency and speed. This makes an attractive option for implementing the ReLU activation function.
physics, multidisciplinary
What problem does this paper attempt to address?