Entropy, Information, Landauer's Limit and Moore's Law

Paul Tobin, Technological University Dublin

Document Type Conference Paper

25th IET Irish Signals & Systems Conference 2014, Limerick, Ireland


n this paper we explore the link between information and entropy by considering the infamous Maxwell demon thought experiment. A non-rigorous math-ematical solution by Leo Szilard established this link for the first time, as did Claude Shannon nineteen years later. In 1961, Rolf Landauer’s mathematical solution resulted in the Landauer limit, which is still being hotly debated, but here we discuss the implica- tion of this limit on Moore’s law and future growth in computing power. A workaround the limit is proposed using an Analogue Artificial Neural Network (AANN). Here, we mimic the action of a human brain synapse formed from memristance connected between two Fitzhugh-Nagumo (FN) neuron models. All designs were simulated in Orcad PSpice version 16.5, but a master-slave synapse was built, tested and outputs compared to simulation results. The synapse was also connected in a star-type network which displayed chaotic-type behaviour for certain parameter values.