Implementation of unsupervised learning mechanisms on oxram devices for neuromorphic computing applications
- Autores: Marta Pedró Puig
- Directores de la Tesis: Montserrat Nafria i Maqueda (dir. tes.)
- Lectura: En la Universitat Autònoma de Barcelona ( España ) en 2019
- Idioma: español
- Tribunal Calificador de la Tesis: Jorge Francisco Suñe Tarruella (presid.), Daniel Arumi Delgado (secret.), Eduardo Pérez Cebollada (voc.)
- Programa de doctorado: Programa de Doctorado en Ingeniería Electrónica y de Telecomunicación por la Universidad Autónoma de Barcelona
- Materias:
- Enlaces
- Tesis en acceso abierto en: TESEO
- Resumen
The present thesis compiles the results of the research oriented to provide a methodology for the electrical characterization, modeling and simulation of resistive switching devices, taking into consideration neuromorphic applications based on unsupervised learning This is widely demanded today as a low-consumption solution to the following issues: on the one hand, the speed limitations that take place in data transfer between the memory and processing units that takes place in conventional computer architectures. On the other hand, the growing need for low-power computational systems that perform tasks of classification, analysis and inference of massive amounts of data (for example, for Big Data applications), together with pattern recognition, prediction of behaviors and decision-making tasks (for applications focused on Internet-of-Things, among others).
Specifically, Oxide-based Resistive Random Access Memory (OxRAM) devices are investigated as candidates for the electronic implementation of synapses in physical artificial neural networks, also referred to as neuromorphic architectures. First of all, a theoretical introduction to the different electronic technologies with resistive switching and non-volatile memory properties is provided. The figures of merit demonstrated and projected of each one of them are indicated according to the International Roadmap for Devices and Systems of 2018. With this first chapter, the intention is to provide the reader with the necessary background required to understand the results outlined in the following chapters.
Next, and by using a bottom-up approach divided into the three following chapters, the procedures and results of the electrical characterization and modeling of the OxRAM devices studied for the implementation of analog electronic synapses are discussed. As a starting point, it is experimentally verified that the devices meet the requirements for the indicated application. In the following chapter, two fundamental learning rules are demonstrated experimentally in order to permit the execution of an autonomous (unsupervised) learning algorithm on a neuromorphic architecture based on the tested devices. The proven learning rules allow the devices to emulate certain processes and learning mechanisms reported in the neuroscience field, such as spike-timing dependent plasticity, or the classical conditioning phenomenon, for which Pavlov’s dog experiment is replicated as to establish the foundations of associative learning, to be implemented between two or more synaptic devices. To conclude this part related to analog electronic synapses, the hardware adaptation of an unsupervised learning algorithm is proposed. The designed algorithm provides the system with the property of self-organization, in such a way that, once trained, the physical neuronal network shows a topographical organization in its output layer, which is characteristic of the sensory processing areas of the biological brain. Furthermore, the proposed design and algorithm allow the concatenation of several neuronal networks, in order to execute cognitive tasks of a more complex nature, such as the association of different attributes to the same concept, related to hierarchical computation.
The last chapter is dedicated to the study of OxRAM devices when a low-power mode is considered, for the implementation of binary synapses. Again using a bottom-up perspective, the chapter begins with the electrical characterization and modeling of the devices, which in this case constitute a neuromorphic chip. A probabilistic learning rule is demonstrated, which is then used in an unsupervised on-line learning algorithm designed for the inference and prediction of periodic temporal sequences. Finally, the differences and similarities between the two algorithms described in the thesis are discussed, and a proposal is made as to how each of these can be used in a joint and complementary way.
