Understanding Attention for Modern AI
Video recording:
Speaker: Raul Ian Sosa (Co-founder of NeuralWave technologies & Department of Physics, FSTM, University of Luxembourg)
Title: Understanding Attention for Modern AI.
Time: Wednesday, 2023.10.04, 10:00 a.m. (CET)
Place: fully virtual (contact Jakub Lengiewicz to register)
Format: 30 min. presentation + 30 min. discussion
Abstract: In our talk, we will explore the attention mechanism, a pivotal concept in artificial intelligence. We will demystify what it is, explain its unique ability to focus on specific elements in a sequence, and how it mirrors human cognitive processes. We will discuss its transformative role in AI, from its inception to how it is now a crucial part of the development of transformer models. By the end of this talk, we will have a clear understanding of the attention mechanism’s importance and many of its practical applications.
Ian is a physicist, A.I. developer, and entrepreneur. He completed his Bachelor’s and Master’s degrees in Statistical Physics at the Balseiro Institute, Argentina, in 2020 and 2021 respectively. In 2022, he relocated to Luxembourg to pursue a PhD in the Department of Physics and Materials Science at UniLu, focusing on modeling the emergence of quantum mechanical effects in macroscopic systems. Concurrently, he co-founded an A.I. voice synthesis company, NeuralWave, which develops tools for voice generation and voice cloning to reduce costs in entertainment productions and enhance company-customer interactions..