The LIAE is interested in studying and assessing the feasibility of implementing such a functionality. The main idea is to analyze and quantify the needs and limits for deployment on different architectural candidates (e.g. CPUs, GPUs, or SoCs...) In this context, the objective of this internship is to: Provide a cross-disciplinary and well-supported state of the art of the needs of carefully selected LLMs and the various methods available for KV Cache described in the literature, Develop and validate a lightweight functional model in C++ within the laboratory's tool [11], Implement the mechanism in a selected LLM model.
The French Alternative Energies and Atomic Energy Commission (CEA) is a leading research and innovation organization active in three major fields: energy, information and health technologies, and defense. Within the CEA, the Laboratory for Systems and Technology Integration (LIST), located in Saclay (Ile-de-France), drives technology transfer and innovation in embedded systems. The Embedded Artificial Intelligence Laboratory (LIAE) specializes in designing optimized AI solutions for embedded environments, with a focus on efficiency in surface, power consumption, and computing performance.
Profil : Niveau demandé : 3ème année étude ingénieur ou master 2 Compétences : 1ère expérience avec Pytorch et C++, mise en œuvre d’inférence, des notions sur les architectures matérielles serait un plus Pièces à fournir : CV + Lettre de motivation + Relevés de notes des 3 dernières années
Bac+5 - Diplôme École d'ingénieurs
Talent impulse, the scientific and technical job board of CEA's Technology Research Division
© Copyright 2023 – CEA – TALENT IMPULSE - All rights reserved