{"id":2637,"date":"2022-03-15T15:03:06","date_gmt":"2022-03-15T14:03:06","guid":{"rendered":"\/?post_type=challenges&#038;p=2637"},"modified":"2022-10-24T11:58:12","modified_gmt":"2022-10-24T09:58:12","slug":"innovate-new-processing-paradigms-for-frugal-digital","status":"publish","type":"challenges","link":"https:\/\/talentimpulse.cea.fr\/en\/scienceimpulse\/challenges\/innovate-new-processing-paradigms-for-frugal-digital\/","title":{"rendered":"Junior Investigator - 3 year fellowship - Innovate New Processing Paradigms, Data Intelligence, Methodologies, and Tools for Frugal Digital"},"content":{"rendered":"<div data-elementor-type=\"wp-post\" data-elementor-id=\"2637\" class=\"elementor elementor-2637\" data-elementor-post-type=\"challenges\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-6f82a8d7 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"6f82a8d7\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-73b71786\" data-id=\"73b71786\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-362958ff elementor-widget elementor-widget-text-editor\" data-id=\"362958ff\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><\/p>\n<p><span style=\"font-weight: bold; font-size: 16px;\">\ud83c\udf93 Qualification :&nbsp;<\/span><span style=\"font-size: 16px;\">PhD \u2022&nbsp;<\/span><span style=\"font-weight: bold; font-size: 16px;\">\ud83e\udd1d Employment type :&nbsp;<\/span><span style=\"font-size: 16px;\">3 year contract \u2022&nbsp;<\/span><span style=\"font-weight: bold; font-size: 16px;\">\ud83d\udccd Location :&nbsp;<\/span><span style=\"font-size: 16px;\">Paris area, France<\/span><strong><br><\/strong><\/p>\n<p><strong>CEA-List is seeking an accomplished junior investigator to contribute novel research ideas in processing paradigms, data intelligence, methodologies, and tools to make technology more frugal and sustainable. The winner of this three-year Science Impulse fellowship will manage their own groundbreaking research project and have an opportunity to work with CEA research teams.<\/strong><\/p>\n<h4><strong>Background<\/strong><\/h4>\n<p>Over the past five decades, digital technology has seen unprecedented efficiency gains. But due to exponential growth in the use of technology, these gains have not reduced overall energy consumption. Novel approaches will be required to respond to the urgent need for more sustainable, frugal technologies. In this challenge lies a wide array of research opportunities spanning architectures, algorithms, and applications. Successful research must address these topics holistically and optimize all levels of the technology stack.<\/p>\n<h4><strong>Scope and applications<\/strong><\/h4>\n<p>The proposed research may address one or a combination of the following topics and\/or their applications, and proposals on related topics will also be considered:<\/p>\n<p><strong>1.Performing complex tasks with data.<\/strong>Deep learning can be used to build efficient machine learning models, but with high data and computing budgets. Transfer learning techniques leverage the relatedness of tasks to avoid full, complex-model training for new tasks, but there is still much room for improvement. This will require breakthroughs in:<\/p>\n<ul>\n<li>Formalizing and quantifying task relatedness<\/li>\n<li>Measuring the tradeoff between discriminating efficiency and transferability of induced representations<\/li>\n<li>Understanding the relationship between adversarial robustness and transferability<\/li>\n<li>Analyzing how knowledge is distributed across deep model components and how this can be used to optimize learning and transfer<\/li>\n<li>Characterizing the ability of a deep model to unfold the underlying data manifold and replacing some components of the model by unlearned transforms based on geometrical insights<br><br><\/li>\n<\/ul>\n<p><strong>2. Investigating smart frugal solutions that do not necessarily involve learning,<\/strong>like parsimonious models, lean models, and other approaches such as Bayesian, hyper dimensionality, or self-supervised learning. Continuous learning and updating without full relearning and dynamic adaptation and detection of new events and classes could also be addressed. Specific topics could include:<\/p>\n<ul>\n<li>Understanding \u201cwinning ticket\u201d identification (subnetworks of complex dense models than can be trained to full accuracy according to the lottery ticket hypothesis) and transferability of winning tickets for different downstream tasks <em>des billets de loterie)<\/em>et la transf\u00e9rabilit\u00e9 des billets gagnants pour diff\u00e9rentes t\u00e2ches en aval<\/li>\n<li>Investigating data-free or one-shot model pruning based on network structural properties<\/li>\n<li>Analyzing deep links between model pruning and network architecture search<\/li>\n<li>Disentangling \u201cinnate\u201d architecture-related network capability for a given task and \u201cacquired\u201d training-related knowledge<\/li>\n<li>Going beyond gradient descent-based model optimization<\/li>\n<li>Co-designing hardware and sparse models<\/li>\n<li>Studying model pruning transferability across different classes of models<\/li>\n<li>Developing multi-mode aggregation of different input modalities<\/li>\n<\/ul>\n<p><strong><br>3. Methods and tools for frugal digital engineering.<\/strong>Eco-design has been identified as one of the main ways to contain the digital world\u2019s environmental impacts. And the earlier we intervene (i.e. during the design phase), the greater the potential gains across the digital service lifecycle. The topics addressed could include:<\/p>\n<ul>\n<li>Holistic, systemic eco-design approaches to reduce the IT resources (servers, network, terminals, etc.) needed for a given functional unit (digital service)<\/li>\n<li>Design methods and tools to support these approaches, including collaborative lifecycle analysis (LCA) methods and tools that hardware, software, and infrastructure experts can use to reduce environmental impacts across the entire digital service lifecycle<br><br><\/li>\n<\/ul>\n<p><strong>Specific applications of the topics mentioned above<\/strong> in non-destructive testing (NDT), structural health monitoring (SHM), computer vision, and natural language processing (NLP) could also be addressed by the research.<\/p>\n<p>In terms of NDT and, especially, SHM, a variety of industries from energy (wind turbine and nuclear power plant monitoring) to transportation (rail, aeronautics, maritime) to civil engineering (bridges) are hungry for SHM solutions capable of estimating the remaining useful life of an asset and facilitating long-term maintenance planning with its significant financial and safety benefits. In terms of environmental performance, a CEA-List study showed that the carbon balance of SHM implementation is positive, even when it lengthens asset lifetimes very little. Artificial intelligence has the capacity to make SHM even more powerful. Because the sensors and other devices used in SHM systems are usually battery-powered, frugal AI will be crucial. A holistic and eco-design approach to both AI algorithms and hardware will be needed to design a complete viable SHM system based on AI.<\/p>\n<p>Applications in computer vision and NLP could address potential alternatives to the current paradigm in which powerful models are produced by a few giants and adapted for specific tasks by users\u2014at the cost of huge data and computing budgets. Here, research could address solutions to reduce model complexity, limit the amount of training data needed, and maintain the level of performance required for the target application, from exploiting foundation models (controlling bias, reducing complexity) to developing alternative frugal-by-design architectures. More disruptive approaches based on alternatives to deep learning will also be considered.<\/p>\n<h4><strong>Job description<\/strong><\/h4>\n<p>CEA-List is seeking an accomplished junior investigator to contribute to the study and development of new and innovative solutions in the field of efficient and frugal processing. The candidate will have opportunities to utilize previous CEA-List hardware and software developments as well as resources like the SACHEMS SHM implementation and testing platform at CEA-List.<\/p>\n<p>As principal investigator, the candidate will be in charge of the project and must be capable of working in a very multidisciplinary environment. In addition, a holistic and, therefore, multidisciplinary approach to the proposed topic or topics (see above in scope and applications) will be expected. The end goal is to achieve acceptable tradeoffs between efficient processing and frugality through research that is a natural fit for the programs currently underway at CEA-List.<\/p>\n<h4 style=\"text-align: justify;\"><strong>Biblio references<\/strong><\/h4>\n<ol>\n<li>Fefferman, C., Mitter, S., &amp; Narayanan, H. (2016). Testing the manifold hypothesis.&nbsp;Journal of the American Mathematical Society,&nbsp;29(4), 983-1049.<\/li>\n<li>Frankle, Jonathan, and Michael Carbin. \u00ab\u00a0The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks.\u00a0\u00bb&nbsp;International Conference on Learning Representations. 2018.<\/li>\n<li>Tanaka, H., Kunin, D., Yamins, D. L., &amp; Ganguli, S. (2020). Pruning neural networks without any data by iteratively conserving synaptic flow.&nbsp;Advances in Neural Information Processing Systems,&nbsp;33, 6377-6389.<\/li>\n<li>Gaier, A., &amp; Ha, D. (2019). Weight agnostic neural networks.&nbsp;Advances in neural information processing systems,&nbsp;32.<\/li>\n<li>BORDAGE, Fr\u00e9d\u00e9ric. The environmental footprint of the digital world. Report for GreenIT. fr, 2019.Aujoux, C; Mesnil, O., \u00ab\u00a0Environmental impact assessment of guided wave based structural health monitoring\u00a0\u00bb Structural Health Monitoring, SAGE Publications Sage UK: London, England, 2022<\/li>\n<li>Aujoux, C; Mesnil, O., \u00ab\u00a0Environmental impact assessment of guided wave based structural health monitoring\u00a0\u00bb Structural Health Monitoring, SAGE Publications Sage UK: London, England, 2022<\/li>\n<li><a href=\"http:\/\/www-list.cea.fr\/en\/media\/news\/2020\/471-october-2-2020-sachems-shm-development-and-testing-platform\">http:\/\/www-list.cea.fr\/en\/media\/news\/2020\/471-october-2-2020-sachems-shm-development-and-testing-platform<\/a><\/li>\n<\/ol>\n<p><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>","protected":false},"excerpt":{"rendered":"<p>\ud83c\udf93 Qualification :&nbsp;PhD \u2022&nbsp;\ud83e\udd1d Employment type :&nbsp;3 year contract \u2022&nbsp;\ud83d\udccd Location :&nbsp;Paris area, France Le CEA-List recherche un.e jeune scientifique de haut niveau, qui sera charg\u00e9.e d\u2019impulser des id\u00e9es nouvelles en mati\u00e8re de paradigmes de traitement, d\u2019intelligence des donn\u00e9es, de m\u00e9thodes et d\u2019outils afin de rendre les technologies plus sobres et plus durables. Le ou [&#8230;]<\/p>","protected":false},"featured_media":0,"parent":0,"template":"","meta":{"_acf_changed":false},"categories":[],"tags":[44],"class_list":["post-2637","challenges","type-challenges","status-publish","hentry","tag-cea-si-2022-004"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/talentimpulse.cea.fr\/en\/wp-json\/wp\/v2\/challenges\/2637","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/talentimpulse.cea.fr\/en\/wp-json\/wp\/v2\/challenges"}],"about":[{"href":"https:\/\/talentimpulse.cea.fr\/en\/wp-json\/wp\/v2\/types\/challenges"}],"version-history":[{"count":44,"href":"https:\/\/talentimpulse.cea.fr\/en\/wp-json\/wp\/v2\/challenges\/2637\/revisions"}],"predecessor-version":[{"id":6668,"href":"https:\/\/talentimpulse.cea.fr\/en\/wp-json\/wp\/v2\/challenges\/2637\/revisions\/6668"}],"wp:attachment":[{"href":"https:\/\/talentimpulse.cea.fr\/en\/wp-json\/wp\/v2\/media?parent=2637"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/talentimpulse.cea.fr\/en\/wp-json\/wp\/v2\/categories?post=2637"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/talentimpulse.cea.fr\/en\/wp-json\/wp\/v2\/tags?post=2637"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}