Project Details

Automatizovaný návrh hardwarových akcelerátorů pro strojového učení zohledňující výpočetní zdroje

Project Period: 1. 1. 2021 - 31. 12. 2023

Project Type: grant

Code: GA21-13001S

Agency: Czech Science Foundation

Program: Standardní projekty

English title
Automated design of hardware accelerators for resource-aware machine learning
Type
grant
Keywords

evolutionary algorithm, deep neural network, machine learning, accelerator, digital circuit, power consumption, evolvable hardware

Abstract

Machine learning (ML), particularly the technology based on deep neural networks (DNNs), has already reached and overcome human-level capabilities in many domains. A significant future use of trained ML models is expected in battery powered devices, where the major constraints are energy and the amount of resources available on a chip. The current approach to the DNN design is based on semi-automated simplifying of a network which is created by a human expert who could only partly reflect all hardware implementation aspects. In this project, the aim is to propose and evaluate a methodology for the highly automated design of hardware accelerators of DNNs (and other selected ML methods) that show excellent trade-offs between the output quality, energy and resources used on a single chip. Our approach is based on evolutionary design of such implementations of DNNs (and other ML systems) that reflect a target hardware platform. The proposed method will be evaluated on standard benchmark problems such as image classification and on automated assessment of Parkinsons disease.

Team members
Sekanina Lukáš, prof. Ing., Ph.D. (UPSY FIT VUT) , research leader
Drahošová Michaela, Ing., Ph.D. (UPSY FIT VUT)
Hurta Martin, Ing. (FIT VUT)
Hurta Martin, Ing. (UPSY FIT VUT)
Matoušek Jiří, Ing., Ph.D. (UPSY FIT VUT)
Mrázek Vojtěch, Ing., Ph.D. (UPSY FIT VUT)
Piňos Michal, Ing. (UPSY FIT VUT)
Vašíček Zdeněk, doc. Ing., Ph.D. (UPSY FIT VUT)
Žufan Petr, Ing. (UPSY FIT VUT)
Publications

2024

  • HUSA Jakub and SEKANINA Lukáš. Semantic Mutation Operator for Fast and Efficient Design of Bent Boolean Functions. Genetic Programming and Evolvable Machines, vol. 25, no. 3, 2024, pp. 1-32. ISSN 1389-2576. Detail

2023

  • QADRI Syed Safi Uddin, ARIF Muhammad and SAEED Bin Omer Muhammad. A Novel Variable Step-Size LMS Algorithm for Decentralized Incremental Distributed Networks. Circuits, Systems, and Signal Processing, vol. 41, no. 12, 2023, pp. 7226-7249. ISSN 0278-081X. Detail
  • PIŇOS Michal, MRÁZEK Vojtěch, VAVERKA Filip, VAŠÍČEK Zdeněk and SEKANINA Lukáš. Acceleration Techniques for Automated Design of Approximate Convolutional Neural Networks. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 13, no. 1, 2023, pp. 212-224. ISSN 2156-3357. Detail
  • HURTA Martin, MRÁZEK Vojtěch, DRAHOŠOVÁ Michaela and SEKANINA Lukáš. ADEE-LID: Automated Design of Energy-Efficient Hardware Accelerators for Levodopa-Induced Dyskinesia Classifiers. In: 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE). Antwerp: Institute of Electrical and Electronics Engineers, 2023, pp. 1-2. ISBN 978-3-9819263-7-8. Detail
  • MRÁZEK Vojtěch. Approximation of Hardware Accelerators driven by Machine-Learning Models. In: Proceedings of International Symposium on Design and Diagnostics of Electronic Circuits and Systems (DDECS '23). Tallinn: Institute of Electrical and Electronics Engineers, 2023, pp. 91-92. ISBN 979-8-3503-3277-3. Detail
  • LOJDA Jakub, PÁNEK Richard, SEKANINA Lukáš and KOTÁSEK Zdeněk. Automated Design and Usage of the Fault-Tolerant Dynamic Partial Reconfiguration Controller for FPGAs. Microelectronics Reliability, vol. 2023, no. 144, pp. 1-16. ISSN 0026-2714. Detail
  • MRÁZEK Vojtěch, JAWED Soyiba, ARIF Muhammad and MALIK Aamir Saeed. Effective EEG Feature Selection for Interpretable MDD (Major Depressive Disorder) Classification. In: GECCO 2023 - Proceedings of the 2023 Genetic and Evolutionary Computation Conference. Lisbon: Association for Computing Machinery, 2023, pp. 1427-1435. ISBN 979-8-4007-0119-1. Detail
  • CHLEBÍK Jakub and JAROŠ Jiří. Evolutionary Optimization of a Focused Ultrasound Propagation Predictor Neural Network. GECCO 2023 Companion - Proceedings of the 2023 Genetic and Evolutionary Computation Conference Companion. Lisbon: Association for Computing Machinery, 2023. ISBN 979-8-4007-0120-7. Detail
  • GIACOBINI Mario, PAPPA Gisele and VAŠÍČEK Zdeněk, ed. Genetic Programming. LNCS 13986. Cham: Springer Verlag, 2023. ISBN 978-3-031-29572-0. Detail
  • JŮZA Tadeáš and SEKANINA Lukáš. GPAM: Genetic Programming with Associative Memory. In: 26th European Conference on Genetic Programming (EuroGP) Held as Part of EvoStar. LNCS, vol. 13986. Cham: Springer Nature Switzerland AG, 2023, pp. 68-83. ISBN 978-3-031-29572-0. ISSN 0302-9743. Detail
  • SEKANINA Lukáš, MRÁZEK Vojtěch and PIŇOS Michal. Hardware-Aware Evolutionary Approaches to Deep Neural Networks. Handbook of Evolutionary Machine Learning. Genetic and Evolutionary Computation. Singapore: Springer Nature Singapore, 2023, pp. 367-396. ISBN 978-981-9938-13-1. Detail
  • HURTA Martin, MRÁZEK Vojtěch, DRAHOŠOVÁ Michaela and SEKANINA Lukáš. MODEE-LID: Multiobjective Design of Energy-Efficient Hardware Accelerators for Levodopa-Induced Dyskinesia Classifiers. In: 2023 26th International Symposium on Design and Diagnostics of Electronic Circuits and Systems (DDECS). Tallinn: Institute of Electrical and Electronics Engineers, 2023, pp. 155-160. ISBN 979-8-3503-3277-3. Detail
  • HURTA Martin, MRÁZEK Vojtěch, DRAHOŠOVÁ Michaela and SEKANINA Lukáš. Multi-objective Design of Hardware Accelerators for Levodopa-Induced Dyskinesia Classifiers. Evo* 2023 -- Late-Breaking Abstracts Volume. Brno, 2023. Detail
  • HUSA Jakub and SEKANINA Lukáš. Semantic Mutation Operator for Fast and Efficient Design of Bent Boolean Functions. Evo* 2023 -- Late-Breaking Abstracts Volume. Brno, 2023. Detail
  • PRABAKARAN Bharath S., MRÁZEK Vojtěch, VAŠÍČEK Zdeněk, SEKANINA Lukáš and SHAFIQUE Muhammad. Xel-FPGAs: An End-to-End Automated Exploration Framework for Approximate Accelerators in FPGA-Based Systems. In: 2023 IEEE/ACM International Conference on Computer Aided Design (ICCAD). San Francisco: Institute of Electrical and Electronics Engineers, 2023, pp. 1-9. ISBN 979-8-3503-1559-2. Detail

2022

  • HANIF Muhammad A., MRÁZEK Vojtěch and SHAFIQUE Muhammad. Approximate Computing Architectures. Handbook of Computer Architecture. Handbook of Computer Architecture. Singapore: Springer Nature Singapore, 2022, pp. 1-41. ISBN 978-981-1564-01-7. Detail
  • BOSIO Alberto, DI Carlo Stefano, GIRARD Patrick, RUOSPO Annachiara, SANCHEZ Ernesto, SAVINO Aessandro, SEKANINA Lukáš, TRAIOLA Marcello, VAŠÍČEK Zdeněk and VIRAZEL Arnaud. Design, Verification, Test, and In-Field Implications of Approximate Digital Integrated Circuits. Approximate Computing Techniques. Cham: Springer International Publishing, 2022, pp. 349-385. ISBN 978-3-030-94704-0. Detail
  • PIŇOS Michal, MRÁZEK Vojtěch and SEKANINA Lukáš. Evolutionary Approximation and Neural Architecture Search. Genetic Programming and Evolvable Machines, vol. 23, no. 3, 2022, pp. 351-374. ISSN 1389-2576. Detail
  • HURTA Martin, DRAHOŠOVÁ Michaela, SEKANINA Lukáš, SMITH Stephen L. and ALTY Jane E. Evolutionary Design of Reduced Precision Levodopa-Induced Dyskinesia Classifiers. In: Genetic Programming, 25th European Conference, EuroGP 2022. Lecture Notes in Computer Science, vol. 13223. Madrid: Springer Nature Switzerland AG, 2022, pp. 85-101. ISBN 978-3-031-02055-1. Detail
  • HURTA Martin, DRAHOŠOVÁ Michaela and MRÁZEK Vojtěch. Evolutionary Design of Reduced Precision Preprocessor for Levodopa-Induced Dyskinesia Classifier. In: Parallel Problem Solving from Nature - PPSN XVII. Lecture Notes in Computer Science, vol. 13398. Dortmund: Springer Nature Switzerland AG, 2022, pp. 491-504. ISBN 978-3-031-14713-5. Detail

2021

  • SEKANINA Lukáš. Evolutionary Algorithms in Approximate Computing: A Survey. Journal of Integrated Circuits and Systems, vol. 16, no. 2, 2021, pp. 1-12. ISSN 1872-0234. Detail
  • PIŇOS Michal, MRÁZEK Vojtěch and SEKANINA Lukáš. Evolutionary Neural Architecture Search Supporting Approximate Multipliers. In: Genetic Programming, 24th European Conference, EuroGP 2021. Lecture Notes in Computer Science, vol 12691, vol. 12691. Seville: Springer Nature Switzerland AG, 2021, pp. 82-97. ISBN 978-3-030-72812-0. Detail
  • SEKANINA Lukáš. Neural Architecture Search and Hardware Accelerator Co-Search: A Survey. IEEE Access, vol. 9, no. 9, 2021, pp. 151337-151362. ISSN 2169-3536. Detail
Back to top