Foutse Khomh

Biographie

Foutse Khomh est professeur titulaire de génie logiciel à Polytechnique Montréal, titulaire d'une chaire en IA Canada-CIFAR dans le domaine des systèmes logiciels d'apprentissage automatique fiables, et titulaire d'une chaire de recherche FRQ-IVADO sur l'assurance qualité des logiciels pour les applications d'apprentissage automatique.

Il a obtenu un doctorat en génie logiciel de l'Université de Montréal en 2011, avec une bourse d'excellence. Il a également reçu le prix CS-Can/Info-Can du meilleur jeune chercheur en informatique en 2019. Ses recherches portent sur la maintenance et l'évolution des logiciels, l'ingénierie des systèmes d'apprentissage automatique, l'ingénierie en nuage et l’IA/apprentissage automatique fiable et digne de confiance.

Ses travaux ont été récompensés par quatre prix de l’article le plus important Most Influential Paper en dix ans et six prix du meilleur article ou de l’article exceptionnel (Best/Distinguished Paper). Il a également siégé au comité directeur de plusieurs conférences et rencontres : SANER (comme président), MSR, PROMISE, ICPC (comme président) et ICSME (en tant que vice-président). Il a initié et coorganisé le symposium Software Engineering for Machine Learning Applications (SEMLA) et la série d'ateliers Release Engineering (RELENG).

Il est cofondateur du projet CRSNG CREATE SE4AI : A Training Program on the Development, Deployment, and Servicing of Artificial Intelligence-based Software Systems et l'un des chercheurs principaux du projet Dependable Explainable Learning (DEEL). Il est également cofondateur de l'initiative québécoise sur l'IA digne de confiance (Confiance IA Québec). Il fait partie du comité de rédaction de plusieurs revues internationales de génie logiciel (dont IEEE Software, EMSE, JSEP) et est membre senior de l'Institute of Electrical and Electronics Engineers (IEEE).

Étudiants actuels

Nanda Assobjio Brice Yvan

Maîtrise recherche - Polytechnique

Ahmed Haj Yahmed

Maîtrise recherche - Polytechnique

Gabriel Laberge

Doctorat - Polytechnique

forough majidi

Doctorat - Polytechnique

Site web

mohammadhossein.malekpour@gmail.com

Mohammadhossein Malekpour

Maîtrise recherche - Polytechnique

Elnathan Tiokou Tiokou Fangang

Arghavan Moradi Dakhel

Postdoctorat - Polytechnique

Maîtrise recherche - Polytechnique

Doctorat - Polytechnique

Publications

Ranking code clones to support maintenance activities

Osama Ehsan

Ying Zou

Dong Qiu

2023-04-25

Empirical Software Engineering (publié)

Bugs in machine learning-based systems: a faultload benchmark

Mohammad Mehdi Morovati

Amin Nikanjam

Z. Jiang

2023-04-05

Empirical Software Engineering (publié)

Can Ensembling Preprocessing Algorithms Lead to Better Machine Learning Fairness?

Khaled Badran

Pierre-Olivier Côté

Amanda Kolopanis

Rached Bouchoucha

Antonio Collante

Diego Elias Costa

Emad Shihab

In this work, we evaluate three popular fairness preprocessing algorithms and investigate the potential for combining all algorithms into a … (voir plus)more robust preprocessing ensemble. We report on lessons learned that can help practitioners better select fairness algorithms for their models.

2023-04-01

Computer (publié)

Machine learning application development: practitioners’ insights

Md Saidur Rahman

Alaleh Hamidi

Jinghui Cheng

Giuliano Antoniol

Hironori Washizaki

2023-03-30

Software Quality Journal (publié)

A Probabilistic Framework for Mutation Testing in Deep Neural Networks

Florian Tambon

Giuliano Antoniol

2023-03-01

Information and Software Technology (publié)

Refactoring practices in the context of data-intensive systems

Biruk Asmare Muse

Giuliano Antoniol

2023-02-16

Empirical Software Engineering (publié)

AmbieGen tool at the SBST 2022 Tool Competition

Dmytro Humeniuk

Giuliano Antoniol

AmbieGen is a tool for generating test cases for cyber-physical systems (CPS). In the context of SBST 2022 CPS tool competition, it has been… (voir plus) adapted to generating virtual roads to test a car lane keeping assist system. AmbieGen leverages a two objective NSGA-II algorithm to produce the test cases. It has achieved the highest final score, accounting for the test case efficiency, effectiveness and diversity in both testing configurations.

2023-02-03

Proceedings of the 15th Workshop on Search-Based Software Testing (publié)

Fooling SHAP with Stealthily Biased Sampling

gabriel laberge

Ulrich Aivodji

Satoshi Hara

Mario Marchand

SHAP explanations aim at identifying which features contribute the most to the difference in model prediction at a speciﬁc input versus a … (voir plus)background distribution. Recent studies have shown that they can be manipulated by malicious adversaries to produce arbitrary desired explanations. However, existing attacks focus solely on altering the black-box model itself. In this paper, we propose a complementary family of attacks that leave the model intact and manipulate SHAP explanations using stealthily biased sampling of the data points used to approximate expectations w.r.t the background distribution. In the context of fairness audit, we show that our attack can reduce the importance of a sensitive feature when explaining the difference in outcomes between groups, while remaining undetected. These results highlight the manipulability of SHAP explanations and encourage auditors to treat post-hoc explanations with skepticism.

2023-02-01

ICLR.cc/2023/Conference (poster)

openreview.net

Studying Logging Practice in Machine Learning-based Applications

Patrick Loic Foalem

Heng Li

Logging is a common practice in traditional software development. Several research works have been done to investigate the different charact… (voir plus)eristics of logging practices in traditional software systems (e.g., Android applications, JAVA applications, C/C++ applications). Nowadays, we are witnessing more and more development of Machine Learning-based applications (ML-based applications). Today, there are many popular libraries that facilitate and contribute to the development of such applications, among which we can mention: Pytorch, Tensorflow, Theano, MXNet, Scikit-Learn, Caffe, and Keras. Despite the popularity of ML, we don't have a clear understanding of logging practices in ML applications. In this paper, we aim to fill this knowledge gap and help ML practitioners understand the characteristics of logging in ML-based applications. In particular, we conduct an empirical study on 110 open-source ML-based applications. Through a quantitative analysis, we find that logging practice in ML-based applications is less pervasive than in traditional applications including Android, JAVA, and C/C++ applications. Furthermore, the majority of logging statements in ML-based applications are in info and warn levels, compared to traditional applications where info is the majority of logging statement in C/C++ application and debug, error levels constitute the majority of logging statement in Android application. We also perform a quantitative and qualitative analysis of a random sample of logging statements to understand where ML developers put most of logging statements and examine why and how they are using logging. These analyses led to the following observations: (i) ML developers put most of the logging statements in model training, and in non-ML components. (ii) Data and model management appear to be the main reason behind the introduction of logging statements in ML-based applications.

2023-01-10

ArXiv (prépublication)

SmOOD: Smoothness-based Out-of-Distribution Detection Approach for Surrogate Neural Networks in Aircraft Design

Houssem Ben Braiek

Ali Tfaily

Thomas Reid

Ciro Guida

2023-01-05

Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering (publié)

AmbieGen: A Search-based Framework for Autonomous Systems Testing

Dmytro Humeniuk

Giuliano Antoniol

2023-01-01

Sci. Comput. Program. (publié)

GitHub Copilot AI pair programmer: Asset or Liability?

Arghavan Moradi Dakhel

Vahid Majdinasab

Amin Nikanjam

Michel C. Desmarais

Z. Jiang

Automatic program synthesis is a long-lasting dream in software engineering. Recently, a promising Deep Learning (DL) based solution, called… (voir plus) Copilot, has been proposed by OpenAI and Microsoft as an industrial product. Although some studies evaluate the correctness of Copilot solutions and report its issues, more empirical evaluations are necessary to understand how developers can benefit from it effectively. In this paper, we study the capabilities of Copilot in two different programming tasks: (i) generating (and reproducing) correct and efficient solutions for fundamental algorithmic problems, and (ii) comparing Copilot's proposed solutions with those of human programmers on a set of programming tasks. For the former, we assess the performance and functionality of Copilot in solving selected fundamental problems in computer science, like sorting and implementing data structures. In the latter, a dataset of programming problems with human-provided solutions is used. The results show that Copilot is capable of providing solutions for almost all fundamental algorithmic problems, however, some solutions are buggy and non-reproducible. Moreover, Copilot has some difficulties in combining multiple methods to generate a solution. Comparing Copilot to humans, our results show that the correct ratio of humans' solutions is greater than Copilot's suggestions, while the buggy solutions generated by Copilot require less effort to be repaired.

2023-01-01

J. Syst. Softw. (publié)