Amal Zouaq

Karou Diallo

Doctorat - Polytechnique

diallokarou28@polymtl.ca

Google Scholar

Fabrice Lamarche

Doctorat - Polytechnique

Github

Gaya Mehenni

Maîtrise recherche - Polytechnique

Site web

Github

Maziar Sargordi

Doctorat - Polytechnique

Superviseur⋅e principal⋅e :

Doctorat - Polytechnique

Co-superviseur⋅e :

Publications

Combining Domain and Alignment Vectors to Achieve Better Knowledge-Safety Trade-offs in LLMs

Megh Thakkar

Yash More

Quentin Fournier

Matthew D Riemer

Pin-Yu Chen

Payel Das

There is a growing interest in training domain-expert LLMs that excel in specific technical fields compared to their general-purpose instruc… (voir plus)tion-tuned counterparts. However, these expert models often experience a loss in their safety abilities in the process, making them capable of generating harmful content. As a solution, we introduce an efficient and effective merging-based alignment method called \textsc{MergeAlign} that interpolates the domain and alignment vectors, creating safer domain-specific models while preserving their utility. We apply \textsc{MergeAlign} on Llama3 variants that are experts in medicine and finance, obtaining substantial alignment improvements with minimal to no degradation on domain-specific benchmarks. We study the impact of model merging through model similarity metrics and contributions of individual models being merged. We hope our findings open new research avenues and inspire more efficient development of safe expert LLMs.

2024-11-11

ArXiv (prépublication)

arxiv.org

A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques

Megh Thakkar

Quentin Fournier

Matthew D Riemer

Pin-Yu Chen

Payel Das

2024-06-07

ArXiv (prépublication)

arxiv.org

MVP: Minimal Viable Phrase for Long Text Understanding.

Louis Clouâtre

2024-01-01

International Conference on Language Resources and Evaluation (publié)

dblp.uni-trier.de

Assessing the Generalization Capabilities of Neural Machine Translation Models for SPARQL Query Generation

Samuel Reyd

2023-10-27

The Semantic Web – ISWC 2023 (publié)

SORBET: A Siamese Network for Ontology Embeddings Using a Distance-Based Regression Loss and BERT

Francis Gosselin

2023-10-27

The Semantic Web – ISWC 2023 (publié)

SORBETmatcher results for OAEI 2023.

Francis Gosselin

2023-01-01

OM@ISWC (publié)

dblp.uni-trier.de

Local Structure Matters Most: Perturbation Study in NLU

Louis Clouâtre

Prasanna Parthasarathi

Recent research analyzing the sensitivity of natural language understanding models to word-order perturbations has shown that neural models … (voir plus)are surprisingly insensitive to the order of words.In this paper, we investigate this phenomenon by developing order-altering perturbations on the order of words, subwords, and characters to analyze their effect on neural models’ performance on language understanding tasks.We experiment with measuring the impact of perturbations to the local neighborhood of characters and global position of characters in the perturbed texts and observe that perturbation functions found in prior literature only affect the global ordering while the local ordering remains relatively unperturbed.We empirically show that neural models, invariant of their inductive biases, pretraining scheme, or the choice of tokenization, mostly rely on the local structure of text to build understanding and make limited use of the global structure.

2022-05-01

Findings of the Association for Computational Linguistics: ACL 2022 (publié)

arxiv.org

Local Structure Matters Most: Perturbation Study in NLU

Louis Clouâtre

Prasanna Parthasarathi

2021-07-29

ArXiv (preprint)