Portrait de Victor Akinode

Victor Akinode

victor.akinode@mila.quebec
Maîtrise recherche - McGill
Superviseur⋅e principal⋅e
David Ifeoluwa Adelani
Sujets de recherche
Apprentissage de représentations
Apprentissage par renforcement
Apprentissage profond
IAG (Intelligence Artificielle Générale)
Modèles génératifs
Traitement du langage naturel
Site web
Google Scholar

Publications

TukaBench: A Culturally Grounded Jailbreak Benchmark for African Languages
Victor Akinode
Senyu Li
Wassim Hamidouche
Waqas Zamir
Inbal Becker-Reshef
David Ifeoluwa Adelani
Safety evaluation of Large Language Models (LLMs) remains heavily English-centric, leaving Low-Resource Languages (LRLs), particularly Afric… (voir plus)an ones, critically underexplored. We introduce TUKABENCH, a jailbreak benchmark for seven African languages that extends JailbreakBench (JBB) beyond direct translation through four settings: human translation of JBB prompts, English adaptation to African contexts followed by human translation, human-curated prompts validated through interactions with GPT-5.2, and code-switched prompts combining English and African languages, isolating the effect of language, cultural grounding, and prompt evasiveness on model safety. Across closed and open models, prompting in African languages reduces refusal relative to English, with culturally adapted prompts leading to least refusal. The evaluation also surfaces two structural limitations: model comprehension failures and reduced LLM-as-a-judge reliability in LRLs. To capture the first, we introduce Deflection alongside Refused and Jailbroken; to assess the second, we validate outputs with human annotations, showing that judge-human agreement drops in lower-resource languages and less commonly supported scripts.
2026-05-30
arXiv (prépublication)
doi.org
arxiv.org