Deniz Bayazit
About Publications TA Work

Avatar

About

Hello! My name is Deniz, and I am a PhD candidate in Computer Science advised by Antoine Bosselut at the NLP lab in EPFL, IC.

My research interests broadly lie in natural language processing and artificial intelligence, and more specifically in interpretability. In particular, I am interested in understanding the underlying mechanisms and behavior of Large Language Models (LLMs). I am also interested in understanding the dynamics of LLM training and identifying factors that influence the model’s generalization and decision-making processes.

Previously, I worked with Stefanie Tellex and Ellie Pavlick at the H2R and LUNAR laboratories in the Brown CS Department.

Publications

Preprints

MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
Z Chen, A Hernández-Cano, A Romanou, A Bonnet, K Matoba, F Salvi, M Pagliardini, S Fan, A Köpf, A Mohtashami, A Sallinen, A Sakhaeirad, V Swamy, I Krawczuk, D Bayazit, A Marmet, S Montariol, M Hartley, M Jaggi, A Bosselut
arXiv 2023
Top ML Papers of the Week (by dair.ai)
[PDF] [code]

Conference & Journal Papers

Discovering Knowledge-Critical Subnetworks in Pretrained Language Models
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models
D Bayazit, N Foroutan, Z Chen, G Weiss, A Bosselut
Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2024)
[PDF] [code]
Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants
Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants
B Borges*, N Foroutan*, D Bayazit*, A Sotnikova* et al.
Proceedings of the National Academy of Sciences (PNAS 2024)
[PDF] [code]
PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narratives
PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narratives
S Gao, B Borges, S Oh, D Bayazit, S Kanno, H Wakaki, Y Mitsufuji, A Bosselut
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023)
Outstanding Paper Award
[PDF] [code] [video]
Spatial Language Understanding for Object Search in Partially Observed Cityscale Environments
Spatial Language Understanding for Object Search in Partially Observed Cityscale Environments
K Zheng, D Bayazit, R Mathew, E Pavlick, S Tellex
2021 International Conference on Robot and Human Interactive Communication (RO-MAN)
[PDF] [website] [code] [video]
Grounding Language to Landmarks in Arbitrary Outdoor Environments.
Grounding Language to Landmarks in Arbitrary Outdoor Environments.
M Berg*, D Bayazit*, R Mathew, A Rotter-Aboyoun, E Pavlick, S Tellex
2020 International Conference on Robotics and Automation (ICRA)
[PDF] [data] [video]
Flight, Camera, Action! Using Natural Language and Mixed Reality to Control a Drone
Flight, Camera, Action! Using Natural Language and Mixed Reality to Control a Drone
B Huang, D Bayazit, D Ullman, N Gopalan, S Tellex
2019 International Conference on Robotics and Automation (ICRA)
[PDF] [code] [data] [video]

Thesis Work

Generalizing Natural Language Instruction Following to Aerial Robots and Arbitrary Environments
D Bayazit
2020 Brown University - Undergraduate Thesis
[PDF]

TA Work

Semester Course Code Name Professor
Spring 2023, 2024 CS 552 Modern Natural Language Processing Antoine Bosselut
Fall 2022, 2023, 2024 CS 431 Introduction to Natural Language Processing Jean-Cédric Chappelier, Martin Rajman, Antoine Bosselut
Spring 2021 CSCI 2952I - CLPS 1850 Language Processing in Humans and Machines Ellie Pavlick, Roman Feiman
Fall 2019 CSCI 1410 Artificial Intelligence George Konidaris
Created with Hyde and Poole templates.

© 2025. All rights reserved.