Hi, I'm Eliya Habba 👋

PhD student in Computer Science at The Hebrew University of Jerusalem, working on how we evaluate large language models, and how to make them trustworthy for empirical legal research.

🔍 LLM evaluation 💬 prompt sensitivity 📈 efficient benchmarking ⚖️ legal NLP 🗂️ structured extraction
Eliya Habba

👨‍🔬About

I am a PhD student in Computer Science at the Hebrew University of Jerusalem, advised by Dr. Gabriel Stanovsky and Dr. Renana Keydar. My research focuses on Natural Language Processing, developing evaluation methodologies for LLMs that address challenges like prompt sensitivity and benchmark reliability, alongside work on extracting structured information from large document collections, with applications in the legal domain (yes, both my parents are jurists, so my friends tell me these are daddy-mommy issues).

I received my M.Sc. in Computer Science (2021–2023) under the supervision of Dr. Gabriel Stanovsky, where my thesis research applied computational methods to analyze judicial attitudes in court decisions about sexual violence cases. I also hold a B.Sc. in Mathematics and Computer Science (2017–2019, graduated with honours) from the Hebrew University of Jerusalem.

Beyond academia, I've gained industry experience as an Algorithm Developer at OrCam for two years, a Data Scientist Intern at Microsoft, and a summer research internship at Lightricks.

I'm always open to collaborations and enjoy discussing research at the intersection of NLP, legal AI, and evaluation methodologies. Feel free to reach out! ✉️

📚Publications

2026

Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results

Jan Batzner, Sree Harsha Nelaturu, Damian Stachura, Anastassia Kornilova, Jon Crall, Tommaso Cerruti, Yanan Long, Yifan Mai, Sanchit Ahuja, Asaf Yehudai, Marek Šuppa, John P. Lalor, Oluwagbemike Olowe, Jatin Ganhotra, Brian H. Hu, Eliya Habba, Andrew M. Bean, Chang Liu, Sander Land, Steven Dillmann, Aniketh Garikaparthi, Elron Bandel, Saki Imai, James Edgell, Wm. Matthew Kennedy, Jenny Chim, Patrick Meusling, Asteria Kaeberlein, Venkata Ramachandra Karthik Chundi, Manasi Patwardhan, Martin Ku, Austin Meek, Leon Knauer, Brian Wingenroth, Srishti Yadav, Usman Gohar, Felix Friedrich, Michelle Lin, Jennifer Mickel, Arman Cohan, Stella Biderman, Irene Solaiman, Zeerak Talat, Anka Reuel, Mubashara Akhtar, Gjergji Kasneci, Avijit Ghosh, Leshem Choshen

Preprint · under review

When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation

Mubashara Akhtar, Anka Reuel, Prajna Soni, Sanchit Ahuja, Pawan Sasanka Ammanamanchi, Ruchit Rawal, Vilém Zouhar, Srishti Yadav, Chenxi Whitehouse, Dayeon Ki, Jennifer Mickel, Leshem Choshen, Marek Šuppa, Jan Batzner, Jenny Chim, Jeba Sania, Yanan Long, Hossein A. Rahmani, Christina Knight, Yiyang Nan, Jyoutir Raj, Yu Fan, Shubham Singh, Subramanyam Sahoo, Eliya Habba, Usman Gohar, Siddhesh Pawar, Robert Scholz, Arjun Subramonian, Jingwei Ni, Mykel Kochenderfer, Sanmi Koyejo, Mrinmaya Sachan, Stella Biderman, Zeerak Talat, Avijit Ghosh, Irene Solaiman

ICML 2026
2025

Who Evaluates AI's Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations

Anka Reuel, Avijit Ghosh, Jenny Chim, Andrew Tran, Yanan Long, Jennifer Mickel, Usman Gohar, Srishti Yadav, Pawan Sasanka Ammanamanchi, Mowafak Allaham, Hossein A. Rahmani, Mubashara Akhtar, Felix Friedrich, Robert Scholz, Michael Alexander Riegler, Jan Batzner, Eliya Habba, Arushi Saxena, Anastassia Kornilova, Kevin Wei, Prajna Soni, Yohan Mathew, Kevin Klyman, Jeba Sania, Subramanyam Sahoo, Olivia Beyer Bruvik, Pouya Sadeghi, Sujata Goswami, Angelina Wang, Yacine Jernite, Zeerak Talat, Stella Biderman, Mykel Kochenderfer, Sanmi Koyejo, Irene Solaiman

ICML 2026
2024
2023

💡Patents

Developed during my time at Microsoft: