Serhan Yilmaz

Serhan Yilmaz

Resume

I am a senior-year undergraduate student in Computer Science at Sabanci University.
Currently, I'm a Research Intern with Prof. Kemal Oflazer at Carnegie Mellon University, focusing on advanced question generation, compound AI systems and multi-agent frameworks.

I'm also a contributor to Project Aya by Cohere for AI, contributing to INCLUDE, a multilingual benchmarking dataset for LLMs.

Previously, I worked with Anmol Goel and Prof. Iryna Gurevych at TU Darmstadt, developing a self-sustaining agentic chatbot system for psychological assessment of Ukrainian refugees, optimized for deployment at Charité Berlin.

I worked as a Research Intern at KTH Royal Institute of Technology under Prof. Gabriel Skantze, developing advanced voice activity prediction models and deploying enhanced models on Furhat Robotics' humanoid robots.

I worked as a Research Intern at EPFL, where I initiated Project Charisius, focusing on developing robust, privacy-preserving federated machine learning environments.

At Sabanci University, I founded and led kAi Sabanci, the university's premier AI club, growing membership to over 600 students.

Research Interests

My research focuses on developing intelligent systems that can reason, collaborate, and adapt. I'm particularly interested in:

Agentic AI Reasoning Test-Time Scaling Reliable AI Multi-Agent Systems

Chat with Serhan

i've opened up some 30-minute slots for virtual hangouts. research ideas, cool projects, engineering problems, or just venting about that bug you can't fix - i'm down for whatever!

grab a slot

News

Jan 22, 2025 INCLUDE is accepted at ICLR 2025 as a Spotlight paper!
Dec 1, 2024 INCLUDE is now available on arXiv!
Sep 27, 2024 Submitted a paper to ICLR 2025: "INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge" in collaboration with Cohere for AI, ETH Zurich and the Swiss AI Initiative.
Sep 23, 2024 Concluded the LLM-Agent work at TU Darmstadt, delivered a psychological assessment chatbot to be deployed at Charité Berlin.
Aug 13, 2024 This webpage is live. Migrating from the previous one.
Jul 25, 2024 Started an LLM-Agent project for Charité Berlin. Collaborating with Anmol Goel under Prof. Iryna Gurevych.
Jun 18, 2024 Started working with Prof. Gabriel Skantze at KTH. Moved to Stockholm for 2 months.
Dec 1, 2023 Started working with Prof. Kemal Oflazer.
Sep 9, 2023 Returned back to Turkey after 3 months in Lausanne working at EPFL.
Jun 19, 2023 Started working at EPFL, moved to Lausanne for 3 months.
Mar 15, 2023 Officially founded kAi Sabanci as president, together with an amazing team.

publications

  1. CASCADES: Compound AI Systems for Controlled And Diverse Question Generation
    Serhan Yilmaz and Kemal Oflazer
    In preparation, expected 2025
  2. INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge
    Angelika Romanou, [...], Serhan Yilmaz, [...], Sara Hooker, Antoine Bosselut, et al.
    ICLR 2025 (Spotlight), 2024
    paper | arxiv | code | cite