Serhan Yilmaz

Serhan Yilmaz

resume | linkedin | github | media | misc | email


I am a senior-year undergraduate student in Computer Science at Sabanci University.
Currently, I'm a Research Intern with Prof. Kemal Oflazer at Carnegie Mellon University, focusing on advanced question generation, compound AI systems and multi-agent frameworks.

I'm also a contributor to Project Aya by Cohere for AI, contributing to INCLUDE, a multilingual benchmarking dataset for LLMs.

Previously, I worked with Anmol Goel and Prof. Iryna Gurevych at TU Darmstadt, developing a self-sustaining agentic chatbot system for psychological assessment of Ukrainian refugees, optimized for deployment at Charité Berlin.

I worked as a Research Intern at KTH Royal Institute of Technology under Prof. Gabriel Skantze, developing advanced voice activity prediction models and deploying enhanced models on Furhat Robotics' humanoid robots.

I worked as a Research Intern at EPFL, where I initiated Project Charisius, focusing on developing robust, privacy-preserving federated machine learning environments.

At Sabanci University, I founded and led kAi Sabanci, the university's premier AI club, growing membership to over 600 students.

Research Interests

Multi-Agent Systems, Agentic AI Frameworks, Conversational AI. I'm particularly excited about developing compound AI systems and enhancing multi-agent collaboration frameworks.

News

Dec 1, 2024 INCLUDE is now available on arXiv!
Sep 27, 2024 Submitted a paper to ICLR 2025: "INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge" in collaboration with Cohere for AI, ETH Zurich and the Swiss AI Initiative.
Sep 23, 2024 Concluded the LLM-Agent work at TU Darmstadt, delivered a psychological assessment chatbot to be deployed at Charité Berlin.
Aug 13, 2024 This webpage is live. Migrating from the previous one.
Jul 25, 2024 Started an LLM-Agent project for Charité Berlin. Collaborating with Anmol Goel under Prof. Iryna Gurevych.
Jun 18, 2024 Started working with Prof. Gabriel Skantze at KTH. Moved to Stockholm for 2 months.
Dec 1, 2023 Started working with Prof. Kemal Oflazer.
Sep 9, 2023 Returned back to Turkey after 3 months in Lausanne working at EPFL.
Jun 19, 2023 Started working at EPFL, moved to Lausanne for 3 months.
Mar 15, 2023 Officially founded kAi Sabanci as president, together with an amazing team.

publications

  1. CASCADES: Compound AI Systems for Controlled And Diverse Question Generation
    Serhan Yilmaz and Kemal Oflazer
    In preparation, expected 2024
  2. INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge
    Angelika Romanou, [...], Serhan Yilmaz, [...], Sara Hooker, Antoine Bosselut, et al.
    Under review at ICLR 2025, 2024
    paper | arxiv | code | cite