News

Important: Schedule Updates Assignment 1

Written on 12.11.26 by Anna-Maria Maurer

Hello students,

Please note the following updates:

1. Adjusted timeline for the first assignment

Some of you already had meetings with advisors, I hope they were productive. We heard a lot of interesting research ideas. We want to give you enough time to explore those ideas, so, we adjusted… Read more

Hello students,

Please note the following updates:

1. Adjusted timeline for the first assignment

Some of you already had meetings with advisors, I hope they were productive. We heard a lot of interesting research ideas. We want to give you enough time to explore those ideas, so, we adjusted the schedule to only 2 hands-on assignments (attention & activation patching). Next week, you are only required to submit a draft of your assignment and artefacts. This draft must include:

  • 2-3 research questions (RQs)
  • your methodology
  • your initial results

Your artefacts include your code & data with all notebook outputs saved.

The draft will serve as the basis for your discussion with your advisor in the following week. The final submission of the first assignment is now due on Thursday, 03.12..

There will be no assignments on probing and path patching.

2. LSF registration deadline
The LSF registration deadline has been moved to next Thursday, 19.11., due to registration issues, in particular for proseminar students.

Please remember to register until then for the correct seminar / proseminar!

3. Next session: Thursday, 19.11.
In this session, we will first shortly discuss the challenges you encountered when analyzing attention, followed by a discussion of the second paper about probing. Please remember to upload your discussion questions for this paper until the night before.

The kickoff slides have been updated to reflect these changes and are available in the CMS.

Best regards,
Anna-Maria

 

Reminder: Advisor Feedback Meeting

Written on 10.11.26 by Youssef Abdelsalam

Dear Students,

For the upcoming advisor meeting, please make sure you have looked through the provided notebooks and demo script and are somewhat familiar with your assigned dataset. Try to think of a few interesting research questions or ideas you could explore and how you might investigate them.… Read more

Dear Students,

For the upcoming advisor meeting, please make sure you have looked through the provided notebooks and demo script and are somewhat familiar with your assigned dataset. Try to think of a few interesting research questions or ideas you could explore and how you might investigate them. The provided materials already offer several good starting points.

You don't need to have everything figured out. The meeting is mainly intended to help you refine your research questions and discuss your evaluation approach, rather than technical implementation details. It is also an opportunity to discuss any difficulties you may be facing. If you find the workload too challenging or have concerns about your progress, please feel free to bring this up with your advisor as well.

We look forward to discussing your ideas!

Best regards,  
Youssef Abdelsalam
 

Advisor Mail

Written on 09.11.26 by Anna-Maria Maurer

Hello everyone,

we are sorry about the hold-up regarding the advisor mails.

They were sent out only a few minutes ago.

If possible, please still contact your advisor until tomorrow 3pm, to make scheduling for both you and your advisor easier.

In case anyone did not receive a mail, please… Read more

Hello everyone,

we are sorry about the hold-up regarding the advisor mails.

They were sent out only a few minutes ago.

If possible, please still contact your advisor until tomorrow 3pm, to make scheduling for both you and your advisor easier.

In case anyone did not receive a mail, please contact us immediately.

If you encounter any other issue, please do not hesitate to contact us either.

 

Best regards,

Anna-Maria

Orgaitional Matters for Assignment 1

Written on 06.11.26 by Anna-Maria Maurer

Hello everyone,

Here are a few organizational points for the seminar:

 

  • LaTeX template: We have uploaded a LaTeX template. You must use this template for the submission of your assignment.

 

  • Advisor contact: You will receive an email today with the name of your advisor. Please… Read more

Hello everyone,

Here are a few organizational points for the seminar:

 

  • LaTeX template: We have uploaded a LaTeX template. You must use this template for the submission of your assignment.

 

  • Advisor contact: You will receive an email today with the name of your advisor. Please contact them as soon as possible to schedule a meeting to receive feedback on your work. This meeting is mandatory, and you must contact your advisor by Tuesday Nov 10th, 3 pm.

 

If you have any questions, feel free to reach out.

Best regards,
Anna-Maria

Reminder for Paper 1

Written on 02.11.26 by Kingsley Jun Hao Kuan

Dear all,

Reminder that everyone is required to submit discussion questions on paper 1 for our next session. As mentioned in the last session, you only need to read the first half of paper 1, covering the empirical research (i.e. exclude Section V onwards).

Looking forward to seeing your discussion questions!

Paper 1 Discussion Questions and Registration on LSF

Written on 30.10.26 (last change on 30.10.26) by Kingsley Jun Hao Kuan

Dear all,

Next week we will be discussing paper 1 "Cost-Effective Adversarial Attacks Against Code LLM With Model Attention". You may find both the paper and the template (questions.txt) to submit discussion questions in the CMS. Please follow the template, and reminder that the deadline to submit… Read more

Dear all,

Next week we will be discussing paper 1 "Cost-Effective Adversarial Attacks Against Code LLM With Model Attention". You may find both the paper and the template (questions.txt) to submit discussion questions in the CMS. Please follow the template, and reminder that the deadline to submit discussion questions is the day before the session, 04.11.2026 23:59. 

In addition, you should now be able to register for the seminar on LSF. Please do so before the registration deadline 12.11.2026. Do let us know if you have problems doing so!

See you next week!

Topic preferences: due Tuesday, 27.10., 23:59

Written on 22.10.26 by Youssef Abdelsalam

Dear all,

thank you for attending today's kick-off session! The slides of the kick-off and of the introduction to LLMs are now available in the Materials section.

As mentioned in the session, each of you will work on one topic over the course of the semester. To help us assign each of you a… Read more

Dear all,

thank you for attending today's kick-off session! The slides of the kick-off and of the introduction to LLMs are now available in the Materials section.

As mentioned in the session, each of you will work on one topic over the course of the semester. To help us assign each of you a topic, please let us know which topics you would like most:

1. Download preferences.txt from the Materials section. It briefly describes all seven topics.
2. Fill in your name, matriculation number and whether you take the Seminar or the Proseminar.
3. Rank all seven topics from 1 (most wanted) to 7 (least wanted).
4. Upload the file to the CMS by Tuesday, 27.10., 23:59.

If you do not submit a ranking, you will be assigned a random topic. You will receive your topic and its dataset in the next session on 29.10.2026.

See you there!

Show all

Does Copilot Really Understand my Code? Methods for Mechanistic Interpretability of LLMs

by Sven Apel, Youssef Abdelsalam, Kingsley Kuan, and Anna-Maria Maurer

Code LLMs have become ubiquitous in software understanding and development. However, despite their increasing integration into development workflows, they remain black-box models. What do these AI models actually understand about code, and what methods can we use to peek under the hood? What correlational and causal relationships or characteristics can be identified?

In this seminar, students will read and critically discuss papers about methods for mechanistic interpretability, as well as familiarize themselves with these methods in short demos. Throughout the semester, they will formulate research questions targeting assigned topics centering diverse aspects of code, design small experiments for these questions using these methods, and then apply them to analyze what code LLMs represent internally and how information flows through the transformer architecture. Each student will be supported by a dedicated advisor and receive feedback throughout the semester. The seminar concludes with a final report and research presentations in which each participant presents their results and reflects on their implications.

Kick-Off Meeting: Thursday, 22 October 2026

Location: 106 in E1 1

The seminar takes place during the semester on Thursdays from 12:00 - 14:00 (~12 sessions in sum) and in addition final presentation sessions during the lecture-free period.

Participation in all sessions is mandatory, as is the submission of all assignments.

Requirements: 

This seminar is open to motivated Bachelor and Master students who are eager to understand the inner workings of LLMs while critically and empirically examining their behavior. Prior knowledge of LLMs and transformer architectures is recommended, along with general programming experience.


Further information will be provided via e-mail after registration.


 

Registration

Registration for the seminar is mandatory. To distribute students among the available seminars offered by the computer science department, you have to select your preferences for the seminar on the central registration platform for seminars and will be automatically assigned to a seminar according to your preferences.

If you are assigned to this seminar, for organizational reasons, you have to sign up both in the course registration form that will be given above and in the LSF. Deadlines for the LSF (HISPOS) registration will be posted in the LSF (HISPOS) portal. Registration is possible up to three weeks after the topic assignment / kick-off.

All sessions will take place on-site at the university. Participation in all sessions is mandatory.
Privacy Policy | Legal Notice
If you encounter technical problems, please contact the administrators.