News
Assignment 6 released; AI generated submissionsWritten on 27.11.25 by Cora Haiber Hi everyone, Assignment 6 has just been released and will be due on 04.12.2025, 23:59 CET. Don't forget to submit assignment 5, which is due tonight :) Please also note Diana's post on the forum regarding the use of AI for your assignment submissions. Best, |
Clarifications on Assignment 5Written on 22.11.25 by Diana Victoria Davidson Hi everyone, For Question 1.1 and calculating derivatives, please be sure to show your work (i.e. show all the steps if the calculation takes more than one step). For Question 3 and Bonus 1, please set a random seed to 42 with torch.manual_seed(42) to keep the results reproducible (and also… Read more Hi everyone, For Question 1.1 and calculating derivatives, please be sure to show your work (i.e. show all the steps if the calculation takes more than one step). For Question 3 and Bonus 1, please set a random seed to 42 with torch.manual_seed(42) to keep the results reproducible (and also easier for me to grade) Cheers, Diana |
Assignment 5 Released; Quiz 2 next weekWritten on 20.11.25 by Diana Victoria Davidson Hi everyone, Assignment 5 has now been posted and is due on 27.11.25 at 23:59 CEST. Assignment 4 is due in just a couple of hours. Quiz 2 is Monday and Wednesday of next week during the tutorials. Possible topics covered are on the previous announcement. - Your Tutors
|
Topics possibly covered on Quiz 2 next weekWritten on 19.11.25 by Diana Victoria Davidson Hi everyone, As announced during the tutorials, we will have Quiz 2 next week on 24.11 (M) and 26.11 (W) at 14:15. As previously posted, please remember to bring a pen and come on time. The topics that we expect you to know for the quiz include the following: bias/variance trade-off;… Read more Hi everyone, As announced during the tutorials, we will have Quiz 2 next week on 24.11 (M) and 26.11 (W) at 14:15. As previously posted, please remember to bring a pen and come on time. The topics that we expect you to know for the quiz include the following: bias/variance trade-off; over/under-fitting and its relation to capacity and error; cross-validation and the purpose of train/test/validation sets; components of feed forward networks and equations to describe the input/hidden/output layers; ReLU function and using it in a feed forward network, precision/recall/accuracy. Chapter 4 and Chapter 5 (up to slide 19) of the lecture slides, along with Chapters 5 and 6 of the Goodfellow book, homework assignment 4, and the tutorial slides may be useful study material for the quiz. - Your Tutors (Diana and Cora) |
Today's Tutorial Teams LinkWritten on 19.11.25 by Diana Victoria Davidson To everyone in Diana's Tutorial, The beamer in the seminar room still isn't working. Here is a Teams meeting to see the slides, they're also uploaded on CMS under Materials. https://teams.microsoft.com/meet/33947090404034?p=7dwLJuL7VCGlaq3VN1
|
Important Note on Late/No Show Policy to QuizzesWritten on 14.11.25 (last change on 14.11.25) by Diana Victoria Davidson Hi everyone, Our quizzes start promptly at 14:15 during the respective tutorials. The quizzes are planned to take place biweekly (every other week) unless indicated otherwise. We will let you know both in the tutorial and on CMS when the next quiz takes place with ample time. If you arrive late… Read more Hi everyone, Our quizzes start promptly at 14:15 during the respective tutorials. The quizzes are planned to take place biweekly (every other week) unless indicated otherwise. We will let you know both in the tutorial and on CMS when the next quiz takes place with ample time. If you arrive late to the tutorial, you will only have until 14:30 to finish the quiz. We will not let you take the quiz at the end of the tutorial, even if the tutorial ends early. You may skip a quiz during the scheduled time only for legitimate reasons. Examples of such reasons include being genuinely sick or having an official appointment with the Ausländerbehörde (ABH) that directly clashes with your tutorial time. Please note that personal commitments or a doctor’s appointment during the tutorial do not count as valid excuses. If you are sick and unable to attend, you must send your tutor the official German sick note, the Arbeitsunfähigkeitsbescheinigung (certificate of unfitness for work), and cc Prof. Klakow. Simply writing an email saying you are sick is not enough, the certificate must be attached, and it should be sent promptly. In the case of an official appointment with the Ausländerbehörde, please attach a copy of the appointment letter to your tutor and cc Prof. Klakow. Please remember that tutors are not responsible for following up on absences. It is your responsibility to provide the required documentation to avoid losing points for missing the quiz. Best, |
Assignment 4 released; Tutorials next weekWritten on 13.11.25 by Cora Haiber Hi everyone! Assignment 4 has just been released and will be due on 20.11.2025, 23:59 CET. Don't forget to submit Assignment 3, which is due tonight :) Even though there will be no lecture next week, tutorials will take place as usual on Monday and Wednesday. See you in your tutorials! |
Assignment 3 Released; Quiz next weekWritten on 06.11.25 by Diana Victoria Davidson Hello everyone! Assignment 3 has just been posted and will be due on 13.11.25 at 23:59 CEST. Don't forget to turn in Assignment 2, which is due tonight. The first quiz will be taking place during the tutorial sessions on Monday 10.11.25 and Wednesday 12.11.25. Please be sure to come on time,… Read more Hello everyone! Assignment 3 has just been posted and will be due on 13.11.25 at 23:59 CEST. Don't forget to turn in Assignment 2, which is due tonight. The first quiz will be taking place during the tutorial sessions on Monday 10.11.25 and Wednesday 12.11.25. Please be sure to come on time, since the quiz will be administered at 14:15 (and bring a pen with you!). Potential material that could be on the quiz include the following: Applications of Neural Networks; Linear Algebra Basics (e.g. types of matrices, matrix multiplication); finding eigenvectors and/or eigenvalues of a matrix; PCA theory, and any chapters from the Goodfellow Book or the Aggarwal book that cover these topics. Previous assignments and work done during the Tutorials might be useful review as well :) Slides from this week's tutorial have been posted under Materials in the Tutorial Slides section. Also don't stress too much about the quiz please! - Your Tutors |
Tutorial Slots Assigned; Assignment 2 ReleasedWritten on 30.10.25 by Cora Haiber Hi everyone, Assignment 2 has been uploaded under Materials and will be due on 06.11.25. It contains 5 exercises total! Assignment 1 is due tonight, so please don't forget to turn it in :) Also, tutorials start next week on November 3rd / 5th! We have assigned everyone who listed preferences for… Read more Hi everyone, Assignment 2 has been uploaded under Materials and will be due on 06.11.25. It contains 5 exercises total! Assignment 1 is due tonight, so please don't forget to turn it in :) Also, tutorials start next week on November 3rd / 5th! We have assigned everyone who listed preferences for tutorials. Please don't attend the other tutorial unless you have a scheduling conflict. If you did not submit your preferences, we will assume you are either 1) no longer attending the course or 2) have scheduling conflicts with both tutorial sessions. If you have scheduling conflicts with both tutorial sessions, please reach out to us, as we need to make accommodations for administering the quizzes. If you're still wanting to take the course and didn't submit preferences, please reach out to us as well and we can assign you to a tutorial. Please don't hesitate to contact us if you have any other questions. - Your Tutors (Diana and Cora) |
Assignment 1 Released; Tutorial Slots OpenWritten on 23.10.25 by Diana Victoria Davidson Hi everyone! Assignment 1 has been posted in the Materials section. Assignment 1 is due on 30.10.25 at 23:59 CEST. All assignments from now on will be released on Thursdays and you will have one week to complete them. Please complete the assignments in pairs. Only one person per group has to submit… Read more Hi everyone! Assignment 1 has been posted in the Materials section. Assignment 1 is due on 30.10.25 at 23:59 CEST. All assignments from now on will be released on Thursdays and you will have one week to complete them. Please complete the assignments in pairs. Only one person per group has to submit the assignment for both people to get points. Tutorial slots have also been released. These can be found under the Registration tab. We will have two tutorial sessions: Mondays 14:15-15:45, Building E1.3 Room 013 (Cora) Wednesdays 14:15-15:45 Building E1.3 Room 013 (Diana) Tutorials will start the week of 03.11.25. Please only attend your assigned tutorial because of limited space. Tutorials will mainly be for reviewing the solutions of the previous week's assignment sheet and addressing any concerns with the lecture material. We will also be having biweekly (twice a month) quizzes to ensure understanding of the theory from the past two weeks. You need to get at least 70% of the points on the quizzes as well as on the assignments to be able to qualify for the exam. For assignments, your team member doesn't have to be in the same tutorial as you. - Your NNIA Tutors (Cora and Diana)
|
Welcome to NNIA!Written on 22.10.25 (last change on 22.10.25) by Diana Victoria Davidson Hello everyone! Welcome to NNIA :) The Chapter 1 lecture slides have been posted under Information > Materials > Lecture Slides. I have also enabled the Forum (tab on the top of the screen) so that you all can find partners to work on the assignments together. Assignments will also be posted on… Read more Hello everyone! Welcome to NNIA :) The Chapter 1 lecture slides have been posted under Information > Materials > Lecture Slides. I have also enabled the Forum (tab on the top of the screen) so that you all can find partners to work on the assignments together. Assignments will also be posted on CMS in due time. Tutorials will start in early November, specific date TBD. |
Neural Networks: Implementation and Application (CoLI/LST students only!!!!)
This is the version for CoLis (bachelor and master) only. No other students permitted.
Starts: Tuesday, 21.10.25
Location: large lecture hall mathematics, HS1 in E25
Exam: 10.2.26 (location will follow a few days before the exam)
Tutorials:
Mondays 14:15-15:45, Building E1.3 Room 013 (Cora)
Wednesdays 14:15-15:45 Building E1.3 Room 013 (Diana)
Outline:
- Linear Algebra and Principal Component Analysis (PCA)
- Numerical Computation
- Machine Learning Basics
- Deep Feedforward Neural Networks
- Regularization for Deep Learning
- Optimization for Deep Learning
- Convolutional Neural Networks
- Sequence Modelling: Recurrent and Recursive Neural Networks
- Transformers
- GNNs
Text Books:
Neural Networks and Deep Learning by Charu C. Aggarwal
Deep Learning by Aaron Courville, Ian Goodfellow, Joshua Bengio
Geometry of Deep Learning, Jong Chul Ye
Deep Learning Architectures: A Mathematical Approach, Ovidiu Calin
