Neural Networks: Theory and Implementation

Dietrich Klakow

News

Exam Inspection

Written on 26.03.25 by Dietrich Klakow

will be Tuesday April 22 16:00-18:00 in U15 in C71 . You have a maximum of 30 minutes to inspect your exam. A schedule will be put in the materials section.

This is an exam inspection only! There will be nobody to discuss grading. In case of a grading mistake open a ticket by mailing to… Read more

will be Tuesday April 22 16:00-18:00 in U15 in C71 . You have a maximum of 30 minutes to inspect your exam. A schedule will be put in the materials section.

This is an exam inspection only! There will be nobody to discuss grading. In case of a grading mistake open a ticket by mailing to nnti_ws2425@lsv.uni-saarland.de .

Project presentations: location

Written on 14.03.25 by Dietrich Klakow

will be room -1.05 in the basement of C72

Grades from written exam

Written on 21.02.25 by Dietrich Klakow

Hi,

 

the grades of the written exam are in the NNTI info section of materials. They will be combined with the projects grades and only after that entered into LSF.

 

Best regards,

 

Dietrich Klakow on behalf of the complete team

Seating for Exam

Written on 09.02.25 by Dietrich Klakow

Hi,

in the materials section in the category NNTI Info, you will find which lecture hall you are assigned.

Here is a campus map: https://www.uni-saarland.de/fileadmin/upload/footer/lageplan/saarbruecken_klickbar.pdf

Please make sure you are there at 13:40 latest. Make sure your phone is… Read more

Hi,

in the materials section in the category NNTI Info, you will find which lecture hall you are assigned.

Here is a campus map: https://www.uni-saarland.de/fileadmin/upload/footer/lageplan/saarbruecken_klickbar.pdf

Please make sure you are there at 13:40 latest. Make sure your phone is switched off when entering the lecture hall. All you need is a pen/ball pen and your student Id. Put everything else to the front or the side of the lecture hall. The tutors will tell you which seat to use.

Good luck!

Project

Written on 27.01.25 by Ghada Nait Said

Hi everyone, 

The project has been released. You can find the project zip file under Materials. Please go through the Readme files and the jupyter notebook for further instructions about the tasks.

Kind regards and good luck,

NNTI Tutors

On book references for the course

Written on 27.01.25 by Filippo Garosi

Dear students,

often the lecture slides alone are not sufficient to fully understand some concept. We encourage you to read the literature, and strengthen your understanding.

One of you asked us to point you to the right books/readings. Unless otherwise stated, the material of the lecture is… Read more

Dear students,

often the lecture slides alone are not sufficient to fully understand some concept. We encourage you to read the literature, and strengthen your understanding.

One of you asked us to point you to the right books/readings. Unless otherwise stated, the material of the lecture is based on the Goodfellow book, freely available in the CS library or at https://www.deeplearningbook.org. Sometimes, under selected slides, as a footnote, you can find additional material specific to that topic. For example, there is a reference to the Bishop book under Chapter 6, slide 7.

Hope you find this useful!

Best wishes for your studies,

The NNTI team

Cancellation of Tutorial #2 This Week

Written on 27.01.25 by Nhi Pham

Hi all,

Due to illness, Tutorial #2 will not take place this week. You are welcome to attend one of the remaining tutorials scheduled for this week.

Thank you for your understanding.

Best regards,

Nhi

Assignment 9.1.6 solution

Written on 22.01.25 by Filippo Garosi

We released the solution to the exercise above under Tutorial Material. Check it out!

Your tutor,
Filippo

SIC Cluster Access

Written on 21.01.25 by Monseej Purkayastha

Hello Everyone,

You can now find your SIC cluster credentials for GPU access under your Personal Status page on CMS. Check under the section SIC Cluster credentials.

 

Regards,

Your NNTI Tutors

 

 

Assignment 10 - Submission Deadline extended

Written on 21.01.25 by Nhi Pham

Hello everyone,

Due to the current issue with the cluster credentials, we have decided to extend the submission deadline for Assignment 10 to next monday, 27.01.2025, at 8:00.

Cheers,

NNTI tutors

Assignment 11

Written on 21.01.25 by Nguyen Duc Anh Pham

Hi everyone,

Assignment 11 has been released. Please note that the deadline for Assignment 11 is 11:59 PM on January 29, 2025

Best,
Nguyen Duc Anh Pham

Assignment 10 released

Written on 14.01.25 by Nhi Pham

Hi everyone,

Assignment 10 has been released. The deadline for this assignment is 22.01.2025.

Cheers,

Nhi

Additional Resources for Backpropagation for FNNs: General Explanation + Question 7.1.c Solution

Written on 13.01.25 (last change on 13.01.25) by Ghada Nait Said

Hi everyone,

I hope your exam preparation is going well. We’ve decided to share a handwritten note on Backpropagation for FNNs, along with a proposed solution to the Backpropagation question from Assignment 7 (can be found under the Tutorial Materials section).

Please note that this is not an… Read more

Hi everyone,

I hope your exam preparation is going well. We’ve decided to share a handwritten note on Backpropagation for FNNs, along with a proposed solution to the Backpropagation question from Assignment 7 (can be found under the Tutorial Materials section).

Please note that this is not an official solution. If you find the handwriting unclear or encounter any ambiguities, don’t hesitate to reach out for clarification.

Good luck!

Best regards,

Ghada Nait Said

Assignment 9 released

Written on 09.01.25 by Filippo Garosi

Hi everyone,

Assignment #9 was released two days ago. I just didn't release a news piece for it. The deadline for the assignment is January 15, 2025 at 23:59.

As always, head to the forum if you have any questions on it!

 

Best Regards,

Filippo

Tutorial #5 Room change (again)

Written on 20.12.24 by Monseej Purkayastha

Hi everyone,

It seems like the old regular room SR 016, E1 3 is locked out for some work today again, so we will be holding today's tutorial in Lecture Hall 002, E1 3. Sorry about this, but we'll try to ake sure this doesn't happen in the new year.

Thanks,

Monseej

 

Assignment #8 Update

Written on 13.12.24 by Monseej Purkayastha

Hi All,

The questions for Assignment #8 have been updated. For the programming assignment Q8.4, the fourth experiment was asked to be done with weight-decay and early-stopping, both enabled. There was a typo in the questions, where in one instance, it was mentioned only with early-stopping. We have… Read more

Hi All,

The questions for Assignment #8 have been updated. For the programming assignment Q8.4, the fourth experiment was asked to be done with weight-decay and early-stopping, both enabled. There was a typo in the questions, where in one instance, it was mentioned only with early-stopping. We have uploaded a new updated version of the Assignment, please use that.

Also, a few of you may not have noticed, but Assignment #8 was also updated previously due to some dimensionality problems in Q8.2(b). At that time, 8.4 was also updated to make the requirements and instructions clearer. Please use the latest version to avoid any problems during grading.

Best Regards,

Monseej

Tutorial 5 Room change

Written on 13.12.24 by Monseej Purkayastha

Hi everyone,

It seems like the old regular room SR 016, E1 3 is locked out for some work today, so we will be holding today's tutorial in Lecture Hall 002, E1 3

Note: This is just for today, we should be back in our classroom next week.

Thanks,

Monseej

 

 

Assignment #8 Released

Written on 10.12.24 by Monseej Purkayastha

Hello everyone,

Assignment #8 has been released. The deadline for this assignment is December 18, 2024 at 23:59.

 

Best Regards,

Monseej

Written on 03.12.24 by Ghada Nait Said

Hi everyone,

The deadline for Assignment 6 has been extended to 05.12.2024 at 23:59 due to ongoing issues with Overleaf.

Best regards,

Ghada Nait Said

Assignment 7

Written on 03.12.24 (last change on 03.12.24) by Kunwar Maheep Singh

Assignment 7 has been released. The deadline is 11:59 PM on December 11, 2024.

Best of luck,

Kunwar

Assignment 6

Written on 26.11.24 by Ghada Nait Said

Hi everyone,

Assignment 6 has been released. Please note that the deadline is 11:59 PM on December 04, 2024.

If you have any questions, feel free to ask on the forum. Good luck!

Best regards,

Ghada Nait Said

Assignment 5

Written on 19.11.24 by Nguyen Duc Anh Pham

Hi everyone,

Assignment 5 has been released. Please note that the deadline for Assignment 5 is 11:59 PM on November 27, 2024.

Best,
Nguyen Duc Anh Pham

Tutorial #5 Online session

Written on 15.11.24 by Monseej Purkayastha

Hi Everyone,

Just a heads-up, just like last week, we'll be holding today's Tutorial starting at 14:15 online via Microsoft Teams. If you plan to attend, please join this team's… Read more

Hi Everyone,

Just a heads-up, just like last week, we'll be holding today's Tutorial starting at 14:15 online via Microsoft Teams. If you plan to attend, please join this team's link:

https://teams.microsoft.com/l/meetup-join/19%3ameeting_MzY2ZThhNDYtYTMyMi00M2M5LWI4YjgtN2E1ZWRiYjliODM4%40thread.v2/0?context=%7b%22Tid%22%3a%2267610027-1ac3-49b6-8641-ccd83ce1b01f%22%2c%22Oid%22%3a%22c41ecae6-cb71-45d7-9ce8-3e33e8ed91f8%22%7d

 

Note: This will be the last online session we'll have (hopefully), from next week onwards, it will be in-person at  SR 016, E1 3.

 

Thanks and Regards,

Monseej Purkayastha

Old exam

Written on 13.11.24 by Dietrich Klakow

Hi,

yesterday I was asked for an old exam. Here is one: https://cms.sic.saarland/nnti_2425/dl/10/Old_Exam.pdf (also in the materials section).

Please note that it has very limited predicitve power about this years exam. The team is different and the assignments are different and this will… Read more

Hi,

yesterday I was asked for an old exam. Here is one: https://cms.sic.saarland/nnti_2425/dl/10/Old_Exam.pdf (also in the materials section).

Please note that it has very limited predicitve power about this years exam. The team is different and the assignments are different and this will certainly have an impact on this years exam.

Best,

Dietrich Klakow

 

Assignment 4

Written on 12.11.24 (last change on 12.11.24) by Nhi Pham

Hello everyone,

Assignment 4 has been released. Deadline for this assignment is November 20, 2024 at 23:59.

Best,

Nhi

Tutorial #5 Online session

Written on 08.11.24 by Monseej Purkayastha

Hi Everyone,

For all those who opted for the Friday afternoon Tutorial slot starting at 14:15, please join this team's… Read more

Hi Everyone,

For all those who opted for the Friday afternoon Tutorial slot starting at 14:15, please join this team's link:

https://teams.microsoft.com/l/meetup-join/19%3ameeting_MzY2ZThhNDYtYTMyMi00M2M5LWI4YjgtN2E1ZWRiYjliODM4%40thread.v2/0?context=%7b%22Tid%22%3a%2267610027-1ac3-49b6-8641-ccd83ce1b01f%22%2c%22Oid%22%3a%22c41ecae6-cb71-45d7-9ce8-3e33e8ed91f8%22%7d

 

Thanks and Regards,

Monseej Purkayastha

Tutorial 6: Wednesday 10:15

Written on 08.11.24 by Dietrich Klakow

Tutorial group 6 has been set up. It will be Wednesdays 10:15 in SR 016, E1 3 starting next week. Please reach out to the tutors or me if you want to join that tutorial.

Best,

Dietrich Klakow

 

Written on 06.11.24 by Monseej Purkayastha

Hi everyone,

Assignment 3 has been released. Please note that you have a timeline of 1 week to complete it, i.e. the deadline is on 13th November.

Best,

Your NNTI tutors

6th Tutorial Group: please doodle asap

Written on 05.11.24 (last change on 05.11.24) by Dietrich Klakow

Hi,

as announced today in the lecture we will have a 6th tutorial group in particular for those who have not yet been assigned to a tutorial yet. Here is a doodle with three alternatives:

https://doodle.com/meeting/participate/id/bqDzOp2a

Please doodle as soon as possible, latest by Thursday… Read more

Hi,

as announced today in the lecture we will have a 6th tutorial group in particular for those who have not yet been assigned to a tutorial yet. Here is a doodle with three alternatives:

https://doodle.com/meeting/participate/id/bqDzOp2a

Please doodle as soon as possible, latest by Thursday lunchtime (11:59 am).

Best regards,

Dietrich Klakow

On the additional materials for the course

Written on 05.11.24 by Nhi Pham

Hi everyone,

By popular demand (and maybe a little peer pressure), here’s a lineup of recommended books to supercharge your course experience:

  1. Deep Learning, Ian Goodfellow and Yoshua Bengio and Aaron Courville (also available online: https://www.deeplearningbook.org/)

  2. Pattern… Read more

Hi everyone,

By popular demand (and maybe a little peer pressure), here’s a lineup of recommended books to supercharge your course experience:

  1. Deep Learning, Ian Goodfellow and Yoshua Bengio and Aaron Courville (also available online: https://www.deeplearningbook.org/)

  2. Pattern Recognition and Machine Learning, Christopher Bishop

Both of these books are available in the library. Happy studying – or at least happy book-collecting!

Cheers,

Nhi

On eligibility and bonus points (and Assignment 2)

Written on 31.10.24 by Filippo Garosi

Dear students,

for those of you that missed last lecture,

  • 60% of the points grants you the exam admission
  • participating fruitfully in a tutorial, for example by presenting your solution to an exercise, grants you bonus points towards the exam admission.

Moreover, Assignment 2 has been… Read more

Dear students,

for those of you that missed last lecture,

  • 60% of the points grants you the exam admission
  • participating fruitfully in a tutorial, for example by presenting your solution to an exercise, grants you bonus points towards the exam admission.

Moreover, Assignment 2 has been released a couple of days ago, at the end of the lecture. The due date is 06/11/24 at 23:59.
From now on, the assignments will always be released at the end of the lecture and be due on Wednesday of the following week. 

Good luck!

Assignment 1 released

Written on 23.10.24 by Kunwar Maheep Singh

Assignment 1 has been released. The release was delayed by one day because of the CMS system being down. In this special case, the deadline is extended by one day and this assignment will be due on 30th October 23:59. After this, all assignments will follow the regular schedule of being released at… Read more

Assignment 1 has been released. The release was delayed by one day because of the CMS system being down. In this special case, the deadline is extended by one day and this assignment will be due on 30th October 23:59. After this, all assignments will follow the regular schedule of being released at lecture time and being due before the lecture.
Best of luck
Show all

Neural Networks: Theory and Implementation

This is is the version for CS, DSAI, VC, Bioinformatics, Systems Engineering, wirtschaftsinformatik, etc. No CoLi students permitted in this edition.

Starts: 22.10.24

Location: large lecture hall mathematics, HS1 in E25

Exam: 11.2.25 (location will follow a few days before the exam)

Tutorials: tbd

Outline:

  1. Linear Algebra and Principal Component Analysis (PCA)
  2. Numerical Computation
  3. Machine Learning Basics
  4. Deep Feedforwad Neural Networks
  5. Regularization for Deep Learning
  6. Optimization for Deep Learning
  7. Convolutional Neural Networks
  8. Sequence Modelling: Recurrent and Recursive Neural Networks
  9. Transformers
  10. GNNs

Text Books:

Neural Networks and Deep Learning by Charu C. Aggarwal

Deep Learning by Aaron Courville, Ian Goodfellow, Joshua Bengio

Geometry of Deep Learning, Jong Chul Ye

Deep Learning Architectures: A Mathematical Approach, Ovidiu Calin

 

Privacy Policy | Legal Notice
If you encounter technical problems, please contact the administrators.