News
Currently, no news are available
Differential Equations in Image Processing and Computer Vision
Five Teaching Awards (4 in Computer Science, 1 in Mathematics)
Lecturer: Prof. Joachim Weickert
Assistant: Vassillen Chizhov
Winter Term 2024 / 2025
Lectures (4h) with tutorials (2h)
(9 ETCS points)
Online lectures based on the Zoom platform (privacy information):
Wednesday, 10:15-12:00
Friday, 10:15-12:00
First lecture: Wednesday, October 16
The permanent Zoom link can be found in the materials section.
Tutorials: 2 hours each week; see below.
Synopsis – Prerequisites – Tutorials – Registration – Written Exams – Contents – References
Synopsis
Many model-based techniques in image processing and computer vision make use of methods based on partial differential equations (PDEs) and variational calculus. Moreover, many classical methods may be reinterpreted as approximations of PDE-based techniques. In this course we will get an in-depth insight into these methods. For each of these techniques, we will discuss the basic ideas as well as theoretical and algorithmic aspects. Examples from medical imaging and other fields illustrate the various application possibilities.
Since this class guides its participants to many research topics in our group, its attendance is required for everyone who wishes to pursue a master thesis in our group.
Prerequisites
Equally suited for students of visual computing, mathematics, computer science, and related study programs. It is based on undergraduate mathematical knowledge from the first three semesters (such as "Mathematics for Computer Scientists I-III"). For the programming assignments, some elementary knowledge of C is required. Knowledge in image processing or differential equations is useful, but not required. The lectures will be given in English.
Assignments and Tutorials
The tutorials include homework assignments (theory and programming) as well as classroom assignments. The programming assignments give an intuition about the way how image processing and computer vision algorithms work, while the theoretical assignments provide additional mathematical insights. Classroom assignments are supposed to be easier and should guide you gently to the main themes.
For the homework assignments you can obtain up to 24 points per week. Actively participating in the classroom assignments gives you 12 more points per week, regardless of the correctness of your solutions. You can earn up to 2 bonus points in a tutorial by presenting a solution to a classroom assignment. To qualify for both exams you need 2/3 of all possible points. For 13 weeks, this comes down to 13 x 24 = 312 points. Working in groups of up to 3 people is permitted, but all persons must be in the same tutorial group.
If you miss a tutorial because you are sick, you can still get the points for participation, if you bring a doctor's certificate.
If you have questions concerning the tutorials, please do not hesitate to contact Vassillen Chizhov.
Two tutorial groups are scheduled:
- Group 1 (in English): Tuesday, 14:15-16:00
Tutor: Vassillen Chizhov
Building E1.1, Seminar Room 106 - Group 2 (in English): Tuesday, 16:15-18:00
Tutor: Enes Ulus
Building E1.1, Seminar Room 106
First tutorials: Tuesday, October 22
Additionally the following office hours are offered:
- Group 1 (in English): Tuesday, 16:15-17:15
Tutor: Vassillen Chizhov
Building E1.7, Room 4.05
- Group 2 (in English): Wednesday, 12:15-13:15
Tutor: Enes Ulus
Building E1.7, Room 4.15
Registration
You can register for this course and change your tutorial preference until 13:15 on the 18th of October (Friday).
By 13:15 on the 25th of October (Friday) you should have formed groups for the submission of assignments and submitted the first homework assignment. Ideally you can form groups in the tutorial on the 22nd.
Please do not forget to register for the exam also in the HISPOS/LSF system (apart from Erasmus students). This system administrates your exam admission and your grades.
Written Exams
It is planned to have two written exams, one at the beginning and one at the end of the semester break.
The first written exam takes place on Friday, February 21, 14:00 - 17:00, in E1.3 HS002.
The second written exam takes place on Monday, March 31, 14:00 - 17:00, in E1.3 HS002.
Please be at the exam hall at 13:30 to allow for sufficient time for all organisational matters to be handled.
In order to qualify for the exams you need 312 points. In case of qualification, you are allowed to take part in both exams. The better grade counts, but each exam will count as an individual attempt.
Please do not forget to bring your student ID card with you.
The exams will be closed book. These are the rules during the exams:
- You are allowed and obliged to bring three things to your desk only: Your student ID card (Studierendenausweis), a ball-pen that has no function other than writing, and a so-called cheat sheet. This cheat sheet is a A4 page with formulas or important equations from the lecture. Please note that the cheat sheet has to be handwritten by yourself. It will be collected at the end of the exam, and you can get it back at the exam inspection.
- In particular, electronic devices (including your cell phone), bags, jackets, briefcases, lecture notes, homework and classroom work solutions, additional handwritten notes, books, dictionaries, and paper are not allowed at your desk.
- Please keep your student ID card ready for an attendance check during the exam.
- Do not use pencils or pens that are erasable with a normal rubber.
- You are not allowed to take anything with you that contains information about the exam. A violation of this rule means failing the DIC course.
- You must stay until the exam is completely over.
Contents
Course material will be made available in the materials section in order to support the classroom teaching and the tutorials, not to replace them. Additional organisational information, examples and explanations that may be relevant for your understanding and the exam are provided in the lectures and tutorials. It is solely your responsibility - not ours - to make sure that you receive this information.
The following table shows a preliminary list of topics that will be covered during the semester.
Date | Topic |
---|---|
16/10 | Introduction, Overview |
18/10 | Homogeneous Diffusion I: Basic Concepts (contains classroom assignment C1 and homework H1) |
23/10 | Homogeneous Diffusion II: Key Points, Algorithms, Limitations, Alternatives |
25/10 | Nonlinear Isotropic Diffusion I: Modelling and Continuous Theory (contains classroom assignment C2 and homework H2) |
30/10 | Nonlinear Isotropic Diffusion II: Semidiscrete and Fully Discrete Theory |
04/11 | Nonlinear Isotropic Diffusion III: Diffusion Echo and Efficient Algorithms (contains classroom assignment C3 and homework H3) |
06/11 | Nonlinear Anisotropic Diffusion I: Modelling |
08/11 | Nonlinear Anisotropic Diffusion II: Continuous and Discrete Theory (contains classroom assignment C4 and homework H4) |
13/11 | Nonlinear Diffusion: Parameter Selection |
15/11 | Variational Methods I: Basic Ideas (contains classroom assignment C5 and homework H5) |
20/11 | Variational Methods II: Discrete Aspects |
22/11 | Variational Methods III: TV Regularisation and Primal-Dual Methods (contains classroom assignment C6 and homework H6) |
27/11 | Variational Methods IV: Functionals of Two Variables |
29/11 | Vector- and Matrix-Valued Images (contains classroom assignment C7 and homework H7) |
04/12 | Image Sequence Analysis I: Models for the Smoothness Term |
06/12 | Image Sequence Analysis II: Models for the Data Term (contains classroom assignment C8 and homework H8) |
11/12 | Image Sequence Analysis III: Practical Aspects |
13/12 | Image Sequence Analysis IV: Numerical Methods (contains classroom assignment C9 and homework H9) |
18/12 | Osmosis I: Continuous Theory and Modelling |
20/12 | Osmosis II: Discrete Theory and Efficient Algorithms (contains classroom assignment C10 and homework H10) |
08/01 | Continuous-Scale Morphology I: Basic Ideas |
10/01 | Continuous-Scale Morphology II: Shock Filters and Nonflat Morphology (contains classroom assignment C11 and homework H11) |
15/01 | Curvature-Based Morphology I: Mean Curvature Motion |
17/01 | Curvature-Based Morphology II: Affine Morphological Scale-Space (contains classroom assignment C12 and homework H12) |
22/01 | Self-Snakes and Active Contours |
24/01 | Backward Parabolic PDEs and M-smoothers (contains classroom assignment C13 and homework H13) |
29/01 | PDE-Based Image Compression I: Data Selection |
31/01 | PDE-Based Image Compression II: Optimised Encoding and Better PDEs (please take a look at the self-test problems) |
05/02 | PDEs and Learning |
07/02 | Summary and Outlook |
The slides for these lectures will be made available in the materials section before each lecture.
References
- J. Weickert: Anisotropic Diffusion in Image Processing. Teubner, Stuttgart, 1998.
- G. Aubert and P. Kornprobst: Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations. Second Edition, Springer, New York, 2006.
- T. F. Chan and J. Shen: Image Processing and Analysis: Variational, PDE, Wavelet, and Stochastic Methods. SIAM, Philadelphia, 2005.
- K. Bredies, D. Lorenz: Mathematical Image Processing. Birkhäuser, Basel, 2018.
- F. Cao: Geometric Curve Evolutions and Image Processing. Lecture Notes in Mathematics, Vol. 1805, Springer, Berlin, 2003.
- Articles from journals and conferences.