News

Exam Time

Written on 26.02.24 by Eddy Ilg

Dear Students, 

the exam time and place is:
28th February 2024,  2:00 pm - 5:00 pm
Geb. E2 2, Günter-Hotz-Hörsaal

In general you can find exam times at the bottom of this page:
https://saarland-informatics-campus.de/studium-studies/#study-calendar

Best, 

 

Read more

Dear Students, 

the exam time and place is:
28th February 2024,  2:00 pm - 5:00 pm
Geb. E2 2, Günter-Hotz-Hörsaal

In general you can find exam times at the bottom of this page:
https://saarland-informatics-campus.de/studium-studies/#study-calendar

Best, 

 

Eddy 

Assignment Grades

Written on 22.02.24 by Eddy Ilg

Dear Students, 

please find the assignment evaluation here:
https://docs.google.com/spreadsheets/d/1suDBViLj8DO2Wm_DlKwEnYgBSlVGgx-VU-307gBT-gc/edit?usp=sharing

Best, 

 

Eddy 

Looking for Hiwi

Written on 21.02.24 by Eddy Ilg

Dear Students, 

Michael Hahn is a close collaborator of our lab and looking for Hiwi to support an exciting project in the intersection of language, vision and neuroscience. The contract can be between 4 and 16 hours per week. Please find the lab website here: 
Read more

Dear Students, 

Michael Hahn is a close collaborator of our lab and looking for Hiwi to support an exciting project in the intersection of language, vision and neuroscience. The contract can be between 4 and 16 hours per week. Please find the lab website here: 
https://lacoco-lab.github.io/home/

To apply, please send transcripts and CV to:
mhahn@lst.uni-saarland.de

Best, 

 

Eddy

Registration for Exam Ends Today 23:39

Written on 21.02.24 by Eddy Ilg

Dear Students, 

this is just a notice that the registration for the exam ends tonight at 23:59. If you were admitted and would like to take the exam, please register in LSF. 

Best, 

 

Eddy 

Office Hours

Written on 20.02.24 by Eddy Ilg

Dear Students, 


we encourage you to come to the office hours to discuss the project, which many have already done. Please note:

  • On the upcoming Thursday I will be absent and only our PhD student Raza will be there 
  • Next week the office hours will be Monday 4-6pm and Friday 4-6pm instead… Read more

Dear Students, 


we encourage you to come to the office hours to discuss the project, which many have already done. Please note:

  • On the upcoming Thursday I will be absent and only our PhD student Raza will be there 
  • Next week the office hours will be Monday 4-6pm and Friday 4-6pm instead of Tuesday and Thursday 
  • The remaining office hours will Tuesdays and Thursdays 4-6pm 

Best, 

 

Eddy

Admission to Exam

Written on 20.02.24 by Eddy Ilg

Dear Students, 

please find the list of admitted students below. 

The following groups have been admitted to the exam: 
30, 19, 26, 7023705, 10, 13, 27, 16, 1, 12, 28, 25, 21, 14, 24, 11, 31, 7, 17

The following groups have not been admitted to the exam:
22

For the groups 13 and 14 we… Read more

Dear Students, 

please find the list of admitted students below. 

The following groups have been admitted to the exam: 
30, 19, 26, 7023705, 10, 13, 27, 16, 1, 12, 28, 25, 21, 14, 24, 11, 31, 7, 17

The following groups have not been admitted to the exam:
22

For the groups 13 and 14 we have detected a case of plagiarism. Please come talk to me during the project office hours. 

The following student IDs are admitted to the exam (please check): 
7059080
2551271
2576064
7058726
7059404
7012375
7015701
2581575
7023705
7046952
7026841
7040419
7039059
2578983
7047365
7007584
7028704
7041511
7038998
7043719
7047554
7044248
7039954
7044113
7002316
7046909
7043821
7040005
7024015
7047530
7047619
7047281
7028849
7047804
7047931
7039480
7047939
7023892
7047856
7055226
7012787
7059212
7058116
7056894
7055706
7056998
7047009
7058536
7058343
7047533
7055462
7058867
7058783
7047447


Best,

 

Eddy















 

 

Stage 1 Data v2 Online

Written on 19.02.24 (last change on 19.02.24) by Eddy Ilg

Dear Students, 

we have provided a new version of the stage 1 data with a scale invariant evaluation function. Please use the newly provided data. 

Best, 

 

Eddy

Important Information

Written on 18.02.24 by Eddy Ilg

Dear Students, 

please note the following important information: 

  • For the stage 1 data there is a scale ambiguity in the evaluation. We will release updated data tomorrow. 
  • Stage 2 data will follow shortly. 
  • The assignment results will be released on Tuesday during the day. This will… Read more

Dear Students, 

please note the following important information: 

  • For the stage 1 data there is a scale ambiguity in the evaluation. We will release updated data tomorrow. 
  • Stage 2 data will follow shortly. 
  • The assignment results will be released on Tuesday during the day. This will determine if you are admitted to the exam. From what we can currently tell, everyone who handed in assignments is likely to be admitted. In the unlikely case you are not admitted, please schedule a personal meeting with me on Tuesday if you would like to discuss the results. 
  • For everyone else, the assignment discussion will take place on Friday the 23rd from 1 - 6pm in my office (E17 1.06). 
  • Please note that your project grades will not be available for the registration of the re-exam. As discussed with the examination office, everyone in doubt of passing the course should register for the re-exam. When your project grades come out and indicate that you have passed, you will be automatically deregistered from the re-exam. 
  • Please note that you need to submit the code of your projects before the presentation on March 18th at 8m. Your submission needs to contain a short write-up explaining the equations in your code. The submission is open in the CMS system. 

Best, 

 

Eddy 

Assignment 6 Submission Extended

Written on 09.02.24 by Eddy Ilg

Dear Students, 

it seems there was an issue with the COLMAP assignment. In the virtual machine, you need to execute "conda activate base" instead of "conda activate colmap". 

To this end, we have granted an extension until Monday 8am for the… Read more

Dear Students, 

it seems there was an issue with the COLMAP assignment. In the virtual machine, you need to execute "conda activate base" instead of "conda activate colmap". 

To this end, we have granted an extension until Monday 8am for the assignment. 

Best, 

 

Eddy 

 

Project Stage 1 Data Online

Written on 06.02.24 by Eddy Ilg

Dear Students, 

please find the data and description for stage 1 of the project in the materials section. 

Best, 

 

Eddy

No Lecture on Friday the 9th

Written on 05.02.24 by Eddy Ilg

Dear Students, 


as mentioned in the lecture, due to a university event that I am required to attend on Friday, there will be no lecture. 

I have presented the project in the lecture today (see slides and recordings) and the data will be released today as well. The next meeting is the project… Read more

Dear Students, 


as mentioned in the lecture, due to a university event that I am required to attend on Friday, there will be no lecture. 

I have presented the project in the lecture today (see slides and recordings) and the data will be released today as well. The next meeting is the project office hours on Feb 13th from 4-6pm. 

 

Best, 

 

Eddy 
 

Assignment 6 Online

Written on 25.01.24 by Eddy Ilg

Dear students, 

please find the final assignment 6 online in the materials section. It is due Feb 9th 8am. 

Best, 

 

Eddy 

Assignment 5 Online

Written on 16.01.24 by Eddy Ilg

Dear Students, 

please find assignment 5 online. Note that it is due next Friday the 26th at 8am. 

Best, 

 

Eddy 

Course Evaluation Online (until 01/31)

Written on 15.01.24 by Eddy Ilg

Dear Students, 

it has been great to work with all of you so far, and I would like to thank everyone for attending the first 3D computer vision lectures! While it has been the first time for the course, and we know that some content still has to be improved, we would appreciate any feedback from… Read more

Dear Students, 

it has been great to work with all of you so far, and I would like to thank everyone for attending the first 3D computer vision lectures! While it has been the first time for the course, and we know that some content still has to be improved, we would appreciate any feedback from you that helps us improve the course even further in the future. Please take a few minutes to fill out the evaluation form: 

Lecture: 
https://qualis.uni-saarland.de/eva/?l=147024&p=9wbj4h

Tutorial:
https://qualis.uni-saarland.de/eva/?l=1470241&p=6d1o8w

Best, 

 

Eddy

Notes on Assigment 4

Written on 10.01.24 by Eddy Ilg

Dear students, 

a few notes regarding the assignment: 
- There is a spurious argument "i" to the function sgm(). Please remove it, it was from some old testing code. 
- You do not need to normalize image values (keep them between 0..255) 
- There was accidentally an "argmin" instead of a "min"… Read more

Dear students, 

a few notes regarding the assignment: 
- There is a spurious argument "i" to the function sgm(). Please remove it, it was from some old testing code. 
- You do not need to normalize image values (keep them between 0..255) 
- There was accidentally an "argmin" instead of a "min" in the slides. I will provide an updated version in a few minutes. 

Best, 

 

Eddy 

Assignment 4 Online and Merry Christmas

Written on 23.12.23 (last change on 23.12.23) by Eddy Ilg

Dear Students, 

the assignment 4 is online and is due Jan 12th. Please post any questions in the forum. 

You have been a great class in 2023, and it is great to work with you. I wish you a Merry Christmas and a Happy New Year! 

Best, 

 

Eddy

Lecture on 12/22

Written on 18.12.23 by Eddy Ilg

Dear Students, 

please note that there will be a lecture on the upcoming Friday, 12/22. There will be video recordings available. 

The next exercise will be release on this Friday. You will have the first two weeks to complete it. 

Please note that in the first week of January there are no… Read more

Dear Students, 

please note that there will be a lecture on the upcoming Friday, 12/22. There will be video recordings available. 

The next exercise will be release on this Friday. You will have the first two weeks to complete it. 

Please note that in the first week of January there are no lectures. 

Best, 

 

Eddy 

Assignment 3 Online

Written on 11.12.23 by Eddy Ilg

Dear Students, 

please find assignment 3 in the materials section and note that it is due next Monday 8am

Best, 

 

Eddy

Student Groups

Written on 08.12.23 by Eddy Ilg

Dear Students, 

our student Kunwar Maheep Singh is looking for a group. If there is a remaining spot in any group, please message him at kusi00001@stud.uni-saarland.de and update the Google spreadsheet at: 
Read more

Dear Students, 

our student Kunwar Maheep Singh is looking for a group. If there is a remaining spot in any group, please message him at kusi00001@stud.uni-saarland.de and update the Google spreadsheet at: 
https://docs.google.com/spreadsheets/d/1imQEpU-laCKUuoxVrZT477OLLg9CjenK2lGD-tdpbGI/edit?usp=sharing

Best, 

 

Eddy

Assignment 2 Correction

Written on 08.12.23 (last change on 08.12.23) by Eddy Ilg

Dear Students, 

unfortunately, there is a small error in assignment 2. Please note the following correction: 

In Q2, where it says:
"# Rotate the camera such that its z-axis points in the direction of the world x-axis"

this should be the "world y-axis". 


Best, 

 

Read more

Dear Students, 

unfortunately, there is a small error in assignment 2. Please note the following correction: 

In Q2, where it says:
"# Rotate the camera such that its z-axis points in the direction of the world x-axis"

this should be the "world y-axis". 


Best, 

 

Eddy

Assignment 2 Bonus

Written on 08.12.23 by Eddy Ilg

Dear Students, 

we have added a bonus question to the assignment 2. Please find it in the materials section. 

Best, 

Eddy 

Assignment 2 Online

Written on 05.12.23 (last change on 05.12.23) by Eddy Ilg

Dear Students, 

please find assignment 2 in the materials section and note that it is due next Monday 8am. 

Best, 

Eddy

Exercise and Lecture Tomorrow

Written on 03.12.23 by Eddy Ilg

Dear Students, 

tomorrow we will discuss exercise 1 and continue with the lecture. 

Please note that for the exercise discussion, there will be *no* video recordings, as we do not want that people from future semesters have access to the sample… Read more

Dear Students, 

tomorrow we will discuss exercise 1 and continue with the lecture. 

Please note that for the exercise discussion, there will be *no* video recordings, as we do not want that people from future semesters have access to the sample solutions. 

Best, 

 

Eddy 

Updated Keypoints for 2b and 2c and Deadline Extension

Written on 30.11.23 (last change on 30.11.23) by Eddy Ilg

Dear Students, 

thank you for pointing out that there was an issue with the keypoints for tasks 2b and 2c. Please find a zip file with updated keypoints in the materials section and use it accordingly. 

Due to my Covid infection and the update in keypoints, the deadline for the exercise was… Read more

Dear Students, 

thank you for pointing out that there was an issue with the keypoints for tasks 2b and 2c. Please find a zip file with updated keypoints in the materials section and use it accordingly. 

Due to my Covid infection and the update in keypoints, the deadline for the exercise was extended until Monday Dec 4th 8:00am

Best, 

 

Eddy

No Exercise Tomorrow

Written on 30.11.23 by Eddy Ilg

Dear Students, 

unfortunately, I am still struggling with the Covid infection, and there will be no class meeting tomorrow. 

The exercise deadline will be extended until Monday for which I will follow up with a post shortly. 

Monday will then be the exercise discussion and the two missed… Read more

Dear Students, 

unfortunately, I am still struggling with the Covid infection, and there will be no class meeting tomorrow. 

The exercise deadline will be extended until Monday for which I will follow up with a post shortly. 

Monday will then be the exercise discussion and the two missed lectures from last Monday and next Monday will be made available by video. 

I apologize for the inconvenience. 

Best, 

 

Eddy 

 

No lecture tomorrow due to COVID case

Written on 26.11.23 by Eddy Ilg

Dear Students, 

unfortunately, I have tested positive for COVID. Due to these circumstances, there will be no lecture tomorrow. 

I will provide the material as a video for everyone in the next days. 

Best, 

 

Eddy 

Group ID and Submission

Written on 26.11.23 by Eddy Ilg

Dear Students, 

I have extended the deadline, please try once more if you can register your team now. 

I have also created a submission that you can use for the upload. Please note that the deadline is on the upcoming Friday, 8am. 

Best, 

 

Eddy 

Group ID

Written on 20.11.23 by Eddy Ilg

Dear Students, 

please use the group ID from CMS. Please do NOT use the group ID from the spreadsheet. 

Best, 

Eddy 

Virtual Machine

Written on 15.11.23 by Eddy Ilg

Dear Students, 

please find the virtual machine online at:
https://oc.cs.uni-saarland.de/owncloud/index.php/s/kSdd6ifY2MmgirL

PLEASE NOTE: all submissions must be runnable in this virtual machine. 


Best, 

 

Eddy 

Assignment 1 Online

Written on 12.11.23 by Eddy Ilg

Dear Students, 

please find the assignment 1 in the Materials section. An updated virtual machine will be provided tomorrow. 

Best, 

 

Eddy 

Change in Upcoming Lectures

Written on 12.11.23 by Eddy Ilg

Dear students, 


due to CVPR deadline which affects myself as well as some of you, there will be a change in the upcoming lectures (please see the calendar):
- Tomorrow (11/13) there will be no lecture. I will be there to answer questions for the exercise if you have any. 
- Next Monday (11/20)… Read more

Dear students, 


due to CVPR deadline which affects myself as well as some of you, there will be a change in the upcoming lectures (please see the calendar):
- Tomorrow (11/13) there will be no lecture. I will be there to answer questions for the exercise if you have any. 
- Next Monday (11/20) there will be lecture 3. 
- Next Friday (11/24) there will be lecture 4. 

Apologies for the delay in releasing the excercise, it will be available soon. 

Best,  

 

Eddy

Submission Deadline Extended

Written on 10.11.23 by Eddy Ilg

Dear Students, 

we are still in the process of preparing exercise 1 and will release it tomorrow. 

Upon request, since there is CVPR deadline in a few days, the submission deadline of the exercise will be extended to Dec 1st. I will provide more information in the lecture on… Read more

Dear Students, 

we are still in the process of preparing exercise 1 and will release it tomorrow. 

Upon request, since there is CVPR deadline in a few days, the submission deadline of the exercise will be extended to Dec 1st. I will provide more information in the lecture on Monday. 

Best, 

 

Eddy 

E-Mails for Group Members

Written on 10.11.23 by Eddy Ilg

Dear Students, 

for those of you who don't know their group members yet - please also provide your E-Mail at:
https://docs.google.com/spreadsheets/d/1imQEpU-laCKUuoxVrZT477OLLg9CjenK2lGD-tdpbGI/edit?usp=sharing
such that your group members can contact you. 

Best, 

 

Eddy

Names and Immatriculation IDs

Written on 10.11.23 by Eddy Ilg

Just a reminder to please fill in your full names and matriculation IDs:

https://docs.google.com/spreadsheets/d/1imQEpU-laCKUuoxVrZT477OLLg9CjenK2lGD-tdpbGI/edit?usp=sharing

Groups and Virtual Machine

Written on 08.11.23 by Eddy Ilg

Dear Students, 

this is just a reminder to please register for groups in this spreadsheet:
https://docs.google.com/spreadsheets/d/1imQEpU-laCKUuoxVrZT477OLLg9CjenK2lGD-tdpbGI/edit?usp=sharing

and a reminder to please try out if you can use the virtual machine:
Read more

Dear Students, 

this is just a reminder to please register for groups in this spreadsheet:
https://docs.google.com/spreadsheets/d/1imQEpU-laCKUuoxVrZT477OLLg9CjenK2lGD-tdpbGI/edit?usp=sharing

and a reminder to please try out if you can use the virtual machine:
https://drive.google.com/file/d/1Lk4kTEZUhdtf-GBbQxzNxQs1Oo_0fFEU/view?usp=sharing
(password 3dcv_2324)

Best, 

 

Eddy 

Lecture on Friday (11/10)

Written on 06.11.23 by Eddy Ilg

Dear Students, 

please note that the upcoming Friday, we will have a lecture and tutorial to introduce the first exercise. 

Best, 

 

Eddy

Slides and Recordings Online

Written on 30.10.23 by Eddy Ilg

Dear Students, 

the slides for the introduction and first lecture as well as today's recording have been uploaded. Please let me know if you have any trouble accessing them. 

Best, 

 

Eddy

Course Contact E-Mail

Written on 26.10.23 (last change on 26.10.23) by Eddy Ilg

Please send all E-Mails regarding the course to: cvmp-3dvision@cs.uni-saarland.de. Please do not use my personal E-Mail. 

Location Changed

Written on 26.10.23 by Eddy Ilg

Hi everyone, 

please note: the location for the lecture and the exercises was changed to Gebäude E1 3 - Hörsaal I (0.01.1)

Best, 

 

Eddy 

Intro Lecture on Friday Oct. 27th

Written on 23.10.23 by Eddy Ilg

Hi everyone, 

the first introductory lecture will take place this Friday at 8:30am in Gebäude E1 3 - Hörsaal III (0.03.1). This lecture will give an overview of the field and the course material. 

After this, there will be a lecture every Monday at 8:30am and a tutorial every Friday at 8:30am in… Read more

Hi everyone, 

the first introductory lecture will take place this Friday at 8:30am in Gebäude E1 3 - Hörsaal III (0.03.1). This lecture will give an overview of the field and the course material. 

After this, there will be a lecture every Monday at 8:30am and a tutorial every Friday at 8:30am in the same location. 

Looking forward to seeing you, 
 

Eddy

Course Registration Open

Written on 23.10.23 by Eddy Ilg

Hi everyone, 

the course registration on CMS is now open. Please contact me if you have issues registering.

Eddy

Lecture extended to 9 ECTS

Written on 02.10.23 by Eddy Ilg

Dear Students, 
 

in the end of the lecture, there will be an exciting project on building your own SLAM pipeline. Due to the additional work, we decided to extend the lecture to 9 credit points similar to the lecture Neural Networks: Theory and Implementation. 

Best, 

 

Eddy … Read more

Dear Students, 
 

in the end of the lecture, there will be an exciting project on building your own SLAM pipeline. Due to the additional work, we decided to extend the lecture to 9 credit points similar to the lecture Neural Networks: Theory and Implementation. 

Best, 

 

Eddy   

New 3D Computer Vision Lectures

Written on 25.07.23 (last change on 25.07.23) by Eddy Ilg

The CVMP lab will offer the new lectures “3D Computer Vision” and “3D Real World Modeling and Inference” in upcoming winter and summer semesters.

The 3D Computer Vision lecture will teach you the fundamentals of going from 2D images to 3D. After having given an intuition of the field and… Read more

The CVMP lab will offer the new lectures “3D Computer Vision” and “3D Real World Modeling and Inference” in upcoming winter and summer semesters.

The 3D Computer Vision lecture will teach you the fundamentals of going from 2D images to 3D. After having given an intuition of the field and traditional methods, it will proceed to state-of-the-art approaches and provide you with a basis for working in 3D vision. The lecture will cover the mathematical fundamentals, feature matching, stereo, optical flow and scene flow estimation, rigid 3D reconstruction, non-rigid 3D reconstruction and SLAM. 

The 3D Real World Modeling and Inference lecture will teach you how to design models in 3D. It will start with introducing the basic 3D representations ranging from point clouds to meshes, triplanes and voxel grids. Basic and modern deep learning techniques to train and perform inference on these representations will be introduced. Afterwards, the recent implicit representations such as NeRF and DeepSDF with MLPs and how to encode 3D scenes with them efficiently will be covered. Many modern models involve generative models and subsequently the basics of generative models from autodecoders to GANs and finally diffusion models will be presented.

Show all

3D Computer Vision

 

Summary

Computer vision has led to many recent technology breakthroughs and is today one of the most demanded fields. 3D computer vision is becoming increasingly important, and the field has recently shown remarkable progress.

This lecture will teach you the fundamentals of 3D computer vision. After having given an intuition of the field and traditional methods, it will proceed to state-of-the-art approaches and provide you with a basis for working on any 3D computer vision approaches.

The lecture starts with fundamentals on projective geometry and sensor devices. It will then dive into correspondence and depth estimation techniques that provide the foundation of 3D reconstruction. Starting with feature extraction and matching, the lecture will continue with stereo depth estimation, optical flow and scene flow estimation. Having covered the fundamentals, the lecture will proceed to complete reconstruction pipelines ranging from SfM, COLMAP and KinectFusion to the modern deep learning techniques NeRF and NeuS.

The lecture will then advance to online reconstruction with simultaneous localization and mapping (SLAM) approaches and show applications in autonomous driving and AR technology. Finally, the lecture will conclude with the most challenging discipline of generic non-rigid reconstruction.

The lecture will be accompanied by hands-on exercises comprised of sheets and coding tasks. Towards the end of the lecture, there will be and challenging and fun project to set up a simple complete SLAM pipeline.

The lecture is the prerequisite for the 3D Real World Modeling and Inference lecture that will be held in summer and presents the foundation of modern deep learning techniques in 3D.

The lecture is offered by the Computer Vision and Perception Lab that focuses on building the next generation machine perception algorithms. Please contact ilg@cs.uni-saarland.de if you are interested in working with the lab.

Requirements

  • As a prerequisite for this course, you must have taken either “High Level Computer Vision” or “Neural Networks: Theory and Implementation” with the computer vision project in the end. You must be familiar with CNNs and how to implement and train them with PyTorch.
  • Having taken “Computer Graphics” and “Image Processing and Computer Vision” is helpful, but not required.

Credit Points

9 ECTS (advanced lecture with project)

Lecturer 

Prof. Eddy Ilg 

Syllabus

Lecture 1: Acquisition Devices (RGB-, ToF-, Event-Cameras; LIDARs; IMUs) and Calibration
Lecture 2: Feature Extraction and Matching
Lecture 3: Projective Geometry and Image Formation, Part 1
Lecture 4: Projective Geometry and Image Formation, Part 2
Lecture 5: Rotations and Spherical Harmonics
Lecture 6: Stereo Depth Estimation Methods
Lecture 7: Optical Flow Estimation Methods
Lecture 8: Scene Flow Estimation Methods
Lecture 9: Rigid 3D Reconstruction: SfM, COMAP, KinectFusion, Sphere Tracing and Implicit Rep.
Lecture 10: Rigid 3D Reconstruction: Volumetric Representations (NeRF + NeuS)
Lecture 11: Visual Localization
Lecture 12: Simultaneous Localization and Mapping (SLAM) and Autonomous Driving
Lecture 13: Non-Rigid 3D Reconstruction (DynamicFusion, OcclusionFusion)
Lecture 14: Non-Rigid 3D Reconstruction (NeRFies, NeuS2, DynIBaR)

Exercises

Excercise 1: Geometry Fundamentals
Excercise 2: Estimating Poses with COLMAP and Visualizing Camera Rays
Excercise 3: Feature Matching with HoG and Deep-Learned Features
Excercise 4: Semi-Global Matching for Stereo Depth Estimation
Excercise 5: FlowNet for Optical Flow Estimation
Project: Implementing and Running a SLAM Pipeline

Privacy Policy | Legal Notice
If you encounter technical problems, please contact the administrators.