News
Assignment 01Written on 17.04.25 by Luca Gretscher Dear students, we have just uploaded Assignment 01. The solutions will be published after the mini-test next week. Kind regards, |
Reminder: Mini-Test Slot RegistrationWritten on 14.04.25 by Luca Gretscher Dear students, we would like to remind you to register for a mini-test slot. Currently, we offer two mini-test slots at the following times: Registration is mandatory to attend the mini-tests and works on a… Read more Dear students, we would like to remind you to register for a mini-test slot. Currently, we offer two mini-test slots at the following times: Registration is mandatory to attend the mini-tests and works on a first-come-first-served basis. Depending on the number of students, we will add a third slot from 12:45 - 13:00 or in parallel to one of the other two slots, s.t. everyone who wants to attend the mini-tests will be able to register. More information about the mini-test procedure will follow after the registration has been closed. Please register for a mini-test slot on your personal status page by Sunday, 20.04.2025, 23:59! Kind regards, |
Reminder: Tutorial PreferencesWritten on 14.04.25 by Luca Gretscher Dear students, we would like to remind you to set your preferences for the tutorials starting next week. We offer eight regular tutorials at the following times: Dear students, we would like to remind you to set your preferences for the tutorials starting next week. We offer eight regular tutorials at the following times: In the tutorials, you have the opportunity to briefly discuss the solution of the previous assignment sheet and to inspect your mini-test. However, the main focus will be a recap of the lecture material by providing additional exercises. Please note, that both the solutions of the assignment sheets as well as the tutorial slides including solutions will be timely uploaded to our Materials. Because of this, experience has shown that some students will not attend the tutorials in person. Therefore, we also created an additional (pseudo) tutorial (Slot 1: Wednesday, 00:00). Please give preference to this tutorial if you do not plan to attend the tutorials in general and rule out the other tutorial choices. With this, we can allow students that plan to attend, to more likely get their preferred choice. Furthermore, we can better assess how many in-person tutorials we really need. Of course, you can always attend a tutorial if you change your mind. Please submit your tutorial preferences on your personal status page by Sunday, 20.04.2025, 23:59! Kind regards, |
DockerWritten on 14.04.25 by Luca Gretscher Dear students, in the course of this lecture, we will use Python and in particular Jupyter Notebooks to explain various concepts. For a few notebooks, we also require additional software (e.g. PostgreSQL). Therefore, we provide a Virtual Machine using Docker that has all the required software and… Read more Dear students, in the course of this lecture, we will use Python and in particular Jupyter Notebooks to explain various concepts. For a few notebooks, we also require additional software (e.g. PostgreSQL). Therefore, we provide a Virtual Machine using Docker that has all the required software and systems already installed. You can find detailed instructions at the following Github repository. The link is also available under Information > Docker. We spent a lot of time preparing the tools and the instructions. Please read them carefully before asking questions. Please note, that you are also able to run most of the notebooks by just having a Python installation with the required packages. For more information see Information > Manual Installation. If you still have problems with the installation, you can always ask a question in the forum (BDE25 > Technical). Additionally, there will be a special Docker support office hour on Tuesday, 15.04.2025, 12:15 - 14:00 in E2 2 - Lecture Hall 0.01 (Günter-Hotz). Kind regards, |
Big Data Engineering
This course covers the fundamentals of data management and query processing.
- Learn basic techniques in "Big Data Engineering" conceptually.
- Learn to apply basic techniques in "Big Data Engineering".
- Help you not to reinvent the wheel later.
- Learn to map new problems to existing problems and solve them using established techniques.
- Raise awareness for problems of important applications: Privacy, deanonymization, ethical issues.
- Raise awareness for solutions of important applications: Effort, performance, robustness, extensibility, maintainability.
Lecture
The lecture takes place every Thursday at 10:15 in building E2 2 - lecture hall 0.01 (Günter-Hotz-Hörsaal). The recording of the lecture will be uploaded to YouTube afterwards. The lecture was awarded with two busy beaver teaching awards (2011, 2021) and three busy beaver honorable mentions (2022, 2023, 2024).
Tutorials
On Wednesdays, there will be tutorials. In the tutorials there will be both exercises and the possibility to ask questions regarding the assignment sheets, the mini-tests, and the lectures. Please indicate your preferred tutorial timeslots on your personal status page by 23:59 on 20.04.2025. We will then assign you to your tutorial. If you are unable to attend on your assigned date at some point, you are welcome to attend another tutorial. The tutorials will start in the third week on 23.04.2025.
Office Hours
In addition to the tutorials, there will be an Office Hour on Mondays 10:15 - 11:45 in the seminar room E1.1, 3.06. In the Office Hour you can ask questions about the lectures and the assignment sheets, as well as get help with technical problems.
Assignment Sheets
During the day after each lecture we publish an assignment sheet with tasks related to the lecture under Materials. These usually consist of three written exercises and one programming exercise. Assignment sheets are voluntary and are intended as practice for the mini-tests and the exams.
Mini-Tests
On Tuesdays at 12:15 in building E2 2 - lecture hall 0.01 (Günter-Hotz-Hörsaal), there will be mandatory mini-tests with tasks related to the topics covered in the lecture the week before. Afterwards, your mini-test will be corrected by our team and you will receive points via CMS. Please register for a mini-test timeslots on your personal status page by 23:59 on 20.04.2025. This timeslot must not be changed during the semester. More information about the exact dates for the mini-tests can be found in the Timetable.
Project
Near the end of the lecture, there will be a small project for which you have to develop a toy backend server for a social network. The project is to be completed by you in groups of 3-4 students. Your points will be determined by functional tests and the quality of your code together with the outcome of a short code review. Note that all team members must know and understand all code. Team members who are not able to explain parts of the code do not get points for the project. More information about the exact dates for the release and the submission of the project and for the code reviews can be found in the Timetable.
Exam Admission
To be eligible for the written exam and/or re-exam, you must achieve at least 50% of the possible points in the mini-tests and at least 50% in the project separately. Additionally, no more than two mini-tests may be graded with 0 points.
Exam
At the end of the semester there will be both a written exam and a re-exam.
- Exam: 29.07.2025 12:00 - 14:00
- Re-Exam: 25.09.2025 14:00 - 16:00
Grade
The better result of the written exam and the re-exam determines 100% of the final grade. In order to pass the lecture, at least 50% of the points must be achieved in the written exam or the re-exam.