Deep Probabilistic Generative Models

With the development of neural networks and increased computational power, deep generative modeling has emerged as one of the leading directions in AI. We are shifting from traditional discriminative tasks (such as classification, segmentation, or clustering), which focus on modeling conditional distributions, to a more comprehensive framework aimed at modeling the joint distribution of the data itself. Discriminative models alone can be insufficient for robust decision-making and the development of intelligent systems, as it is also necessary to understand the underlying data-generating process and be able to express uncertainty about the environment.

Typically, in deep learning literature, generative models are viewed as methods for synthesizing new data. However, in this seminar, we will adopt a probabilistic perspective to highlight that modeling the marginal likelihood of the data has much broader applicability, and this could be essential for building successful AI systems.

In this seminar, we will ask ourselves how to formulate deep generative models (i.e., how to express and learn the marginal likelihood of the data) and explore the different approaches proposed in the literature. The aim is for students to critically assess existing methods, understand their strengths and limitations, and identify potential directions for future research.

- Block 1: Explicit Density Models (VAEs and Flows)

- Block 2: Implicit Density Models (GANs and DDPMs)

- Block 3: Multimodal Generation

Each block includes a paper sessions and a panel discussion, as detailed below. Student evaluation is based on their presentations, active participation in discussions, and a final report summarizing the seminar topics, offering critical analysis, identifying limitations, and suggesting potential research directions.

 

Date	Block	Content
28/10/2025 (12:15 - 13:45)	Background Session	Introduction to probabilistic modeling
04/11/2025 (12:15 - 13:45)	Background Session	Introduction to generative modeling
11/11/2025 (12:15 - 13:45)	Block 1 - Explicit Density Models	Paper presentations + Q&A
18/11/2025 (12:15 - 13:45)	Block 1 - Explicit Density Models	Panel discussion
09/12/2025 (12:15 - 13:45)	Block 2 - Implicit Density Models	Paper presentations + Q&A
16/12/2025 (12:15 - 13:45)	Block 2 - Implicit Density Models	Panel discussion
13/01/2026 (12:15 - 13:45)	Block 3 - Multimodal Generation	Paper presentations + Q&A
20/01/2026 (12:15 - 13:45)	Block 3 - Multimodal Generation	Panel discussion

 

 

Attendance

The seminar will be held in person, and attendance is required. Students may miss no more than two sessions without providing a justification.

Deliverables and Grading Scheme

• Paper Presentation (15 minutes) (40%)

  • Submission (requirement): Students should submit a pdf file with the slides the day they are presenting.
  • Context
    • Positioning of the paper within the state of the art and identification of gaps the paper addresses.
    • Clear articulation of What/Why/How.
  • Content
    • Clear explanation of the paper's core intuition and methodology.
    • Rationale behind experiments and significance of results.
    • Advantages and disadvantages of the method presented.
    • Final slide/section presenting the take-home messages.
  • Q&A
    • Responding questions from TAs and audience.

• Discussion Session (20%)

  • Pre-Submission Requirements
    • Each participant must submit one discussion question per block. This requirement is mandatory for students who did not present a paper in that block.
    • Submission deadline: 2 days before the session via CMS.
  • Participation Expectations
    • For Presenters:
      • Active engagement answering the questions.
      • Facilitating broader discussion.
    • For Listeners:
      • Quality of pre-submitted questions.
      • Active participation in discussions.

• Final Report (6-8 pages, excluding references) (40%)

  • Template: https://www.overleaf.com/read/tsdwmchpkmms#16f2eb

  • Critical Analysis
    • Comprehensive summary of the seminar, including the key points from the papers presented and discussion sessions.
    • Comprehensive analysis regarding limitations, advantages, and open challenges in the field.
    • Connect the the discussion with broader research context, beyond the papers discussed in the seminar.
  • Evaluation Criteria
    • Content
      • Depth of the analysis.
      • Demonstration of understanding across all three seminar blocks.
      • Synthesis of seminar content with broader research context.
    • Delivery
      • Quality of writing and argumentation.