phy731 - Compulsory Optional Subject Theory

phy731 - Compulsory Optional Subject Theory

Institute of Physics 6 KP
Module components Semester courses Summer semester 2024 Examination
Lecture
  • Unlimited access 2.01.5402 - Trustworthy Machine Learning Show lecturers
    • Prof. Dr. Nils Strodthoff
    • Tiezhi Wang

    Monday: 12:00 - 14:00, weekly (from 08/04/24)
    Thursday: 08:00 - 10:00, weekly (from 04/04/24)
    Machine learning algorithms find its way into an increasing number of (safety-critical) application domains but their quality is rarely assessed in a systematic way. The focus of this module are quality criteria for machine learning algorithms, in particular of deep neural networks, ranging from performance evaluation over explainability/interpretability (XAI), robustness (adversarial robustness, robustness against input perturbations), uncertainty quantification, distribution shift, domain adaptation, fairness/bias to privacy. The methods are introduced theoretically in the lecture and implemented/applied practically in the exercises. Prerequisites are basic theoretical knowledge in machine learning, programming skills in Python and ideally practical knowledge in training neural networks.
  • Unlimited access 5.04.4012 - Informationsverarbeitung und Kommunikation / Information Processing and Communication Show lecturers
    • Priv.-Doz. Dr. Jörn Anemüller

    Thursday: 10:00 - 12:00, weekly (from 04/04/24)
    Course topics: - Information processing in the brain, neurons, receptive fields - Simple classification models, the perceptron, linear discriminant analysis, regression approach to classification - Generative approaches, k-nearest neighbour classification, Bayes equation - Model selection and cross-validation - Logistic regression, binary cross-entropy loss function, gradient descent - Gradient descent optimization and regularization, multi-layer perceptron and error backpropagation - Convolutional networks, deep neural networks, receptive fields in deep netoworks - Reinforcement learning - Sequence modeling, speech recognition, markov chains, hidden markov model (HMMs) - Transformer deep networks, large language models (LLMs), from HMMs to LLMs - Information theory, measuring information, entropy - Information theory continued, entropy bound for coding, compression The course language is English or German, with English used by default and German used in case of only German native language speakers taking the course.
  • Unlimited access 5.04.4215 - Machine Learning II – Advanced Learning and Inference Methods Show lecturers
    • Prof. Dr. Jörg Lücke

    Thursday: 10:00 - 12:00, weekly (from 04/04/24), Location: V03 0-D001, V03 0-C003
    The students will deepen their knowledge on mathematical models of data and sensory signals. Building up on the previously acquired Machine Learning models and methods, the students will be lead closer to current research topics and will learn about models that currently represent the state-of-the-art. Based on these models, the students will be exposed to the typical theoretical and practical challenges in the development of current Machine Learning algorithms. Typical such challenges are analytical and computational intractabilities, or local optima problems. Based on concrete examples, the students will learn how to address such problems. Applications to different data will teach skills to use the appropriate model for a desired task and the ability to interpret an algorithm’s result as well as ways for further improvements. Furthermore, the students will learn interpretations of biological and artificial intelligence based on state-of-the-art Machine Learning models. Contents: This course builds up on the basic models and methods introduced in introductory Machine Learning lectures. Advanced Machine Learning models will be introduced alongside methods for efficient parameter optimization. Analytical approximations for computationally intractable models will be defined and discussed as well as stochastic (Monte Carlo) approximations. Advantages of different approximations will be contrasted with their potential disadvantages. Advanced models in the lecture will include models for clustering, classification, recognition, denoising, compression, dimensionality reduction, deep learning, tracking etc. Typical application domains will be general pattern recognition, computational neuroscience and sensory data models including computer hearing and computer vision.
  • Unlimited access 5.04.4586 - Digital Signal Processing Show lecturers
    • Prof. Dr. Simon Doclo

    Monday: 16:00 - 18:00, weekly (from 08/04/24)
    Engineering Physics: Alternative für Signal- und Systemtheorie
  • Unlimited access 5.04.4643 - Adaptive systems for speech signal processing Show lecturers
    • Prof. Dr. Gerald Enzner

    Monday: 12:00 - 14:00, weekly (from 08/04/24)
    Monday: 14:00 - 16:00, weekly (from 08/04/24)
    The students gain a broad operational perspective for the design of speech adaptive systems and respective algorithms with a particular focus on adaptive digital filters. The important NLMS, RLS, FDAF and Kalman-Filter algorithms can be derived from fundamental principles. Diverse applications from speech and acoustic signal processing deliver practical insight into the utilization of the fundamentals, for instance, in acoustic noise reduction, echo cancellation, dereverberation, acoustic channel estimation and equalization. However, the acquired knowledge allows for a broader interpretation in the context of engineering and physics. The computer exercises of larger scale will teach the students to argue, select and evaluate algorithms for the problem at hand. By discussion in the panel, students learn to demonstrate, defend and trade their solution against others. Theoretical exercises finally deliver the ability to argue and prove a speech processing design with the appropriate vocabulary.
Seminar
Exercises
  • Unlimited access 2.01.5402 - Trustworthy Machine Learning Show lecturers
    • Prof. Dr. Nils Strodthoff
    • Tiezhi Wang

    Monday: 12:00 - 14:00, weekly (from 08/04/24)
    Thursday: 08:00 - 10:00, weekly (from 04/04/24)
    Machine learning algorithms find its way into an increasing number of (safety-critical) application domains but their quality is rarely assessed in a systematic way. The focus of this module are quality criteria for machine learning algorithms, in particular of deep neural networks, ranging from performance evaluation over explainability/interpretability (XAI), robustness (adversarial robustness, robustness against input perturbations), uncertainty quantification, distribution shift, domain adaptation, fairness/bias to privacy. The methods are introduced theoretically in the lecture and implemented/applied practically in the exercises. Prerequisites are basic theoretical knowledge in machine learning, programming skills in Python and ideally practical knowledge in training neural networks.
  • Unlimited access 5.04.4012 Ü1 - Übung zu Informationsverarbeitung und Kommunikation / Information Processing and Communication Show lecturers
    • Priv.-Doz. Dr. Jörn Anemüller
    • Eike Jannik Nustede, M. Sc.

    Tuesday: 16:00 - 18:00, weekly (from 09/04/24)
    Die Studierenden erlernen, wie statistische Eigenschaften von Signalen zur Lösung von Problemen der Angewandten Physik, insbesondere der Klassifikation, parametrischen Modellierung und Übertragung von Signalen genutzt werden können. Theoretische Lernziele beinhalten damit eine Wiederholung und Festigung statistischer Grundlagen und eine Verständnis von deren Nutzung für Algorithmen unterschiedlicher Zielsetzung und Komplexität. Im praktischen Teil werden Eigenschaften der behandelten Methoden selbständig erarbeitet sowie Algorithmen auf dem Rechner implementiert und auf reale Daten angewendet, so daß der Umgang mit theoretischen Konzepten und ihre praktische Umsetzung erlernt werden. Inhalte: Grundfragen der Informationsverarbeitung (Klassifikation, Regression, Clustering), Lösungsmethoden basierend auf Dichteschätzung und diskriminativen Ansätzen (z.B. Bayes Schätzung, k-nearest neighbour, Hauptkomponentenanalyse, support-vector-machines, Hidden-Markov- Modelle), Grundlagen der Informationstheorie, Methoden der analogen und digitalen Nachrichtenübertragung, Prinzipien der Kanalcodierung und Kompression
  • Unlimited access 5.04.4215 Ü1 - Exercises to Machine Learning II – Advanced Learning and Inference Methods Show lecturers
    • Prof. Dr. Jörg Lücke
    • Dmytro Velychko
    • Sebastian Salwig
    • Veranika Boukun
    • Yidi Ke

    Tuesday: 10:00 - 12:00, weekly (from 09/04/24), Übung
    The students will deepen their knowledge on mathematical models of data and sensory signals. Building up on the previously acquired Machine Learning models and methods, the students will be lead closer to current research topics and will learn about models that currently represent the state-of-the-art. Based on these models, the students will be exposed to the typical theoretical and practical challenges in the development of current Machine Learning algorithms. Typical such challenges are analytical and computational intractabilities, or local optima problems. Based on concrete examples, the students will learn how to address such problems. Applications to different data will teach skills to use the appropriate model for a desired task and the ability to interpret an algorithm’s result as well as ways for further improvements. Furthermore, the students will learn interpretations of biological and artificial intelligence based on state-of-the-art Machine Learning models. Contents: This course builds up on the basic models and methods introduced in introductory Machine Learning lectures. Advanced Machine Learning models will be introduced alongside methods for efficient parameter optimization. Analytical approximations for computationally intractable models will be defined and discussed as well as stochastic (Monte Carlo) approximations. Advantages of different approximations will be contrasted with their potential disadvantages. Advanced models in the lecture will include models for clustering, classification, recognition, denoising, compression, dimensionality reduction, deep learning, tracking etc. Typical application domains will be general pattern recognition, computational neuroscience and sensory data models including computer hearing and computer vision.
  • Unlimited access 5.04.4215 Ü2 - Exercises to Machine Learning II – Advanced Learning and Inference Methods Show lecturers
    • Prof. Dr. Jörg Lücke
    • Dmytro Velychko
    • Till Kahlke
    • Dr. rer. nat. Seyyed Hamid Mousavi Hashemi

    Tuesday: 14:00 - 16:00, weekly (from 09/04/24), Übung
    The students will deepen their knowledge on mathematical models of data and sensory signals. Building up on the previously acquired Machine Learning models and methods, the students will be lead closer to current research topics and will learn about models that currently represent the state-of-the-art. Based on these models, the students will be exposed to the typical theoretical and practical challenges in the development of current Machine Learning algorithms. Typical such challenges are analytical and computational intractabilities, or local optima problems. Based on concrete examples, the students will learn how to address such problems. Applications to different data will teach skills to use the appropriate model for a desired task and the ability to interpret an algorithm’s result as well as ways for further improvements. Furthermore, the students will learn interpretations of biological and artificial intelligence based on state-of-the-art Machine Learning models. Contents: This course builds up on the basic models and methods introduced in introductory Machine Learning lectures. Advanced Machine Learning models will be introduced alongside methods for efficient parameter optimization. Analytical approximations for computationally intractable models will be defined and discussed as well as stochastic (Monte Carlo) approximations. Advantages of different approximations will be contrasted with their potential disadvantages. Advanced models in the lecture will include models for clustering, classification, recognition, denoising, compression, dimensionality reduction, deep learning, tracking etc. Typical application domains will be general pattern recognition, computational neuroscience and sensory data models including computer hearing and computer vision.
  • Unlimited access 5.04.4586 Ü1 - Exercises to Digital Signal Processing Show lecturers
    • Wiebke Middelberg, M. Sc.
    • Klaus Brümann

    Wednesday: 12:00 - 14:00, weekly (from 03/04/24)
    Engineering Physics: Alternative für Signal- und Systemtheorie
  • Unlimited access 5.04.4643 - Adaptive systems for speech signal processing Show lecturers
    • Prof. Dr. Gerald Enzner

    Monday: 12:00 - 14:00, weekly (from 08/04/24)
    Monday: 14:00 - 16:00, weekly (from 08/04/24)
    The students gain a broad operational perspective for the design of speech adaptive systems and respective algorithms with a particular focus on adaptive digital filters. The important NLMS, RLS, FDAF and Kalman-Filter algorithms can be derived from fundamental principles. Diverse applications from speech and acoustic signal processing deliver practical insight into the utilization of the fundamentals, for instance, in acoustic noise reduction, echo cancellation, dereverberation, acoustic channel estimation and equalization. However, the acquired knowledge allows for a broader interpretation in the context of engineering and physics. The computer exercises of larger scale will teach the students to argue, select and evaluate algorithms for the problem at hand. By discussion in the panel, students learn to demonstrate, defend and trade their solution against others. Theoretical exercises finally deliver the ability to argue and prove a speech processing design with the appropriate vocabulary.
Hinweise zum Modul
Prerequisites
Bachelor in Physik, Technik und Medizin oder entsprechender Abschluss
Module examination
M
Skills to be acquired in this module
Die Studierenden erwerben die theoretischen Voraussetzungen für die numerische und analytische Modellierung komplexer Vorgänge in der Medizin, Biologie und Biophysik, und wenden Forschungsmethoden des Exzellenzcluster Hearing4all im Modellierungsbereich an. Spezielle Kompetenzen abhängig von der gewählten Veranstaltung.

Top