Lecture: 5.04.4012 Informationsverarbeitung und Kommunikation / Information Processing and Communication - Details
You are not logged into Stud.IP.
Course name Lecture: 5.04.4012 Informationsverarbeitung und Kommunikation / Information Processing and Communication
Subtitle Schwerpunkt: Akustik und Signalverarbeitung
Course number 5.04.4012
Semester
SoSe2023
Current number of participants
23
expected number of participants
28
Home institute
Institute of Physics
Courses type
Lecture in category Teaching
Next date Thursday, 01.06.2023 12:15 - 13:45, Room: W16A 015/016
Type/Form V
Pre-requisites
Kenntnisse der Inhalte aus den Veranstaltungen Lineare Algebra, Mathematische Methoden der Physik, Messtechnik und Block-Praktikum Digitale Signalverarbeitung (FPR-B)
Performance record
Exam or presentation or oral exam or homework or practical report
Lehrsprache
deutsch und englisch
ECTS points
6
Course topics:
Information processing in the brain, neurons, receptive fields Simple classification models, the perceptron, linear discriminant analysis, regression approach to classification Generative approaches, k-nearest neighbour classification, Bayes equation Model selection and cross-validation Logistic regression, binary cross-entropy loss function, gradient descent Gradient descent optimization and regularization, multi-layer perceptron and error backpropagation Convolutional networks, deep neural networks, receptive fields in deep netoworks Reinforcement learning Sequence modeling, speech recognition, markov chains, hidden markov model (HMMs) Transformer deep networks, large language models (LLMs), from HMMs to LLMs Information theory, measuring information, entropy Information theory continued, entropy bound for coding, compression
