Moses - Information Theory and Applications

Display language

To modulepage Generate PDF

Module / Version:
#40981 / #1

Validity:
Seit SoSe 2020

Default display language:
English

Module title:
Information Theory and Applications

Credits:
6

Responsible person:
Caire, Giuseppe

Grading:
benotet

Type of exam:
Portfolioprüfung

Zugehörigkeit

Faculty:
Fakultät IV

Institute:
Institut für Telekommunikationssysteme

Area of expertise:
34331600 FG Theoretische Grundlagen der Kommunikationstechnik

Prüfungsausschuss:
No information

Kontakt

Office:
HFT 6

Contact person:
Caire, Giuseppe

E-mail address:
caire@tu-berlin.de

Website:

http://www.commit.tu-berlin.de

Learning Outcomes

At the end of this module the students will have acquired a deep knowledge of the fundamental concepts of information theory and will be able to apply such concepts to advanced applications in multiuser communication networks, channel coding, and source coding. The students will be able to analyze simple information theoretic problems by computing the entropy of a discrete source, the rate-distortion function for a continuous source with a given fidelity criterion, and the channel capacity of memoryless discrete and continuous channels. Through the lecture and the exercises, the students will apply the learned fundamental concepts to advanced problems, with applications to source coding and channel coding in a multiuser/network scenario, and will be able to implement in software and verify by computer simulation state of the art algorithms in source coding and channel coding.

Content

- Definition and main properties of entropy, cross-entropy (information divergence) and mutual information - Fundamental Limits of data compression; - Fundamental Limits of Data Transmission and Channel capacity; - Fundamental limits of source compression (rate-distortion theory); - Multiple Access Channel and Broadcast Channels as models for the uplink and downlink of wireless networks - Coping with interference - Relaying networks - Project work

Module Components

Pflichtgruppe:

All Courses are mandatory.

Course Name	Type	Number	Cycle	Language	SWS	VZ
Information Theory and Applications	VL	34331600 L 011	SoSe	English	2
Information Theory and Applications	UE	34331600 L 012	SoSe	English	2

Workload and Credit Points

Information Theory and Applications (VL):

Workload description	Multiplier	Hours	Total
Attendance	15.0	2.0h	30.0h
Examination preparation	1.0	30.0h	30.0h
Pre/post processing	15.0	2.0h	30.0h
			90.0h(~3 LP)

Information Theory and Applications (UE):

Workload description	Multiplier	Hours	Total
Attendance	15.0	2.0h	30.0h
Examination preparation	1.0	30.0h	30.0h
Pre/post processing	15.0	2.0h	30.0h
			90.0h(~3 LP)

The Workload of the module sums up to 180.0 Hours. Therefore the module contains 6 Credits.

Description of Teaching and Learning Methods

The first component of the module consists of conventional frontal teaching in class, developing theoretical and mathematical concepts, exercises developed in class, in order to develop problem-solving skills and reinforce comprehension of the theory, proposed homework exercises in order to develop independent and autonomous thinking skills in the students. The second component of the module consists of independent reading and project work development, and preparation of a scientific presentation, training the students to develop independent thinking, spirit of initiative, and ability to present their findings in a scientific conference-like environment.

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

Students must have taken the module Foundations of Stochastic Processes (40256). Special permission can be granted on a case by case basis. In this case, students should contact directly Prof. Caire.

Mandatory requirements for the module test application:

This module has no requirements.

Module completion

Grading

graded

Type of exam

Portfolio examination

Type of portfolio examination

100 Punkte insgesamt

Language

English

Test elements

Name	Points	Categorie	Duration/Extent
(Examination) Midterm test	20	written	60 minutes
(Examination) Final test	30	written	60 minutes
(Deliverable assessment) Project presentation and oral discussion	50	oral	30 minutes

Grading scale

Notenschlüssel »Notenschlüssel 3: Fak IV (3)«

Gesamtpunktzahl	1.0	1.3	1.7	2.0	2.3	2.7	3.0	3.3	3.7	4.0
100.0pt	85.0pt	80.0pt	75.0pt	70.0pt	65.0pt	60.0pt	55.0pt	50.0pt	45.0pt	40.0pt

Test description (Module completion)

The final grade according to § 47 (2) AllgStuPO will be calculated according to Notenschlüssel 3 of Faculty IV.

Duration of the Module

The following number of semesters is estimated for taking and completing the module:
1 Semester.

This module may be commenced in the following semesters:
Sommersemester.

Maximum Number of Participants

This module is not limited to a number of students.

Registration Procedures

The examination registration is running with Qispos.

Recommended literature
T. Cover and J. Thomas, Elements of Information Theory, 2nd Ed., Wiley Interscience, 2006.
El Gamal, Abbas, and Young-Han Kim. Network information theory. Cambridge University Press, 2011.

Assigned Degree Programs

Semester:

Zeige auch ausgelaufene Studiengänge und StuPOs

This module is used in the following Degree Programs (new System):

Studiengang / StuPO	StuPOs	Verwendungen	Erste Verwendung	Letzte Verwendung
Computer Engineering (M. Sc.)	1	45	SoSe 2020	SoSe 2024
Computer Science (Informatik) (M. Sc.)	1	36	SoSe 2020	SoSe 2024
Elektrotechnik (M. Sc.)	1	34	SoSe 2020	SoSe 2024
Information Systems Management (Wirtschaftsinformatik) (M. Sc.)	1	9	SoSe 2020	SoSe 2024
Technomathematik (B. Sc.)	1	9	SoSe 2020	SoSe 2024
Technomathematik (M. Sc.)	1	9	SoSe 2020	SoSe 2024
Wirtschaftsingenieurwesen (M. Sc.)	1	20	SoSe 2020	SoSe 2024

Miscellaneous

No information

Information Theory and Applications