Zur Modulseite PDF generieren

#40106 / #6

SS 2017 - WS 2019/20

English

Information Theory and Coding (TI)
Informationstheorie und Codierung (TI)

9

Caire, Giuseppe

Benotet

Portfolioprüfung

English

Zugehörigkeit


Fakultät IV

Institut für Telekommunikationssysteme

34331500 FG Komplexe und verteilte IT-Systeme (alt)

Keine Angabe

Kontakt


HFT 6

Caire, Giuseppe

caire@tu-berlin.de

Lernergebnisse

Communication networks are perhaps the most pervasive and ubiquitous infrastructure of our times. Billions of people around the world access information, make business, share experiences and stay in touch with each other through the Internet, and in particular using wireless access. The fundamental science and engineering knowledge that made this astonishing development possible finds its origin in the seminal paper by Claude E. Shannon, "A Mathematical Theory of Communication", published in 1948. This fundamental work represents the birth of the modern information age. Astonishingly, at a time where the telephone networks was analog and based on electromechanical circuit switching and radio reduced to analog broadcasting, Shannon deployed the fundamental concepts of information measures (Entropy, Mutual Information) and their operational significance as the fundamental limits of data compression (how many bits of information are necessary to compress an information source without any loss?), channel coding (how many bits of information per unit time can be sent through a communication channel such that the message is recovered by the receiver with arbitrarily low error probability?) and source coding (how many bits of information are necessary to represent an information source such that its can be reconstructed within a desired fidelity level?). Since Shannon's work, the field of modern digital communications, channel coding, data networks, source coding and wireless/cellular communications has developed enormously. Very large and successful companies, such as Qualcomm, Ericsson, Nokia, Alcatel Lucent, Siemens, Huawei, Broadcom, Intel, Samsung, have been setting the technology trends, and standards such as TCP/IP, IEEE 802.11, IEEE 802.16, GSM, IS-95, and the more recent 3GPP family of standards (e.g., LTE/LTE-A) enable ubiquitous connectivity and the merging of a variety of communication networks onto a common interconnected platform. Perhaps the most striking fact is that Shannon's theoretical conclusions, that information is essentially "discrete" (i.e., digital) and that any source can be reduced to a common currency (bits), such bits can be exchanged reliably through a network which is somehow source-agnostic, and reconstructed at the end users within a near-optimal fidelity level, has become a fact of everyday's life, that we all enjoy and experience. Today, we use the Internet, most of the times supported by a wireless access network, to consume a wealth of different sources (audio, speech, video, data, images, text) that in the not-so-distant past required separate and very different networks (e.g., FM radio, land-line telephone networks, cellular telephone networks, telegraph/telex, mail/currier delivery, cable TV, UHF/VHF TV, Satellite TV). The module ``Information Theory and Coding'' provides a comprehensive background on foundations and specific theoretical knowledge on information theory and channel coding, thus providing the theoretical background that stays at the basis of modern digital communication networks. Furthermore, through a rich set of possible elective courses, the students will have the opportunity of acquiring additional knowledge in specific areas of interest, some of which are advanced theoretical, and others are more applied and practical, according to each student specific orientation and interest.

Lehrinhalte

The module ``Information Theory and Coding'' consists of 3 courses of 3 Pts each, for a total of 9 Pts (ECTS). Two of these courses are required: 1) Information Theory; 2) Modern Channel Coding; Another can be chosen within a list of elective courses. Information Theory presents the fundamentals of Information Theory. In particular, information measures and information sources, and the fundamental limits of data compression, channel coding and (lossy) source coding. Relations to channel coding theory, communication theory and signal processing (notably, audio, image and video coding) are evidenced. Modern Channel Coding presents an overview of the channel coding techniques currently used in wireless network standards and data storage systems. Classical coding theory (algebraic coding) is presented at a glance, with some examples of classical codes (Hamming codes and their duals) and particular emphasis on Reed-Solomon codes. Then, a graph-theoretic framework is adopted to present convolutional codes and sparse graph codes (Turbo Codes, LDPC codes) and their decoding algorithms (Viterbi Decoding, Belief Propagation Decoding). Finally, some special topics are presented as on-going research, such as regenerative storage codes and their relationship with network coding, spatially coupled codes and their iterative decoding threshold analysis. In the list of elective courses, there is the possibility of choosing the lab-oriented course: Wireless Digital Communications Lab I, which provide the students with a hands-on practical training based on Matlab on the algorithms studied in theory on the two required courses. Other elective include: Compressed Sensing (also known as sparse signal reconstruction, provides the basics of a new area in signal processing focused on the estimation of inherently redundant signals when only a small number of linear projections are available, which is gaining more and more importance in areas such as image coding, features identification, machine learning schemes, channel estimation in wireless communications, and computation in big-data sets), Network Information Theory (this presents the extension of classical information theory to network problems, i.e., problems involving more than one source and one destination, which is at the basis of modern and efficient system design in wireless networks), Modern Channel Coding (a comprehensive overview of ``graph-based'' modern channel codes and their iterative decoding algorithms, such as Turbo Codes, LDPC codes, Spatially coupled LDPC codes), Wireless Communication Systems (a deep overview of present and future wireless communication standards, their design rationale and their main working principles), Physical- Layer Security (information-theoretic methods to achieve secure communication over a wireless channel), MIMO Systems and Adaptive Transmission (schemes and techniques for multiple-antenna systems, which have become very popular in recent years and have been massively adopted in wireless communication standards such as IEEE 802.11n, 802.11ac, and 3GPP LTE-Advanced).

Modulbestandteile

Compulsory area

Die folgenden Veranstaltungen sind für das Modul obligatorisch:

LehrveranstaltungenArtNummerTurnusSpracheSWS ISIS VVZ
Information TheoryVL0432 L 654WiSeKeine Angabe2
Modern Channel CodingVL34331600 L 003SoSeKeine Angabe2

Compulsory elective area

Aus den folgenden Veranstaltungen müssen 3 Leistungspunkte abgeschlossen werden.

LehrveranstaltungenArtNummerTurnusSpracheSWS ISIS VVZ
Compressed SensingVL0432 L 664WiSeKeine Angabe2
MIMO Systems and Adaptive TransmissionVL34331600 L 006SoSeKeine Angabe2
Network Information TheoryVL34331600 L 001SoSeKeine Angabe2
Physical-Layer SecurityVL34331600 L 002WiSeKeine Angabe2
Sparse Signal Processing, Applications and AlgorithmsSEM34331600 L 009SoSeKeine Angabe2
Wireless Communication SystemsVL0432 L 615SoSeKeine Angabe2
Wireless Digital Communications Lab IPR0432 L 658WiSeKeine Angabe2

Arbeitsaufwand und Leistungspunkte

Compressed Sensing (VL):

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit15.02.0h30.0h
Vor-/Nachbereitung15.04.0h60.0h
90.0h(~3 LP)

Information Theory (VL):

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit15.02.0h30.0h
Vor-/Nachbereitung15.04.0h60.0h
90.0h(~3 LP)

MIMO Systems and Adaptive Transmission (VL):

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit15.02.0h30.0h
Vor-/Nachbereitung15.04.0h60.0h
90.0h(~3 LP)

Modern Channel Coding (VL):

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit15.02.0h30.0h
Vor-/Nachbereitung15.04.0h60.0h
90.0h(~3 LP)

Network Information Theory (VL):

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit15.02.0h30.0h
Vor-/Nachbereitung15.04.0h60.0h
90.0h(~3 LP)

Physical-Layer Security (VL):

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit15.02.0h30.0h
Vor-/Nachbereitung15.04.0h60.0h
90.0h(~3 LP)

Sparse Signal Processing, Applications and Algorithms (SEM):

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit15.02.0h30.0h
Vor-/Nachbereitung15.04.0h60.0h
90.0h(~3 LP)

Wireless Communication Systems (VL):

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit15.02.0h30.0h
Vor-/Nachbereitung15.06.0h90.0h
120.0h(~4 LP)

Wireless Digital Communications Lab I (PR):

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit15.02.0h30.0h
Vor-/Nachbereitung15.04.0h60.0h
90.0h(~3 LP)
Der Aufwand des Moduls summiert sich zu 270.0 Stunden. Damit umfasst das Modul 9 Leistungspunkte.

Beschreibung der Lehr- und Lernformen

Courses are taught through lectures, problem-solving sessions (exercises in class), and integrated laboratory practical work, computer projects (mainly in Matlab), and homework/independent work at home. Attendance is required in all events held in the classroom and in the labs, both practical work and lectures.

Voraussetzungen für die Teilnahme / Prüfung

Wünschenswerte Voraussetzungen für die Teilnahme an den Lehrveranstaltungen:

Suitable desired pre-requisites for participation to courses are a basic knowledge of information technology, as described in particular in the courses "Signale und Systeme" and "Nachrichtenübertragung" of the field of study "Elektronik und Informationstechnik" of the BSc degree program. This module is open to students enrolled in the Technische Informatik MSc degree program. For participation in the laboratory work, basic knowledge of programming with MatLab is desirable, but it will be in any case provided for those students who do not have such background.

Verpflichtende Voraussetzungen für die Modulprüfungsanmeldung:

Dieses Modul hat keine Prüfungsvoraussetzungen.

Abschluss des Moduls

Benotung

Benotet

Prüfungsform

Portfolio examination

Art der Portfolioprüfung

100 Punkte insgesamt

Sprache(n)

English

Prüfungselemente

NamePunkteKategorieDauer/Umfang
Written performance assessments for the required courses80schriftlich90 min
Oral performance assessments, including possible project presentations, for elective courses20mündlich20 min

Notenschlüssel

Notenschlüssel »Notenschlüssel 3: Fak IV (3)«

Gesamtpunktzahl1.01.31.72.02.32.73.03.33.74.0
100.0pt85.0pt80.0pt75.0pt70.0pt65.0pt60.0pt55.0pt50.0pt45.0pt40.0pt

Prüfungsbeschreibung (Abschluss des Moduls)

A total of 100 points portfolio can be achieved: • two written performance assessments (40 portfolio points each) for the required courses: Modern Channel Coding and Information Theory. • Oral performance assessments, including possible project presentations, for all other elective courses (20 portfolio points each). Die Gesamtnote gemäß § 47 (2) AllgStuPO wird nach dem Notenschlussel 3 der Fakultät IV ermittelt.

Dauer des Moduls

Für Belegung und Abschluss des Moduls ist folgende Semesteranzahl veranschlagt:
2 Semester.

Dieses Modul kann in folgenden Semestern begonnen werden:
Winter- und Sommersemester.

Maximale teilnehmende Personen

Dieses Modul ist nicht auf eine Anzahl Studierender begrenzt.

Anmeldeformalitäten

The number of participants is limited only in the Laboratory course, because of lab space. Registration for the lab course is done online. Information can be found at: www.commit.tu-berlin.de, and it will be given anyway on the first date of the lecture in the required courses.

Literaturhinweise, Skripte

Skript in Papierform

Verfügbarkeit:  nicht verfügbar

 

Skript in elektronischer Form

Verfügbarkeit:  verfügbar

 

Literatur

Empfohlene Literatur
Keine empfohlene Literatur angegeben

Zugeordnete Studiengänge


Diese Modulversion wird in folgenden Studiengängen verwendet:

Studiengang / StuPOStuPOsVerwendungenErste VerwendungLetzte Verwendung
Dieses Modul findet in keinem Studiengang Verwendung.

Studierende anderer Studiengänge können dieses Modul ohne Kapazitätsprüfung belegen.

Sonstiges

Course material for the various courses will be provided on-line. Textbooks are indicated as ``non-mandatory desirable reading'', but the courses are self-contained, i.e., purchase of textbooks is not mandatory.