Moses - Database Internals & Scalable Data Processing

Display language

Diese Modulbeschreibung gilt nicht im aktuellen Semester.

Die Modulbeschreibung gilt nur für den Zeitraum SS 2014 - SS 2015. Die Version für das aktuelle Semester (SoSe 2024) finden Sie hier: Modulbeschreibung des SoSe 2024

Module / Version:
#40405 / #2

Validity:
SS 2014 - SS 2015

Default display language:
English

Module title:
Database Internals & Scalable Data Processing

Credits:
6

Responsible person:
Markl, Volker

Grading:
benotet

Type of exam:
Portfolioprüfung

Zugehörigkeit

Faculty:
Fakultät IV

Institute:
Institut für Softwaretechnik und Theoretische Informatik

Area of expertise:
34351500 FG Datenbanksysteme und Informationsmanagement (DIMA)

Prüfungsausschuss:
No information

Kontakt

Office:
EN 7

Contact person:
Zeuch, Steffen

E-mail address:
sekr@dima.tu-berlin.de

Website:

https://www.tu.berlin/dima

Learning Outcomes

The global data volume is increasing dramatically each year. Understanding how to store, process and manage these huge amounts of data efficiently is a key requirement for software engineers and data analysts in the modern IT world. This course will teach students both the fundamentals of data processing in traditional single-node database systems and how to scale out these techniques to huge amounts of data in large-scale, distributed environments. Technical skills: 30%; Method skills: 30%; System skills: 30%; Social competence: 10%.

Content

The lecture is split into two parts, each covering roughly one half of the semester. During the first part, the students become acquainted with the fundamentals of query processing in traditional relational database systems. This includes the general architecture of a DBMS, file- & buffer management, query processing, indexing, metadata management, query optimization, locking, recovery and transaction management. In the second half of the lecture, the basics of parallel data processing will be covered with a focus on large-scale, distributed systems and “cloud computing”. Topics include parallel processing platforms like MapReduce, distributed data storage and retrieval – e.g., via DHTs –, techniques for distributed locking and transaction handling, multi-tenancy and software as a service. The course consists of a lecture and theoretical, written exercises. An additional practice project in conjunction with this lecture is offered and recommended to be taken in parallel.

Module Components

Pflichtteil:

All Courses are mandatory.

Course Name	Type	Number	Cycle	Language	SWS	VZ
IDB: Implementation of Database Systems and Scalable Data Processing	VL	0434 L 431	WiSe	No information	2
IDB: Implementation of Database Systems and Scalable Data Processing	UE	0434 L 431	WiSe	No information	2

Workload and Credit Points

IDB: Implementation of Database Systems and Scalable Data Processing (VL):

Workload description	Multiplier	Hours	Total
Participation in class IDB	15.0	2.0h	30.0h
			30.0h(~1 LP)

IDB: Implementation of Database Systems and Scalable Data Processing (UE):

Workload description	Multiplier	Hours	Total
Participation in exercises IDB	15.0	2.0h	30.0h
			30.0h(~1 LP)

Course-independent workload:

Workload description	Multiplier	Hours	Total
Exam preparation	1.0	30.0h	30.0h
Graded problem sheets	1.0	60.0h	60.0h
Preparation/Consolidation IDB	15.0	2.0h	30.0h
			120.0h(~4 LP)

The Workload of the module sums up to 180.0 Hours. Therefore the module contains 6 Credits.

Description of Teaching and Learning Methods

Lectures are accompanied by exercises in small groups to practically rehearse the theory taught in the lectures. The course will be given in English.

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

This course is the base course for master students with focus on database systems and information management and should be attended in the first semester of the master program. In contrast to the introduction of database systems (MPGI5/DBS), which looks at database systems from an application programmers point of view, this class focuses on the internals of database systems. To participate, students are required to have successfully completed a Bachelor in computer science with a focus on database systems (participation in the Datenbankpraktikum, Datenbankprojekt). Knowledge of data modeling, relational algebra, and SQL as well as a very good command of Java, or possibly C/C++/C#, programming is required to participate in the course. Due to capacity reasons, the class is limited to at most 60 participants.

Mandatory requirements for the module test application:

This module has no requirements.

Module completion

Grading

graded

Type of exam

Portfolio examination

Type of portfolio examination

No information

Language

English

Test elements

Name	Points/Weight	Categorie	Duration/Extent
Assessment of the homework exercises	20	No information	No information
Result of the written exam	80	No information	No information

Grading scale

No information

Test description (Module completion)

No information

Duration of the Module

The following number of semesters is estimated for taking and completing the module:
1 Semester.

This module may be commenced in the following semesters:
Wintersemester.

Maximum Number of Participants

The maximum capacity of students is 60.

Registration Procedures

No information

Recommended literature
[1] Hector Garcia-Molina, Jeffrey D. Ullman, Jennifer Widom: Database Systems - The Complete Book, Pearson Education International, 2002. Or:
[2] Garcia-Molina, Ullman, Widom: “Database Systems: The Complete Book,” Prentice Hall, 2000.
[3] R. Elmasri und S.B. Navathe: Fundamentals of Database Systems, Benjamin Cummings Deutsche Übersetzung: “Grundlagen von Datenbanksystemen,“ Pearson, 2002.
[4] J. Gray, A. Reuter: Transaction Processing, Morgan Kaufman, 1993.
[5] T. Özsu und P. Valduriez: Principles of Distributed Database Systems, Prentice Hall, 1999.
[6] Saake, Heuer, Sattler: “Datenbanken: Implementierungstechniken”, mitp Verlag, 2005 (2. Auflage).
[7] Härder, Rahm: “Datenbanksysteme. Konzepte und Techniken der Implementierung,” Springer, 2. Auflage 2001.
[8] Kemper, Eickler: “Datenbanksysteme – Eine Einführung,” Oldenburg, 5. Auflage 2004.

Assigned Degree Programs

Semester:

Zeige auch ausgelaufene Studiengänge und StuPOs

This module is used in the following Degree Programs (new System):

	Studiengang / StuPO	StuPOs	Verwendungen	Erste Verwendung	Letzte Verwendung
This module is not used in any degree program.

Students of other degrees can participate in this module without capacity testing.

Miscellaneous

No information

Database Internals & Scalable Data Processing

Zugehörigkeit

Kontakt

Learning Outcomes

Content

Module Components

Pflichtteil:

Workload and Credit Points

IDB: Implementation of Database Systems and Scalable Data Processing (VL):

IDB: Implementation of Database Systems and Scalable Data Processing (UE):

Course-independent workload:

Description of Teaching and Learning Methods

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

Mandatory requirements for the module test application:

Module completion

Grading

Type of exam

Type of portfolio examination

Language

Test elements

Grading scale

Test description (Module completion)

Duration of the Module

Maximum Number of Participants

Registration Procedures

Recommended reading, Lecture notes

Lecture notes

Electronical lecture notes

Literature

Assigned Degree Programs

This module is used in the following Degree Programs (new System):

Miscellaneous