Large-scale SQL Processing

This lecture covers the execution models for distributed computing in data-intensive applications and systems, introducing the concept of data frames as a space-efficient and computationally-efficient data representation with an extensible SQL-like language. It explains the data model supporting nested and complex types, the key notion of data frames, and their operators for relational operations. The lecture also discusses optimization principles, advantages of the model over traditional SQL, and concludes with the importance of distribution for scalability and the significance of the programming model for expressiveness and performance.

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (36)

Related concepts (14)

CS-422: Database systems

This course is intended for students who want to understand modern large-scale data analysis systems and database systems. It covers a wide range of topics and technologies, and will prepare students

Relational database

A relational database is a (most commonly digital) database based on the relational model of data, as proposed by E. F. Codd in 1970. A system used to maintain relational databases is a relational database management system (RDBMS). Many relational database systems are equipped with the option of using SQL (Structured Query Language) for querying and updating the database. The term "relational database" was first defined by E. F. Codd at IBM in 1970. Codd introduced the term in his research paper "A Relational Model of Data for Large Shared Data Banks".

Relational model

The relational model (RM) is an approach to managing data using a structure and language consistent with first-order predicate logic, first described in 1969 by English computer scientist Edgar F. Codd, where all data is represented in terms of tuples, grouped into relations. A database organized in terms of the relational model is a relational database.

Relational algebra

In database theory, relational algebra is a theory that uses algebraic structures for modeling data, and defining queries on it with a well founded semantics. The theory was introduced by Edgar F. Codd. The main application of relational algebra is to provide a theoretical foundation for relational databases, particularly query languages for such databases, chief among which is SQL. Relational databases store tabular data represented as relations. Queries over relational databases often likewise return tabular data represented as relations.

Data model

A data model is an abstract model that organizes elements of data and standardizes how they relate to one another and to the properties of real-world entities. For instance, a data model may specify that the data element representing a car be composed of a number of other elements which, in turn, represent the color and size of the car and define its owner. The corresponding professional activity is called generally data modeling or, more specifically, database design.

Data modeling

Data modeling in software engineering is the process of creating a data model for an information system by applying certain formal techniques. It may be applied as part of broader Model-driven engineering (MDD) concept. Data modeling is a process used to define and analyze data requirements needed to support the business processes within the scope of corresponding information systems in organizations. Therefore, the process of data modeling involves professional data modelers working closely with business stakeholders, as well as potential users of the information system.

Relational Model: Basics CS-322: Introduction to database systems

Introduces the relational model, SQL, keys, integrity constraints, ER translation, weak entities, ISA hierarchies, and SQL vs. noSQL.

Relational Model: Basics CS-422: Database systems

Covers the basics of the relational model in database management systems, including data models, primary and foreign keys.

Database Management Systems: Fundamentals CS-422: Database systems

Introduces the fundamentals of database management systems, covering relational model, storage options, data integrity, queries, and data manipulation languages.

Relational Databases: Summary MOOC: Geographical Information Systems 1

Concludes the exploration of relational databases and introduces database management systems.

Relational Databases: Summary MOOC: Introduction to Geographic Information Systems (part 1)

Covers relational databases and database management systems basics for upcoming lessons.