Data Engineering Fundamentals 1 — Questions and Answers
Question 1: Three different types of data models are listed below, EXCEPT:
- Logical Data Model
- Conceptual Data Model
- Schema Data Model (Correct answer)
- Physical Data Model
Correct answer: Schema Data Model
The three primary types of data models are Conceptual, Logical, and Physical. A Conceptual Data Model defines high-level business concepts, a Logical Data Model details entities and relationships without specific database technology, and a Physical Data Model describes how data is stored in a specific database system. 'Schema Data Model' is not a standard, distinct type in this widely accepted classification.
Question 2: The process of normalizing a data model is one of the steps in data modeling, particularly in...
- Logical Data Model (Correct answer)
- Conceptual Data Model
- Schema Data Model
- Physical Data Model
Correct answer: Logical Data Model
Normalization is a crucial process primarily applied during the creation of a Logical Data Model. It involves organizing the columns and tables of a relational database to minimize data redundancy and improve data integrity. This step ensures the logical structure of the database is efficient, consistent, and adheres to best practices before moving to physical implementation.
Question 3: We need data engineers for a number of reasons, EXCEPT:
- Various Data Format
- Various Data Sources
- Various Capabilities (Correct answer)
- Various Technologies
Correct answer: Various Capabilities
Data engineers are essential due to the complexities arising from various data formats (structured, unstructured), diverse data sources (databases, APIs, streaming), and a multitude of technologies (cloud platforms, big data tools). 'Various Capabilities' refers to the skills of the engineers themselves, not a reason for the *need* for engineers in the face of data challenges, which are driven by the data's characteristics and sources.
Question 4: Which of the following is NOT a part of the ETL / ELT process:
- Extract
- Transform
- Export (Correct answer)
- Load
Correct answer: Export
ETL stands for Extract, Transform, Load, which are the three core phases of moving data from source systems to a data warehouse or data lake. 'Export' is not a standard component of the ETL/ELT acronym. While data might be exported at various stages in a broader data pipeline, it is not part of the fundamental definition of the ETL process itself.
Question 5: The following are components of the Data Pipeline in which Data Engineers play a significant role in:
- Prepare and Visualize Data
- Collect and Prepare Data (Correct answer)
- Analyze and Visualize Data
- Collect and Analyze Data
Correct answer: Collect and Prepare Data
Data engineers play a significant role in the initial stages of the data pipeline, which involve collecting raw data from various sources and preparing it for analysis. This preparation includes cleaning, transforming, and structuring the data to make it usable for data scientists and analysts. Their expertise ensures data quality and accessibility for subsequent analytical processes.
Question 6: Which of the following is NOT a common source of big data?
- Google Trends
- Sensors
- Official Statistics Surveys (Correct answer)
Correct answer: Official Statistics Surveys
Big data typically refers to datasets characterized by high volume, velocity, and variety, often requiring specialized tools for processing. Common sources include sensors (IoT data), social media feeds, and web logs (like Google Trends data). Official statistics surveys, while producing large datasets, are generally structured, planned, and collected through traditional methods, and are not typically categorized as 'big data' in the context of its defining challenges.
Question 7: Which of the following commands belongs to the data manipulation language?
- Rollback, Commit
- Alter, Create, Drop
- Select, Insert, Delete (Correct answer)
- Grant, Revoke
Correct answer: Select, Insert, Delete
The Data Manipulation Language (DML) in SQL includes commands used to manage data within database objects. `SELECT` retrieves data, `INSERT` adds new data, `UPDATE` modifies existing data, and `DELETE` removes data. These commands are specifically designed for interacting with and manipulating the data stored in the database tables.
Three different types of data models are listed below, EXCEPT: