Data Engineering Introduction To Data Engineering 2 — Questions and Answers
Question 1: What is the primary role of a data engineer in an organization?
- Building and maintaining data pipelines and infrastructure (Correct answer)
- Designing marketing campaigns
- Writing front-end user interfaces
- Managing payroll systems
Correct answer: Building and maintaining data pipelines and infrastructure
Data engineers build and maintain the pipelines and infrastructure that make data available for analysis.
Question 2: Which process describes Extract, Transform, Load (ETL)?
- Pulling data from sources, reshaping it, then storing it in a target system (Correct answer)
- Loading raw data first, then querying it directly
- Encrypting data before transmission
- Compressing files for backup
Correct answer: Pulling data from sources, reshaping it, then storing it in a target system
ETL extracts data from sources, transforms it into a usable shape, and loads it into a destination.
Question 3: What distinguishes a data warehouse from a data lake?
- A warehouse stores structured, schema-defined data while a lake stores raw data of any format (Correct answer)
- A warehouse is always cheaper than a lake
- A lake can only store images
- A warehouse cannot be queried with SQL
Correct answer: A warehouse stores structured, schema-defined data while a lake stores raw data of any format
Warehouses hold structured, schema-on-write data, while lakes hold raw data in many formats with schema-on-read.
Question 4: Which of the following is a common batch processing framework?
- Apache Spark (Correct answer)
- React
- Photoshop
- Nginx
Correct answer: Apache Spark
Apache Spark is a widely used distributed engine for batch (and stream) data processing.
Question 5: What does 'data normalization' aim to reduce in a relational database?
- Data redundancy and update anomalies (Correct answer)
- Network latency
- CPU temperature
- Screen resolution
Correct answer: Data redundancy and update anomalies
Normalization organizes tables to minimize redundancy and avoid anomalies during updates.
Question 6: Which term describes data processed continuously as it arrives?
- Stream processing (Correct answer)
- Batch archiving
- Cold storage
- Manual entry
Correct answer: Stream processing
Stream processing handles data record-by-record in near real time as it arrives.
Question 7: What is the purpose of a schema in a database?
- To define the structure, types, and relationships of the data (Correct answer)
- To encrypt the database files
- To speed up the network card
- To render charts automatically
Correct answer: To define the structure, types, and relationships of the data
A schema defines how data is organized, including tables, columns, types, and relationships.
Data Engineering Introduction To Data Engineering 2
What is the primary role of a data engineer in an organization?