Mixed Deck — All ADE Topics Flashcards

What is the PRIMARY objective of automation & scripting within the Associate Data Engineer profession?

Answer: To ensure quality outcomes through standardized practices and continuous improvement

The primary objective is ensuring quality outcomes through established standards while continuously improving practices and processes.

What is the PRIMARY objective of security & access control within the Associate Data Engineer profession?

Answer: To ensure quality outcomes through standardized practices and continuous improvement

The primary objective is ensuring quality outcomes through established standards while continuously improving practices and processes.

What is the purpose of a data lake in a modern cloud architecture?

Answer: To serve as a central repository for raw data in any format

A data lake stores raw data in any format (structured, semi-structured, unstructured) at scale, enabling flexible downstream processing.

In Azure, which service is used to ingest, process, and analyze streaming data in real time?

Answer: Azure Stream Analytics

Azure Stream Analytics is a real-time analytics service designed to process high-throughput streaming data from sources like IoT devices and event hubs.

Which tool is popular for monitoring data pipelines?

Answer: Prometheus

Prometheus is a popular open-source monitoring system and time-series database widely used in cloud-native environments, including for data pipelines. It collects metrics from configured targets at specified intervals, evaluates rule expressions, displays the results, and can trigger alerts. Its powerful query language (PromQL) and robust alerting capabilities make it excellent for observing pipeline health and performance.

Which factor BEST indicates mastery of security & access control in Associate Data Engineer?

Answer: The ability to adapt knowledge and skills to varying contexts while maintaining standards

True mastery is demonstrated by the ability to apply knowledge flexibly across different contexts while consistently maintaining quality standards.

What is the MOST important skill for effective project planning & deployment in Associate Data Engineer?

Answer: Clear communication and the ability to align team efforts with objectives

Clear communication is essential for aligning team efforts, building consensus, and ensuring everyone understands and works toward shared objectives.

What distinguishes a snowflake schema from a star schema?

Answer: Snowflake schemas normalize dimension tables into sub-dimensions

In a snowflake schema, dimension tables are further normalized into related sub-dimension tables, reducing redundancy at the cost of more complex joins.

What does GDPR stand for, and which region's data privacy regulation does it represent?

Answer: General Data Protection Regulation — European Union

GDPR (General Data Protection Regulation) is the European Union's comprehensive data privacy law governing how organizations collect, store, and process personal data.

Which data quality dimension measures whether data accurately represents the real-world entity it models?

Answer: Accuracy

Data accuracy measures whether values correctly reflect the real-world facts they represent, such as a customer's correct address or birth date.

Which cloud storage format is optimized for analytical queries due to its columnar storage layout?

Answer: Parquet

Parquet is a columnar storage format designed for efficient analytical queries, reducing I/O by reading only relevant columns.

A surrogate key in data modeling is best described as:

Answer: A system-generated unique identifier with no business meaning

A surrogate key is a system-generated (often sequential integer or UUID) unique identifier that has no inherent business meaning, used to uniquely identify rows in a dimension table.

What is the goal of data cleansing?

Answer: To correct errors

Data cleansing, also known as data scrubbing, is the process of detecting and correcting or removing corrupt, inaccurate, or irrelevant records from a dataset. Its primary goal is to improve data quality by ensuring data is accurate, consistent, and complete. This is vital for reliable analysis, accurate reporting, and sound decision-making, as flawed data can lead to incorrect insights.

In data warehouse design, a 'degenerate dimension' is best described as:

Answer: A dimension attribute stored directly in the fact table with no corresponding dimension table

A degenerate dimension is a dimension key (like an invoice number or order ID) that resides in the fact table itself because it has no descriptive attributes that would justify a separate dimension table.

Which technique replaces sensitive data with a non-sensitive substitute while preserving data format and usability?

Answer: Masking

Data masking replaces sensitive values with realistic but fictional substitutes (e.g., replacing a real SSN with a fake one) for use in non-production environments.

Which framework is commonly used in the US healthcare industry to govern patient data privacy and requires HIPAA compliance?

Answer: HIPAA

HIPAA (Health Insurance Portability and Accountability Act) is the US federal law governing the privacy and security of protected health information (PHI).

What does 'data consistency' mean across distributed data systems?

Answer: The same data entity has the same values across all systems and replicas

Data consistency ensures that the same attribute of the same entity holds the same value across all systems, databases, and replicas at any given time.

Why is schema validation important during transformation?

Answer: To ensure data format correctness

Schema validation during data transformation is crucial for maintaining data quality and integrity. It verifies that incoming data conforms to the expected structure, data types, and constraints of the target schema. This prevents malformed or inconsistent data from entering downstream systems, which could lead to errors, incorrect analyses, or system failures.

Which competency is MOST essential for professionals working in troubleshooting & problem resolution in Associate Data Engineer?

Answer: Critical thinking combined with practical application of knowledge

Critical thinking allows professionals to apply knowledge effectively in varied situations, leading to better outcomes than rote procedures.

In Associate Data Engineer, how does implementation & configuration contribute to professional credibility?

Answer: By demonstrating competence, maintaining standards, and delivering consistent results

Professional credibility is built through demonstrated competence, consistent adherence to standards, and reliable delivery of quality results.