ACP ACP Data Engineering & Workflow Automation 3

Question 1

Which Python library provides the `Parquet` file format support for high-performance columnar storage of DataFrames?

Accepted Answer

pyarrow

Answer

h5py

Answer

openpyxl

Answer

feather

Question 2

Which conda command exports a complete list of all packages in the current environment to a file for reproducibility?

Accepted Answer

conda env export > environment.yml

Answer

conda freeze > requirements.txt

Answer

conda list --export > packages.txt

Answer

conda save environment.yml

Question 3

In a data engineering context, what is the purpose of using Dask instead of pandas for large dataset processing in Python?

Accepted Answer

Dask enables parallel and out-of-core computation on datasets larger than RAM

Answer

Dask provides faster single-threaded operations than pandas

Answer

Dask replaces pandas with a SQL-only interface

Answer

Dask is only used for streaming real-time data

Question 4

Which method in pandas handles missing values by filling them with a specified value or strategy (e.g., forward fill)?

Accepted Answer

df.fillna()

Answer

df.dropna()

Answer

df.impute()

Answer

df.replace_nan()

Question 5

When automating a data pipeline on a schedule using cron or a task scheduler, which Python standard library module provides programmatic access to run shell commands and subprocesses?

Accepted Answer

subprocess

Answer

os.system only

Answer

shutil

Answer

threading

Question 6

In pandas, which method converts a column's data type (e.g., from object/string to numeric or datetime)?

Accepted Answer

df['col'].astype()

Answer

df['col'].convert()

Answer

df['col'].cast()

Answer

df['col'].to_type()