CDP Data Engineer - Certification Exam (CDP-3002) Free Practice Test

Question 1

In the context of Airflow, what is the purpose of the "XCom" feature?

A. To manage dependencies and package installations across tasks.

B. To execute commands across different operating systems.

C. To trigger external systems when a DAG reaches a specific state.

D. To enable communication between different tasks within the same DAG.

Correct Answer: D

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 2

In the context of Cloudera's Optimization Framework, what role does data statistics collection play?

A. It is used to generate more data

B. It reduces the need for data compression

C. It provides metadata for security enforcement

D. It helps the optimizer make informed decisions about data layout and query execution plans

Correct Answer: D

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 3

Which Kubernetes tool would you use to access logs from a Spark Driver running in a pod?

A. 'spark-submit'

B. 'kubectl exec'

C. Kubernetes Dashboard

D. 'kubectl logs'

Correct Answer: D

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 4

You want to schedule your ETL pipeline to run daily at 5:00 AM. How can you configure the DAG's scheduling?

A. Utilize Airflow triggers to initiate the DAG execution at 5:00 AM daily.

B. Set the schedule_interval parameter to "0 5

C. Use the cron expression "daily at 5:00".

D. Define a custom Python function to schedule the DAG at the desired time.

Correct Answer: B

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 5

How does Hive handle bucketing when the data inserted into a bucketed table does not evenly distribute across the buckets?

A. Hive automatically rebalances the data across buckets using a round-robin distribution.

B. Hive rejects the data insertion and raises an error.

C. Hive distributes the data based on the hash value of the bucketing column, potentially leading to skewed buckets.

D. Hive dynamically adjusts the number of buckets to evenly distribute the data.

Correct Answer: C

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 6

Your Iceberg table has a hidden partition by month(event_timestamp). You frequently query with filters on the event_timestamp column. What potential problem might you encounter, and how would you address it?

A. No problems; hidden partitioning is designed for this use case.

B. Errors due to incorrect partition discovery; you'll need to manually update Iceberg table metadata.

C. Compatibility issues with older Spark versions; ensure you're using a version supporting hidden partitioning

D. Performance issues due to unnecessary file scanning; consider adding event_timestamp as an explicit partition.

Correct Answer: D

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 7

You're building an Airflow DAG that involves multiple data processing tasks. How can you handle task dependencies and ensure the tasks execute in the correct order?

A. Define the tasks directly within the DAG code using Python operators and set their dependencies manually.

B. Use the Airflow UI to visually connect the tasks with arrows, indicating their execution order.

C. All of the above

D. Leverage XCom to share data between tasks and define dependencies based on the data availability.

Correct Answer: C

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 8

You need to filter data from a Hive table based on a specific date range. Which approach would be most efficient and maintainable?

A. Implement a custom filter function in Spark to process each row individually

B. Use Spark SQL functions like filter with a date comparison expression

C. Convert the Hive table to a temporary table and then use Spark SQL filtering

D. Leverage HiveQL's built-in filtering capabilities with a WHERE clause

Correct Answer: B

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Welcome to TestSimulate

Cloudera CDP Data Engineer - Certification (CDP-3002) Free Practice Test