Databricks Associate Data Engineer Questionnaire

• A data organization leader is upset about the data analysis team’s reports being different from the data engineering team’s reports. The leader believes the siloed nature of their organization’s data engineering and data analysis architectures is to blame. Which of the following describes how a data lakehouse could alleviate this issue?

• A. Both teams would autoscale their work as data size evolves

• B. Both teams would use the same source of truth for their work

• C. Both teams would reorganize to report to the same department

• D. Both teams would be able to collaborate on projects in real-time

• E. Both teams would respond more quickly to ad-hoc requests

Answer explanation

Databricks Lakehouse enables using data as the single source of truth. Duplicating data often results in data silos in organizations.

 

• Which of the following describes a scenario in which a data team will want to utilize cluster pools?

• A. An automated report needs to be refreshed as quickly as possible

• B. An automated report needs to be made reproducible

• C. An automated report needs to be tested to identify errors

• D. An automated report needs to be version-controlled across multiple collaborators

• E. An automated report needs to be runnable by all stakeholders

Answer explanation

Using cluster pools reduces the cluster startup time. So in this case, the reports can be refreshed quickly and not having to wait long for the cluster to start

• Which of the following is hosted completely in the control plane of the classic Databricks architecture?

• A. Worker node

• B. JDBC data source

• C. Databricks web application

• D. Databricks Filesystem

• E. Driver node

Answer explanation

Databricks web application is hosted in Control plane

• Which of the following benefits of using the Databricks Lakehouse Platform is provided by Delta Lake?

• A. The ability to manipulate the same data using a variety of languages

• B. The ability to collaborate in real time on a single notebook

• C. The ability to set up alerts for query failures

• D. The ability to support batch and streaming workloads

• E. The ability to distribute complex data operations

Answer explanation

Delta Lake supports both Batch & Stream workloads

• Which of the following describes the storage organization of a Delta table?

• A. Delta tables are stored in a single file that contains data, history, metadata, and other attributes

• B. Delta tables store their data in a single file and all metadata in a collection of files in a separate location

• C. Delta tables are stored in a collection of files that contain data, history, metadata, and other attributes

• D. Delta tables are stored in a collection of files that contain only the data stored within the table

• E. Delta tables are stored in a single file that contains only the data stored within the table

Answer explanation

Delta table stores data as a directory of files on a cloud object storage and registers table metadata to the metastore within a catalog and schema

• Which of the following code blocks will remove the rows where the value in column age is greater than 25 from the existing Delta table my table and save the updated table?

• A. SELECT * FROM my_table WHERE age > 25;

• B. UPDATE my_table WHERE age > 25;

• C. DELETE FROM my_table WHERE age > 25;

• D. UPDATE my_table WHERE age <= 25;

• E. DELETE FROM my_table WHERE age <= 25;

Answer explanation

DELETE FROM to delete existing records from the table. UPDATE is used to modify existing records. SELECT only creates a view, it does not alter the table records.

A data engineer has realized that they made a mistake when making a daily update to a table. They need to use Delta time travel to restore the table to a version that is 3 days old. However, when the data engineer attempts to time travel to the older version, they are unable to restore the data because the data files have been deleted.

Which of the following explains why the data files are no longer present?

• A. The VACUUM command was run on the table

• B. The TIME TRAVEL command was run on the table

• C. The DELETE HISTORY command was run on the table

• D. The OPTIMIZE command was nun on the table

• E. The HISTORY command was run on the table

Answer explanation

VACUUM command is the only way to explicitly remove the history information from a delta table. There is no command like DELETE HISTORY exists in Databricks

Which of the following Git operations must be performed outside of Databricks Repos?

• A. Commit

• B. Pull

• C. Push

• D. Clone

• E. Merge

Answer explanation

MERGE is the only git operation that is listed in the options that cannot be performed with Databricks repos

Which of the following data lakehouse features results in improved data quality over a traditional data lake?

• A. A data lakehouse provides storage solutions for structured and unstructured data

• B. A data lakehouse supports ACID-compliant transactions

• C. A data lakehouse allows the use of SQL queries to examine data

• D. A data lakehouse stores data in open formats

• E. A data lakehouse enables machine learning and artificial Intelligence workloads

Answer explanation

ACID-compliant transactions ensure that data is consistent, reliable, and accurate. By supporting ACID transactions, a data lakehouse can provide improved data quality over a traditional data lake. This is because ACID transactions guarantee that updates to the data are either completed in their entirety or not at all, reducing the risk of data corruption or errors.

A data engineer needs to determine whether to use the built-in Databricks Notebooks versioning or version their project using Databricks Repos

Which of the following is an advantage of using Databricks Repos over the Databricks Notebooks versioning?

• A. Databricks Repos automatically saves development progress

• B. Databricks Repos supports the use of multiple branches

• C. Databricks Repos allows users to revert to previous versions of a notebook

• D. Databricks Repos provides the ability to comment on specific changes

• E. Databricks Repos is wholly housed within the Databricks Lakehouse Platform

Answer explanation

An advantage of using Databricks Repos over the Databricks Notebooks versioning is that Databricks Repos supports the use of multiple branches. With Databricks Repos, you can create and manage multiple branches of your codebase, enabling parallel development, collaboration, and the ability to work on different features or bug fixes simultaneously.