Apache Spark 3 for Data Engineering and Analytics with Python - Challenge - XYZ Research

The video tutorial introduces a project to explore the use of RDDS through a research challenge. The challenge involves analyzing data from XYZ Research, which conducts projects over a span of up to three years. The tutorial outlines specific questions to address, such as the number of projects initiated and completed within certain timeframes. It also introduces data transformations like union and subtract to solve the challenge. Viewers are encouraged to download the data file and follow along in the next lecture.

What is the first question that needs to be answered regarding the research projects?

What two transformations does the teacher want to introduce to tackle the problem?