Python - from 0 to HERO

Which mark did we exceed in 2023 for the 1st time regarding annual size of generated data?

• 100 TB (Terabyte) = 10^3 GB

• 100 PB (Petabyte) = 10^6 GB

• 100 EB (Exabyte) = 10^9 GB

• 100 ZB (Zetabyte) = 10^12 GB

Answer explanation

In 2023 about 120 ZB of data were produced and by 2025 it is expected that more than 175 ZB will be generated.

The 4 Vs of BIG data include: Volume, Validity, Variety, and

Answer explanation

Volume: Data set size and computing power

Validity: Data governance and trustworthiness

Variety: Diverse data sources and formats

Velocity: Data processing speed and growing demand

When working processing and analyzing big data using Python the implementation takes a lot of time and also rerunning the process/analysis takes very long.

• True

• False

Answer explanation

While the initial set up might take longer when programming, it saves a lot of time when refreshing data/analysis.

Data typically flows circular, from data sources up to the users and back.

• True

• False

Answer explanation

Data typically flows in one direction (from the data source via data loaders and data lakes to data sharing platforms or user interfaces). However, data can end up in multiple different destinations, but it usually does not flow back to the source.

Which three data lake types do we have in our CCHBC cloud infrastructure?

• Production

• Development

• Test

• Quality

• Delivery

Answer explanation

In the curated layer, we have the Development (for all products that are still being developed), Quality (for deployed products, which are still checked on their quality), and Production (for the final product that can be used and accessed).

The source code of Python and thus the programming language itself is publicly available. This characteristic is also known as

Answer explanation

The nice thing about open-source is, that it usually comes with a large community support and that it is FREE.

Which of the following are advantages of Python over Excel?

• Easy to use

• No real data size limitation

• Scalable and compatible with other programs

• Open source, thus free and big community support

• Useful for small and one-time analysis

Answer explanation

Python may be a fairly easy programming language compared to others, but it is still harder than Excel and also sometimes simply not worth the time for small one-time tasks/requests. However it really beats Excel with regards to big data handling, scalability, compatibility and community support.

Which of the following statements is/are True.

• Pandas is a package for data manipulation and analysis

• Seaborn is a package for interactive visualization

• Python has a small community of coders / contributors

• Python is especially useful for scalability, automation and big data analytics / processing

Answer explanation

Seaborn allows many statistical static plots, Plotly is used for interactive plotting. And Python has a very large community support.

Python also allows to do machine & deep learning.

• True

• False

Answer explanation

Python is one of the most used and best supported programs for Data Science which includes machine & deep learning. The most common packages here are PyTorch and TensorFlow.

The answer options of the previous question were of which data type in Python language?

Answer explanation

The previous questions had the answers "True" and "False" as options, which is also known as boolean in Python lingo.