Web Scraping using Python

What protocol can be used to retrieve web pages using python?

• urllib

• bs4

• HTTP

• GET

What is a python library that can be used to send and receive data over HTTP?

• http

• urllib

• port

• header

What does the following block of code do?

• It creates a file named 'romeo.txt' in 'data.pr4e.org'

• It finds the urls linked to 'data.pr4e.org' and prints it.

• It opens a file named 'http://data.pr4e.org/romeo.txt' in local storage

• It prints the contents of 'romeo.txt' after retrieving it from 'data.pr4e.org'

What does the following regex match?

http[s]?://.+?

• Exact match to 'http[s]?://.+?'

• 'http://' or 'http[s]://' followed by one or more character

• 'http://' or 'https://' followed by one or more characters.

• 'https://' followed by one or more characters.

What does the following block of code do?

• retrieves and displays the webpage

• parses the html content of the "https://www.nytimes.com" webpage.

• downloads the webpage

Which line of code correctly gets the first item in items and makes the most sense following the below code snippet?

soup = BeautifulSoup(response.content, 'html.parser') items = soup.find_all(class_='items')

• first_item = items[0]

• first_item = items.find(0)

• first_item = items.get(0)

• first_item = items.find[0]

• first_item = soup.items[0]

How does one parse the HTML into a BeautifulSoup object given a response object?

• soup = BeautifulSoup(response.text, 'html.parser')

• soup = BeautifulSoup(response.content, 'html.parser')

• soup = BeautifulSoup(response.string, 'html.parser')

Which of the following is the best way to get the value for the id in the first p tag?

• soup.p.get('id')

• soup.p.get('id', None)

• soup.p[id]

• soup.p['id']

How does one get the first header 1 tag after creating a soup object?

• soup.h1

• soup.header1

• soup.h1[0]

• soup.h1[1]

Which of the following finds all link tags?

• all_links = soup.find('a')

• all_links = soup.findall('a')

• all_links = soup.findall('link')

• all_links = soup.find_all('a')

• all_links = soup.find_all('link')