FNLP W10

What is the colour of Dr Joel's shirt?

• Black

• Blue

• Red

• PINK

Which one is not a type of QA task

• Extractive QA

• Open Generative QA

• Closed Generative QA

• Multilayered Generative QA

What does BERT stand for?

• Bidirectional Encoder Representations from Transformers

• Bilayered Encoder Representations from Transformers

• Bidirectional Entropy Refined Transformers

• Bidirectional Encoder Residual Transformers

Pre-training of transformers can be done on?

• Encoders

• Decoders

• Encoder-Decoders

• All of the answers here

TRUE OR FALSE? "DistilBERT model is a distilled form of the BERT model. The size of a BERT model was reduced by 40% via knowledge distillation during the pre-training phase while retaining 97% of its language understanding abilities and being 60% faster"

• TRUE

• FALSE

TRUE OR FALSE? BERT is a form of decoder where as GPT is a form of encoder

• TRUE

• FALSE

"Replace some fraction of words in the input with a special [MASK] token; predict these words". Which word below is best associated with the statement above?

• BERT

• GPT

• Transformers

• LSTM

Which of the below is NOT a requirement of a standard dataset for QA?

• Context

• Question

• Answer

• Class

BERT can be fine-tuned to be used to solve other tasks including QA

• TRUE

• FALSE

For QA, BERT basically just predicts the START and END token in a context

• TRUE

• FALSE