NLP 2

What is tokenization in NLP?

• Identifying named entities in a text

• Breaking down a text into individual words or tokens

• Grouping similar words together

• Removing stop words from a text

Which part-of-speech (POS) tag is typically assigned to the word "quickly" in the sentence "She ran quickly"?

• Noun

• Adjective

• Verb

• Adverb

Dependency parsing in NLP is used to:

• Identify structure by focusing on the relationships between words

• Break down a document into sentences

• Extract named entities from a sentence

• Classify text into categories

What is chunking in NLP?

• Splitting a text into tokens

• Grouping words into predefined categories

• Lemmatizing words into their base forms

• Identifying the sentiment of a sentence

Which of the following techniques is used to convert words into their base or dictionary form?

• Stemming

• Lemmatization

• Stop word removal

• Tokenization

Stemming is different from lemmatization because:

• Stemming removes stop words, while lemmatization does not

• Lemmatization removes affixes to derive the base form of a word, while stemming does not

• Stemming removes affixes and produces non-dictionary words, while lemmatization produces dictionary words

• Lemmatization is a simpler approach than stemming

Named Entity Recognition (NER) is used to identify:

• Common nouns in a sentence

• Punctuation marks

• Words that refer to persons, organizations, or locations

• The structure of sentences

Entity linking refers to:

• Linking words to their grammatical categories

• Connecting named entities in text to a knowledge base

• Grouping synonyms together

• Removing irrelevant entities from the text

Sentence segmentation or tokenizing sentence is the task of:

• Breaking a text into individual words

• Identifying and extracting named entities

• Dividing a text into individual sentences

• Grouping words into meaningful phrases

Which of the following is typically considered a stop word in text processing?

• "rain"

• "John"

• "the"

• "quick"