What is Tokenization?

• Splitting text into individual words or tokens

• Removing common words from text

• Reducing words to their base form

• Extracting named entities from text

What is Stopword Removal?

• Splitting text into individual words or tokens

• Removing common words from text

• Reducing words to their base form

• Extracting named entities from text

What is Stemming?

• Splitting text into individual words or tokens

• Removing common words from text

• Reducing words to their base form

•  Extracting named entities from text

What is Bag of Words (BoW)?

• Representing text as a collection of words, disregarding grammar and word order

• Weighing words based on their frequency in a document

• Using vectors to represent words in a continuous vector space

• Identifying topics within a collection of documents

What is TF-IDF?

• Representing text as a collection of words, disregarding grammar and word order

• Weighing words based on their frequency in a document

• Using vectors to represent words in a continuous vector space

• Identifying topics within a collection of documents

What is Sentiment Analysis?

• Determining if the sentiment expressed in text is positive, negative, or neutral

• Identifying specific emotions expressed in text

• Extracting named entities from text

• Summarizing text by selecting key sentences

What is Topic Modeling?

• Using vectors to represent words in a continuous vector space

•  Identifying specific emotions expressed in text

• Grouping similar texts together without predefined labels

• Identifying topics within a collection of documents

Generating a summary that captures the main ideas in new sentences

• Abstractive Summarization

•  Extractive Summarization

How does clustering differ from classification?

• Clustering groups data without predefined labels, while classification assigns data to predefined categories

• Classification is unsupervised, while clustering is supervised

Collocation analysis focuses on

• Words that frequently appear together in a text

•  Identifying synonyms

• Translating text

•  Identifying sentence structure