Text Analysis 2 (week 6)

A collection of successive items in a text document that may include words, numbers, symbols, and punctuation

• n-gram

• collocation

• phrase

• sentence

Words, character sets, or combinations of words and punctuation that are used to decompose text into

• n-grams

• symbols

• lemmas

• tokens

A basic form in linguistics upon which a word form pattern is based

• unigram

• infinitive

• lemma

• token

Words without informational value

• stopwords

• auxiliaries

• nonwords

• euphemisms

Objects are being grouped based on similarity

• grouping

• clustering

• classification

• association

Series of words or terms that co-occur more often than would be expected by chance

• collocation

• stemming

• classification

• association

Seeking to locate and classify named entity mentions in unstructured text into pre-defined categories such as the person names, organizations, locations, medical codes, time expressions, quantities, monetary values, percentages, etc.

• Information Retrieval

• Representational State Transfer (REST)

• Named-entity recognition (NER)

• entity extraction

A model of text which uses a representation of text that is based on an unordered collection of words

• bag of words

• phraseology

• datafication

• lemmatization