Tokens Lexeme and Pattern

What is a token in the context of a compiler?

• A sequence of characters in the source code.

• A category that defines the meaning of a lexeme.

• The smallest meaningful unit in the source code, represented as a category.

• A regular expression used to define a pattern.

Which of the following best describes a lexeme?

• A syntactic rule for defining a programming language.

• A regular expression used to match patterns in the source code.

• A sequence of characters in the source code that matches a pattern.

• A symbolic representation of a token in the source code.

Which of the following is an example of a token?

• int

• int x = 10;

• KEYWORD

• x = 10

A pattern in the context of lexical analysis is:

• A regular expression that defines a category for a token.

• A predefined token type in the grammar.

• A sequence of characters in the program source code.

• A rule that defines the syntax of a programming language.

Which of the following is a lexeme for the token IDENTIFIER in the source code?

• x

• int

• =

• 10

What is the role of a pattern in the tokenization process?

• It provides the name for a token type.

• It matches lexemes in the source code and classifies them into token types.

• It defines how to combine tokens into expressions.

• It stores the value of the lexeme.

Which of the following is an example of a pattern for matching an integer literal?

• [a-zA-Z][a-zA-Z0-9]*

• [0-9]+

• \d+

• ".*"

In the statement int a = 10;, which of the following is the lexeme for the token OPERATOR?

• int

• a

• =

• 10

What is the pattern for matching an identifier in most programming languages?

• [0-9]+

• [a-zA-Z_][a-zA-Z0-9]*

• "[a-zA-Z_]*"

• [a-zA-Z]

In the following program segment: c Copy code int main() { int a = 10; } What is the token for 10?

• KEYWORD

• IDENTIFIER

• INTEGER_LITERAL

• OPERATOR