Abstract and Index Evaluation

What is the primary goal of evaluating an index or abstracting system?

• To ensure the system effectively connects users with the information they need.

• To decrease the size of the database by removing irrelevant documents.

• To increase the complexity of search queries for advanced users.

• To prove that one database is definitively better than all others.

A search for 'effects of climate change' retrieves 100 documents. Upon review, 75 of them are found to be relevant. What is the precision of this search?

• Cannot be determined from the information given.

• 75%

• 25%

• 100%

A database contains 50 relevant documents on a specific topic. A search retrieves 20 of these relevant documents. What is the recall of this search?

• 60%

• 20%

• 50%

• 40%

The famous Cranfield experiments established a foundational model for which type of evaluation?

• Economic evaluation based on system cost

• Technical evaluation based on system processing speed

• Quantitative evaluation using metrics like precision and recall.

• Qualitative evaluation based on user satisfaction.

If you broaden a search query to include more synonyms and related terms, what is the MOST likely impact on precision and recall?

• Precision will increase, and recall will decrease.

• Precision will decrease, and recall will decrease.

• Precision will decrease, and recall will increase.

• Precision will increase, and recall will increase.

Two indexers are asked to assign keywords to the same article. Their choices have very few terms in common. This is a problem of low:

• Relevance

• Exhaustivity

• Consistency

• Specificity

Which evaluation method involves observing users as they perform searches and asking them to verbalize their thought process?

• Think-Aloud Protocol

• User Survey

• Focus Group

• Precision/Recall Test

An abstract that provides the key findings and conclusions of a research paper is best described as:

• Structured

• Indicative

• Informative

• Critical

Assigning the index term 'Animals' to a document specifically about 'Siberian Tigers' is an error in:

• Syntax

• Consistency

• Exhaustivity

• Specificity

Qualitative evaluation methods are primarily concerned with:

• The processing power of the search server.

• Objective, numerical data about system performance.

• User perceptions, satisfaction, and experiences.

• The number of documents in the collection.