Introduction to Natural Language Processing (i-NLP) · Quiz 1 · Sep 2024

In a whimsical language where adjectives change based on the weather, an FST is designed to transform “happy” into “happyrain” on rainy days and “happysun” on sunny days. If the FST has 5 states for “happy” and 3 states each for weather conditions, what’s the minimum total number of states required?

In a graph-based dependency parser using edge-factored scoring, the following edge scores have been calculated for a sentence:

What is the score of the maximum spanning tree (assuming all other possible edges have lower scores)?

In evaluating a dependency parser, the following results were obtained on a test set of 500 words: • 450 words have the correct head • 425 words have both the correct head and correct label • 475 words have the correct label What are the Unlabeled Attachment Score (UAS) and Label Accuracy Score (LS)?

A legal document analysis tool is being developed to identify key clauses. If the tool correctly identifies 80 relevant clauses out of 100 actual relevant clauses, and incorrectly flags 20 irrelevant clauses as relevant, what is the F1 score of the tool?

In the sentence “The old Shakespearean Globe Theatre on the banks of the Thames hosted a modern rendition of ’A Midsummer Night’s Dream’”, which phrase is NOT a Named Entity?

In processing the sentence “After John beat him in chess, Bill lost his Queen,” which NLP level is most crucial for understanding “Queen” ?

Anaphora resolution, which falls under the discourse level of NLP, can be fully solved using only syntactic parsing techniques.

In the sentence “I saw her duck,” morphological analysis alone is sufficient to determine whether “duck” is being used as a noun or a verb.

What is a primary feature of agglutinative languages?

In morphological analysis, what is the primary difference between Item and Arrangement (IA) and Item and Process (IP) approaches?

Context-Free Grammar (CFG) rules can only generate sentences with a fixed word order.

The CKY parsing algorithm requires the grammar to be in Chomsky Normal Form (CNF).

Treebanks are automatically generated without human intervention.

In the sentence “He gave her a book,” the dependency relationship between “gave” and “book” is labeled as nsubj.

In the sentence “The cat sat on the mat,” the prepositional phrase “on the mat” serves as a dependent of “sat” in a case relation.

Which of the following NLP tasks would benefit from processing at the discourse level?

Which of the following are characteristics of Naive Bayes classifiers? (Select all that apply)

Which of the following are applications of clustering in NLP tasks? (Select all that apply)

In developing a sarcasm detection system for social media posts, which levels of NLP processing would be most crucial?

In a Hidden Markov Model (HMM) for POS tagging, the transition probability from the tag NOUN (noun) to VERB (verb) is 0.3, and the transition probability from VERB (verb) to DET (determiner) is 0.4. What is the joint transition probability of the sequence NOUN → VERB → DET?

In a Conditional Random Field (CRF) model for POS tagging, if there are 6 features per word and the sentence has 10 words, how many total feature values does the model compute for this sentence?

In a POS tagging model, out of 500 total predictions made, 420 were correct. What is the accuracy of the model as a percentage (rounded to two decimal places)?

In a binary classification task, the number of True Positives (TP) is 80, and the number of False Positives (FP) is 20. What is the precision of the model as a decimal (rounded to two decimal places)?

In a semantic role labeling evaluation, a model has identified 100 correct semantic roles out of 120 total semantic roles it predicted. What is the precision of the model as a decimal (rounded to two decimal places)?