Topic summary

Part of speech tagging

Part of speech tagging

Extracted from the Wikipedia article Part-of-speech tagging.

Use of hidden Markov models

CLAWS pioneered the field of HMM-based part of speech tagging but was quite expensive since it enumerated all possibilities. It sometimes had to resort to backup methods when there were simply too many options (the Brown Corpus contains a case with 17 ambiguous words in a row, and there are words such as "still" that can represent as many as 7 distinct parts of speech.