Friday, February 23, 2018

Word of the Day: lemmatization

Word of the Day WhatIs.com
Daily updates on the latest technology terms |February 23, 2018
lemmatization

Lemmatization is the grouping together of different forms of the same word. In search queries, lemmatization allows end users to query any version of a base word and get relevant results. Because search engine algorithms use lemmatization, the user is free to query any inflectional form of a word and get relevant results. For example, if the user queries the plural form of a word (routers), the search engine knows to also return relevant content that uses the singular form of the same word (router).

Lemmatization is an important aspect of natural language understanding (NLU) and natural language processing (NLP) and plays an important role in big data analytics and artificial intelligence. Complex algorithms use the rules of linguistic morphology, in context with a particular language's vocabulary, to group words used in speech and writing by inflected forms. Deep learning is used to analyze and understand the grouping as a whole, so when any inflectional form of a word is mentioned, the base term's entire lemmatization is included.

 

In linguistics, lemmatization is closely related to stemming, the practice of stripping of prefixes and suffixes that have been added to a word's base form. Lemmatization, is more complex than stemming, however, because it requires words to be categorized by a part-of-speech as well as by inflected form. This can become quite complicated in languages other than English, whose only inflected forms are singular/plural, verb tense and comparative/superlative forms of adverbs and adjectives.

Quote of the Day

"NLP technology uses text and speech analytics to identify patterns in speech, a capability that can help businesses gain insight into how they can improve their products." - Nicole Lewis

 

Trending Terms

natural language understanding

search engine

HCI
natural language processing
stemming
AI

 
Learning Center

NLP technology inspires customer interaction projects in key verticals
NLP technology is starting to generate projects for IT service companies as businesses look to improve customer experience through chatbots and other apps.

Call center automation advances, but only as far as NLP can take it
Call center automation is changing customer service and enriching survey efforts, but strides forward hinge on natural language processing improvements.

AI in IT tools promises better, faster, stronger ops
Autonomous robots don't lurk around every corner, but there is growing AI in IT operations, and it yields improved speed, accuracy, analysis and insight.

Natural language generation software making inroads in enterprises
Natural language generation software is gradually finding its way into enterprises as businesses look to deploy emerging artificial intelligence tools.

Natural language driving proliferation of FB Messenger
Natural language processing isn't quite ready to pass the Turing test, but NLP bots using the technology are taking off.

Writing for Business

Although some parts of the consumer industry are adept at using artificial intelligence apps practically and profitably, most businesses are slow to ________ and implement AI.

a. except
b. accept

Answer


 

Stay In Touch
For feedback about any of our definitions or to suggest a new definition, please contact me at: mrouse@techtarget.com

 

Visit the Word of the Day Archives and catch up on what you've missed!

 

FOLLOW US

TwitterRSS
About This E-Newsletter
This e-newsletter is published by the TechTarget network. To unsubscribe from Whatis.com, click here. Please note, this will not affect any other subscriptions you have signed up for.
TechTarget

TechTarget, Whatis, 275 Grove Street, Newton, MA 02466. Contact: webmaster@techtarget.com

Copyright 2018 TechTarget. All rights reserved.

No comments: