ARTIFICIAL INTELLIGENCE FOR IT & NON-IT PROFESSIONALS NATURAL LANGUAGE PROCESSING (NLP) NATURAL LANGUAGE PROCESSING (NLP)
• a part of Computer Science, Human language, and AI
• used by machines to understand, analyze, manipulate, and interpret human languages • helps perform various tasks such as translation, automatic summarization, Named Entity Recognition (NER), speech recognition, relationship extraction, and topic segmentation NATURAL LANGUAGE PROCESSING (NLP) COMPONENTS OF NLP
• two components of NLP:
• Natural Language Understanding (NLU) • Natural Language Generation (NLG) NATURAL LANGUAGE UNDERSTANDING (NLU) • helps the machine to understand and analyze human language by extracting the metadata from the content such as concepts, entities, keywords, emotions, relations, and semantic roles • mainly used in Business apps NATURAL LANGUAGE GENERATION (NLG)
• acts as a translator that converts the computerized data into natural
language representation • mainly involves Text planning, Sentence planning, and Text Realization DIFFERENCE BETWEEN NLU & NLG
• NLU is essentially the process of reading and interpreting language
• NLU produces non-linguistic outputs from natural language inputs • Example of NLU: Automatic Routing of Tickets
• NLG is the process of writing or generating language
• NLG constructs and produces natural language outputs from non-linguistic inputs • Example of NLG: Automated Journalism SYNTAX VS SEMANTICS
• Syntax — determines valid form of program statements
• Semantics — behavior of valid program SYNTACTIC ANALYSIS (PARSING)
• is used to check grammar, word arrangements, and shows the
relationship among the words including nouns, verbs, etc • Example: Lahore goes to Amber - sentence is rejected by the Semantic Analyzer but acceptable to the Syntax Analyzer SEMANTIC ANALYSIS
• concerned with the meaning of the sentence
• considers literal meaning of words, phrases, context of sentence, etc. • Example: I want to get my fan DIFFERENCE BETWEEN SYNTAX AND SEMENTICS • Syntax: Grammar • Semantics: Meaning or sense of the sentence. Does the sentence make sense?