Natural Language Processing Concepts
Natural language processing (NLP) is the area of AI that deals with making sense of written and spoken language. It involves a fascinating array of techniques designed to transform raw text into meaningful insights. Typically, an NLP solution starts with a large volume of raw text, which is then pre-processed to prepare it for modeling.
Imagine you are using a virtual assistant like Siri or Alexa. When you ask, “What’s the weather like today?”, the assistant uses NLP to process your spoken words. First, it converts your speech into text. Then, it pre-processes the text by removing stop-words and tokenizing the important terms. Finally, it interprets the tokens to understand that you’re inquiring about the weather forecast for today and provides you with the relevant information. This seamless interaction is made possible by the sophisticated NLP techniques that enable machines to understand and respond to human language.
Natural language processing and conversational AI in Azure
 |  |  |
| • Language detection • Key phrase extraction • Named entity detection • Sentiment analysis and opinion mining • Personal information detection • Summarization • Question answering • Conversational language understanding • (…) | • Text to speech • Speech to text • Speech translation • Speaker identification • Language identification • (…) | • Text translation • Document translation • Custom translation • (…) |
Analyzing text
Azure AI Language service provides pretrained and customizable deep learning models to analyze text. These models use tokens and embeddings to turn words into numerical representations. Deep learning models perform calculations on these numerical representations to provide responses returned in natural language.
Text Analysis encompasses many capabilities, including:
– identifying the predominant language of the text
– identifying the sentiment of the text
– identifying key phrases
– identifying entities
Azure bot service
Azure Bot Service provides a platform for creating, deploying, and managing bots. With the Azure Bot Service, developers can use the Microsoft Bot Framework SDK to develop bots and easily deploy and manage them in Azure.
I highly recommend completing the exercise provided here.
