Develop AI solutions in Azure

Outline

• Plan and prepare to develop AI solutions on Azure
  • What is AI?
  • Azure AI services
  • Azure AI Foundry
  • Developer tools and SDKs
  • Responsible AI
  • Exercise - Prepare for an AI development project
  • Module assessment
• Choose and deploy models from the model catalog in Azure AI Foundry portal
  • Explore the model catalog
  • Deploy a model to an endpoint
  • Optimize model performance
  • Exercise - Explore, deploy, and chat with language models
  • Module assessment
• Develop an AI app with the Azure AI Foundry SDK
  • What is the Azure AI Foundry SDK?
  • Work with project connections
  • Create a chat client
  • Exercise - Create a generative AI chat app
  • Module assessment
• Get started with prompt flow to develop language model apps in the Azure AI Foundry
  • Understand the development lifecycle of a large language model (LLM) app
  • Understand core components and explore flow types
  • Explore connections and runtimes
  • Explore variants and monitoring options
  • Exercise - Get started with prompt flow
  • Module assessment
• Develop a RAG-based solution with your own data using Azure AI Foundry
  • Understand how to ground your language model
  • Make your data searchable
  • Create a RAG-based client application
  • Implement RAG in a prompt flow
  • Exercise - Create a generative AI app that uses your own data
  • Module assessment
• Fine-tune a language model with Azure AI Foundry
  • Understand when to fine-tune a language model
  • Prepare your data to fine-tune a chat completion model
  • Explore fine-tuning language models in Azure AI Studio
  • Exercise - Fine-tune a language model
  • Module assessment
• Implement a responsible generative AI solution in Azure AI Foundry
  • Plan a responsible generative AI solution
  • Map potential harms
  • Measure potential harms
  • Mitigate potential harms
  • Manage a responsible generative AI solution
  • Exercise - Apply content filters to prevent the output of harmful content
  • Module assessment
• Evaluate generative AI performance in Azure AI Foundry portal
  • Assess the model performance
  • Manually evaluate the performance of a model
  • Automated evaluations
  • Exercise - Evaluate generative AI model performance
  • Module assessment
• Get started with AI agent development on Azure
  • What are AI agents?
  • Options for agent development
  • Azure AI Foundry Agent Service
  • Exercise - Explore AI Agent development
  • Module assessment
• Develop an AI agent with Azure AI Foundry Agent Service
  • What is an AI agent
  • How to use Azure AI Foundry Agent Service
  • Develop agents with the Azure AI Foundry Agent Service
  • Exercise - Build an AI agent
  • Module assessment
• Integrate custom tools into your agent
  • Why use custom tools
  • Options for implementing custom tools
  • How to integrate custom tools
  • Exercise - Build an agent with custom tools
  • Module assessment
• Develop an AI agent with Semantic Kernel
  • Understand Semantic Kernel AI agents
  • Create an Azure AI agent with Semantic Kernel
  • Add plugins to Azure AI agent
  • Exercise - Develop an Azure AI agent with the Semantic Kernel SDK
  • Knowledge check
• Orchestrate a multi-agent solution using Semantic Kernel
  • Understand the Semantic Kernel Agent Framework
  • Create an agent group chat
  • Design an agent selection strategy
  • Define a chat termination strategy
  • Exercise - Develop a multi-agent solution
  • Knowledge check
• Analyze text with Azure AI Language
  • Provision an Azure AI Language resource
  • Detect language
  • Extract key phrases
  • Analyze sentiment
  • Extract entities
  • Extract linked entities
  • Exercise - Analyze text
  • Module assessment
• Create question answering solutions with Azure AI Language
  • Understand question answering
  • Compare question answering to Azure AI Language understanding
  • Create a knowledge base
  • Implement multi-turn conversation
  • Test and publish a knowledge base
  • Use a knowledge base
  • Improve question answering performance
  • Exercise - Create a question answering solution
  • Module assessment
• Build a conversational language understanding model
  • Understand prebuilt capabilities of the Azure AI Language service
  • Understand resources for building a conversational language understanding model
  • Define intents, utterances, and entities
  • Use patterns to differentiate similar utterances
  • Use pre-built entity components
  • Train, test, publish, and review a conversational language understanding model
  • Exercise - Build an Azure AI services conversational language understanding model
  • Module assessment
• Create a custom text classification solution
  • Understand types of classification projects
  • Understand how to build text classification projects
  • Exercise - Classify text
  • Module assessment
• Custom named entity recognition
  • Understand custom named entity recognition
  • Label your data
  • Train and evaluate your model
  • Exercise - Extract custom entities
  • Module assessment
• Translate text with Azure AI Translator service
  • Provision an Azure AI Translator resource
  • Understand language detection, translation, and transliteration
  • Specify translation options
  • Define custom translations
  • Exercise - Translate text with the Azure AI Translator service
  • Module assessment
• Create speech-enabled apps with Azure AI services
  • Provision an Azure resource for speech
  • Use the Azure AI Speech to Text API
  • Use the text to speech API
  • Configure audio format and voices
  • Use Speech Synthesis Markup Language
  • Exercise - Create a speech-enabled app
  • Module assessment
• Translate speech with the Azure AI Speech service
  • Provision an Azure resource for speech translation
  • Translate speech to text
  • Synthesize translations
  • Exercise - Translate speech
  • Module assessment
• Develop an audio-enabled generative AI application
  • Deploy a multimodal model
  • Develop an audio-based chat app
  • Exercise - Develop an audio-enabled chat app
  • Module assessment
• Analyze images
  • Provision an Azure AI Vision resource
  • Analyze an image
  • Exercise - Analyze images
  • Module assessment
• Read text in images
  • Explore Azure AI options for reading text
  • Read text with Azure AI Vision Image Analysis
  • Exercise - Read text in images
  • Module assessment
• Detect, analyze, and recognize faces
  • Plan a face detection, analysis, or recognition solution
  • Detect and analyze faces
  • Verify and identify faces
  • Responsible AI considerations for face-based solutions
  • Exercise - Detect and analyze faces
  • Module assessment
• Classify images
  • Azure AI Custom Vision
  • Train an image classification model
  • Create an image classification client application
  • Exercise - Classify images
  • Module assessment
• Detect objects in images
  • Use Azure AI Custom Vision for object detection
  • Train an object detector
  • Develop an object detection client application
  • Exercise - Detect objects in images
  • Module assessment
• Analyze video
  • Understand Azure Video Indexer capabilities
  • Extract custom insights
  • Use Video Analyzer widgets and APIs
  • Exercise - Analyze video
  • Module assessment
• Develop a vision-enabled generative AI application
  • Deploy a multimodal model
  • Develop a vision-based chat app
  • Exercise - Develop a vision-enabled chat app
  • Module assessment
• Generate images with AI
  • What are image-generation models?
  • Explore image-generation models in Azure AI Foundry portal
  • Create a client application that uses an image generation model
  • Exercise - Generate images with AI
  • Module assessment
• Create a multimodal analysis solution with Azure AI Content Understanding
  • What is Azure AI Content Understanding?
  • Create a Content Understanding analyzer
  • Use the Content Understanding REST API
  • Exercise - Extract information from multimodal content
  • Module assessment
• Create an Azure AI Content Understanding client application
  • Prepare to use the AI Content Understanding REST API
  • Create a Content Understanding analyzer
  • Analyze content
  • Exercise - Develop a Content Understanding client application
  • Module assessment
• Use prebuilt Document intelligence models
  • Understand prebuilt models
  • Use the General Document, Read, and Layout models
  • Use financial, ID, and tax models
  • Exercise - Analyze a document using Azure AI Document Intelligence
  • Module assessment
• Extract data from forms with Azure Document intelligence
  • What is Azure Document Intelligence?
  • Get started with Azure Document Intelligence
  • Train custom models
  • Use Azure Document Intelligence models
  • Use the Azure Document Intelligence Studio
  • Exercise - Extract data from custom forms
  • Module assessment
• Create a knowledge mining solution with Azure AI Search
  • What is Azure AI Search?
  • Extract data with an indexer
  • Enrich extracted data with AI skills
  • Search an index
  • Persist extracted information in a knowledge store
  • Exercise - Create a knowledge mining solution
  • Module assessment