Building LLM Applications With Prompt Engineering

Topics

• NVIDIA NIM
• LangChain
• Llama 3.1

Certificate

Upon successful completion of the workshop, participants will receive an NVIDIA DLI certificate to recognize their subject matter competency and support professional career growth.

Course Introduction

• Orient to the main worshop topics, schedule and prerequisites.
• Learn why prompt engineering is core to interacting with Large Languange Models (LLMs).
• Discuss how prompt engineering can be used to develop many classes of LLM-based applications.
• Learn about NVIDIA LLM NIM, used to deploy the Llama 3.1 LLM used in the workshop.

Introduction to Prompting

• Get familiar with the workshop environment.
• Create and view responses from your first prompts using the OpenAI API, and LangChain.
• Learn how to stream LLM responses, and send LLMs prompts in batches, comparing differences in performance.
• Begin practicing the process of iterative prompt development.
• Create and use your first prompt templates.
• Do a mini project where to perform a combination of analysis and generative tasks on a batch of inputs.

LangChain Expression Language (LCEL), Runnables, and Chains

• Learn about LangChain runnables, and the ability to compose them into chains using LangChain Expression Language (LCEL).
• Write custom functions and convert them into runnables that can be included in LangChain chains.
• Compose multiple LCEL chains into a single larger application chain.
• Exploit opportunities for parallel work by composing parallel LCEL chains.
• Do a mini project where to perform a combination of analysis and generative tasks on a batch of inputs using LCEL and parallel execution.

Prompting With Messages

• Learn about two of the core chat message types, human and AI messages, and how to use them explictly in application code.
• Provide chat models with instructive examples by way of a technique called few-shot prompting.
• Work explicitly with the system message, which will allow you to define an overarching persona and role for your chat models.
• Use chain-of-thought prompting to augment your LLMs ability to perform tasks requiring complex reasoning.
• Manage messages to retain conversation history and enable chatbot functionality.
• Do a mini-project where you build a simple yet flexible chatbot application capable of assuming a variety of roles.

Structured Output

• Explore some basic methods for using LLMs to generate structured data in batch for downstream use.
• Generate structured output through a combination of Pydantic classes and LangChain's `JsonOutputParser`.
• Learn how to extract data and tag it as you specify out of long form text.
• Do a mini-project where you use structured data generation techniques to perform data extraction and document tagging on an unstructured text document.

Tool Use and Agents

• Create LLM-external functionality called tools, and make your LLM aware of their availability for use.
• Create an agent capable of reasoning about when tool use is appropriate, and integrating the result of tool use into its responses.
• Do a mini-project where you create an LLM agent capable of utilizing external API calls to augment its responses with real-time data.

Assessment and Final Review

• Review key learnings and answer questions.
• Earn a certificate of competency for the workshop.
• Complete the workshop survey.
• Get recommendations for the next steps to take in your learning journey.