8349  Reviews star_rate star_rate star_rate star_rate star_half

Securing & Red-Teaming Generative AI Deployments

Learn how to secure and test generative AI deployments against vulnerabilities. In this Generative AI course, participants learn the top GenAI vulnerabilities from the OWASP Top 10 for LLMs, the...

Read More
Duration 3 days
Course Code GAI-2501
Available Formats Classroom

Overview

Learn how to secure and test generative AI deployments against vulnerabilities. In this Generative AI course, participants learn the top GenAI vulnerabilities from the OWASP Top 10 for LLMs, the patterns of adversarial threads with the MITRE ATLAS, and ways to address risk with the NIST AI Risk Management Framework, all ensuring robust and secure GenAI applications.

Skills Gained

By the end of this course, participants will be able to:

  • Secure generative AI deployments against unique threats
  • Identify and mitigate vulnerabilities using OWASP Top 10 and MITRE ATLAS
  • Implement red-teaming techniques to uncover security gaps
  • Apply strategies to protect and maintain AI applications
  • Develop comprehensive security plans for long-term AI protection

Who Can Benefit

  • Cybersecurity
  • DevOps
  • Software Developers
  • Data Scientists

Prerequisites

  • Comfort writing Python code and working in developer interfaces
  • Practical cybersecurity experience and/or hold a major cybersecurity certification (e.g., Security+, CISSP)
  • Foundational knowledge of generative AI, prompt engineering, retrieval augmented generation, and GenAI development patterns (Covered by GAI-1101 or similar)

Course Details

Software

All attendees must have a modern web browser and an Internet connection.

Introduction to Generative AI Security

  • What differentiates GenAI security from traditional cybersecurity?
  • Applying the CIA Triad to Generative AI
  • Security by Modality
  • Current Threat Actors

OWASP Top 10 for LLM

  • Prompt Injection and Indirect Prompt Injection
  • Supply Chain Vulnerabilities and Data & Model Poisoning
  • Sensitive Information Disclosure, Improper Output Handling, and System Prompt Leakage
  • Vector and Embedding Weaknesses
  • Misinformation, Excessive Agency, and Unbounded Consumption

MITRE ATLAS Tactics and Techniques

  • Reconnaissance, Resource Development, and Initial Access
  • ML Model Access, Execution, and Persistence
  • Privilege Escalation, Defense Evasion, and Credential Access
  • Discovery and Collection
  • ML Attack Staging, Exfiltration, and Impact

Foundations of GenAI Red-Teaming

  • Building a Group of Red Teamers
  • Deciding What to Test
  • Open-Ended vs. Closed-List Testing
  • Recording the Testing Output

Automating GenAI Red-Teaming

  • Adversarial Simulations vs. Model Evaluations
  • Benchmarks for Security and Harm
  • Building Custom Benchmarks

Securing Training Data

  • Controlling Access to Training Data
  • Sanitizing Training Data
  • Maintaining Dataset Provenance
  • Verifying Datasets Integrity

Mitigating Input and Output Data Attacks

  • Model Hardening & Guardrails
  • Detecting and Recovering Adversarial Inputs
  • Active and Passive Output Obfuscation
  • Restricting Queries and Using Ensemble Methods

Protecting Models

  • Limiting Public Release of Information
  • Controlling Access to Model Artifacts
  • Verifying ML Artifacts
  • AI Bill of Materials
  • AI Monitoring and Telemetry Logging

Using the NIST AI Risk Management Framework to Maintain Generative AI Security

  • Understanding the Core Functions
  • The Generative AI Profile
  • Applying the NIST AI RMF to GenAI
  • Integrating Security into Governance
  • Maintaining Security Posture

Schedule

FAQ

Does the course schedule include a Lunchbreak?

Classes typically include a 1-hour lunch break around midday. However, the exact break times and duration can vary depending on the specific class. Your instructor will provide detailed information at the start of the course.

What languages are used to deliver training?

Most courses are conducted in English, unless otherwise specified. Some courses will have the word "FRENCH" marked in red beside the scheduled date(s) indicating the language of instruction.

What does GTR stand for?

GTR stands for Guaranteed to Run; if you see a course with this status, it means this event is confirmed to run. View our GTR page to see our full list of Guaranteed to Run courses.

Does Ascendient Learning deliver group training?

Yes, we provide training for groups, individuals and private on sites. View our group training page for more information.

What does vendor-authorized training mean?

As a vendor-authorized training partner, we offer a curriculum that our partners have vetted. We use the same course materials and facilitate the same labs as our vendor-delivered training. These courses are considered the gold standard and, as such, are priced accordingly.

Is the training too basic, or will you go deep into technology?

It depends on your requirements, your role in your company, and your depth of knowledge. The good news about many of our learning paths, you can start from the fundamentals to highly specialized training.

How up-to-date are your courses and support materials?

We continuously work with our vendors to evaluate and refresh course material to reflect the latest training courses and best practices.

Are your instructors seasoned trainers who have deep knowledge of the training topic?

Ascendient Learning instructors have an average of 27 years of practical IT experience and have also served as consultants for an average of 15 years. To stay current, instructors spend at least 25 percent of their time learning new, emerging technologies and courses.

Do you provide hands-on training and exercises in an actual lab environment?

Lab access is dependent on the vendor and the type of training you sign up for. However, many of our top vendors will provide lab access to students to test and practice. The course description will specify lab access.

Will you customize the training for our company’s specific needs and goals?

We will work with you to identify training needs and areas of growth.  We offer a variety of training methods, such as private group training, on-site of your choice, and virtually. We provide courses and certifications that are aligned with your business goals.

How do I get started with certification?

Getting started on a certification pathway depends on your goals and the vendor you choose to get certified in. Many vendors offer entry-level IT certification to advanced IT certification that can boost your career. To get access to certification vouchers and discounts, please contact info@ascendientlearning.com.

Will I get access to content after I complete a course?

You will get access to the PDF of course books and guides, but access to the recording and slides will depend on the vendor and type of training you receive.

How do I request a W9 for Ascendient Learning?

View our filing status and how to request a W9.

Reviews

Course was great and informative. The instructor had a good flow and was very personable.

ExitCertified provided us with a great opportunity to learn more about React and in easy to follow way.

Concise and good to follow along. Although it is a lot to take in under a short period of time.

Labs and the study materials provided for Architecting on AWS course are very easy to understand and explains all the topics required to pass the Associate certification.

Sean is the very good instructor. I would like to take his class again in the future.