Upcoming · CAQA AI AcademyLevel 4

Securing Generative AI

Enable practitioners to secure generative AI applications by design: placing controls outside the model, making retrieval respect permissions, limiting what AI tools can do, protecting sensitive data across prompts, outputs and logs, testing before release, and monitoring in production, then documenting it all in a controls plan that can be assured.

Upcoming course. LMS delivery and enrolment are not open. Release dates will be confirmed.

Express interest →

Planned learning outcomes

  1. Describe the components and trust boundaries of an LLM application and where each security control belongs
  2. Design retrieval so that answers only draw on content the requesting user is entitled to see
  3. Apply least privilege and graduated autonomy to the identities and tools an AI application uses
  4. Protect sensitive data across prompts, retrieved content, outputs, logs and vendor processing
  5. Plan pre-release adversarial testing as a release gate using defensive test categories
  6. Specify logging, detections and response actions for a generative AI application in production
  7. Prepare a generative AI security controls plan with owners, evidence and priorities