Bringing Guardrails in Production for AI Apps using Portkey and Postman
Thursday, September 19, 2024 | 9:00 a.m. (PDT)
Presented by Vrushank Vyas, Dev Rel at Portkey.
LLM outputs are still unreliable. Some of it is fixed with having strong AI guardrails that scan your inputs & outputs and fix LLM behavior on the fly. By using Postman along with Portkey's open source AI Gateway, we now bring these Guardrails right on top of the Gateway to help AI teams fully orchestrate their requests EXACTLY the way they want. This talk will demonstrate how the "Guardrails on the Gateway" pattern is crucial for all AI teams going to production.
Control Panel for AI Apps
With Portkey's AI Gateway, Guardrails, and Observability Suite, thousands of teams ship reliable, cost-efficient, and fast apps.
Your AI strategy is only as strong as your APIs.
Postman helps teams collaboratively build APIs that power workflows and intelligent agents. With support for the Model Context Protocol (MCP), your APIs are integration ready. Learn how top teams avoid pitfalls and rescue APIs from chaos.