When the agent formulates a response, it passes the conversation (user message plus proposed reply) through MetaText AI's Evaluate endpoint. The system checks the response against your configured policies. If a violation is detected, the agent receives either a corrected version or a custom override message. All this happens in milliseconds before the customer sees anything.

Yes. MetaText AI supports project-based classification with trained models. You define your labels (like 'billing,' 'technical,' 'complaint,' 'sales') and train the model on your data. The agent then classifies every incoming message using your custom model, returning labels with confidence scores for each category.

Policies can target user input, assistant output, context, or system messages. Rules can block PII disclosure, prevent off-topic responses, enforce brand voice, restrict discussion of competitors, block harmful content, and more. Each policy supports custom override responses and can be applied to specific conversation roles.

The red team scan sends real adversarial probes against your application through MetaText AI's API. It simulates actual attack patterns including prompt injection, jailbreaking, and data extraction. The probes test your configured policies under realistic conditions. Results show which probes succeeded and which were blocked, giving you actionable hardening data.

MetaText AI processes classification and guardrail evaluation at API speed. The fail_fast option stops evaluation on the first violation for maximum speed. For most conversations, the added latency is under 200 milliseconds, imperceptible to customers. You can tune the balance between thoroughness and speed using the evaluation settings.

OpenAI's moderation flags broad content categories like violence or hate speech. MetaText AI lets you define custom policies specific to your business: no discussing competitors, no sharing internal pricing, no medical advice without disclaimers. Plus MetaText AI adds classification, extraction, red team testing, and full guardrail management, not just binary moderation flags.

Yes. MetaText AI provides both chat completion and text generation endpoints that are OpenAI-compatible. You can use these for generating responses, summaries, or content while simultaneously running guardrail checks on the output. Generation and safety work together in the same API ecosystem.

You can enable the correction_enabled flag, which returns a modified version of the response that satisfies the policy rather than completely blocking it. You can also adjust policy rules to be more or less strict, update definitions, and monitor policy performance. Guardrails are iterative, you refine them as you see real conversation patterns.