AI Glossary · Governance & Ops
Observability (AI Observability)
Tracing prompts, tool calls, retrievals and outputs across an AI system to diagnose quality, cost and safety issues in production.
Related terms in Governance & Ops
- AIOps
- Applying machine learning to IT operations data (logs, metrics, traces) to detect anomalies, correlate incidents and automate remediation.
- AI Gateway
- A managed proxy that routes model calls, enforces quotas, redacts PII, logs prompts, and applies policy across multiple LLM providers.
- Bias (Model Bias)
- Systematic error in model output that disadvantages a group or skews decisions — introduced through data, labeling, objectives or deployment context.
- Data Loss Prevention (DLP)
- Detecting and blocking sensitive data (PII, PCI, PHI, IP) from leaving controlled systems — a critical layer around LLM inputs and outputs.
- Deepfake
- Synthetic media (voice, video, image) generated by AI to imitate a real person. Growing threat surface for authentication and social engineering.
- Drift (Model Drift)
- Degradation in model quality over time as input data or the world changes; detected through monitoring and addressed with retraining or prompt updates.