Evidence search
Search
Search titles, summaries, topics, providers, authors, and the full open-access corpus.
Results for “Usage accounting”
2 publicationsTechnical guideSource-based analysisTechnical guideSource-based analysis
Handle Azure OpenAI rate limits without retry storms
Separate deployment quota, short request bursts and bounded client retry behavior.
AI systems · Azure · By Cloud Security DeskA budget model for bounded AI inference
Request throttles, token quotas and billing alerts control different things. An inference service needs an admission decision that reserves bounded work and reconciles what actually ran.
AI systems · AWS / Kubernetes / vLLM · By Cloud Security Desk