OpenAI Opens Decisions API to All Customers

OpenAI is making its Decisions API widely available after announcing it at its developer day on September 29, according to TechCrunch. The public version adds voice and visual support, along with geographically targeted inference resources intended to reduce latency across regions.

The API uses a reconfigured version of the Luna model to select from predefined options and return confidence scores. OpenAI says typical response times have fallen from one to three seconds to about 100 to 180 milliseconds.

Box, Datadog, Ramp and Speak tested the API as a faster alternative to large language models for some workflows. Speak reduced the delay between actions in its language tutoring product from 1.4 seconds to 0.13 seconds. OpenAI also used the API to improve the responsiveness of its Dots voice assistant.