oh doh. thanks ... we just pushed a fix for the crash. Unfortunately our currently implementation needs service works for streaming audio, so the "fix" was to disable the feature if the worker isn't available
really depends on the voice. but in general, no we want to sound as realistic as possible and I expect future voices to keep improving on this front
this is a good solve. we don't support word time stamps natively yet, but are working on teaching GPT-4o that skill
S2S is where we're investing the most effort on audio ... sorry it's been slow but we are working hard on it Top priorities at the moment 1) Better function calling performance 2) Improved perception accuracy (not…
we're working hard on it at the moment and hope we'll have a snapshot ready in the next month or so we've debugged the cutoff issues and have fixes for them internally but we need a snapshot that's better across the…
this has been coming up often recently. nothing to announce yet, but when enough developers ask for it, we'll build it into the model's training diarization is also a feature we plan to add
we'll keep expanding these GPT-4o based models with more controls. Is the main feature missing we're missing custom voices?
not open source at this time. unfortunately they're much to large to run on normal consumer hardware
Should do! here's an example https://www.openai.fm/#4a5a82db-faea-4f80-813c-3131902c2458
thanks for flagging ... number fidelity (especially on languages that are unfortunately less represented in training data) is still something we're working to improve
nothing to share on open source yet, it's something we'll keep exploring. Especially as the models get smaller so more able to run on regular devices
try the ballad or fable voices
We've been using the FLUERS eval and you can see comparisons to other models on the market in the post https://openai.com/index/introducing-our-next-generation-aud... Curious if there's a benchmark you trust most?
It's a slightly better model for TTS. With extra training focusing on reading the script exactly as written. e.g. the audio-preview model when given instruction to speak "What is the capital of Italy" would often speak…
1/ we've been working a lot on accents, so expect improvements with these models... though we're not done. Would be curious how you find them. And try giving specific detailed instructions + examples for the accents you…
Yes, from our terms: "Don’t build tools that may be inappropriate for minors, including: Sexually explicit or suggestive content. This does not include content created for scientific or educational purposes."…
We're thinking about diarization (adding time awareness to GPT models) but no firm plans to share just yet
so good! https://www.openai.fm/#28540f27-5b51-445a-b1d6-1c89711a2c4f
some of the older voices are definitely less steerable, more robotic we put little stars in the bottom right corner for the newer voices, which should sound better
Hey, I'm Jeff and I was PM for these models at OpenAI. Today we launched three new state-of-the-art audio models. Two speech-to-text models—outperforming Whisper. A new TTS model—you can instruct it how to speak (try it…
apologies: it's taken us a minute to switch the default `gpt-4o` pointer to the newest snapshot we're planning on doing that default change next week (October 2nd). And you can get the lower prices now (and the…
yep image input on the new model is also 50% cheaper and apologies for the outdated pricing calculator ... we'll be updating it later today
oh doh. thanks ... we just pushed a fix for the crash. Unfortunately our currently implementation needs service works for streaming audio, so the "fix" was to disable the feature if the worker isn't available
really depends on the voice. but in general, no we want to sound as realistic as possible and I expect future voices to keep improving on this front
this is a good solve. we don't support word time stamps natively yet, but are working on teaching GPT-4o that skill
S2S is where we're investing the most effort on audio ... sorry it's been slow but we are working hard on it Top priorities at the moment 1) Better function calling performance 2) Improved perception accuracy (not…
we're working hard on it at the moment and hope we'll have a snapshot ready in the next month or so we've debugged the cutoff issues and have fixes for them internally but we need a snapshot that's better across the…
this has been coming up often recently. nothing to announce yet, but when enough developers ask for it, we'll build it into the model's training diarization is also a feature we plan to add
we'll keep expanding these GPT-4o based models with more controls. Is the main feature missing we're missing custom voices?
not open source at this time. unfortunately they're much to large to run on normal consumer hardware
Should do! here's an example https://www.openai.fm/#4a5a82db-faea-4f80-813c-3131902c2458
thanks for flagging ... number fidelity (especially on languages that are unfortunately less represented in training data) is still something we're working to improve
nothing to share on open source yet, it's something we'll keep exploring. Especially as the models get smaller so more able to run on regular devices
try the ballad or fable voices
We've been using the FLUERS eval and you can see comparisons to other models on the market in the post https://openai.com/index/introducing-our-next-generation-aud... Curious if there's a benchmark you trust most?
It's a slightly better model for TTS. With extra training focusing on reading the script exactly as written. e.g. the audio-preview model when given instruction to speak "What is the capital of Italy" would often speak…
1/ we've been working a lot on accents, so expect improvements with these models... though we're not done. Would be curious how you find them. And try giving specific detailed instructions + examples for the accents you…
Yes, from our terms: "Don’t build tools that may be inappropriate for minors, including: Sexually explicit or suggestive content. This does not include content created for scientific or educational purposes."…
We're thinking about diarization (adding time awareness to GPT models) but no firm plans to share just yet
so good! https://www.openai.fm/#28540f27-5b51-445a-b1d6-1c89711a2c4f
some of the older voices are definitely less steerable, more robotic we put little stars in the bottom right corner for the newer voices, which should sound better
Hey, I'm Jeff and I was PM for these models at OpenAI. Today we launched three new state-of-the-art audio models. Two speech-to-text models—outperforming Whisper. A new TTS model—you can instruct it how to speak (try it…
apologies: it's taken us a minute to switch the default `gpt-4o` pointer to the newest snapshot we're planning on doing that default change next week (October 2nd). And you can get the lower prices now (and the…
yep image input on the new model is also 50% cheaper and apologies for the outdated pricing calculator ... we'll be updating it later today