Hardly the hundreds of so-called 'AI startups' crying for VC money over a wrapper AI product aren't smart enough to realize how OpenAI is directly competing against them.
OpenAI has every right to "kill" any startup that is just a wrapper around their API. You aren't obligated to not compete with people using your own product to make money.
The IT worlds is basically integration and / or very niche custom software development.
There are plenty of countries around the world, special use cases, etc. and enough work for the normal it world to go around.
For my startup, im pretty sure the finetuning is a huge win even if we 'just use' openai because openai doesn't have the information we have and i'm pretty sure they also don't care for our niche (right now, and AGI in 20 years, i will probably no longer be needed one way or the other ;P)
What are folks most excited about? I personally would love some of the code interpreter stuff as an API. But, currently trying to fix the breaking changes on their latest pypi package -- maybe before the livestream starts
All of the tooling they've done for ChatGPT folded into one tool instead of having to choose between evaluating code or browsing the web, would be a good one.
Tree history of chat messages would be great as well. Their data structures already seem to support it/made for it, so probably coming soon.
That's what I do today and I still occasionally see failures that are extremely annoying because there's nothing I can do but resend the request to the API.
It seems like you'd need finetuning to make it truly consistent, which is what I'm assuming they did.
No joke, I heard from someone who interviewed there that they told him he wouldn't need to know how to code for the role because chatgpt would do it for him.
i guess someone needs to be ultimately responsible for decision making and so forth. chatgpt can do the coding but a human will confirm all business decisions
I am even more confused now. They claim ai can do everything. So that includes business decisions. Weren't there claims that someone even built a business following chatgpt advice? Someone even claimed it cured their dog.
Yes. But my understanding is that you have to be exceptional already - probably have a pHD and notoriety in some way so you won't be surprised when you get the offer anyways and already would have a strong opinion on it. Most of us don't have to worry about that decision.
Goodbye all the startups trying to build LLMs/fine tuning/agents. OpenAI is so dominant all of these startups are solving sub problems of the generalized algorithms of OpenAI. Good for them for crushing the competition, finally a competent company broke the monopolies of Google/FB. All those highly paid researchers at Google/FB cannot release models that are remotely close. The emperor has no clothes
How does this actually kill fine tuning? I don't think OpenAI can kill open models. People are not going to to stop wanting to keep their data in-house or at least more under their own control. And there are massive companies behind the open models.
OK but their secret sauce is out there. There are other foundational models. Curious to see if they can create lock-in or network effects with their APIs and such
my uneducated guess is they may aim to get major share of income via selling ChatGPT Enterprise to Fortune 500 list, where cost of running probably is not much of a concern
There's thousands of niches where you have to really know the domain, which OpenAI will never bother doing. If startup is smart and has a moat, it's going to be OK.
I wonder if they will release improvements to voice in ChatGPT. I have been working on a local AI with voice and it responds much, much faster than ChatGPT[1]. OpenAI's voices sound amazing and GPT-4 is still the best chat model, but despite that it's a lot more fun to have a conversation with reasonable latency. I expect it's only a matter of time before OpenAI does something better, I'm actually surprised they released it in such a slow state.
I've been extremely happy with their generated voice!
I had GPT read something to me in the car. My wife was nonplussed with my "audiobook" until I told her that you can talk to it like Siri. Then she called it "scary" haha
The voices sound great! But the latency is too high, and it's clunky to use with voice alone, it only listens to you at specific times and you can't interrupt it with your voice. I wanted something that felt more like having a casual conversation with a real person, instead of "Siri but smarter". And I know it's possible because I built something closer to what I want.
I’m really curious how much of the speech to text is happening on device, I’m fairly sure the answer is “none”. That would have a fairly immediate performance boost. Right now it is cool as hell, just way too slow to be truly useful.
Yeah I expect the speech recognition is happening in the cloud. But that doesn't mean it necessarily has to be slow. You can stream audio with very low latency on most connections. The problem is what they do with the audio once it gets to the server. I suspect it would be far too expensive to dedicate a GPU to each customer so they need to run everything in batch mode which increases latency.
They didn't do a good job of "gathering" then. Real AI researchers don't have time to keep reading blogs. They should have announced it first and foremost on arXiv or inside the GPT API documentation if they wanted real researchers.
Are they even a real researcher, if an AI agent hasn't scavenged the Internet for relevant events and planned the trip. Check, maybe your virtual AI persona is attending it.
Underwhelming, in the sense that it s mostly predictable stuff that others are making, too.
they are making an app platform (GPTs) that might make some money. But more likely apple and google will make their own platforms.
I don't believe "building with language" is possible, unless you are already a programmer , which defeats the purpose. Most developers can attest to this, people don't actually know what they want, nor how to express it clearly.
A few thoughts: cheaper GPT-4 will only extend their lead. The biggest thing holding us back right now is not being able to get open-ai hosted in AWS with the rest of our stack. And I cant wait to see more tools built on top of these LLM tools that help us iterate on prompts and protect against regressions while pushing forward at the same time.
- Better memory retrieveal across a longer span of time
- 4 new APIs: DALLE-3, GPT-4-vision, TTS (speech synthesis), and Whisper V3 (speech recognition).
- GPT-4 Turbo, a more intelligent iteration, confirmed as superior to GPT-4.
- GPT-4 Turbo pricing significantly reduced, about 3 times less expensive than GPT-4. Input and output tokens are respectively 3× and 2× less expensive than GPT-4. It’s available now to all developers in preview.
- Improved JSON handling (via JSON mode) and function invocation for more sophisticated control.
- Doubled rate limits with the option to request increases in account settings.
- Built-in retrieval-augmented generation (RAG) and knowledge current as of April 2023.
- Whisper V3 to be open-sourced and added to the API suite.
- Copyright Shield initiative to cover legal fees for copyright-related issues.
- Ability to create your own, custom "GPTs".
- Assistants API and new tools (Retrieval, Code Interpreter)
This is much better than I would have thought, especially pricing. It may also be a sign that OpenAI expects competition in the near future, which would be another good news.
> It may also be a sign that OpenAI expects competition in the near future, which would be another good news.
Of course there is competition. OpenAI is using the Andrew Carnegie playbook of aggressively cutting costs so that the competitors have no chance to get up and running. They are cutting off the competition before they can start. I don't see evidence to believe that AI moves into a commodity business anytime soon.
So nutty. I didn't think they were going to drop such a huge bomb on the industry. We're firmly in "singularity" territory where the pace of acceleration is so fast, huge strides are being made every day / week, it feels like.
Well April 2023 is a key date here - that's presumably when they started final training a lot of these models.
We're probably able to conclude what we're seeing in public is about about 6 months behind what's happening in development. We know that in the past OpenAI relied on a lot more lag.
Point is innovation is certainly accelerating but also OpenAI's time-to-market is shrinking (/shrunk - it probably can't get much shorter).
Nice. So it's just a new checkpoint for the large model, no other changes? Should be easy to integrate, though it would be nice to have updates for the smaller models too.
Ooh, Whisper V3! I wonder how it will compare to Distil-Whisper just released by Hugging Face. I imagine it's better, although I noticed that ChatGPT's voice mode still has the classic Whisper hallucinations ("Thank you for watching!"), I wonder if it's been using Whisper v3 already.
... and to publish them to the "GPT Store" that comes later this month. They are turning this into a new type of operating system, everyone can use the "GPT Builder" to publish apps/GPTs to that store.
People that saw PARC back in the day: do you think OpenAI eventually suffers the same fate? As in, will all of these improvements end up 'stolen' by another company?
Why it could happen: natural language is a UI. A UI is only as good as what it can connect to. Browsers are OpenAI's current limit.
Why it could not happen: experts and foundation models are actually very hard to get working like presented. This is a moat.
Fundamental difference is PARC was a side project for Xerox and they had no clue what they have in hand. OpenAI is AI only company and they know what they have built and how it may change the world, so today you can see all the new moats they are adding and going up the food chain.
Will they succeed or end up being MS division with "paltry" 10-20 billion payout, let's see.
It's amazing how quickly this company went from a "hacker startup" to "maximally corporate" within less than a year(!).
Just one year ago, it released a transcendental experimental product early and with no grand plan for monetization (chatGPT). Now, we have a polished keynote, with an "app store," a "developer platform," complete with your cheesy music and smiling company reps. How nice of them for sharing their revenue with us when we publish on their app store!
It's amazing and sad how quickly the hacker joy has been sucked out of this company.
> It's amazing and sad how quickly the hacker joy has been sucked out of this company.
I get the aversion to polished presentations like this, but I dunno, I work here and still feel like there's a lot of hacker joy still. You clearly aren't the audience for this presentation, but one audience doesn't exclude another.
GPT-4 Turbo vision is much cheaper than I expected. A 768*768 px image costs just $0.00765 to input. That's practical to replace more specialized computer vision models for many use-cases.
119 comments
[ 4.1 ms ] story [ 171 ms ] threadhttps://pypi.org/project/openai/
First it was Jasper, then the Chat with PDF apps and now it will be the custom chatbot services like Chatbase.
The second biggest lie by OpenAI after its now contradictory namesake, is that it competes against its own partners after denying that they don’t. [0]
[0] https://www.theinformation.com/articles/the-best-little-unic...
Hardly the hundreds of so-called 'AI startups' crying for VC money over a wrapper AI product aren't smart enough to realize how OpenAI is directly competing against them.
There are plenty of countries around the world, special use cases, etc. and enough work for the normal it world to go around.
For my startup, im pretty sure the finetuning is a huge win even if we 'just use' openai because openai doesn't have the information we have and i'm pretty sure they also don't care for our niche (right now, and AGI in 20 years, i will probably no longer be needed one way or the other ;P)
https://twitter.com/OpenAIDevs
https://www.reddit.com/r/ChatGPT/comments/17p0tot/leaked_ope...
Tree history of chat messages would be great as well. Their data structures already seem to support it/made for it, so probably coming soon.
It seems like you'd need finetuning to make it truly consistent, which is what I'm assuming they did.
However, I have a virtually 100% success rate with the JSON feature in Langchain.
there are plenty of people able to do what im able to do. They will not just move me over to SF just to have some MLOps/Platform expert.
The crypto stuff Sam A. is doing is garbage but he is rich enough, it has less of a 'get rich scheme' i believe. That would be otherwise a no go
[1] For anyone who has a gaming PC with 12GB+ Nvidia GPU and wants to try: https://www.microsoft.com/store/apps/9NC624PBFGB7
I had GPT read something to me in the car. My wife was nonplussed with my "audiobook" until I told her that you can talk to it like Siri. Then she called it "scary" haha
Where exactly were they "gathering"? I'm squarely in AI research at a major co and I never received anything about it.
they are making an app platform (GPTs) that might make some money. But more likely apple and google will make their own platforms.
I don't believe "building with language" is possible, unless you are already a programmer , which defeats the purpose. Most developers can attest to this, people don't actually know what they want, nor how to express it clearly.
(GPT store and Assistant API too)
But click yourself an azure account, build an API and just use it.
- Better memory retrieveal across a longer span of time
- 4 new APIs: DALLE-3, GPT-4-vision, TTS (speech synthesis), and Whisper V3 (speech recognition).
- GPT-4 Turbo, a more intelligent iteration, confirmed as superior to GPT-4.
- GPT-4 Turbo pricing significantly reduced, about 3 times less expensive than GPT-4. Input and output tokens are respectively 3× and 2× less expensive than GPT-4. It’s available now to all developers in preview.
- Improved JSON handling (via JSON mode) and function invocation for more sophisticated control.
- Doubled rate limits with the option to request increases in account settings.
- Built-in retrieval-augmented generation (RAG) and knowledge current as of April 2023.
- Whisper V3 to be open-sourced and added to the API suite.
- Copyright Shield initiative to cover legal fees for copyright-related issues.
- Ability to create your own, custom "GPTs".
- Assistants API and new tools (Retrieval, Code Interpreter)
Of course there is competition. OpenAI is using the Andrew Carnegie playbook of aggressively cutting costs so that the competitors have no chance to get up and running. They are cutting off the competition before they can start. I don't see evidence to believe that AI moves into a commodity business anytime soon.
We're probably able to conclude what we're seeing in public is about about 6 months behind what's happening in development. We know that in the past OpenAI relied on a lot more lag.
Point is innovation is certainly accelerating but also OpenAI's time-to-market is shrinking (/shrunk - it probably can't get much shorter).
Say what you want about OpenAI, and trust me I think there's a lot of material there, but you can't say they don't ship. Nobody else is even close.
Fine tuned 16k: 0.003c / 0.004c
Assistants API with RAG and code interpreter (sandboxed jupyter).
... and to publish them to the "GPT Store" that comes later this month. They are turning this into a new type of operating system, everyone can use the "GPT Builder" to publish apps/GPTs to that store.
Why it could happen: natural language is a UI. A UI is only as good as what it can connect to. Browsers are OpenAI's current limit.
Why it could not happen: experts and foundation models are actually very hard to get working like presented. This is a moat.
Thoughts?
Will they succeed or end up being MS division with "paltry" 10-20 billion payout, let's see.
Isn't all of the technology that Open AI has popularized originally from Google?
Just one year ago, it released a transcendental experimental product early and with no grand plan for monetization (chatGPT). Now, we have a polished keynote, with an "app store," a "developer platform," complete with your cheesy music and smiling company reps. How nice of them for sharing their revenue with us when we publish on their app store!
It's amazing and sad how quickly the hacker joy has been sucked out of this company.
I get the aversion to polished presentations like this, but I dunno, I work here and still feel like there's a lot of hacker joy still. You clearly aren't the audience for this presentation, but one audience doesn't exclude another.
New models and developer products - https://news.ycombinator.com/item?id=38166420