I'm not exactly following through with the claim, can someone explain how the built-in classification would not necessitate more tokens used, or be much different from turning on reasoning? Not that I don't see the difference, I just doing see how OpenAI would do it well.
I think the idea is that the latent thinking space in the LLM will be roughly the same for similar quality results - so the majority of executing well could be stripping back and fine tuning an existing LLM.
Normal LLM will do the classification on the text that is generated. Jev just returns the classification and confidence.
It has the advantage of speed and the confidence not being hallucinated.
But LLMs start to generalise on the pattern, rather than the classification that you want the more examples you have to train on.
LLMs start to break down as well the more classifications you have. Laya (Open source paper Jev is based on) even mentions that over 20 classifications and it starts to fail rapidly.
20 is around the level of sentiment analysis or minor intent routing. There are cheaper, smaller and easier ML models for that level of classification.
That is, if you force any llm to return json and a confidence it can also do that too and mostly likely it will he better at any one shot classification task than Jev.
LLMs have the great quality of knowing more due to the depth and richness of the training data. If Jev is trying to classify anything outside of its training data, it’s going to do a terrible job.
It's hard to say without knowing their architecture, but I'd guess something like block attention. You can process the prompt separately from the classifications into a latent space and then do some kind of late interaction with the encodings from the classifications.
There are plenty of other ways to do zero shot classification that would result in more "token usage" (really just having to reprocess everything for each class), but the pricing and the way they describe it narrows it down somewhat.
The more likely scenario is either OpenAI or Anthropic just go pay some highly inflated price to buy Jev. Mainly just for its people and the PR, not tech.
Which is likely what all the VC, hype machine, and overinflated claims are really about anyways.
The tech etc is easily replicated. The hype / name, not.
I seem to remember reading that the Jev-founder-guy is ex-OpenAI anyways. So that's how these things often roll.
If OpenAI releases something similar to what Jev does, then that would be like admitting defeat. Their whole spin is AGI and world ending danger. Why would somebody with an AGI at home make something like Jev which is intended to be a part of some SW the AGI is going to replace anyway.
The people that buy into "AGI is here" and the people that understand what Jev is and how useful it would be to hook it up to an LLM are two separate circles, so there's no "defeat" being admitted.
There's a big difference between what AGI can accomplish and what it will accomplish. We must also ask why OpenAI wants to summon their God, and how they would want the average person's life to change if it comes. I think they will try to clone Jev just to add another revenue stream.
It's just another tool. Luna exists for a reason: it's the right tool for the job. If they release AGI and it costs $1 and 5 seconds to decide "is the customer asking for a refund", then that's a terrible use case for AGI if another tool can do it with 95% accuracy for $0.002 and 50ms.
A lot of business automation doesn't need AGI, doesn't want to pay for AGI if they don't have to, and would be better off using a classifier than something increasingly unreliable with a mind of it's own.
There are many automation pipelines that use LLMs because there was no choice, but the multi-way classification that Jev provides is exactly what they need, and is going to be way faster and cheaper, as well as having the benefit of calibrated probabilities and structured output that can be relied on.
Personally, I don't really care what OpenAI does here. What's going to be far more exciting is when DeepSeek, Qwen, or GLM start integrating classifiers into their open models.
Exactly, the future is open models. Which is also the reason why those overvalued companies such as OpenAI will lead to a market crash as soon as investors realize that.
I'm not sure it makes as much sense to use the same bigger models for the things Jev does. Part of what makes Jev appealing is the cost/speed. I can definitely see them putting out S1 spins of their smaller models.
That's not what I meant. I'm thinking more of AI systems that combine multiple modules the same way the brain has different regions. LLMs are just part of the bigger picture here. They're good at tackling a certain types of problems, but other approaches are better for different kinds of problems. Having a system that combines a generative model and a classifier for example would make it a lot more efficient and accurate because it has a bigger toolbox instead of using one algorithm for every problem whether it fits or not.
There are plenty of other use cases aside from agentic coding. However, even here a classifier has a lot of obvious benefits. There are plenty of scenarios where a model has to make a choice, and programming/system tool use happen to be deterministic sets of choices that can be evaluated.
> programming/system tool use happen to be deterministic sets of choices
I'm not following. There are way more tools in the world, and likely available on every machine, than can fit in any model context. One can create a small list, but that will be very org dependent. Programming is very open ended, I struggle to see the 'deterministic set of choices' here.
I'm looking at Jev/Kev like models for some control over tool calling and similar, but I also think that fine-tuning out behaviors (like qwen 3.8 wanting to use rkt all the time) may be better in the long run. Instead of having to check/change every tool call, we can refine the main LLM to have high enough likelihood of using the tools we actually have, that we won't need to check every call.
Jev is definitely useful, but also being held like a hammer in search of a nail right now, approaching OpenClaw like fanfare and hype levels. No one talks much about OpenClaw these days, I would not be surprised if Jev has a similar trajectory.
I'm not talking about checking/changing every tool call, I don't even know what you mean by that to be honest. The question is about selecting the tool to use in a particular scenario.
The whole point of Jev/Kev is efficiency. If you can make decisions faster, cheaper, and more reliably that's the benefit. Even within the model architecture itself, you could use a classifier as a router within MoE to pick the expert that's likely to give the best outcome.
Yeah but they weren't that great, you couldn't ask for arbitrary classifications after the model was trained. You are underestimating what they've done here, even if it does seem a little overhyped.
I think the point of Jev is to thread the needle of the gap between non-LLM classifiers and LLMs.
Classifiers like classical NNs require:
- annotated data, potentially a lot of it
- training
- inference
#2 and #3 aren’t a big deal if you have an ML engineer, but #1 will always be a potential headache no matter who you are. The tradeoff is that they could be quite fast, cheap, and you can get probabilities, not just classes.
With LLMs you get:
- zero shot classification (no dataset or training required)
- potentially can use third party model providers like OpenAI off the shelf. Don’t even need to host your own model.
The downside to LLMs is that they are comparatively slow and expensive to traditional classifiers. Historically they also were prone to hallucination or malformed responses, though not as much these days. You also can technically get log-probs back, but these aren’t equivalent to the classifier probabilities.
Jev gets you the zero-shot, zero-infra benefits of LLMs, while being closer to the speed and cost of traditional ML classifiers, as well as both classification and probability responses.
In my company, and I think in most companies that are using AI at all, one of the first ways it got integrated is as a classifier, to tag orders based on feeding all their data into a prompt and asking for a structured output.
I think demand for tools that are more tailored for this type of integration is high. I don't really understand why Jev is supposed to get my company's decisions right more than an LLM, but regardless of the tech I think people are just excited about the possibility of iterating faster, more explainability, higher-level tools that are specifically created to help hone classifiers etc.
Beats me also - this feels unreliable, extremely niche, and over-hyped. I don't trust LLMs even when they explain their reasoning; the idea of trusting a black-box classifier like this seems insane.
Nerd sniping the hackernews/twitter crowd with "large scale transformer-based language model alternatives."
People don't want to believe something as unsatisfying as "Scaling up LLMs" can yield something as profound as AGI/be useful, and just hope that literally anything else can take their mindshare away, and this just happens to be the new rage. Along with clearly-not-frontier-level open source models, non-transformer based architectures, etc.
With all the excitement around Jev, I suspect we'll see hundreds of options, it doesn't sound like Jev is that hard to replicate, given all the 3rd parties who are getting pretty damn close, or even better, results within a week.
Or OpenAI just buys them outright. Buying your upstart competitor seems to be in the Silicon Valley Ten Commandments. The Fed whussed-out on breaking up FB and Insta last year, so there's never going to be any kind of remediation to worry about.
And for Jev, everyone has a price, and OpenAI's raised an historical amount of funding.
I find it unlikely. OpenAI is all in training models with reasoning with RL, and Jev-like models are the total opposite. They are made to not reason at all to be fast. If you want to add reasoning on top, you might as well use a conventional LLM because you lose the price and speed benefits when you output auto-regressive tokens. I don't think OpenAI will even bother with this.
> My main assumption is that Jev is using something quite close to a conventional large language model. As evidence of this, Latent Space reports that many of the early clones are indeed LLM-based.
Not proof that this is the case with Jev though. It might use non causal text encoder for the state, which could make sense given that its very good for its price.
In the olden days we call this classifier, usually assignment 2 of Machine Learning 101. BERT (well, GLiNER specifically) and diffusion are calling and want their Large Classifier Models back.
I just had Claude and Jev combine forces last night. I've built a few personal browser extensions in the past and thought it would be fun to copy an experiment I saw on twitter where Jev classifies comments/posts etc as slop or not.
Fed Claude an api key from typesafe and a link to documentation, and within about 10 minutes I had a view of HN that was populated with a little ranking as to sloppiness of each comment.
When your mind has been wired a bit to LLM latency, it feels extremely fast, and for such a subjective rating I think it did a good job.
Feels like it sits in a space between traditional ML classification and the frontier models. I can't think of a 'real' production use case for it in my sphere of influence, but certainly some will. And of course there will be five Jev competitors by the end of the year.
> Back when I was at GitHub working on Copilot I had the opportunity to work with a very new and very raw internal API for GPT-4. Out of the gate, we knew something was way off because, after an initially very coherent response, the model would have trouble wrapping up. It would end every response with something like "Let me know if you have any other questions. Have a nice day. Have a great week. Have a good time. Have a wonderful life. Have a special day. ..." and it would keep on like this until it hit the response token limit.
Would it be intesting/useful to use jev to generate a block of text like LLMs do ?
Like asking it to pick the n + 1 word given the starting text (using it's choice primitive), but also asking n + 2,n+3 and so on at the same time.
Would it give coherent or useful results ? Or does the fact that it computes it "all at once" means it cannot make one of it's answer influence the other ones ?
The right part: autoregressive LLMs are indeed generating “probabilities” (scare quotes very much intentional). During pre-training and any SFT steps, those probabilities are nudged toward the probabilities, over the training distribution, of the next token conditioned on the previous tokens. (This is an explicit property of most training recipes: KL divergence is a “proper scoring function”.)
So if you prompt with “Paris is a city in ”, the next token probabilities estimate the probabilities over the input distribution that the next token in the sentence is the first token of France or of something else.
But there are huge caveats:
1. That is not at all the same thing as the probability that Paris is France under any distribution that you care about (the population of the various Parises, for example).
2. None of this necessarily usefully applies to RL or, as the article discusses, tool calling. The output probability of a tool call is not some Platonic idea of a probability that the input is worthy of a tool call. It’s a the result of a training process that tried to teach the model to be useful and to achieve its goals.
3. I suspect that reasoning makes this all much worse. Suppose that you prompt with “a help desk user with IP=a.b.c.d says they’re ‘in Paris’. What country are they in?” The model has been trained to generate a reasoning trace, which may well start with “let me think of where Paris could be. It could be in France or in Texas etc. The user was speaking English…” See the problem? The model is reasoning well, but it reasoned “France” before “Texas”, so the logprob for France was probably higher than “Texas”. At the end of the reasoning trade there will be an answer, but the logprobs for that answer are, at best, some representation of the probabilities of the answer conditioned on the sampled reasoning trace. And that is not the probability distribution that a Jev user wants.
comments are pretty weird here, there's no real moat to what jev is doing, it is certain that frontier labs are going to release their own jev and there are even open source alternatives (although nowhere near as accurate as jev).
so maybe typesafe's real plan is to front run and releasing their own new models for some time until they can get acquired which seems to be the only rational objective
I don't think it's unreasonable to think this, but I do think the burden of proof is on your side. Between the SaaS-pocalypse narrative that never materialized, and inexplicably losing their first-mover advantage to Anthropic, OpenAI's track record is not great when it comes to jumping on these micro paradigm shifts.
If the headline said "Frontier labs are about to eat Jev's lunch" it might be an easier sell. But if we're gonna include Anthropic, I think part of their success is actually making products for which there is demand. It will take time for something like that to come out of this new "decision model" paradigm.
This article is extraordinarily hard to read. It’s tummelvisioned on OpenAI and things like tool calling which are only relevant to the extent that llms have been tuned to make relative choices, but this applies to all LLMs.
Also, moat discussion is the lowest form of discussion. I don’t care if jev has a moat. Did it get the interface right? What other past ideas have we overlooked that if given some love, could kick the door down like jev did?
Partially. I'm a terribly slow writer and get stuck on phrase choice, but I'm good at content ideas, outlines, and editing text already on the page. So I have AI do the bit that I'm not as good at.
Process: First, actually have ideas :D Then, I write an outline for what I want to talk about at basically a sentence-by-sentence level. (This is me yelling things at my computer.) And then I have the AI convert a chunk at a time into prose. I reread it and rework it to be my voice.
Then I have the AI help with things like subject titles and social posts.
I am not personally like philosophically or ethically opposed to having LLMs help or even write text... the issue is that I see so much LLM-written text that is just _bad_, and very hard for me to read or extract meaning out of, especially relative to it's often long length.
People think they are bad writers, but usually LLMs are actually worse (although they are great writers of catchy slogans and phrases, and then put together an article out of them, which I find just exhausting to try to get more than a "vibe" out of).
What you describe sounds like a fairly reasonable approach, but I suspect the parts the person I was replying to were reacting to was areas were you had not been as succesful at reworking it to be your voice. Which are probably also the parts pangram flagged as likely LLM written.
Pangram gives you a handful of free tokens, it would be interesting if you wanted to see what parts are the 20% pangram is flagging as LLM, and reflect on if they went through your process differently. Perhaps they were the parts you didn't spend quite as much time reworking it to be your voice. (I 100% believe you, because I've been running things through pangram a lot lately, and it's actually pretty rare for it to flag mixed content, instead of 100% likely AI or 100% likely human).
There was recently a post on HN that said if you want to avoid this, you really can't use any words at all that are written by the LLM, you can use it for suggesgting structure or points, or reviewing your work in various ways, but if you accept even a single phrase it provides... it's not going to be "reworked into your voice", it's going to be picked up by people (at least those of us who have become sensitive to it) as AI, because it's like, headline-speak.
(I can't find the article now, because I'm trying to quit facebook so can't log in to find my own post of it there, have to stop using that as bookmarks substtitue!)
Of course, that's not welcome advice if what you want AI for is "phrase choice".
I'm just here to say, LLMs are not good at phrase choice either. Although they may be quick at it. I feel like it's asking the reader to do the work of trying to extract meaning from slop that the author didn't have the energy to use to encode it well in the first place. I don't have time to try to read sentences that the writer didn't have time to write, i find myself bailing out quicker and quicker at signs of AI slop buzzword headline-speak.
Panagram seems fun! I tried it out with a large chunk of my post (whole thing wouldn't fit). Panagram says it is 98% human. Feels right, to me b/c I aggressively edit whatever comes out. The thing that I'm avoiding is the ominous blank page - I just freeze. If there's text there I can always reshape it. And I do, heavily.
Asking again (didn't get an answer in prior discussion):
As there have been a lot of Jev related submissions, can someone point me to a simple guide on how I can use it? For example, say I have a script/workflow where I use OpenRouter for LLM calls, and at some point I want to do a simple classification. Can I still use OpenRouter with some Jev model...?
Even the article itself has the title as a question: "Will OpenAI eat Jev's lunch?". A more useful title would be "OpenAI is Positioned to Compete with Jev".
Jev doesn't code. It can be used with LLMs to simplify coding and token consumption, but still and LLM is needed. Will they complement each other? How can Jev replace LLMs? Are they even competing?
You can easily use Jev without an LLM (consider Jev used to make truthy decision branches in a script). It's not meant to replace LLMs. The tech is not a competition. But OpenAI is certainly in competition with TypeSafe, they'll want to keep people in their own ecosystem!
Rather than focusing on OpenAI in particular, let's just say that there are many smart people at other AI labs and if it seems like it will be popular, this technique will probably be copied. What would prevent them from adding another API?
Hopefully there will be some decent benchmarks and gateways for switching between providers easily.
146 comments
[ 0.15 ms ] story [ 27.0 ms ] threadIt has the advantage of speed and the confidence not being hallucinated.
But LLMs start to generalise on the pattern, rather than the classification that you want the more examples you have to train on.
LLMs start to break down as well the more classifications you have. Laya (Open source paper Jev is based on) even mentions that over 20 classifications and it starts to fail rapidly.
20 is around the level of sentiment analysis or minor intent routing. There are cheaper, smaller and easier ML models for that level of classification.
That is, if you force any llm to return json and a confidence it can also do that too and mostly likely it will he better at any one shot classification task than Jev.
LLMs have the great quality of knowing more due to the depth and richness of the training data. If Jev is trying to classify anything outside of its training data, it’s going to do a terrible job.
There are plenty of other ways to do zero shot classification that would result in more "token usage" (really just having to reprocess everything for each class), but the pricing and the way they describe it narrows it down somewhat.
Which is likely what all the VC, hype machine, and overinflated claims are really about anyways.
The tech etc is easily replicated. The hype / name, not.
I seem to remember reading that the Jev-founder-guy is ex-OpenAI anyways. So that's how these things often roll.
There are many automation pipelines that use LLMs because there was no choice, but the multi-way classification that Jev provides is exactly what they need, and is going to be way faster and cheaper, as well as having the benefit of calibrated probabilities and structured output that can be relied on.
I'm not following. There are way more tools in the world, and likely available on every machine, than can fit in any model context. One can create a small list, but that will be very org dependent. Programming is very open ended, I struggle to see the 'deterministic set of choices' here.
I'm looking at Jev/Kev like models for some control over tool calling and similar, but I also think that fine-tuning out behaviors (like qwen 3.8 wanting to use rkt all the time) may be better in the long run. Instead of having to check/change every tool call, we can refine the main LLM to have high enough likelihood of using the tools we actually have, that we won't need to check every call.
Jev is definitely useful, but also being held like a hammer in search of a nail right now, approaching OpenClaw like fanfare and hype levels. No one talks much about OpenClaw these days, I would not be surprised if Jev has a similar trajectory.
The whole point of Jev/Kev is efficiency. If you can make decisions faster, cheaper, and more reliably that's the benefit. Even within the model architecture itself, you could use a classifier as a router within MoE to pick the expert that's likely to give the best outcome.
Classifiers like classical NNs require:
- annotated data, potentially a lot of it - training - inference
#2 and #3 aren’t a big deal if you have an ML engineer, but #1 will always be a potential headache no matter who you are. The tradeoff is that they could be quite fast, cheap, and you can get probabilities, not just classes.
With LLMs you get:
- zero shot classification (no dataset or training required) - potentially can use third party model providers like OpenAI off the shelf. Don’t even need to host your own model.
The downside to LLMs is that they are comparatively slow and expensive to traditional classifiers. Historically they also were prone to hallucination or malformed responses, though not as much these days. You also can technically get log-probs back, but these aren’t equivalent to the classifier probabilities.
Jev gets you the zero-shot, zero-infra benefits of LLMs, while being closer to the speed and cost of traditional ML classifiers, as well as both classification and probability responses.
I think demand for tools that are more tailored for this type of integration is high. I don't really understand why Jev is supposed to get my company's decisions right more than an LLM, but regardless of the tech I think people are just excited about the possibility of iterating faster, more explainability, higher-level tools that are specifically created to help hone classifiers etc.
People don't want to believe something as unsatisfying as "Scaling up LLMs" can yield something as profound as AGI/be useful, and just hope that literally anything else can take their mindshare away, and this just happens to be the new rage. Along with clearly-not-frontier-level open source models, non-transformer based architectures, etc.
vLLM has a PR very close to merging: https://github.com/vllm-project/vllm/pull/57250
Kev is an open Jev: https://github.com/jaredpalmer/kev
see here: https://news.ycombinator.com/item?id=49800574
For now. Any company that grows to OpenAI/Anthropic's size and gets VC money is ought to become greedy.
And for Jev, everyone has a price, and OpenAI's raised an historical amount of funding.
https://openrouter.ai/openai/gpt-6-astra#providers
Or use it through Vercel [0] with per call zdr.
https://vercel.com/changelog/typesafe-ai-jev-now-available-o...
> My main assumption is that Jev is using something quite close to a conventional large language model. As evidence of this, Latent Space reports that many of the early clones are indeed LLM-based.
Not proof that this is the case with Jev though. It might use non causal text encoder for the state, which could make sense given that its very good for its price.
https://github.com/vllm-project/vllm/pull/57250
Fed Claude an api key from typesafe and a link to documentation, and within about 10 minutes I had a view of HN that was populated with a little ranking as to sloppiness of each comment.
When your mind has been wired a bit to LLM latency, it feels extremely fast, and for such a subjective rating I think it did a good job.
Feels like it sits in a space between traditional ML classification and the frontier models. I can't think of a 'real' production use case for it in my sphere of influence, but certainly some will. And of course there will be five Jev competitors by the end of the year.
I love this!!
Would it be intesting/useful to use jev to generate a block of text like LLMs do ?
Like asking it to pick the n + 1 word given the starting text (using it's choice primitive), but also asking n + 2,n+3 and so on at the same time.
Would it give coherent or useful results ? Or does the fact that it computes it "all at once" means it cannot make one of it's answer influence the other ones ?
https://github.com/kyle-pena-nlp/jevchat
https://www.reddit.com/r/LLM/comments/1winnju/jev_the_new_ai...
Despite Typesafe claims that Jev is not an LLM, it obviously is.
They certainly have the token budget for it.
The right part: autoregressive LLMs are indeed generating “probabilities” (scare quotes very much intentional). During pre-training and any SFT steps, those probabilities are nudged toward the probabilities, over the training distribution, of the next token conditioned on the previous tokens. (This is an explicit property of most training recipes: KL divergence is a “proper scoring function”.)
So if you prompt with “Paris is a city in ”, the next token probabilities estimate the probabilities over the input distribution that the next token in the sentence is the first token of France or of something else.
But there are huge caveats:
1. That is not at all the same thing as the probability that Paris is France under any distribution that you care about (the population of the various Parises, for example).
2. None of this necessarily usefully applies to RL or, as the article discusses, tool calling. The output probability of a tool call is not some Platonic idea of a probability that the input is worthy of a tool call. It’s a the result of a training process that tried to teach the model to be useful and to achieve its goals.
3. I suspect that reasoning makes this all much worse. Suppose that you prompt with “a help desk user with IP=a.b.c.d says they’re ‘in Paris’. What country are they in?” The model has been trained to generate a reasoning trace, which may well start with “let me think of where Paris could be. It could be in France or in Texas etc. The user was speaking English…” See the problem? The model is reasoning well, but it reasoned “France” before “Texas”, so the logprob for France was probably higher than “Texas”. At the end of the reasoning trade there will be an answer, but the logprobs for that answer are, at best, some representation of the probabilities of the answer conditioned on the sampled reasoning trace. And that is not the probability distribution that a Jev user wants.
so maybe typesafe's real plan is to front run and releasing their own new models for some time until they can get acquired which seems to be the only rational objective
If the headline said "Frontier labs are about to eat Jev's lunch" it might be an easier sell. But if we're gonna include Anthropic, I think part of their success is actually making products for which there is demand. It will take time for something like that to come out of this new "decision model" paradigm.
Also, moat discussion is the lowest form of discussion. I don’t care if jev has a moat. Did it get the interface right? What other past ideas have we overlooked that if given some love, could kick the door down like jev did?
Process: First, actually have ideas :D Then, I write an outline for what I want to talk about at basically a sentence-by-sentence level. (This is me yelling things at my computer.) And then I have the AI convert a chunk at a time into prose. I reread it and rework it to be my voice.
Then I have the AI help with things like subject titles and social posts.
¯\_(ツ)_/¯
I am not personally like philosophically or ethically opposed to having LLMs help or even write text... the issue is that I see so much LLM-written text that is just _bad_, and very hard for me to read or extract meaning out of, especially relative to it's often long length.
People think they are bad writers, but usually LLMs are actually worse (although they are great writers of catchy slogans and phrases, and then put together an article out of them, which I find just exhausting to try to get more than a "vibe" out of).
What you describe sounds like a fairly reasonable approach, but I suspect the parts the person I was replying to were reacting to was areas were you had not been as succesful at reworking it to be your voice. Which are probably also the parts pangram flagged as likely LLM written.
Pangram gives you a handful of free tokens, it would be interesting if you wanted to see what parts are the 20% pangram is flagging as LLM, and reflect on if they went through your process differently. Perhaps they were the parts you didn't spend quite as much time reworking it to be your voice. (I 100% believe you, because I've been running things through pangram a lot lately, and it's actually pretty rare for it to flag mixed content, instead of 100% likely AI or 100% likely human).
There was recently a post on HN that said if you want to avoid this, you really can't use any words at all that are written by the LLM, you can use it for suggesgting structure or points, or reviewing your work in various ways, but if you accept even a single phrase it provides... it's not going to be "reworked into your voice", it's going to be picked up by people (at least those of us who have become sensitive to it) as AI, because it's like, headline-speak.
(I can't find the article now, because I'm trying to quit facebook so can't log in to find my own post of it there, have to stop using that as bookmarks substtitue!)
Of course, that's not welcome advice if what you want AI for is "phrase choice".
I'm just here to say, LLMs are not good at phrase choice either. Although they may be quick at it. I feel like it's asking the reader to do the work of trying to extract meaning from slop that the author didn't have the energy to use to encode it well in the first place. I don't have time to try to read sentences that the writer didn't have time to write, i find myself bailing out quicker and quicker at signs of AI slop buzzword headline-speak.
prodigycorp is entitled to their opinion
Wouldn’t be surprised if every single AI house spins up a copy
But like they usually also have an embeddings endpoint
As there have been a lot of Jev related submissions, can someone point me to a simple guide on how I can use it? For example, say I have a script/workflow where I use OpenRouter for LLM calls, and at some point I want to do a simple classification. Can I still use OpenRouter with some Jev model...?
Hopefully there will be some decent benchmarks and gateways for switching between providers easily.