Show HN: Anything To JSON – a language model for structured extraction (anythingtojson.com)
We’ve trained a small(ish) language model on structured extraction, and today we’re launching a playground for it at https://anythingtojson.com. Give it a try!
This model continues our work on structured generation, following last week’s launch of Fructose[1], a python client for strongly-typed LLM responses.
There seem to be two distinct halves of the problem intended to be solved by Fructose and structured generation:
1. the reasoning ability of the model, such as performing chain of thought, creative acts, and natural language tasks. In a way, the “business logic”.
2. the structured json response, to make sure the receiving code doesn't break
AnythingToJson is intended to solve the latter. No big-brain work, just find data in text and extract it. Constrained generation at inference time helps keep it on track, and our finetuning has improved the accuracy and consistency of extracted data.
There’s much more progress to be made (longer context window, hallucination to squash out, etc), but ship early and fast.
8 comments
[ 7.1 ms ] story [ 39.9 ms ] threadI think it can be useful for some cases, but you’ll always have the limitation of the model size to compete against large closed source models.
I bet there are some good post-processing heuristics you could also apply for hallucination with a flag for "this should be in the text verbatim" & then string matching whether the answer it outputted was a string from the text or not.