Intuitively, regex or json grammar have a much lower "semantic dimension" than what today LLMs allow. Maybe the observed performance gains result from such lower dimensionality.
One month ago, the French Navy lost the nuclear submarine "La Perle" meanwhile the ship was being maintained. The similarities with the "Bonhomme Richard" accident are striking.
Intuitively, regex or json grammar have a much lower "semantic dimension" than what today LLMs allow. Maybe the observed performance gains result from such lower dimensionality.
One month ago, the French Navy lost the nuclear submarine "La Perle" meanwhile the ship was being maintained. The similarities with the "Bonhomme Richard" accident are striking.