Ask HN: What questions do LMMs fail with?

2 points by sourcecodeplz ↗ HN
Basically, what's your question that LLMs just don't "get"?

Are they:

- nonsensical

- meaningless

- jokes

- morality

Please do give some examples if you can.

7 comments

[ 1.3 ms ] story [ 36.0 ms ] thread
(comment deleted)
It keeps inventing features and command-line flags. A dozen times it presented me with code (Postgresql/PostGIS related) where it turns out a method cannot be called with those parameters.

https://blog.opencagedata.com/post/dont-believe-chatgpt "TL;DR ChatGPT claims we offer an API to turn a mobile phone number into the location of the phone. We do not."

encoding="utf-8" for creating files. it always gets this wrong. I have to write it and when I asked it to make another change it will forget it.
LLM can't do linguistic nuances like irony, humor and sarcasm. It also have difficulty with ambiguous statements and multiple negation. It may also have problem with technical jargon (though it work quite well with medical terms for some reason).