The practice of rephrasing to get your word count up really irks me.
"Today, wolves, foxes, and snakes inhabit the cave, but it was once a popular spot for human pastoralists and their domesticated animals."
"Rather, they think it was a convenient spot for herders to stop and provide their flocks with shade and water."
"Even though humans didn’t have a permanent presence in the lava tube, the natural structure provided shelter for people and their herds for thousands of years"
Generalizing topics and/or adding caveats about how something may not always be true is the easiest way for a LLM to increase the rate of providing factually accurate responses (aside from refusing to answer). Both of those strategies requires being more verbose.
Concise and to the point is not in the best interest of a LLM designed to give decent answers 99% of the time.
I also believe that OpenAI's RLHF process highly biased the model towards producing that sort of specific verbose, padded-out 'chatGPT speak' that we are seeing. The RLHF fine tuning process took outputs from the instruction-tuned model and A/B tested variations with human workers who may or may not have had the same feelings towards writing quality as many of us.
The process resulted in those verbose, interjection-laden responses that we see now, because that type of response was deemed 'better' (thumbs-up'd more) than the shorter, more-direct-but-less-impressive-sounding responses.
I use it for work so much I’d gladly pay way more than $20 just for access to GPT-4. It’s pretty terrible at programming but it still saves me loads of time generating the easy functions.
Anything remotely complex I still do by hand. But holy shit its nice having something do my boilerplate.
Gizmodo and anything gawker media is utter and total junk, pushing Disney media and other hidden agenda. Was irked when I accidentally clicked it, I block it on almost all my systems to avoid feeding the beast.
They're a gizmodo writer. An attention predator. If they cared about producing genuine values for humanity, they would not be working in attention predator journalism
Therefore don't expect their writing to improve from your criticism. It's designed to take, not give.
I like to stop reading these kinds of authors as soon as I realize I'm experiencing a memetic attention attack. Then I write a snarky comment so others will start to hate them as well.
34 comments
[ 3.5 ms ] story [ 78.6 ms ] thread"Today, wolves, foxes, and snakes inhabit the cave, but it was once a popular spot for human pastoralists and their domesticated animals."
"Rather, they think it was a convenient spot for herders to stop and provide their flocks with shade and water."
"Even though humans didn’t have a permanent presence in the lava tube, the natural structure provided shelter for people and their herds for thousands of years"
Generalizing topics and/or adding caveats about how something may not always be true is the easiest way for a LLM to increase the rate of providing factually accurate responses (aside from refusing to answer). Both of those strategies requires being more verbose.
Concise and to the point is not in the best interest of a LLM designed to give decent answers 99% of the time.
The process resulted in those verbose, interjection-laden responses that we see now, because that type of response was deemed 'better' (thumbs-up'd more) than the shorter, more-direct-but-less-impressive-sounding responses.
>Hi again :wave:.
>As always I prefer terse replies.
>Let's <context of activity>
><First question>
I usually then get short answers and then I query for more info if required.
Anything remotely complex I still do by hand. But holy shit its nice having something do my boilerplate.
Therefore don't expect their writing to improve from your criticism. It's designed to take, not give.
I like to stop reading these kinds of authors as soon as I realize I'm experiencing a memetic attention attack. Then I write a snarky comment so others will start to hate them as well.
If you zoom out there are a crapload of lava flows and volcanic craters nearby. A bit to the east there is this landscape: https://www.google.com/maps/@25.6327898,39.9400629,22944m/da...
https://gizmodo.com/hyenas-left-a-massive-pile-of-bones-in-a...
https://en.wikipedia.org/wiki/Cueva_de_los_Verdes