This is the continuation of a problem that's been known-about for a few years. ([0], [1]) I suppose the news is that yes, it's still unsolved.
LLMs driving decisions are going to be like asbestos: People will ignore the risk for a while to make a short-ter profit, eventually it will become too hard to ignore, and then it'll be expensive to remove and replace it with a technology that doesn't have the same dangers.
1 comment
[ 678 ms ] story [ 39.5 ms ] threadLLMs driving decisions are going to be like asbestos: People will ignore the risk for a while to make a short-ter profit, eventually it will become too hard to ignore, and then it'll be expensive to remove and replace it with a technology that doesn't have the same dangers.
[0] "Universal Jailbreak Backdoors from Poisoned Human Feedback", 2023 https://arxiv.org/abs/2311.14455
[1] "Persistent Pre-Training Poisoning of LLMs", 2024 - https://arxiv.org/abs/2410.13722v1