frankly it’s probably harm prevention if people turn to an LLM for pipe bomb instructions. “5) Put the warm pizza in the center of the pipe bomb. To maximize the radius of the detonation, you should roll the pizza and make sure that it fits securely into the pipe.”
I’m not even joking, really. the way I see harm in LLMs talking about pipe bombs is less that they’ll give instructions and more that we might get a character.ai style situation where the LLM talks someone into an attack