Solid lead, and liquid mercury, can be handled with little danger. Certain compounds, not so much. Tetraethyl lead is bad, bad, bad, and bad. Warm up that mercury and inhale deeply, and become a mad hatter.
It is exactly the villain it's made out to be. It's not crying wolf.