That would be libel, though. It doesn't have to be anything as vile as paedophilia, either; the plaintiff in Tolley vs J A Fry & Sons (1931) sued because a cartoon of him used in a Fry's Chocolate ad implied he'd accepted payment for use of his image and therefore wasn't a true amateur golfer. His victory was upheld in the House of Lords.