I think it was more that he finally had a decent meal and started getting fat. Him and Nathan Fillion. Get a little food in them and they age ridiculously.
He's still exceedingly good-looking, moreso now than he was during the last season of Angel, but it's not just the weight. There was a quality in his face that just disappeared.