I dunno what you call this but I think it's kinda offensive?

It's only offensive if your dad expresses this opinion to others. If he only said it to you then it's his opinion. It becomes an offense when it affects someone else.