Is my dog afraid of me?

I love my dog. When my family is home he is very playful with all of us. But when he is alone with me he stays in his crate and lays down most of the time. I try to pet him but it's as if he is in hibernation mode. Then when my family comes home he is all livened up and playful. Is my dog afraid of me?