Greys do tend to pick a favorite and Junior has picked your husband, now this doesn't mean you and the rest of your family can't be friends with him, it just means it may be different from the one he has with your husband.
He trusts your husband and will allow him to get him from the cage and he won't step up for you from the cage, you may have to accept this until a time that he may allow you to do it. Continue to work with him, you be the one to give him treats but if he doesn't want you getting him out of his cage then accept that.