He could just have a strict no work colleagues on facebook thing. I know I have that. I will not accept an invite from a work colleague but i won't reject it either. I just leave it pending. Facebook can have too many personal things on it that you may not want someone at work seeing. I wouldn't take it too personally.