Being able to do your job from home does NOT mean that you never show up in the office or that you don't build relationships with other people in the company.

What you describe sounds like there are two groups of people: The valuable ones, who go to the office and socialize, and the disposable ones, who sit around at home and have no contact with others. This is far from reality and I wonder where you got that idea.