I remember seeing this as a kid when it was first aired on HBO In the early 80's and liking it. Hell, I even remember Gene Siskel (who hated Roger Moore; if memory serves I believe he called him "that block of wood" in this particular review) slamming it on his show with Roger Ebert...now that was back in the day.
And yes, in this day and age a misogynistic character like Moore's in this film would likely be completely unacceaptable. A cat-loving, anti-social hermit who hates women? Hmmm, I wonder what would be made of that in this day and age?