Train fare from Geelong to the city really THAT expensive?!

So, my husband and I have fallen for Geelong. Like, head over heels. We want to buy a place and live happily ever after. However....I checked the cost to commute to Melbourne and it is unreal! Anywhere from $18-$24 roundtrip. Really?! It's not that much further than Frankston, yet Frankston is only in zone 2 and more than half the price.
Ok, so I can't imagine going to Melbourne city all that often and I'll drive to work then - at least until I'm able to work closer to Geelong. But the thought of spending that kind of money every time I want to go to the city to see a friend, or go to a gig is such a deal breaker. Not to mention the fact that we have family members living in the city that do not drive and cannot afford to visit by train. I'm writing to simply ask how locals feel about such expensive train fare and if it affects them at all? Any feedback is much appreciated! Thank you in advance :)