Hi thinking of buying in Toogoom for future investment/retirement.

Have heard a lot of possitive about the town, personally I love the feel of the town and relaxing nature. People seem lovely. But, I have also heard some comments not so good regarding government housing for families of those held in the local correctional centre, and was wanting to know if there is any feedback on firstly, If true is this a concern at all and if so, what is the impact it is having on the town. I am trying to get a local opinion, so I can better plan where to spend my investment money.