Firstly, how are you checking the users can see this? You can only genuinely tell by creating a new account and looking at the site like your users do, not through the option to view the site with someone elses permissions.
group forum permissions
select the forum
Make sure the bots and guests groups are set the same.
Give standard access to the groups you do want to be able to see it.
That is enough.