Issue
All users can see the "Post a Question" on the Knowledge Base pages.
Cause
The "Post a question" button can't be disabled. This is expected behavior and by design in the current releases. This feature is always available to the users who have read access to the KB.
Resolution
The button is hardcoded in the Java Layer and its visibility can't be controlled at the moment using out of box features.