All users can see the "Post a Question" on the Knowledge Base pages.

The "Post a question" button can't be disabled. This is expected behavior and by design in the current releases. This feature is always available to the users who have read access to the KB.

The button is hardcoded in the Java Layer and its visibility can't be controlled at the moment using out of box features.