Admin Answers Only

I’m coming across a bit of a problem. I would like anonymous users to be able to ask question, but only the admin to be able to answer. I’ve enable both the Non-loggedin user can post questions and answers and the Only allow admin to answer question, but it seems that the non-loggedin toggle is overriding the only allow admin. I’m hoping for it to be reversed. Is there any way to do this with some css code?