I don't know what you mean by "admin login panel", there is no such thing. Admin user logs in the same as everyone using the login page.
If you mean the key icon and other icons, those already show and hide as they should. If you login as a user who is not in the admins role the key will not appear.