Can I remove the blacklist user from Panel itself?

Yes, the user can be blacklisted from the panel by navigating to Configuration >> Manage Interface >> Search User >> Edit >> Advanced Settings >> BlackListed = False