While it's not possible to block someone from viewing a public website, you do have some options.
Firstly, you can moderate your followers and remove them. There's more information about managing your followers and specifically removing them here:
You can also change your comment moderation settings. Here you can ensure that comments from specific users and / or IP addresses are send straight to spam. There are more details on how to do that here: