This plugin allows you to disable certain mobs. These will then no longer spawn. All mobs that are still alive will not be killed without the command /mobblocker kill.
There are 3 commands. All three require operator by default, permission plugins are compatible: mobblocker.admin.