I would suggest you could send an email once or twice before cleaning your list. You can have it as a note in your newsletter with a disclaimer or something. "Cleaning out the list is not 100% so if I accidentally remove you from the list but you want to keep on receiving these email please subscribe again" etc etc.
Then when you kick them out trigger maybe a last email to those affected with a similar email.