When a character is dead (0 HP) a "Bury" option will appear that will allow you to delete the character. You can use a Kill Pill item to purposely reduce a character to 0 HP if you want to delete it.