In the "Manage Templates" dialog box, I am unable to delete templates that I added before. The delete button is enabled but nothing seems to happen when I click it.
You can delete the file that contains the template. In Windows find the directory .RapidMiner5 that contains your settings. Here you can find the template. It will be a file with an extension .template and the name of the template. With RM closed delete that file and voila.