On the manage Categories page: Staff/StaffManageCategories1.aspx
if you right click any category a menu will appear. The delete option is on there.
Regards
The Prophet