For Activity Templates we should be able to select from the "advanced" or "detailed" options. For example, with a specific type of activity template I may want to notify a person or specific team without adding them as an attendee. I don't see any way to do this right now so our activity templates just "add" everyone who should really only be notified.