I added someone as an attendee, can I change them to an organizer?

Yes, you can also invite an attendee to be an organizer, which would allow that user to have both roles on the event.  If you would like that user to only be an organizer, you would invite them as an organizer and then remove them as an attendee using the menu to the right of their name on the attendee detail page.