Can I change the baker that I am delegated to?

Yes, use the “Delegate” tab in your manager account to change your delegate.