Do I have to be a lead owner to attach referrals to a lead?

No, you can attach referrals to a lead without being the lead’s owner.