From my experience, contributions/donations stay within the group. So if you leave a group for another, it would leave you a group contribution/donation of 0, and only group skills carry over.