Allright, for those interested, what I have done is:
Export my personal Google calendar
Export my work Google calendar
Deleted all content of my personal Google calendar (primairy)
Deleted work calendar
Imported work activities into personal Google calendar and renamed Work
Imported personal activiteits into new Google calendar and name Personal
Now my primary calendar is my work calendar and that gets synced with my Exchange.