Calendar Integration Cancelling Guests when Changes are Made!

When you have the Google Calendar integration enabled, it creates and updates the calendar in Google through the linked calendar.

HOWEVER, whenever you make a change to the workshop in aX, like changing something in the title, it removes all of the invited guests in google (guests need to be added through Google because your integration does not invite attendees from the workshop - perhaps another feature request!). 

So, we make a change in aX, all of our guests in Google get a cancelled calendar invite and freak out. 

Is there any way to prevent this from happening?