@quansenB, it looks like your site has a service worker registers. This can typically cause issues as described here: [Support Guide] Understanding & unregistering service workers. On Gatsby, you’ll want to disable the offline-plugin and then de-register the existing service worker as mentioned in that topic I linked to.
Hope that helps.