Hey all -
Throwing this out there in case anyone has thoughts on how this intermittent issue we’re experiencing.
We’re running a split test on our site, mixmax.com, and we’ve heard reports of loading issues. I managed to reproduce the issue myself and take this screenshot:
(Unfortunately I didn’t grab more information than that screenshot. I wish I grabbed headers or a HAR file - sorry!)
What appears to be happening is that my browser is not respecting the Netlify A/B test cookie (“nf_ab”) on first page load, then loading page assets which are being returned 50/50 from the split test sites. So a random 50% of them were failing.
I can reproduce this issue 100% of the time by turning off cookies in the my browser. Though I’m certain I had cookies enabled when I took the screenshot of the issue. Our users that reported the same issue likely also had cookies enabled.
Has anyone seen an issue like this? This could either be a bug in Netlify’s split test implementation - in that it doesn’t always return the nf_ab cookie - or it could just be a Chrome bug causing it to ignore cookies.
A question for the Netlify team: is there a way I can make our split-test robust to browsers without cookies enabled? Shouldn’t the absence of a cookie in a request for anything other than a page route always return the asset?