Dates:

Thursday, June 4, 8:00 - 9:30 AM CEST

What happened:

Customers experienced intermittent failures when starting new Real Device Cloud live testing sessions on all platforms in our EU and US datacenters.

Why it happened:

We experienced performance issues in our live testing services which resulted in state changes of sessions becoming out of sync between our backend and frontend systems. This made those sessions appear stuck or take longer than usual.

How we fixed it:

We collected debug data and restarted the affected services which cleared the situation.

What we are doing to prevent it from happening again:

We analyzed the data we collected during the incident and fixed the underlying issues. In addition, we added monitoring to detect issues while starting live testing sessions faster.