Internal Errors - please contact support

[Preben]

So, today these errors started ticking in:

They happen for different flows. So it’s not just one flow having these issues.

Example flow IDs:
3Dm3JRwhL4FTc9u3dVzin
IALAKGi71KjZfVMwGVwHF
QjxTMvS9s9vmXZNiy836V

What they have in common is reading from a Google Sheet (one every 10 minutes, and the other when the sheet is updated)

And the use of Open AI.

[abuaboud]

Apologies for that. There was an issue causing the SSD to fill up on the workers. I’ve cleaned up, and everything should turn into green again soon in next 5 minutes. I’ll identify the root cause and fix it soon.

[abuaboud]

Postmortem: Resolving the Internal Error Issue in Flow Runs

Hi everyone, In the past couple of hours, we encountered an issue where around 4,000 flow runs experienced internal errors. This happened because some servers reached their disk capacity. The reason for the disk full issue was our frequent deployments, and the images/deployment files were not being deleted from the server. We’ve cleaned up the servers, and all impacted flows have already been retried. They should now have a normal outcome. Additionally, we’re implementing an automated way to …