File and flow_run table has large volume of data causing disk full issue

Hi ,

The flow_run and file tables contain a large number of records, which is causing a disk space issue. Could you please suggest a solution to resolve this problem?

Space issue

In file table, we have data from date 2024-10-25 to 2025-01-28.

Thanks,
Bharathan.

Hi there @Bharathan, what have you set AP_EXECUTION_DATA_RETENTION_DAYS environment variable to ?

by default if it is not set we run a job every 4 hours to delete files older than AP_EXECUTION_DATA_RETENTION_DAYS (we set it to 30) if you haven’t.

Please check your logs for any errors related to file-cleanup-trigger, to see if any errors had occured.

Hi Abdul,

We have not set the environment variable AP_EXECUTION_DATA_RETENTION_DAYS, and we have not observed any errors related to the term “file-cleanup-trigger” in the logs.

Thanks,
Bharathan.

In System.ts file, we see Execution_Data_Retention_days is with value 14.

retention_days

In trigger_event table, we cant able to see records older than 14 days.

Thanks,
Bharathan.

Setting retention should work do you see files older than 14 days?, the other suggestion you can configure S3 Storage