Insights_Periodic_Data_Load job constantly failing

Symptoms

The Insights_Periodic_Data_Load and ends in HELD status until is released while using the Insights feature.

Cause

• Monthly partitions are used within each schema to facilitate purging
• When the Insights_ETL_Flow runs and picks up new/updated records, they get added to the proper partition
• If the Insights_ETL_Flow workflow stopped long enough to miss the creation of a new partition and then later, a record is needed for that partition, the error occurs. For example, if a job that was started more than a year ago finally got canceled - triggering the ETL update for the termination state of the job. 

Workaround

1. Locate Redwood > Insights folder
2. Cancel existing occurrences of Insights_ETL_Flow
3. Run Insights_Data_Aggregation job (this will create missing database partition)
4. After successful completion,  run Insights_deploy_Reporting_Schema with parameters of action: report, test: false to verify partition creation
5. Assuming successful completion of previous job, run Insights_Schedule_ETL and verify that Insights_ETL_Flow is run to completion and is rescheduled.

Affected version

2025.2 and lower versions

Resolution

This ticket will be fixed in the future.

Reference 

INSIGHTS-863