We just setup batch jobs to to run nightly. There are 150K jobs in each batch.
5 days later, our redis storage blew up. We just scaled up our storage but its a temporary fix, in a few days we’d have to scale up again.
How do we configure how long batch data is retained, it looks like the default is 7 days.