Can I change when a failed job will retry?

You absolutely can! You have to replace the default filter that defines the retries as Ashley shows here: Automatic retries - how to manually configure the time between retries

This is basically how i did it as well. I expanded the class to include the original retry schedule, a fixed schedule that’s slightly configurable, then an extended schedule so different instances of HF could choose which strategy they would like to use.