We are evaluating some integration tools for upcoming work. We are doing batched data integration from various stores, e.g. SQL Server dbs and CRMs, and would like for them to be jobs.
From reading the docs, Hangfire is an ideal candidate from the background job scheduling standpoint due to the web front-end, job persistence, and community, but what about data processing and data-pipeline workflows?
Does Hangfire compete with TPL Dataflow in those two areas, or are they to be used in conjunction? E.g., build the pipelines with TPL Dataflow but utilize Hangfire to schedule the jobs?