Hangfire job in Windows service taking huge CPU usage


I have created two windows service jobs using Hangfire 1.6.17 to process the queue jobs. I have set HangFireWorker 1 for the first one and default 0 for the next one. While running from visual studio(debugging mode), it shows normal CPU usage. But, after deployment into windows service, it took more than 50% CPU usage although there is no active queue job to run.

I have no idea where to start diagnosing what is going on. Does this happen due to Hangfire Infinite loop or service installation issue? Any Idea or thoughts.