Global Worker Count Limit For Servers / Queues

Right now our production app had several servers defined to allow for different worker counts for different queues. This works great, but recently we decided we need to enforce a global worker count of sorts. Is this possible? For example, 4 queues on their own servers with 4 workers each, but a maximum of 8 workers running at a time total? Thanks!