The simplest way to accomplish this is to put the set of workers into a host group. Workers in a host group will accept any job, but jobs will only run on workers that are in the group specified by the job's hosts value.
hosts
Controlling Host Selection