- Create the user group for tasks (say "task assignees")
- Change the site setting "Assignable user groups for tasks" and add the group you just created
- Find the users you wish to assign tasks to and edit the user groups to include the group you just created