A possibility is:
You could use executionContext.getProcessInstance().getTaskMgmtInstance().getTaskInstances() in your assignmentHandler. This gives you all task instances of the current process instance. Then you can look up the start task, find the swimlane instance and its actorid and add this to the group of users.
Maybe there are better solutions...