If you skip a call, it will go to the next available agent for that job. 

Note that it can still be reassigned to you if the number of available agents is low.