I should RTFM
"Message redistribution can be configured on a per address basis, by specifying the redistribution delay in the address settings, for more information on configuring address settings, please see Chapter 26, Queue Attributes."
Anyway.. I was missing that on the code.. I copied over the examples but did something stupid.
Redistribution delay of -1 means no redistribution