I forgot to mention my datatable is inside a a4j:outputPanel.
Not sure if that matters.
I think it has to do with the fact that it's inside the a4j:outputPanel
I have another datatable that isn't inside the outputpanal and the datascroller works fine with it.
Has anyone used the rich:datascroller within a a4j:outputpanel?