Anybody faced this issue?
So far I did not resolved my issue. But I did an workaround here, I increased the pagination size on server side to 2500 (this size is not used to display on UI), the total number of records are usually less than 2500. This is working fine.
It would be great to solve the pagination issue overall.