I realise this is about 4 years late but I came to this page after a google search so its safe to assume others will follow.
you can define a style class as such:
then apply it to each column in the rich:dataTable as so:
<rich:column id ="checkboxColum" styleClass="noRowBorders">
this should remove the boarders from each row.
hope this helps someone out there ....