Can we point to multiple databases in oracle-ds.xml.
What I mean is the that different servers with different instances, passwords etc.
Yes you can. Just have multiple < local-tx-datasource > entries in the file, each one referencing a different database.
However, it is better to have multiple *-ds.xml files, each for its own database.