Are you sure you have your relationship set to be bidirectional?
Yes, especially because Account actually has the foreign key, and the relationships work fine in both directions normally.
The only time there is a problem is if the entity is first loaded by portfolio.getAccounts(). If the entity has already been loaded getAccounts() works fine.
Make sure you are using the most recent hibernate annotations. Ask on the hibernate forum and have a testcase if possible.