-
1. Re: MongoDB 2.6/ Teiid 8.10 with usedisk option
rareddy May 6, 2015 9:07 AM (in response to ichanjasper)Ivan,
MongoDB has 16 MB size limit on any one document size, I believe you are hitting that limit. useDisk is IMO only used for intermediate calculations. MongoDB Limits and Thresholds — MongoDB Manual 3.0.2
Ramesh..
-
2. Re: MongoDB 2.6/ Teiid 8.10 with usedisk option
ichanjasper May 7, 2015 8:09 PM (in response to rareddy)I see. And I created another test case, but still bumped into error.
Here is my sql:
select "antiNucleus",
"eventFile",
"eventNumber",
"eventTime"
from "MongoDB_DS"."star2002"
order by "eventFile", "antiNucleus"
limit 900000001
And Teiid translates it to:
{"$project": {{ "c_0" : "$antiNucleus" , "c_1" : "$eventFile" , "c_2" : "$eventNumber" , "c_3
" : "$eventTime"}}}
{"$sort": {{ "c_1" : 1 , "c_0" : 1}}}
{"$skip": {0}}
{"$limit": {900000001}}
And I hit this error right away:
Caused by: com.mongodb.CommandFailureException: { "serverUsed" : "ec2-54-161-255-173.compute-1.amazonaws.com:27017" , "errmsg" : "exception: Sort exceeded memory limit of 104857600 bytes, but did not
opt in to external sorting. Aborting operation. Pass allowDiskUse:true to opt in." , "code" : 16820 , "ok" : 0.0}
at com.mongodb.CommandResult.getException(CommandResult.java:76)
at com.mongodb.CommandResult.throwOnError(CommandResult.java:131)
at com.mongodb.DBCollectionImpl.aggregate(DBCollectionImpl.java:100)
at com.mongodb.DBCollection.aggregate(DBCollection.java:1571)
-
3. Re: MongoDB 2.6/ Teiid 8.10 with usedisk option
rareddy May 8, 2015 10:45 AM (in response to ichanjasper)You can reopen the case I will take look, suspecting some regression in that case.
-
4. Re: MongoDB 2.6/ Teiid 8.10 with usedisk option
ichanjasper May 8, 2015 12:46 PM (in response to rareddy)Thanks. Will do.
-
5. Re: MongoDB 2.6/ Teiid 8.10 with usedisk option
ichanjasper May 8, 2015 12:52 PM (in response to ichanjasper)I added my comment in this issue. [TEIID-3166] Allow allowDiskUse setting in MongoDB translator - JBoss Issue Tracker
But I don't have permission to re-open it.
Thanks,
Ivan