-
1. Re: Infinispan 7 MapReduce giving inconsistent results
william.burns Nov 20, 2014 11:03 AM (in response to bhoomiredy)Is it possible that the topology changed in the middle of the invocation? Unfortunately MapReduce is not tolerant to guarantee consistency when a node joins or leaves.
-
2. Re: Infinispan 7 MapReduce giving inconsistent results
bhoomiredy Nov 21, 2014 4:53 AM (in response to william.burns)William,
We ran this on a single node as we were evaluating map reduce in version 7.0 to compare the performance against version 6.0.2. So the topology remained the same through out which is a single node.
Regards
Vijay
-
3. Re: Infinispan 7 MapReduce giving inconsistent results
rvansa Nov 24, 2014 3:56 AM (in response to bhoomiredy)Do you have any cache store configured? Do you use expiration for some entries or eviction?
-
4. Re: Infinispan 7 MapReduce giving inconsistent results
bhoomiredy Nov 24, 2014 6:18 AM (in response to rvansa)Hi Radim,
We are neither using any cache store not any expiration / eviction strategy.We are keeping the complete data in cache itself and processing the same. The results are accurate when the version used is 6.0.2. but goes inconsistent for version 7.The same data and code has been reused. Only the jar dependencies have been changed from one version to the other.
Regards
Vijay
-
5. Re: Infinispan 7 MapReduce giving inconsistent results
afield Nov 25, 2014 10:18 AM (in response to bhoomiredy)Hey Vijay,
Can you supply more details about the data you are processing and the implementation of your mapper, reducer, combiner, and collator classes. One of the big changes in the Map/Reduce implementation is the increase in parallelization in these phases. I'm wondering if these changes are causes your computation to produce different results.
Thanks,
Alan
[1] http://blog.infinispan.org/2014/07/upcoming-infinispan-700-mapreduce-is.html