-
1. Re: Map/Reduce, Distributed execution over a hotrod cluster.?
mlinhard Mar 6, 2012 4:57 AM (in response to utk4rsh)1 of 1 people found this helpfulHi Utkarsh,
Map/Reduce over Hot Rod is still in a planning phase:
https://issues.jboss.org/browse/ISPN-1094
https://community.jboss.org/wiki/MapReduceOverHotRod
so far it only works with InVM access...
m.
-
2. Re: Map/Reduce, Distributed execution over a hotrod cluster.?
sannegrinovero Mar 6, 2012 5:00 AM (in response to utk4rsh)1 of 1 people found this helpfulHi,
Map/Reduce, Query, Transactions and batching are not yet implemented on Hot Rod. You would need to either:
- Wait we implement it
- Help with implementing it.. providing some code / use cases / tests
- Use Infinispan in embedded mode (without Hot Rod)
-
3. Re: Map/Reduce, Distributed execution over a hotrod cluster.?
utk4rsh Mar 6, 2012 5:10 AM (in response to sannegrinovero)Sanne and Michal. Thanks for the repsonse.
I saw that article but didn't know it is still in planning phase.
ty !
-
4. Re: Map/Reduce, Distributed execution over a hotrod cluster.?
utk4rsh Mar 6, 2012 5:35 AM (in response to utk4rsh)One more question Sanne. May be about the use case.
In case i had texts/words on 10 nodes in a distributed ispn cluster on different machines. I want to find the most frequent word on the cluster by first finding it on each node of the cluster and then getting the most frequent word from the results returned by all nodes.
Does this problem fall in that scope or it can be done in some other way without waiting for the implementation you told about.
Thanks
Utkarsh
-
5. Re: Map/Reduce, Distributed execution over a hotrod cluster.?
sannegrinovero Mar 6, 2012 6:07 AM (in response to utk4rsh)That's an interesting use case, however I wouldn't implement it via Map/Reduce but via Infinispan Query. Finding absolute or relative frequency computations of words in text is the specialization of Lucene, the full-text search engine that Query uses.
Either way, also Query is not supported via Hot Rod.
You would implement this using the embedded CacheManager, and then connect to your grid with a very simple ad-hoc client? For example deploying a REST service on the server which uses the embedded mode should be trivial.
-
6. Re: Map/Reduce, Distributed execution over a hotrod cluster.?
utk4rsh Mar 6, 2012 6:58 AM (in response to sannegrinovero)Ok. Even i am not sure if map/reduce fits the use case .I was looking at the kind of problem where an executable task or a runnable can be passed to access local data on Infinispan node of a cluster each running as a hotrod server which would then return the results back instead of pulling all the data from the caches and then doing the task.
Thanks
Utkarsh
-
7. Re: Map/Reduce, Distributed execution over a hotrod cluster.?
utk4rsh Mar 7, 2012 3:43 AM (in response to utk4rsh)Any suggested approach/solution to the above use case ?
Thanks
Utkarsh
-
8. Re: Map/Reduce, Distributed execution over a hotrod cluster.?
sannegrinovero Mar 7, 2012 7:54 AM (in response to utk4rsh)Since Hot Rod doesn' t provide this, I don' t think you have other options than what I have listed above; also instead of Hot Rod if you could use a custom remote invocation such as RMI you can then do all what the embedded cache can do.