This content has been marked as final.
Show 3 replies
-
1. Re: Spark as big data data sources?
rareddy Mar 15, 2017 9:27 AM (in response to fabsta)Using the Hive driver you can connect to the Spark currently. Currently there is no extension using Dataframes or Spark SQL directly.
-
2. Re: Spark as big data data sources?
fabsta Mar 15, 2017 9:36 AM (in response to rareddy)Thanks, Ramesh!
By "Using the Hive driver you can connect to the Spark currently" you mean using the Spark execution engine in Hive, yes?
-
3. Re: Spark as big data data sources?
rareddy Mar 15, 2017 9:42 AM (in response to fabsta)See this [TEIID-3442] Apache Spark support via SparkSQL and DataFrames - JBoss Issue Tracker
This example at the end for the embedded, but same can be done for the server version.