[omaha] Spark Data Frames - databricks blog post

Bob Haffner bob.haffner at gmail.com
Tue Feb 17 21:38:56 CET 2015


This post talks about how the new data frames in Spark that were inspired
in part by Pandas.  Looks like there's interop between pandas frames and
spark frames as well.

Along with pyspark, I see this playing a significant role in bridging the
python and distributed analysis worlds.

https://databricks.com/blog/2015/02/17/introducing-dataframes-in-spark-for-large-scale-data-science.html


More information about the Omaha mailing list