Slides

https://github.com/keypointt/reading/blob/master/spark/2017_spark_spring_SF_Databricks_spark_memory.pdf

note

Future work to track

• SPARK-19489: Stable serialization format for external & native code integration.
• SPARK-15689: Data source API v2
• SPARK-15687: Columnar execution engine

Reference:

• https://www.youtube.com/watch?v=-Aq1LMpzaKw&feature=youtu.be