Technical Technical — Spark
Spark Structured Streaming with DataFrames
Tuesday 28th November 2017 by Paul Brebner
This blog provides an exploration of Spark Structured Streaming with DataFrames The blog extends the previous Spark MLLib Instametrics data prediction blog example to make predictions from streaming data. We demonstrate a two-phase approach to debugging, starting with static DataFrames first, and then turning on streaming. Finally we explain Spark structured streaming in more detail […]