Spark Streaming

“You can think of Spark Streaming as a train going through a train station, while getting scanned on the way. To better handle the train of data, the D-Stream, we divide it into batches which are internally represented as what we call a Resilient Distributed Dataset (RDD) and analyze it one car at a time…”