大数据流处理系统精彩资源月刊（第1期）

2016-09-01

[Video] Streams, flows and storms - how not to drown with your data? https://www.youtube.com/watch?v=9_mBjsfAfVg

[Webinar] Microservices in the Apache Kafka Ecosystem, Ben Stopford, Engineer, Confluent http://www.confluent.io/microservices-in-the-apache-kafka-ecosystem

[Blog] Using Z-values to efficiently compute k-nearest neighbors for Apache Flink, Daniel Blazevski https://blog.insightdatascience.com/using-z-values-to-efficiently-compute-k-nearest-neighbors-for-apache-flink-9716b6107cad

[Slides] Real Time Streaming with Apache Kafka and Syncsort DMX Connectivity http://www.slideshare.net/Syncsort/confluent-and-syncsort-webinar-august-2016

[Slides] Twitter Heron in Practice http://www.slideshare.net/HiveData/the-hive-think-tank-heron-at-twitter

[Meetup] Value Creation with Streaming Analytics Slides: http://www.iot-inc.com/wp-content/uploads/2016/09/IoT-Biz-Meetup-Presentation-21.pdf

2016-09-02

[Slides] Microservices in the Apache Kafka Ecosystem, Ben Stopford, Confluent. http://www.slideshare.net/ConfluentInc/microservices-in-the-apache-kafka-ecosystem

[Blog] Real-Time Analytics with Kafka and MemSQL, Kevin White,MemSQL http://blog.memsql.com/real-time-analytics-with-kafka-and-memsql/

[Blog] Apache Flink and Apache Kafka Streams: a comparison and guideline for users http://www.confluent.io/blog/apache-flink-apache-kafka-streams-comparison-guideline-users/

[Blog] Running Spark Streaming DCOS http://davidssysadminnotes.blogspot.com/2016/09/running-spark-streaming-dcos.html

[Report] Streaming Analytics Market worth 13.70 Billion USD by 2021 http://prsync.com/marketsandmarkets---information-and-communications/-streaming-analytics-market-worth--billion-usd-by---1101189/

[Video] Twitter Heron in Practice https://www.youtube.com/watch?v=FRvmeoJCZKU

[Slides] Introduction to Amazon Kinesis Firehose - AWS August Webinar Series http://www.slideshare.net/AmazonWebServices/introduction-to-amazon-kinesis-firehose-august-webinar-series

[Video] No shard left behind: APIs for massive parallel efficiency in Apache Beam https://atscaleconference.com/videos/no-shard-left-behind-apis-for-massive-parallel-efficiency/

2016-09-03

[Blog] Fast ETL Pipelines With Apache Kafka, Apache Flink And Druid http://www.cubicnodes.com/2016/09/03/fast-etl-pipelines-with-apache-kafka-apache-flink-and-druid/

[Blog] Streaming analytics goes mainstream http://www.ibmbigdatahub.com/blog/streaming-analytics-goes-mainstream

2016-09-04

[Blog] Streaming: Implementing a storm topology that streams in tweets https://medium.com/@moisesfernandotrelles/streaming-implementing-a-storm-topology-that-streams-in-tweets-210a833019ec

2016-09-05

[News] Apache Flink 1.1.2 Released http://flink.apache.org/news/2016/09/05/release-1.1.2.html

[Blog] August 2016 in Review: Apache Flink® 1.1, Flink Forward announcements, and more http://data-artisans.com/august-2016-in-review/

[Slides] Improved Reliable Streaming Processing: Apache Storm as example http://www.slideshare.net/HadoopSummit/improved-reliable-streaming-processing-apache-storm-as-example

[Slides] Future of Apache Storm http://www.slideshare.net/HadoopSummit/future-of-apache-storm

[News] Announcing Apache Apex Malhar 3.5.0 Release https://blogs.apache.org/apex/entry/apache_apex_malhar_3_5

2016-09-06

[News] Announcing Confluent Platform 3.0.1 & Apache Kafka 0.10.0.1 http://www.confluent.io/blog/announcing-confluent-platform-3-0-1-apache-kafka-0-10-0-1/

[Blog] Writing Data Engineering Pipelines in Apache Spark on Databricks http://www.bigdatapaper.com/2016/09/06/writing-data-engineering-pipelines-in-apache-spark-on-databricks/

[Blog] How to Get Started with Spark Streaming and MapR Streams Using the Kafka API? https://www.mapr.com/blog/how-get-started-spark-streaming-and-mapr-streams-using-kafka-api

[Whiteboard Walkthrough] MapR Converged Data Platform: What's Important about "Converged?", Ellen Friedman https://www.youtube.com/watch?v=pcYROr7bO98

[Slides] Stream Processing Frameworks http://www.slideshare.net/SirKetchup/stream-processing-frameworks

[Webinar] Webinar: Building a real-time analytics pipeline with BigQuery and Cloud Dataflow (EMEA) https://www.youtube.com/watch?v=kdmAiQeYGgE

[News] AWS August Roundup: Now you can query streaming data with SQL http://www.cio.com/article/3117111/aws-august-roundup-now-you-can-query-streaming-data-with-sql.html

2016-09-07

[Meetup] Intro to Apex (Next Gen Hadoop) and Storm Comparison http://www.meetup.com/Apache-Apex-Toronto/events/233772976/

[News] Storm 0.9.7 Released https://storm.apache.org/2016/09/07/storm097-released.html

[Slides] Stream Processing Frameworks http://www.slideshare.net/SirKetchup/stream-processing-frameworks

[Article] Yahoo’s New Pulsar: A Kafka Competitor? https://www.datanami.com/2016/09/07/yahoos-new-pulsar-kafka-competitor/

2016-09-08

[Book] MEAP edition of Flink in Action is out. https://www.manning.com/books/flink-in-action

[Meetup] Apache Flink Coding Dojo, Apache Flink Lodon Meetup http://www.meetup.com/Apache-Flink-London-Meetup/events/233471954/

[Conference Talk] Adaptive Data Cleansing with StreamSets and Cassandra http://myeventagenda.com/sessions/1CBFC920-807D-41C1-942C-8D1A7C10F4FA/5/5#sessionID=77

[Webinar] Protecting Your Data at Rest in Apache Kafka http://www.confluent.io/webinar-protecting-your-data-at-rest-in-apache-kafka

[Webinar] Building a real-time analytics pipeline with BigQuery and Cloud Dataflow https://cloudwebinars.withgoogle.com/live/real-time-analytics-amer

[Blog] Data Stream Processing on IBM Bluemix: Streaming Analytics, Apache Spark, and BigInsights http://126kr.com/article/5ylnckrrypm

[Article] Beam Capability Matrix http://beam.incubator.apache.org/learn/runners/capability-matrix/

2016-09-09

[Blog] Apache Spark™ 2.0: Keeping Count - Spark Technology Center http://www.spark.tc/apache-spark-2-0-keeping-count/

[Blog] Getting Started With Flink Streaming API,

Diethard Steiner

http://diethardsteiner.github.io/flink/2016/09/09/Getting-Started-With-Flink-Streaming-API.html

2016-09-10

[Article] Comparing Hadoop, MapReduce, Spark, Flink, and Storm http://www.metistream.com/comparing-hadoop-mapreduce-spark-flink-storm/

2016-09-11

[Blog] Hortonworks DataFlow Leverages Open Apache Tools for Streaming Analytics, Sam Dean http://ostatic.com/blog/hortonworks-dataflow-leverages-open-apache-tools-for-streaming-analytics

[Slides] Intro to Apache Apex - Next Gen Platform for Ingest and Transform http://www.slideshare.net/ApacheApex/intro-to-apache-apex-next-gen-platform-for-ingest-and-transform

2016-09-12

[Conference] Flink Forward Conference, Berlin, Germany http://flink-forward.org/

[Conference Talk] Streaming SQL, FlinkForward, Berlin. Slides: http://www.slideshare.net/julianhyde/streaming-sql-at-flinkforward-berlin-20160912

[Conference Talk] Dynamic Scaling: How Apache Flink Adapts to Changing Workloads http://www.slideshare.net/tillrohrmann/dynamic-scaling-how-apache-flink-adapts-to-changing-workloads

[Article] Taking Spark Apps from Prototype to Production https://dzone.com/articles/taking-spark-apps-from-prototype-to-production

[Slides] Log Event Stream Processing In Flink Way http://www.slideshare.net/TsungChih/log-event-stream-processing-in-flink-way

[Blog] Real-time Streaming Attribution Using Apache Flink http://devblog.mediamath.com/real-time-streaming-attribution-using-apache-flink

[Blog] The strong adoption of streaming analytics http://www.ibmbigdatahub.com/blog/strong-adoption-streaming-analytics

2016-09-13

[Webinar] Data Streaming with Apache Kafka & MongoDB https://www.mongodb.com/webinar/data-streaming-with-apache-kafka-and-mongodb

[Conference Talk] RBea: Scalable Real-Time Analytics at King, Gyula Fora http://www.slideshare.net/GyulaFra/rbea-scalable-realtime-analytics-at-king

[Conference Talk] Beaming flink to the cloud @ netflix http://www.slideshare.net/mdaxini/beaming-flink-to-the-cloud-netflix-ff-2016monaldaxini

[Blog] Running Apache Beam Spark Runner on HDP 2.5 https://community.hortonworks.com/articles/56373/running-apache-beam-spark-runner-on-hdp-25.html

[Podcast] How streaming analytics is transforming businesses? http://www.ibmbigdatahub.com/podcast/how-streaming-analytics-transforming-businesses

[Conference Talk] Taking a look under the hood of Apache Flink's relational APIs Slides: http://www.slideshare.net/fhueske/taking-a-look-under-hood-of-apache-flinks-relational-apis

[Conference Talk] Flink and Beam: Current State and Roadmap Slides: http://www.slideshare.net/FlinkForward/maximilian-michels-flink-and-beam

2016-09-14

[Meetup] Data Pipelines with Kafka Connect, Future of Data: Princeton http://www.meetup.com/futureofdata-princeton/events/232204892/

[Training] Apache Flink Training v1.1.2 http://dataartisans.github.io/flink-training/

[Training] Flink Training Preparations http://flink-forward.org/program/flink-training-preparations/

[Training -Slides] Apache Flink Training - DataStream API - Basics, Flink Forward 2016 http://www.slideshare.net/dataArtisans/apache-flink-datastream-api-basics

[Training- Slides] Apache Flink Training - DataStream API - Windows & Time, Flink Forward 2016 http://www.slideshare.net/dataArtisans/apache-flink-training-datastream-api-windows-time

[Training - Slides] Apache Flink Training - DataStream API - Connectors, Flink Forward 2016 http://www.slideshare.net/dataArtisans/apache-flink-training-datastream-api-connectors

[Training - Slides] Apache Flink Training - DataStream API - State & Failure Recovery, Flink Forward 2016 http://www.slideshare.net/dataArtisans/apache-flink-training-datastream-api-state-failure-recovery

[Article] All Data As Streams: The Rise of Streaming Analytics for Real-time and Beyond http://insidebigdata.com/2016/09/14/all-data-as-streams-the-rise-of-streaming-analytics-for-real-time-and-beyond/

[Meetup] Alluxio: Unifying APIs, Accelerating ML, & Enabling Cloud Architectures http://www.meetup.com/Alluxio/events/233453125/

[Blog] Solving the First and Last Mile Problem With Kafka Part 1 http://www.jesse-anderson.com/2016/09/solving-the-first-and-last-mile-problem-with-kafka-part-1/

2016-09-15

[Meetup] Integrating Realtime Data Streams with Spark & Kafka. Presented by Talend. Atlanta Big Data User Group. https://www.meetup.com/BigData-Atlanta/events/233722045/

[Meetup] Enter Kafka Streams, Nikola Ivancevic. Big Data Novi Sad, Serbia http://www.meetup.com/Big-Data-Novi-Sad/events/233709585/

[Conference Talk] Spark versus Flink: Understanding Performance in Big Data Analytics Frameworks http://www.ieeecluster2016.org/files/Cluster%202016%20program.pdf The Institute of Electrical and Electronics Engineers Cluster 2016, Taipei, Taiwan.

[Conference Talk] Building a real time Tweet map with Flink in six weeks, Flink Forward Slides: http://www.slideshare.net/MatthiasKricke/building-a-real-time-tweet-map-with-flink-in-six-weeks

[Meetup] Rise of Intermediate APIs - Beam and Alluxio at Alluxio Meetup 2016 Slides http://www.slideshare.net/Alluxio/rise-of-intermediate-apis-beam-and-alluxio-at-alluxio-meetup-2016

[Blog] Writing SQL on Streaming Data with Amazon Kinesis Analytics – Part 2 http://blogs.aws.amazon.com/bigdata/post/Tx3QZUFCI71QTOZ/Writing-SQL-on-Streaming-Data-with-Amazon-Kinesis-Analytics-Part-2 Part 1 https://blogs.aws.amazon.com/bigdata/post/Tx2D4GLDJXPKHOY/Writing-SQL-on-Streaming-Data-with-Amazon-Kinesis-Analytics-Part-1

2016-09-16

[Article] Flink: Worth a Second Look https://www.datanami.com/2016/09/16/flink-worth-second-look/

[Podcast] Cloud Dataflow with Eric Anderson http://softwareengineeringdaily.com/2016/09/16/cloud-dataflow-with-eric-anderson/

[Conference Talk] Real-time Data Integration w Kafka & Cassandra (Ewen Cheslack-Postava, Confluent) | C* Summit 2016 https://www.youtube.com/watch?v=ccDfWlskMm4

[Blog] Apache Spark™ 2.0: Deep Dive into Spark Catalog and DDL Native Supports http://www.spark.tc/apache-spark-2-0-deep-dive-into-spark-catalog-and-ddl-native-supports/

[Report] Apache Flink: Distributed Stream Data Processing. K.M.J. Jacobs. CERN, Geneva, Switzerland https://cds.cern.ch/record/2208322/files/report.pdf

[News] Striim Certified on Cloudera Enterprise 5 http://www.businesswire.com/news/home/20160916005764/en/Striim-Certified-Cloudera-Enterprise-5

[Blog] Scalable Stream Processing: A Survey of Storm, Samza, Spark and Flink, Wolfram Wingerath https://engineering.linkedin.com/blog/2016/06/stream-processing-hard-problems-part-1-killing-lambda

2016-09-17

[Conference Talk] Deep Dive into Unbounded Data Processing Systems, Monal Daxini. http://www.slideshare.net/mdaxini/unbounded-boundeddatastrangeloop2016monaldaxini

2016-09-18

[Meetup] Building Your First Apache Apex (Next Gen Big Data/Hadoop) Application http://www.meetup.com/Big-Data-Ingest-SF/events/233991210/

2016-09-19

[Conference Talk] Solving the problem of Stream Processing with Apache Beam, Amit Sela http://summit2016.reversim.com/session/f033d29f-e591-e212-cf81-9f428f938669

[Blog] Apache Kafka for GCP users: connectors for Pub/Sub, Dataflow and BigQuery https://cloud.google.com/blog/big-data/2016/09/apache-kafka-for-gcp-users-connectors-for-pubsub-dataflow-and-bigquery

2016-09-20

[New product] The dA Platform, the streaming data applications platform powered by Apache Flink.

[Blog] Kafka Streams – A First Impression https://experoinc.com/kafka-streams-a-first-impression/

2016-09-21

[Meetup] Apache Spark Streaming with Apache NiFi and Apache Kafka, Future of Data: Warsaw http://www.meetup.com/futureofdata-warsaw/events/233139200/

[Walkthough] Event Time in Apache Flink Stream Processing | Whiteboard Walkthrough https://www.youtube.com/watch?v=-LiZR1457Kw

[Blog] Apache Flink: another Leap in Big Data Processing http://www.mytechlogy.com/IT-blogs/13245/apache-flink-another-leap-in-big-data-processing/

[News] Flink Distro Now Available from data Artisans https://www.datanami.com/2016/09/21/flink-distro-now-available-data-artisans/

[News] Apache Beam won 2016 Bossie Award for Big Data http://www.infoworld.com/article/3120856/open-source-tools/bossie-awards-2016-the-best-open-source-big-data-tools.html#slide3

2016-09-22

[Meetup] Twitter Heron in Practice, New York City Apache Storm User Group https://www.meetup.com/New-York-City-Storm-User-Group/events/233508409/

[Meetup] Shining a Beam on Big Data in a Microsoft word, Future of Data: Triangle (Raleigh-Durham) http://www.meetup.com/futureofdata-triangle/events/234169941/

[Article] Want to migrate to AWS Cloud? Use Apache Kafka. http://www.confluent.io/blog/want-migrate-aws-cloud-use-apache-kafka/

2016-09-23

Google Cloud Platform http://flink-forward.org/what-flink-means-to-google-and-apache-beam

2016-09-24

Introduction to Apache Spark 2.0 http://www.slideshare.net/knoldus/introduction-to-apache-spark-20

2016-09-25

[News] New Lightbend Survey of 2,000 Java and Scala Developers Reveals Shake-Up In Enterprise Application Architecture http://insidebigdata.com/2016/09/25/new-lightbend-survey-of-2000-java-and-scala-developers-reveals-shake-up-in-enterprise-application-architecture/

2016-09-26

[Article] Top Streaming Technologies for Data Lakes and Real-Time Data https://dzone.com/articles/top-streaming-technologies-for-data-lakes-and-real

[News] Announcing Lightbend Fast Data Platform: Removing Risks for Teams Embracing Streaming for Faster Answers http://finance.yahoo.com/news/announcing-lightbend-fast-data-platform-143000181.html

2016-09-27

[Conference] Strata + Hadoop World, New York http://conferences.oreilly.com/strata/hadoop-big-data-ny

[Conference Tutorial] Learn stream processing with Apache Beam. Strata + Hadoop World, New York http://conferences.oreilly.com/strata/hadoop-big-data-ny/public/schedule/detail/52129

[Slides] New stream processing platform with Apache Flink http://www.slideshare.net/linecorp/b-6-new-stream-processing-platformwith-apache-flink

[Video] Athena - Stream Processing Platform @ Uber https://www.youtube.com/watch?v=YUBPimFvcN4

2016-09-28

[Conference] Stream Conf 2016, San Francisco http://www.streamconf.com/agenda/

[Meetup] Making Sense of Stream Processing in the Big Data Zoo, Criteo Labs - Tech Talks, Paris, France. http://www.meetup.com/Criteo-Labs-Tech-Talks/events/234001806/

[Article] What Spark “Structured Streaming” Really Has to Offer http://www.businessintelligenceinfo.com/business-intelligence/big-data/what-spark-structured-streaming-really-has-to-offer

[Conference Talk] Building a Spark Streaming App with DSE File System, Cassandra Summit 2016. Slides: http://pt.slideshare.net/DataStax/datastax-building-a-spark-streaming-app-with-dse-file-system-rocco-varela-cassandra-summit-2016 Video: https://www.youtube.com/watch?v=qd7KmlyZns4

[News] Apache Kafka Grabs Big Data Spotlight https://adtmag.com/articles/2016/09/28/kafka-spotlight.aspx

[News] GigaSpaces Highlights Streaming of Geospatial Data in Spark At Strata + Hadoop World http://www.businesswire.com/news/home/20160928005419/en/GigaSpaces-Highlights-Streaming-Geospatial-Data-Spark-Strata

[Conference Talk] Triggers in Apache Beam (incubating) http://conferences.oreilly.com/strata/hadoop-big-data-ny/public/schedule/detail/51747 Slides: https://goo.gl/hgIEsz

[Article] Why Akamai bought a tiny New York startup with big ambitions? http://www.bizjournals.com/boston/blog/techflash/2016/09/why-akamai-bought-a-tiny-new-york-startup-with-big.html

[Conference Talk] DataStax | Spark Streaming App with DSE File System (Rocco Varela) | Cassandra Summit 2016 Video: https://www.youtube.com/watch?v=qd7KmlyZns4

[Slides] Streaming Platforms by Sam Bessalah https://speakerdeck.com/samklr/streaming-platforms

2016-09-29

[Meetup] Introduction to Apache Flink, Apache Flink Meetup Amsterdam http://www.meetup.com/Apache-Flink-Meetup-Amsterdam/events/233817119/

[Interview] Twitter Open Sources Stream Processing Engine Heron https://www.infoq.com/news/2016/09/twitter-opensources-heron

[Conference Talk] The evolution of massive-scale data processing http://conferences.oreilly.com/strata/hadoop-big-data-ny/public/schedule/detail/52076 Slides: http://goo.gl/wuW5O0

[Conference Talk] DataStax | Highly Available Spark Stream + Confluent & DSE (Ryan Svihla & Wei Deng) | C* Summit 2016 https://www.youtube.com/watch?v=p5U9rTFYq0c

[Slides] Building Real-Time Data Analytics Applications on AWS - September 2016 Webinar Series http://www.slideshare.net/AmazonWebServices/building-realtime-data-analytics-applications-on-aws-september-2016-webinar-series

2016-09-30

[Meetup] Apache Flink, Kostas Tzoumas, data Artisans (Data Driven NYC / FirstMark) https://www.youtube.com/watch?v=u7-qm_Ygquw

[Presentation]Video: https://www.youtube.com/watch?v=BLgPaDS9hVE

[Article]Apache Flink vs. Spark: Which one is best for streaming? https://www.linkedin.com/pulse/apache-flink-vs-spark-which-one-best-streaming-fernandez

[Conference Talk] Adaptive Data Cleansing with StreamSets and Cassandra, Pat Patterson Video: https://www.youtube.com/watch?v=DjRVEB2J7wo