SlideShare a Scribd company logo
Streams and Things
JAX London 2013 - Darach Ennis - @darachennis
Streams and Things - Darach Ennis (Ubiquiti Networks)
Internet of Things
Internet of Things (noun) - a proposed
development of the Internet in which everyday
objects have network connectivity, allowing
them to send and receive data …
– “Internet of Things” - added to Oxford English Dictionary - August 2013
Internet of Things (noun) - a proposed
development of the Internet in which everyday
people can easily network everyday

objects, allowing them to send and receive
data …
– “Internet of Things” - a better definition - Darach Ennis, October 2013
Streams of Events
Streams of Events - receiving, processing
and generating data flows in near real-time
using software algorithms to analyse the event
data in

flight…
Things
Streams and Things - Darach Ennis (Ubiquiti Networks)
#firstworldproblems
Streams and Things - Darach Ennis (Ubiquiti Networks)
Streams and Things - Darach Ennis (Ubiquiti Networks)
Streams and Things - Darach Ennis (Ubiquiti Networks)
Streams and Things - Darach Ennis (Ubiquiti Networks)
AR Drone 2.0 Protocols
•

A flying wireless access point with
•

9 Protocols: FTP, Auth, Video Recording,
Navigation Data, Video, Command, Raw
Capture, Printf, Control

•

Hackable: Linux based embedded system
Streams
Streams and Things - Darach Ennis (Ubiquiti Networks)
a.pipe(b).pipe(a)
by: @maxogden
Embedded
Event
Processing
Embedded Event
Processing
•

Simple embeddable subset of CEP

•

Flow a la Node.js streams and pipes

•

Aggregate windows

•

Extensible, modular

•

Functional, reactive, easy to port
Embedded Event
Processing
•

Windows / Aggregates
•

eep-js

•

eep-php

•

beam-js

•

eep-clj!

•

beam-erl

•

eep-java!

•

beam-java

•

eep-erl

•

Flow
Sources
Sinks
Operators
Pipelines
A

op

B
Filter
Transform
Builtin Functions
Branch
op
A

op
op
Branch
Combine
op
op
op

B
Combine
filter!
up
filter!
down

In

filter!
keys

fly!
up
fly!
down

…

…

filter!
right

fly!
right

land?

do!
land
Streams and Things - Darach Ennis (Ubiquiti Networks)
Streams and Things
… putting it all together … demo, with you and robots!
People and Things - can we take the
simplicity of an educational tool
such as scratch and empower
ordinary people to hack and
mashup their things in ways ‘we the
creators’ never imagined?!
!
– “Internet of Things” - added to Oxford English Dictionary - August 2013
!

!
Thanks.
Questions?
!

@darachennis
http://github.com/darach/eep-java!
!
http://github.com/darach/beam-java

More Related Content

PDF
Big Data, Mob Scale.
PDF
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
PPTX
A real-time architecture using Hadoop & Storm - Nathan Bijnens & Geert Van La...
PDF
Building a Real-Time Data Pipeline: Apache Kafka at LinkedIn
PDF
A Day in the Life of a Druid Implementor and Druid's Roadmap
PPTX
Intro to Spark development
PDF
Workflow Hacks #1 - dots. Tokyo
PDF
AUTOMATED DATA EXPLORATION - Building efficient analysis pipelines with Dask
Big Data, Mob Scale.
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
A real-time architecture using Hadoop & Storm - Nathan Bijnens & Geert Van La...
Building a Real-Time Data Pipeline: Apache Kafka at LinkedIn
A Day in the Life of a Druid Implementor and Druid's Roadmap
Intro to Spark development
Workflow Hacks #1 - dots. Tokyo
AUTOMATED DATA EXPLORATION - Building efficient analysis pipelines with Dask

What's hot (20)

PDF
Lens: Data exploration with Dask and Jupyter widgets
PDF
Spark Summit EU 2015: Combining the Strengths of MLlib, scikit-learn, and R
PDF
Tiny Batches, in the wine: Shiny New Bits in Spark Streaming
PPTX
Building data pipelines
PPTX
Distributed Deep Learning on Hadoop Clusters
PDF
Real-Time Anomoly Detection with Spark MLib, Akka and Cassandra by Natalino Busa
PDF
Challenging Web-Scale Graph Analytics with Apache Spark with Xiangrui Meng
PDF
Microservices and Teraflops: Effortlessly Scaling Data Science with PyWren wi...
PDF
Using Pluggable Apache Spark SQL Filters to Help GridPocket Users Keep Up wit...
PDF
Spark and Cassandra: An Amazing Apache Love Story by Patrick McFadin
PDF
Spark Application Carousel: Highlights of Several Applications Built with Spark
PPTX
Re-envisioning the Lambda Architecture : Web Services & Real-time Analytics ...
PDF
Spark Summit EU 2015: Reynold Xin Keynote
PDF
CERN’s Next Generation Data Analysis Platform with Apache Spark with Enric Te...
PDF
Strata EU 2014: Spark Streaming Case Studies
PPTX
Data Pipelines & Integrating Real-time Web Services w/ Storm : Improving on t...
PPTX
Implementing the Lambda Architecture efficiently with Apache Spark
PDF
Practical Large Scale Experiences with Spark 2.0 Machine Learning: Spark Summ...
PDF
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
PPTX
Graph databases: Tinkerpop and Titan DB
Lens: Data exploration with Dask and Jupyter widgets
Spark Summit EU 2015: Combining the Strengths of MLlib, scikit-learn, and R
Tiny Batches, in the wine: Shiny New Bits in Spark Streaming
Building data pipelines
Distributed Deep Learning on Hadoop Clusters
Real-Time Anomoly Detection with Spark MLib, Akka and Cassandra by Natalino Busa
Challenging Web-Scale Graph Analytics with Apache Spark with Xiangrui Meng
Microservices and Teraflops: Effortlessly Scaling Data Science with PyWren wi...
Using Pluggable Apache Spark SQL Filters to Help GridPocket Users Keep Up wit...
Spark and Cassandra: An Amazing Apache Love Story by Patrick McFadin
Spark Application Carousel: Highlights of Several Applications Built with Spark
Re-envisioning the Lambda Architecture : Web Services & Real-time Analytics ...
Spark Summit EU 2015: Reynold Xin Keynote
CERN’s Next Generation Data Analysis Platform with Apache Spark with Enric Te...
Strata EU 2014: Spark Streaming Case Studies
Data Pipelines & Integrating Real-time Web Services w/ Storm : Improving on t...
Implementing the Lambda Architecture efficiently with Apache Spark
Practical Large Scale Experiences with Spark 2.0 Machine Learning: Spark Summ...
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
Graph databases: Tinkerpop and Titan DB
Ad

Similar to Streams and Things - Darach Ennis (Ubiquiti Networks) (20)

PPTX
Web of Things
PDF
How to over-engineer things and have fun? | Oto Brglez, OPALAB
PPTX
Internet of things
PPTX
Internet of Things by Shantanu Garg
PDF
From the Internet of Computers to the Internet of Things
PPTX
IoT - IT 423 ppt
PPTX
Overview of internet of things (IoT) the new upcoming technology in hand
DOCX
Internet of Things
PPTX
Internet of Things.pptx
PPTX
Internet of Things Basics and its protocols
PDF
Дорожная карта промышленного интернета
PDF
Webinos approach in IOT
ODP
Internet of things
PDF
Internet of Things IoT Meaning, Application and Challenges
PDF
The internet of things
DOCX
iot report 3 (2)
PPTX
IOT Introduction.pptx
PDF
IoT R19 unit 1.pdf
PDF
IoT Challenges: Technological, Business and Social aspects
PPT
Data Modeling and Knowledge Engineering for the Internet of Things
Web of Things
How to over-engineer things and have fun? | Oto Brglez, OPALAB
Internet of things
Internet of Things by Shantanu Garg
From the Internet of Computers to the Internet of Things
IoT - IT 423 ppt
Overview of internet of things (IoT) the new upcoming technology in hand
Internet of Things
Internet of Things.pptx
Internet of Things Basics and its protocols
Дорожная карта промышленного интернета
Webinos approach in IOT
Internet of things
Internet of Things IoT Meaning, Application and Challenges
The internet of things
iot report 3 (2)
IOT Introduction.pptx
IoT R19 unit 1.pdf
IoT Challenges: Technological, Business and Social aspects
Data Modeling and Knowledge Engineering for the Internet of Things
Ad

More from jaxLondonConference (20)

PDF
Garbage Collection: the Useful Parts - Martijn Verburg & Dr John Oliver (jCla...
PDF
Conflict Free Replicated Data-types in Eventually Consistent Systems - Joel J...
PDF
JVM Support for Multitenant Applications - Steve Poole (IBM)
PDF
Packed Objects: Fast Talking Java Meets Native Code - Steve Poole (IBM)
PDF
What You Need to Know About Lambdas - Jamie Allen (Typesafe)
PPTX
Why other ppl_dont_get_it
PDF
Databases and agile development - Dwight Merriman (MongoDB)
PDF
Introducing Vert.x 2.0 - Taking polyglot application development to the next ...
PDF
Are Hypermedia APIs Just Hype? - Aaron Phethean (Temenos) & Daniel Feist (Mul...
PPT
How Java got its Mojo Back - James Governor (Redmonk)
PDF
Real-world polyglot programming on the JVM - Ben Summers (ONEIS)
PDF
Java Testing With Spock - Ken Sipe (Trexin Consulting)
PDF
Big Events, Mob Scale - Darach Ennis (Push Technology)
PDF
What makes Groovy Groovy - Guillaume Laforge (Pivotal)
PDF
The Java Virtual Machine is Over - The Polyglot VM is here - Marcus Lagergren...
PDF
Java EE 7 Platform: Boosting Productivity and Embracing HTML5 - Arun Gupta (R...
PPT
Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Br...
PDF
The Curious Clojurist - Neal Ford (Thoughtworks)
PPTX
TDD at scale - Mash Badar (UBS)
PDF
Run Your Java Code on Cloud Foundry - Andy Piper (Pivotal)
Garbage Collection: the Useful Parts - Martijn Verburg & Dr John Oliver (jCla...
Conflict Free Replicated Data-types in Eventually Consistent Systems - Joel J...
JVM Support for Multitenant Applications - Steve Poole (IBM)
Packed Objects: Fast Talking Java Meets Native Code - Steve Poole (IBM)
What You Need to Know About Lambdas - Jamie Allen (Typesafe)
Why other ppl_dont_get_it
Databases and agile development - Dwight Merriman (MongoDB)
Introducing Vert.x 2.0 - Taking polyglot application development to the next ...
Are Hypermedia APIs Just Hype? - Aaron Phethean (Temenos) & Daniel Feist (Mul...
How Java got its Mojo Back - James Governor (Redmonk)
Real-world polyglot programming on the JVM - Ben Summers (ONEIS)
Java Testing With Spock - Ken Sipe (Trexin Consulting)
Big Events, Mob Scale - Darach Ennis (Push Technology)
What makes Groovy Groovy - Guillaume Laforge (Pivotal)
The Java Virtual Machine is Over - The Polyglot VM is here - Marcus Lagergren...
Java EE 7 Platform: Boosting Productivity and Embracing HTML5 - Arun Gupta (R...
Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Br...
The Curious Clojurist - Neal Ford (Thoughtworks)
TDD at scale - Mash Badar (UBS)
Run Your Java Code on Cloud Foundry - Andy Piper (Pivotal)

Recently uploaded (20)

PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Heart disease approach using modified random forest and particle swarm optimi...
PPTX
Machine Learning_overview_presentation.pptx
PDF
Empathic Computing: Creating Shared Understanding
PPTX
1. Introduction to Computer Programming.pptx
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Approach and Philosophy of On baking technology
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PPTX
SOPHOS-XG Firewall Administrator PPT.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
August Patch Tuesday
PDF
Encapsulation theory and applications.pdf
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Machine learning based COVID-19 study performance prediction
PDF
Spectral efficient network and resource selection model in 5G networks
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Heart disease approach using modified random forest and particle swarm optimi...
Machine Learning_overview_presentation.pptx
Empathic Computing: Creating Shared Understanding
1. Introduction to Computer Programming.pptx
Reach Out and Touch Someone: Haptics and Empathic Computing
Approach and Philosophy of On baking technology
Group 1 Presentation -Planning and Decision Making .pptx
SOPHOS-XG Firewall Administrator PPT.pptx
Programs and apps: productivity, graphics, security and other tools
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
Digital-Transformation-Roadmap-for-Companies.pptx
August Patch Tuesday
Encapsulation theory and applications.pdf
Mobile App Security Testing_ A Comprehensive Guide.pdf
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
Machine learning based COVID-19 study performance prediction
Spectral efficient network and resource selection model in 5G networks

Streams and Things - Darach Ennis (Ubiquiti Networks)