SlideShare a Scribd company logo
Reactive Programming with Examples 
London Java Community and Skills Matter eXchange. 
Thursday 20th November 2014 
Peter Lawrey, CEO 
Higher Frequency Trading Ltd.
Agenda 
• What is Reactive Programming? 
• History behind reactive programming 
• What are the traits of reactive programming? 
• Reactive design with state machines.
Reactive means 
Reactive 
a) Readily response to a stimulus. 
-- merriam-webster.com
Reactive means … 
Reactive 
a) Readily response to a stimulus. 
b) Occurring as a result of stress 
or emotional upset. 
-- merriam-webster.com
What is Reactive Programming? 
“In computing, reactive programming is 
a programming paradigm oriented around data 
flows and the propagation of change.” – 
Wikipedia. 
Reactive Systems “are Responsive, Resilient, 
Elastic and Message Driven” – Reactive 
Manifesto.
What is Reactive Programming? 
Reactive Programming and Design is a higher level 
description of the flow of data rather than dealing 
with individual elements or events. 
Map<String, List<Position>> positionBySymbol = 
positions.values().stream() 
.filter(p -> p.getQuantity() != 0) 
.collect(groupingBy(Position::getSymbol));
What Reactive Programming isn’t? 
Procedural Programming 
Polling to check what has changed 
e.g. ad hoc queries. 
Same as event driven programming. 
Same as functional programming
In the beginning there was the Callback 
• Function pointers used in assembly, C and others. 
• Could specify code to call when something changed 
(Event driven) 
• Could specify code to inject to perform an action 
void qsort(void* field, 
size_t nElements, 
size_t sizeOfAnElement, 
int(_USERENTRY *cmpFunc)(const void*, const void*));
Model View Controller architecture 
1970s and 1980s 
• First used in the 1970s by Xerox Parc by Trygve 
Reenskaug. 
• Added to smalltalk-80 with almost no documentation 
• "A Cookbook for Using the Model-View-Controller User 
Interface Paradigm in Smalltalk -80", by Glenn Krasner 
and Stephen Pope in Aug/Sep 1988. 
• Event driven design.
Embedded SQL (1989) 
• Compiler extension to allow SQL to be written in C, C++, 
Fortran, Ada, Pascal, PL/1, COBOL. 
for (;;) { 
EXEC SQL fetch democursor; 
if (strncmp(SQLSTATE, "00", 2) != 0) 
break; 
printf("%s %sn",fname, lname); 
} 
if (strncmp(SQLSTATE, "02", 2) != 0) 
printf("SQLSTATE after fetch is %sn", SQLSTATE); 
EXEC SQL close democursor; 
EXEC SQL free democursor;
Gang of Four, Observer pattern (1994) 
• Described Observerables and Observers. 
• Focuses on event driven, not streams. 
• Added to Java in 1996. 
• No manipulation of observerables. 
Observable o = new Observable(); 
o.addObservable(new MyObserver()); 
o.notifyObservers(new MyEvent());
InputStream/OutputStream in Java (1996) 
• Construct new streams by wrapping streams 
• Socket streams were event driven. 
• TCP/UDP inherently asynchronous. 
• Very low level byte manipulation 
InputStream is = socket.getInputStream(); 
InputStream zipped = new GZIPInputStream(is); 
InputStream objects = new ObjectInputStream(zipped); 
Object o = objects.readObject();
Staged Event-Driven Architecture (2000) 
• Based on a paper by Matt Welsh 
• “Highly Concurrent Server Applications” 
• A set of event driven stages separated by queues. 
• Libraries to support SEDA have been added.
Reactive Extensions in .NET 2009 
• Built on LINQ added in 2007. 
• Combines Observable + LINQ + Thread pools 
• Functional manipulation of streams of data. 
• High level interface. 
var customers = new ObservableCollection<Customer>(); 
var customerChanges = Observable.FromEventPattern( 
(EventHandler<NotifyCollectionChangedEventArgs> ev) 
=> new NotifyCollectionChangedEventHandler(ev), 
ev => customers.CollectionChanged += ev, 
ev => customers.CollectionChanged -= ev);
Reactive Extensions in .NET (cont) 
var watchForNewCustomersFromWashington = 
from c in customerChanges 
where c.EventArgs.Action == NotifyCollectionChangedAction.Add 
from cus in c.EventArgs.NewItems.Cast<Customer>().ToObservable() 
where cus.Region == "WA" 
select cus; 
watchForNewCustomersFromWashington.Subscribe(cus => { 
Console.WriteLine("Customer {0}:", cus.CustomerName); 
foreach (var order in cus.Orders) { 
Console.WriteLine("Order {0}: {1}", order.OrderId, 
order.OrderDate); 
} 
});
• library for composing asynchronous and event-based programs by 
using observable sequences. 
• It extends the observer pattern to support sequences of data/events 
and adds operators that allow you to compose sequences together 
declaratively 
• abstracting away concerns about things like low-level threading, 
synchronization, thread-safety, concurrent data structures, and non-blocking 
I/O 
RxJava 
Observable.from(names).subscribe(new Action1<String>() { 
@Override 
public void call(String s) { 
System.out.println("Hello " + s + "!"); 
} 
});
Akka Framework 
• process messages asynchronously using an event-driven receive loop 
• raise the abstraction level and make it much easier to write, test, 
understand and maintain concurrent and/or distributed systems 
• focus on workflow—how the messages flow in the system—instead of 
low level primitives like threads, locks and socket IO 
case class Greeting(who: String) 
class GreetingActor extends Actor with ActorLogging { 
def receive = { 
case Greeting(who) ⇒ log.info("Hello " + who) 
} 
} 
val system = ActorSystem("MySystem") 
val greeter = system.actorOf(Props[GreetingActor], name = "greeter") 
greeter ! Greeting("Charlie Parker")
Reactor Framework 
• a foundation for asynchronous applications on the JVM. 
• make building event and data-driven applications easier 
• process around 15,000,000 events per second 
• Uses Chronicle Queue for a persisted queue 
// U() is a static helper method to create a UriTemplateSelector 
reactor.on(U("/topic/{name}"), ev -> { 
String name = ev.getHeaders().get("name"); 
// process the message 
});
Reactive System traits 
• Responsive – React in a timely manner 
respond with reliable latencies. 
• Resilient – React to failure, 
handle failure well instead of trying to prevent them 
• Elastic – React to load 
• Message Driven – React to events. 
See the Reactive Manifesto for more details
Messages, Event Driven, Actors 
• A message is a self contain piece of information 
• Messaging systems are concerned about how they are 
delivered, rather than what they contain. 
• A messaging system has a header for meta information.
Messages, Event Driven, Actors 
• Events state what has happened. They are associated with the 
source of an event and need not have a listener. 
• The fact an event happened doesn’t imply an action to take. 
• Similar to Publish/Subscribe messaging. 
• Lose coupling between producer and consumer. 
• Can have multiple consumers for the same event.
Messages, Event Driven, Actors 
• Actors-based messages are commands to be executed by a 
specific target. Actor-based messages imply an action to take 
as well as who should take it. 
• It usually doesn’t have a reason, or trigger associated with it. 
• Similar to asynchronous Point-to-point or Request/Reply 
messaging. 
• Tighter coupling between the producer and an actor.
Reactive principles 
• Avoid blocking on IO (or anything else) use futures 
• Pass blocking tasks to supporting thread. 
• Monitor your core threads to report any delays and their cause. 
E.g. take a stack trace if your event loop takes more than 5 ms. 
• Avoid holding locks (ideally avoid locks) 
• Pre-build your listener layout. Don’t dynamically add/remove 
listeners. Create a structure which is basically static in layout.
Reactive principles – don’t forget testing 
• Reproducable inputs and load. Complete replayability 
• Deterministic behavior, diagnose rare bug in stateful components. 
• Controlled timings, diagnose rare timing issues.
Reactive Performance 
• Event Driven programming improves latency on average and 
worst timings, sometimes at the cost to throughput. 
• There is ways to tune event driven systems to handle bursts in 
load which start to look more procedural. 
• Reactive systems should be performant so they are relatively 
lightly loaded, so they can always be ready to react. 
If you have to respond in 20 ms or 200 μs, you want this to be 
the 99%tile or 99.99%tile latency not the average latency.
Performance considerations 
• Micro burst activity. A system which experiences micro bursts is 
not 1% busy, its 100% busy 1% of the time. 
• Eventual consistency vs strong consistency 
• Process every event, or just the latest state. 
By taking the latest state you can absorb high bursts in load. 
• Reactive systems which is relatively lightly loaded, so they can 
always be ready to react.
Functional Reactive Quality 
• Improves quality of code, esp for more junior developers. 
An Empirical Study on Program Comprehension 
with Reactive Programming – Guido Salvaneschi
Functional Reactive Programming 
• No mutable state 
• Easy to reason about 
• Easy to componentize 
• But … no mutable state.
State Machines 
• Local mutable state 
• Easier to reason about, than shared state 
• Easier to componentize 
• Not as simple as FRP.
FRP with a State Machine 
• Minimum of local mutable state 
• Easier to reason about, than shared state 
• Easier to componentize
A typical trading system
Reactive means always being ready. 
Questions and answers 
Peter Lawrey 
@PeterLawrey 
http://higherfrequencytrading.com
Ad

Recommended

Writing and testing high frequency trading engines in java
Writing and testing high frequency trading engines in java
Peter Lawrey
 
Mutiny + quarkus
Mutiny + quarkus
Edgar Domingues
 
Low latency microservices in java QCon New York 2016
Low latency microservices in java QCon New York 2016
Peter Lawrey
 
OOUG - Oracle Performance Tuning with AAS
OOUG - Oracle Performance Tuning with AAS
Kyle Hailey
 
Maintaining Consistency for a Financial Event-Driven Architecture (Iago Borge...
Maintaining Consistency for a Financial Event-Driven Architecture (Iago Borge...
confluent
 
Performance Tuning RocksDB for Kafka Streams' State Stores (Dhruba Borthakur,...
Performance Tuning RocksDB for Kafka Streams' State Stores (Dhruba Borthakur,...
confluent
 
[MLOps KR 행사] MLOps 춘추 전국 시대 정리(210605)
[MLOps KR 행사] MLOps 춘추 전국 시대 정리(210605)
Seongyun Byeon
 
Measuring the CPU Performance of Android Apps at Lyft
Measuring the CPU Performance of Android Apps at Lyft
ScyllaDB
 
Kafka 101
Kafka 101
Clement Demonchy
 
Alfresco Backup and Disaster Recovery White Paper
Alfresco Backup and Disaster Recovery White Paper
Toni de la Fuente
 
ClickHouse Monitoring 101: What to monitor and how
ClickHouse Monitoring 101: What to monitor and how
Altinity Ltd
 
Whitepaper: Mining the AWR repository for Capacity Planning and Visualization
Whitepaper: Mining the AWR repository for Capacity Planning and Visualization
Kristofferson A
 
Debugging node in prod
Debugging node in prod
Yunong Xiao
 
How Adobe uses Structured Streaming at Scale
How Adobe uses Structured Streaming at Scale
Databricks
 
Project Reactor Now and Tomorrow
Project Reactor Now and Tomorrow
VMware Tanzu
 
AWR and ASH Deep Dive
AWR and ASH Deep Dive
Kellyn Pot'Vin-Gorman
 
Fleetwise H4D 2021 Lessons Learned
Fleetwise H4D 2021 Lessons Learned
Stanford University
 
Container Performance Analysis
Container Performance Analysis
Brendan Gregg
 
Alfresco tuning part1
Alfresco tuning part1
Luis Cabaceira
 
오픈 소스 도구를 활용한 성능 테스트 방법 및 사례
오픈 소스 도구를 활용한 성능 테스트 방법 및 사례
MinWoo Byeon
 
YOW2018 Cloud Performance Root Cause Analysis at Netflix
YOW2018 Cloud Performance Root Cause Analysis at Netflix
Brendan Gregg
 
Apache Spark Architecture
Apache Spark Architecture
Alexey Grishchenko
 
Scylla Summit 2022: Making Schema Changes Safe with Raft
Scylla Summit 2022: Making Schema Changes Safe with Raft
ScyllaDB
 
Christo kutrovsky oracle, memory & linux
Christo kutrovsky oracle, memory & linux
Kyle Hailey
 
Ibm data science capstone project-SpaceX launch analysis
Ibm data science capstone project-SpaceX launch analysis
Hang (Henry) YAN
 
로그 기깔나게 잘 디자인하는 법
로그 기깔나게 잘 디자인하는 법
Jeongsang Baek
 
Acing the amazing Elastic Certified Engineer Exam (APAC Version)
Acing the amazing Elastic Certified Engineer Exam (APAC Version)
Sandeep Kanabar
 
오픈소스로 만드는 DB 모니터링 시스템 (w/graphite+grafana)
오픈소스로 만드는 DB 모니터링 시스템 (w/graphite+grafana)
I Goo Lee
 
Microservices for performance - GOTO Chicago 2016
Microservices for performance - GOTO Chicago 2016
Peter Lawrey
 
Introduction to Reactive Java
Introduction to Reactive Java
Tomasz Kowalczewski
 

More Related Content

What's hot (20)

Kafka 101
Kafka 101
Clement Demonchy
 
Alfresco Backup and Disaster Recovery White Paper
Alfresco Backup and Disaster Recovery White Paper
Toni de la Fuente
 
ClickHouse Monitoring 101: What to monitor and how
ClickHouse Monitoring 101: What to monitor and how
Altinity Ltd
 
Whitepaper: Mining the AWR repository for Capacity Planning and Visualization
Whitepaper: Mining the AWR repository for Capacity Planning and Visualization
Kristofferson A
 
Debugging node in prod
Debugging node in prod
Yunong Xiao
 
How Adobe uses Structured Streaming at Scale
How Adobe uses Structured Streaming at Scale
Databricks
 
Project Reactor Now and Tomorrow
Project Reactor Now and Tomorrow
VMware Tanzu
 
AWR and ASH Deep Dive
AWR and ASH Deep Dive
Kellyn Pot'Vin-Gorman
 
Fleetwise H4D 2021 Lessons Learned
Fleetwise H4D 2021 Lessons Learned
Stanford University
 
Container Performance Analysis
Container Performance Analysis
Brendan Gregg
 
Alfresco tuning part1
Alfresco tuning part1
Luis Cabaceira
 
오픈 소스 도구를 활용한 성능 테스트 방법 및 사례
오픈 소스 도구를 활용한 성능 테스트 방법 및 사례
MinWoo Byeon
 
YOW2018 Cloud Performance Root Cause Analysis at Netflix
YOW2018 Cloud Performance Root Cause Analysis at Netflix
Brendan Gregg
 
Apache Spark Architecture
Apache Spark Architecture
Alexey Grishchenko
 
Scylla Summit 2022: Making Schema Changes Safe with Raft
Scylla Summit 2022: Making Schema Changes Safe with Raft
ScyllaDB
 
Christo kutrovsky oracle, memory & linux
Christo kutrovsky oracle, memory & linux
Kyle Hailey
 
Ibm data science capstone project-SpaceX launch analysis
Ibm data science capstone project-SpaceX launch analysis
Hang (Henry) YAN
 
로그 기깔나게 잘 디자인하는 법
로그 기깔나게 잘 디자인하는 법
Jeongsang Baek
 
Acing the amazing Elastic Certified Engineer Exam (APAC Version)
Acing the amazing Elastic Certified Engineer Exam (APAC Version)
Sandeep Kanabar
 
오픈소스로 만드는 DB 모니터링 시스템 (w/graphite+grafana)
오픈소스로 만드는 DB 모니터링 시스템 (w/graphite+grafana)
I Goo Lee
 
Alfresco Backup and Disaster Recovery White Paper
Alfresco Backup and Disaster Recovery White Paper
Toni de la Fuente
 
ClickHouse Monitoring 101: What to monitor and how
ClickHouse Monitoring 101: What to monitor and how
Altinity Ltd
 
Whitepaper: Mining the AWR repository for Capacity Planning and Visualization
Whitepaper: Mining the AWR repository for Capacity Planning and Visualization
Kristofferson A
 
Debugging node in prod
Debugging node in prod
Yunong Xiao
 
How Adobe uses Structured Streaming at Scale
How Adobe uses Structured Streaming at Scale
Databricks
 
Project Reactor Now and Tomorrow
Project Reactor Now and Tomorrow
VMware Tanzu
 
Fleetwise H4D 2021 Lessons Learned
Fleetwise H4D 2021 Lessons Learned
Stanford University
 
Container Performance Analysis
Container Performance Analysis
Brendan Gregg
 
오픈 소스 도구를 활용한 성능 테스트 방법 및 사례
오픈 소스 도구를 활용한 성능 테스트 방법 및 사례
MinWoo Byeon
 
YOW2018 Cloud Performance Root Cause Analysis at Netflix
YOW2018 Cloud Performance Root Cause Analysis at Netflix
Brendan Gregg
 
Scylla Summit 2022: Making Schema Changes Safe with Raft
Scylla Summit 2022: Making Schema Changes Safe with Raft
ScyllaDB
 
Christo kutrovsky oracle, memory & linux
Christo kutrovsky oracle, memory & linux
Kyle Hailey
 
Ibm data science capstone project-SpaceX launch analysis
Ibm data science capstone project-SpaceX launch analysis
Hang (Henry) YAN
 
로그 기깔나게 잘 디자인하는 법
로그 기깔나게 잘 디자인하는 법
Jeongsang Baek
 
Acing the amazing Elastic Certified Engineer Exam (APAC Version)
Acing the amazing Elastic Certified Engineer Exam (APAC Version)
Sandeep Kanabar
 
오픈소스로 만드는 DB 모니터링 시스템 (w/graphite+grafana)
오픈소스로 만드는 DB 모니터링 시스템 (w/graphite+grafana)
I Goo Lee
 

Viewers also liked (6)

Microservices for performance - GOTO Chicago 2016
Microservices for performance - GOTO Chicago 2016
Peter Lawrey
 
Introduction to Reactive Java
Introduction to Reactive Java
Tomasz Kowalczewski
 
Low latency in java 8 v5
Low latency in java 8 v5
Peter Lawrey
 
GC free coding in @Java presented @Geecon
GC free coding in @Java presented @Geecon
Peter Lawrey
 
Low latency for high throughput
Low latency for high throughput
Peter Lawrey
 
Reactive Programming in Java 8 with Rx-Java
Reactive Programming in Java 8 with Rx-Java
Kasun Indrasiri
 
Microservices for performance - GOTO Chicago 2016
Microservices for performance - GOTO Chicago 2016
Peter Lawrey
 
Low latency in java 8 v5
Low latency in java 8 v5
Peter Lawrey
 
GC free coding in @Java presented @Geecon
GC free coding in @Java presented @Geecon
Peter Lawrey
 
Low latency for high throughput
Low latency for high throughput
Peter Lawrey
 
Reactive Programming in Java 8 with Rx-Java
Reactive Programming in Java 8 with Rx-Java
Kasun Indrasiri
 
Ad

Similar to Reactive programming with examples (20)

20160609 nike techtalks reactive applications tools of the trade
20160609 nike techtalks reactive applications tools of the trade
shinolajla
 
Springone2gx 2014 Reactive Streams and Reactor
Springone2gx 2014 Reactive Streams and Reactor
Stéphane Maldini
 
Nelson: Rigorous Deployment for a Functional World
Nelson: Rigorous Deployment for a Functional World
Timothy Perrett
 
Akka london scala_user_group
Akka london scala_user_group
Skills Matter
 
Akka (1)
Akka (1)
Rahul Shukla
 
Planning to Fail #phpne13
Planning to Fail #phpne13
Dave Gardner
 
Mario Fusco - Reactive programming in Java - Codemotion Milan 2017
Mario Fusco - Reactive programming in Java - Codemotion Milan 2017
Codemotion
 
Performance Test Driven Development with Oracle Coherence
Performance Test Driven Development with Oracle Coherence
aragozin
 
Planning to Fail #phpuk13
Planning to Fail #phpuk13
Dave Gardner
 
Scale up your thinking
Scale up your thinking
Yardena Meymann
 
Groovy concurrency
Groovy concurrency
Alex Miller
 
Building large scale, job processing systems with Scala Akka Actor framework
Building large scale, job processing systems with Scala Akka Actor framework
Vignesh Sukumar
 
Sharing-akka-pub
Sharing-akka-pub
Hendri Karisma
 
Reactive Streams - László van den Hoek
Reactive Streams - László van den Hoek
RubiX BV
 
Multi-threading in the modern era: Vertx Akka and Quasar
Multi-threading in the modern era: Vertx Akka and Quasar
Gal Marder
 
Beyond Fault Tolerance with Actor Programming
Beyond Fault Tolerance with Actor Programming
Fabio Tiriticco
 
Beyond fault tolerance with actor programming - Fabio Tiriticco - Codemotion ...
Beyond fault tolerance with actor programming - Fabio Tiriticco - Codemotion ...
Codemotion
 
Distributed Performance testing by funkload
Distributed Performance testing by funkload
Akhil Singh
 
The End of a Myth: Ultra-Scalable Transactional Management
The End of a Myth: Ultra-Scalable Transactional Management
Ricardo Jimenez-Peris
 
StackWatch: A prototype CloudWatch service for CloudStack
StackWatch: A prototype CloudWatch service for CloudStack
Chiradeep Vittal
 
20160609 nike techtalks reactive applications tools of the trade
20160609 nike techtalks reactive applications tools of the trade
shinolajla
 
Springone2gx 2014 Reactive Streams and Reactor
Springone2gx 2014 Reactive Streams and Reactor
Stéphane Maldini
 
Nelson: Rigorous Deployment for a Functional World
Nelson: Rigorous Deployment for a Functional World
Timothy Perrett
 
Akka london scala_user_group
Akka london scala_user_group
Skills Matter
 
Planning to Fail #phpne13
Planning to Fail #phpne13
Dave Gardner
 
Mario Fusco - Reactive programming in Java - Codemotion Milan 2017
Mario Fusco - Reactive programming in Java - Codemotion Milan 2017
Codemotion
 
Performance Test Driven Development with Oracle Coherence
Performance Test Driven Development with Oracle Coherence
aragozin
 
Planning to Fail #phpuk13
Planning to Fail #phpuk13
Dave Gardner
 
Groovy concurrency
Groovy concurrency
Alex Miller
 
Building large scale, job processing systems with Scala Akka Actor framework
Building large scale, job processing systems with Scala Akka Actor framework
Vignesh Sukumar
 
Reactive Streams - László van den Hoek
Reactive Streams - László van den Hoek
RubiX BV
 
Multi-threading in the modern era: Vertx Akka and Quasar
Multi-threading in the modern era: Vertx Akka and Quasar
Gal Marder
 
Beyond Fault Tolerance with Actor Programming
Beyond Fault Tolerance with Actor Programming
Fabio Tiriticco
 
Beyond fault tolerance with actor programming - Fabio Tiriticco - Codemotion ...
Beyond fault tolerance with actor programming - Fabio Tiriticco - Codemotion ...
Codemotion
 
Distributed Performance testing by funkload
Distributed Performance testing by funkload
Akhil Singh
 
The End of a Myth: Ultra-Scalable Transactional Management
The End of a Myth: Ultra-Scalable Transactional Management
Ricardo Jimenez-Peris
 
StackWatch: A prototype CloudWatch service for CloudStack
StackWatch: A prototype CloudWatch service for CloudStack
Chiradeep Vittal
 
Ad

More from Peter Lawrey (15)

Chronicle accelerate building a digital currency
Chronicle accelerate building a digital currency
Peter Lawrey
 
Chronicle Accelerate Crypto Investor conference
Chronicle Accelerate Crypto Investor conference
Peter Lawrey
 
Deterministic behaviour and performance in trading systems
Deterministic behaviour and performance in trading systems
Peter Lawrey
 
Determinism in finance
Determinism in finance
Peter Lawrey
 
Legacy lambda code
Legacy lambda code
Peter Lawrey
 
Responding rapidly when you have 100+ GB data sets in Java
Responding rapidly when you have 100+ GB data sets in Java
Peter Lawrey
 
Streams and lambdas the good, the bad and the ugly
Streams and lambdas the good, the bad and the ugly
Peter Lawrey
 
Low level java programming
Low level java programming
Peter Lawrey
 
Advanced off heap ipc
Advanced off heap ipc
Peter Lawrey
 
Open HFT libraries in @Java
Open HFT libraries in @Java
Peter Lawrey
 
High Frequency Trading and NoSQL database
High Frequency Trading and NoSQL database
Peter Lawrey
 
Introduction to OpenHFT for Melbourne Java Users Group
Introduction to OpenHFT for Melbourne Java Users Group
Peter Lawrey
 
Thread Safe Interprocess Shared Memory in Java (in 7 mins)
Thread Safe Interprocess Shared Memory in Java (in 7 mins)
Peter Lawrey
 
Using BigDecimal and double
Using BigDecimal and double
Peter Lawrey
 
Introduction to chronicle (low latency persistence)
Introduction to chronicle (low latency persistence)
Peter Lawrey
 
Chronicle accelerate building a digital currency
Chronicle accelerate building a digital currency
Peter Lawrey
 
Chronicle Accelerate Crypto Investor conference
Chronicle Accelerate Crypto Investor conference
Peter Lawrey
 
Deterministic behaviour and performance in trading systems
Deterministic behaviour and performance in trading systems
Peter Lawrey
 
Determinism in finance
Determinism in finance
Peter Lawrey
 
Legacy lambda code
Legacy lambda code
Peter Lawrey
 
Responding rapidly when you have 100+ GB data sets in Java
Responding rapidly when you have 100+ GB data sets in Java
Peter Lawrey
 
Streams and lambdas the good, the bad and the ugly
Streams and lambdas the good, the bad and the ugly
Peter Lawrey
 
Low level java programming
Low level java programming
Peter Lawrey
 
Advanced off heap ipc
Advanced off heap ipc
Peter Lawrey
 
Open HFT libraries in @Java
Open HFT libraries in @Java
Peter Lawrey
 
High Frequency Trading and NoSQL database
High Frequency Trading and NoSQL database
Peter Lawrey
 
Introduction to OpenHFT for Melbourne Java Users Group
Introduction to OpenHFT for Melbourne Java Users Group
Peter Lawrey
 
Thread Safe Interprocess Shared Memory in Java (in 7 mins)
Thread Safe Interprocess Shared Memory in Java (in 7 mins)
Peter Lawrey
 
Using BigDecimal and double
Using BigDecimal and double
Peter Lawrey
 
Introduction to chronicle (low latency persistence)
Introduction to chronicle (low latency persistence)
Peter Lawrey
 

Recently uploaded (20)

“Why It’s Critical to Have an Integrated Development Methodology for Edge AI,...
“Why It’s Critical to Have an Integrated Development Methodology for Edge AI,...
Edge AI and Vision Alliance
 
Providing an OGC API Processes REST Interface for FME Flow
Providing an OGC API Processes REST Interface for FME Flow
Safe Software
 
Creating Inclusive Digital Learning with AI: A Smarter, Fairer Future
Creating Inclusive Digital Learning with AI: A Smarter, Fairer Future
Impelsys Inc.
 
Can We Use Rust to Develop Extensions for PostgreSQL? (POSETTE: An Event for ...
Can We Use Rust to Develop Extensions for PostgreSQL? (POSETTE: An Event for ...
NTT DATA Technology & Innovation
 
Crypto Super 500 - 14th Report - June2025.pdf
Crypto Super 500 - 14th Report - June2025.pdf
Stephen Perrenod
 
FIDO Alliance Seminar State of Passkeys.pptx
FIDO Alliance Seminar State of Passkeys.pptx
FIDO Alliance
 
The State of Web3 Industry- Industry Report
The State of Web3 Industry- Industry Report
Liveplex
 
High Availability On-Premises FME Flow.pdf
High Availability On-Premises FME Flow.pdf
Safe Software
 
Supporting the NextGen 911 Digital Transformation with FME
Supporting the NextGen 911 Digital Transformation with FME
Safe Software
 
Edge-banding-machines-edgeteq-s-200-en-.pdf
Edge-banding-machines-edgeteq-s-200-en-.pdf
AmirStern2
 
FIDO Seminar: Evolving Landscape of Post-Quantum Cryptography.pptx
FIDO Seminar: Evolving Landscape of Post-Quantum Cryptography.pptx
FIDO Alliance
 
Kubernetes Security Act Now Before It’s Too Late
Kubernetes Security Act Now Before It’s Too Late
Michael Furman
 
Down the Rabbit Hole – Solving 5 Training Roadblocks
Down the Rabbit Hole – Solving 5 Training Roadblocks
Rustici Software
 
June Patch Tuesday
June Patch Tuesday
Ivanti
 
National Fuels Treatments Initiative: Building a Seamless Map of Hazardous Fu...
National Fuels Treatments Initiative: Building a Seamless Map of Hazardous Fu...
Safe Software
 
AI VIDEO MAGAZINE - June 2025 - r/aivideo
AI VIDEO MAGAZINE - June 2025 - r/aivideo
1pcity Studios, Inc
 
Data Validation and System Interoperability
Data Validation and System Interoperability
Safe Software
 
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure Solutions
Michele Leroux Bustamante
 
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...
Safe Software
 
SAP Modernization Strategies for a Successful S/4HANA Journey.pdf
SAP Modernization Strategies for a Successful S/4HANA Journey.pdf
Precisely
 
“Why It’s Critical to Have an Integrated Development Methodology for Edge AI,...
“Why It’s Critical to Have an Integrated Development Methodology for Edge AI,...
Edge AI and Vision Alliance
 
Providing an OGC API Processes REST Interface for FME Flow
Providing an OGC API Processes REST Interface for FME Flow
Safe Software
 
Creating Inclusive Digital Learning with AI: A Smarter, Fairer Future
Creating Inclusive Digital Learning with AI: A Smarter, Fairer Future
Impelsys Inc.
 
Can We Use Rust to Develop Extensions for PostgreSQL? (POSETTE: An Event for ...
Can We Use Rust to Develop Extensions for PostgreSQL? (POSETTE: An Event for ...
NTT DATA Technology & Innovation
 
Crypto Super 500 - 14th Report - June2025.pdf
Crypto Super 500 - 14th Report - June2025.pdf
Stephen Perrenod
 
FIDO Alliance Seminar State of Passkeys.pptx
FIDO Alliance Seminar State of Passkeys.pptx
FIDO Alliance
 
The State of Web3 Industry- Industry Report
The State of Web3 Industry- Industry Report
Liveplex
 
High Availability On-Premises FME Flow.pdf
High Availability On-Premises FME Flow.pdf
Safe Software
 
Supporting the NextGen 911 Digital Transformation with FME
Supporting the NextGen 911 Digital Transformation with FME
Safe Software
 
Edge-banding-machines-edgeteq-s-200-en-.pdf
Edge-banding-machines-edgeteq-s-200-en-.pdf
AmirStern2
 
FIDO Seminar: Evolving Landscape of Post-Quantum Cryptography.pptx
FIDO Seminar: Evolving Landscape of Post-Quantum Cryptography.pptx
FIDO Alliance
 
Kubernetes Security Act Now Before It’s Too Late
Kubernetes Security Act Now Before It’s Too Late
Michael Furman
 
Down the Rabbit Hole – Solving 5 Training Roadblocks
Down the Rabbit Hole – Solving 5 Training Roadblocks
Rustici Software
 
June Patch Tuesday
June Patch Tuesday
Ivanti
 
National Fuels Treatments Initiative: Building a Seamless Map of Hazardous Fu...
National Fuels Treatments Initiative: Building a Seamless Map of Hazardous Fu...
Safe Software
 
AI VIDEO MAGAZINE - June 2025 - r/aivideo
AI VIDEO MAGAZINE - June 2025 - r/aivideo
1pcity Studios, Inc
 
Data Validation and System Interoperability
Data Validation and System Interoperability
Safe Software
 
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure Solutions
Michele Leroux Bustamante
 
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...
Safe Software
 
SAP Modernization Strategies for a Successful S/4HANA Journey.pdf
SAP Modernization Strategies for a Successful S/4HANA Journey.pdf
Precisely
 

Reactive programming with examples

  • 1. Reactive Programming with Examples London Java Community and Skills Matter eXchange. Thursday 20th November 2014 Peter Lawrey, CEO Higher Frequency Trading Ltd.
  • 2. Agenda • What is Reactive Programming? • History behind reactive programming • What are the traits of reactive programming? • Reactive design with state machines.
  • 3. Reactive means Reactive a) Readily response to a stimulus. -- merriam-webster.com
  • 4. Reactive means … Reactive a) Readily response to a stimulus. b) Occurring as a result of stress or emotional upset. -- merriam-webster.com
  • 5. What is Reactive Programming? “In computing, reactive programming is a programming paradigm oriented around data flows and the propagation of change.” – Wikipedia. Reactive Systems “are Responsive, Resilient, Elastic and Message Driven” – Reactive Manifesto.
  • 6. What is Reactive Programming? Reactive Programming and Design is a higher level description of the flow of data rather than dealing with individual elements or events. Map<String, List<Position>> positionBySymbol = positions.values().stream() .filter(p -> p.getQuantity() != 0) .collect(groupingBy(Position::getSymbol));
  • 7. What Reactive Programming isn’t? Procedural Programming Polling to check what has changed e.g. ad hoc queries. Same as event driven programming. Same as functional programming
  • 8. In the beginning there was the Callback • Function pointers used in assembly, C and others. • Could specify code to call when something changed (Event driven) • Could specify code to inject to perform an action void qsort(void* field, size_t nElements, size_t sizeOfAnElement, int(_USERENTRY *cmpFunc)(const void*, const void*));
  • 9. Model View Controller architecture 1970s and 1980s • First used in the 1970s by Xerox Parc by Trygve Reenskaug. • Added to smalltalk-80 with almost no documentation • "A Cookbook for Using the Model-View-Controller User Interface Paradigm in Smalltalk -80", by Glenn Krasner and Stephen Pope in Aug/Sep 1988. • Event driven design.
  • 10. Embedded SQL (1989) • Compiler extension to allow SQL to be written in C, C++, Fortran, Ada, Pascal, PL/1, COBOL. for (;;) { EXEC SQL fetch democursor; if (strncmp(SQLSTATE, "00", 2) != 0) break; printf("%s %sn",fname, lname); } if (strncmp(SQLSTATE, "02", 2) != 0) printf("SQLSTATE after fetch is %sn", SQLSTATE); EXEC SQL close democursor; EXEC SQL free democursor;
  • 11. Gang of Four, Observer pattern (1994) • Described Observerables and Observers. • Focuses on event driven, not streams. • Added to Java in 1996. • No manipulation of observerables. Observable o = new Observable(); o.addObservable(new MyObserver()); o.notifyObservers(new MyEvent());
  • 12. InputStream/OutputStream in Java (1996) • Construct new streams by wrapping streams • Socket streams were event driven. • TCP/UDP inherently asynchronous. • Very low level byte manipulation InputStream is = socket.getInputStream(); InputStream zipped = new GZIPInputStream(is); InputStream objects = new ObjectInputStream(zipped); Object o = objects.readObject();
  • 13. Staged Event-Driven Architecture (2000) • Based on a paper by Matt Welsh • “Highly Concurrent Server Applications” • A set of event driven stages separated by queues. • Libraries to support SEDA have been added.
  • 14. Reactive Extensions in .NET 2009 • Built on LINQ added in 2007. • Combines Observable + LINQ + Thread pools • Functional manipulation of streams of data. • High level interface. var customers = new ObservableCollection<Customer>(); var customerChanges = Observable.FromEventPattern( (EventHandler<NotifyCollectionChangedEventArgs> ev) => new NotifyCollectionChangedEventHandler(ev), ev => customers.CollectionChanged += ev, ev => customers.CollectionChanged -= ev);
  • 15. Reactive Extensions in .NET (cont) var watchForNewCustomersFromWashington = from c in customerChanges where c.EventArgs.Action == NotifyCollectionChangedAction.Add from cus in c.EventArgs.NewItems.Cast<Customer>().ToObservable() where cus.Region == "WA" select cus; watchForNewCustomersFromWashington.Subscribe(cus => { Console.WriteLine("Customer {0}:", cus.CustomerName); foreach (var order in cus.Orders) { Console.WriteLine("Order {0}: {1}", order.OrderId, order.OrderDate); } });
  • 16. • library for composing asynchronous and event-based programs by using observable sequences. • It extends the observer pattern to support sequences of data/events and adds operators that allow you to compose sequences together declaratively • abstracting away concerns about things like low-level threading, synchronization, thread-safety, concurrent data structures, and non-blocking I/O RxJava Observable.from(names).subscribe(new Action1<String>() { @Override public void call(String s) { System.out.println("Hello " + s + "!"); } });
  • 17. Akka Framework • process messages asynchronously using an event-driven receive loop • raise the abstraction level and make it much easier to write, test, understand and maintain concurrent and/or distributed systems • focus on workflow—how the messages flow in the system—instead of low level primitives like threads, locks and socket IO case class Greeting(who: String) class GreetingActor extends Actor with ActorLogging { def receive = { case Greeting(who) ⇒ log.info("Hello " + who) } } val system = ActorSystem("MySystem") val greeter = system.actorOf(Props[GreetingActor], name = "greeter") greeter ! Greeting("Charlie Parker")
  • 18. Reactor Framework • a foundation for asynchronous applications on the JVM. • make building event and data-driven applications easier • process around 15,000,000 events per second • Uses Chronicle Queue for a persisted queue // U() is a static helper method to create a UriTemplateSelector reactor.on(U("/topic/{name}"), ev -> { String name = ev.getHeaders().get("name"); // process the message });
  • 19. Reactive System traits • Responsive – React in a timely manner respond with reliable latencies. • Resilient – React to failure, handle failure well instead of trying to prevent them • Elastic – React to load • Message Driven – React to events. See the Reactive Manifesto for more details
  • 20. Messages, Event Driven, Actors • A message is a self contain piece of information • Messaging systems are concerned about how they are delivered, rather than what they contain. • A messaging system has a header for meta information.
  • 21. Messages, Event Driven, Actors • Events state what has happened. They are associated with the source of an event and need not have a listener. • The fact an event happened doesn’t imply an action to take. • Similar to Publish/Subscribe messaging. • Lose coupling between producer and consumer. • Can have multiple consumers for the same event.
  • 22. Messages, Event Driven, Actors • Actors-based messages are commands to be executed by a specific target. Actor-based messages imply an action to take as well as who should take it. • It usually doesn’t have a reason, or trigger associated with it. • Similar to asynchronous Point-to-point or Request/Reply messaging. • Tighter coupling between the producer and an actor.
  • 23. Reactive principles • Avoid blocking on IO (or anything else) use futures • Pass blocking tasks to supporting thread. • Monitor your core threads to report any delays and their cause. E.g. take a stack trace if your event loop takes more than 5 ms. • Avoid holding locks (ideally avoid locks) • Pre-build your listener layout. Don’t dynamically add/remove listeners. Create a structure which is basically static in layout.
  • 24. Reactive principles – don’t forget testing • Reproducable inputs and load. Complete replayability • Deterministic behavior, diagnose rare bug in stateful components. • Controlled timings, diagnose rare timing issues.
  • 25. Reactive Performance • Event Driven programming improves latency on average and worst timings, sometimes at the cost to throughput. • There is ways to tune event driven systems to handle bursts in load which start to look more procedural. • Reactive systems should be performant so they are relatively lightly loaded, so they can always be ready to react. If you have to respond in 20 ms or 200 μs, you want this to be the 99%tile or 99.99%tile latency not the average latency.
  • 26. Performance considerations • Micro burst activity. A system which experiences micro bursts is not 1% busy, its 100% busy 1% of the time. • Eventual consistency vs strong consistency • Process every event, or just the latest state. By taking the latest state you can absorb high bursts in load. • Reactive systems which is relatively lightly loaded, so they can always be ready to react.
  • 27. Functional Reactive Quality • Improves quality of code, esp for more junior developers. An Empirical Study on Program Comprehension with Reactive Programming – Guido Salvaneschi
  • 28. Functional Reactive Programming • No mutable state • Easy to reason about • Easy to componentize • But … no mutable state.
  • 29. State Machines • Local mutable state • Easier to reason about, than shared state • Easier to componentize • Not as simple as FRP.
  • 30. FRP with a State Machine • Minimum of local mutable state • Easier to reason about, than shared state • Easier to componentize
  • 32. Reactive means always being ready. Questions and answers Peter Lawrey @PeterLawrey http://higherfrequencytrading.com