Python Ireland 2012 - Message brokers and Python by Fernando Ciciliati
2 likes1,441 views
The document discusses message brokers with a focus on Apache ActiveMQ and its integration with Python using the STOMP protocol. It outlines the problems message brokers address, such as decoupling, scalability, and flexibility, and presents examples of simple producer and consumer implementations using Python. Alternatives to ActiveMQ, such as RabbitMQ and ZeroMQ, are also briefly mentioned.
1 of 17
Downloaded 26 times
![A simple Python producer
def sendJMS(message, host, queue, port=61613, user='', password='', persistent=True):
# Size of a buffer for storing MQServer STOMP answers to commands.
bufsize = 200
# Establish a TCP connection
t = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
t.connect ((host, port))
# Establish a STOMP connection
frame = 'CONNECTnnx00'
t.sendall(frame)
resp = t.recv(bufsize)
if resp[0:9] != 'CONNECTED':
print ('sendJMS: Failed to connect to MQ server')
return 1
# Send the message
if persistent:
persist="true"
else:
persist="false"
frame = 'SENDndestination:%snpersistent:%snn%sx00' % (queue,persist,message)
t.sendall(frame)
# Disconnect STOMP
frame = 'DISCONNECTnnx00'
t.sendall(frame)
# Disconnect TCP
t.close()
del(t)
return 0](https://image.slidesharecdn.com/messagebrokersandpython-120618092208-phpapp01/85/Python-Ireland-2012-Message-brokers-and-Python-by-Fernando-Ciciliati-11-320.jpg)
![A simple stomp.py producer
import time
import sys
import stomp
USAGE = """
producer.py <destination> <message>
<destination> should start by /queue or /topic
<message> is the text to be sent as message body (blank spaces accepted).
"""
if len(sys.argv) < 3:
print USAGE
else:
conn = stomp.Connection() # with default parameters
conn.start()
conn.connect()
conn.send(' '.join(sys.argv[2:]), destination=sys.argv[1])
time.sleep(2)
conn.disconnect()](https://image.slidesharecdn.com/messagebrokersandpython-120618092208-phpapp01/85/Python-Ireland-2012-Message-brokers-and-Python-by-Fernando-Ciciliati-12-320.jpg)
![A simple stomp.py consumer
import sys
import time
import stomp
class MyListener(object):
def on_error(self, headers, message):
print '*** received an error:n%sn***' % message
def on_message(self, headers, message):
print '*** received a message:n%sn***' % message
conn = stomp.Connection()
conn.set_listener('', MyListener())
conn.start()
conn.connect()
conn.subscribe(destination=sys.argv[1], ack='auto')
try:
while True:
time.sleep(1)
except KeyboardInterrupt:
pass
finally:
print "nDisconnecting..."
conn.disconnect()](https://image.slidesharecdn.com/messagebrokersandpython-120618092208-phpapp01/85/Python-Ireland-2012-Message-brokers-and-Python-by-Fernando-Ciciliati-13-320.jpg)
Ad
Recommended
Lindsay distributed geventzmq
Lindsay distributed geventzmqRobin Xiao ZeroMQ provides a simple way to build distributed systems without relying on heavyweight message brokers. It uses a messaging model where messages are atomic and can be routed between applications. ZeroMQ avoids many of the complexities of traditional message queues and makes it easy to implement common distributed patterns like request-reply, publish-subscribe, and routing in a variety of programming languages using simple socket-like APIs.
Zmq in context of openstack
Zmq in context of openstackYatin Kumbhare This document provides an overview of using ZeroMQ (zmq) for messaging in OpenStack, including distributed RPC implementations. It details how various socket types such as req-rep, pub-sub, and push-pull are utilized for communicating between services like nova and rpc-zmq-receiver. Additionally, it explains message routing, configuration settings, and the handling of responses in the context of OpenStack architecture.
Overview of ZeroMQ
Overview of ZeroMQpieterh ØMQ was created to address the need for cheaper and more efficient connectivity between distributed systems as hardware capabilities increased. It is an intelligent socket library that provides various connection patterns for messaging between processes. ØMQ aims to be fast, small, multiplatform, and multilingual. It uses common patterns like request-reply and publish-subscribe to allow processes to communicate simply and efficiently over in-process, inter-process, and network connections. The ØMQ community continues to enhance and support the open source library.
ZeroMQ - Sockets on steroids!
ZeroMQ - Sockets on steroids!Pedro Januário This document provides an overview of 0MQ, an open-source library for message-oriented middleware. It discusses 0MQ's message-oriented communication capabilities, disconnected sockets, asynchronous and high-performance messaging, common messaging patterns like request/reply and publish/subscribe, and language bindings. The document also demonstrates basic usage of 0MQ sockets in Node.js and provides additional resources for learning more about 0MQ.
Build reliable, traceable, distributed systems with ZeroMQ
Build reliable, traceable, distributed systems with ZeroMQRobin Xiao ZeroMQ is used to build a distributed system with reliable and traceable communication. It allows exposing code over RPC with minimal modification. Exceptions are properly propagated across services. The system is language agnostic and brokerless. Introspection allows viewing methods and signatures without opening code. Streaming APIs allow continuous updates without timeouts. Tracing helps profile nested calls and identify performance bottlenecks. Security is not implemented but could use SSL or authentication layers.
Europycon2011: Implementing distributed application using ZeroMQ
Europycon2011: Implementing distributed application using ZeroMQfcrippa The document discusses the messaging patterns and sockets in ØMQ (ZeroMQ), an open-source library for building distributed applications. It describes the basic patterns like publisher-subscriber, request-reply, and load balancing. It explains that ØMQ sockets support asynchronous messaging, are cross-platform, and can be used from multiple programming languages. The document also touches on scalability, dynamic scaling, and built-in devices in ØMQ like proxies and brokers.
ZeroMQ in PHP
ZeroMQ in PHPJosé Lorenzo Rodríguez Urdaneta Ømq is an intelligent socket library for messaging that allows for highly flexible messaging patterns between applications. It is fast, fault tolerant, and language agnostic. Common patterns supported by Ømq include request-reply, publish-subscribe, and push-pull. Devices can be used to route messages and act as brokers or balancers to solve problems like load balancing. Ømq offers advantages over traditional solutions when advanced network interactions or high performance is required.
FOSDEM 2011 - 0MQ
FOSDEM 2011 - 0MQpieterh 1) The document discusses concurrency and the traditional model of sharing data between threads which leads to complexity, bugs, and diminishing returns.
2) It introduces the actor model from 1973 which uses message passing between isolated processes or "actors" to achieve concurrency without shared data.
3) ZeroMQ is presented as a modern implementation of the actor model, allowing applications to connect threads and processes across machines using messaging without locks or shared state.
zeromq
zeromqRajan Bhatt This document provides an overview of ZeroMQ, an open-source messaging library that provides sockets for various messaging patterns like request-reply, publish-subscribe, and push-pull. It discusses how ZeroMQ implements these patterns without a centralized broker through intelligent message batching and transport. Examples are given of how ZeroMQ is used in production systems and how it compares to brokered messaging systems. The document concludes with discussing other open-source messaging projects.
ZeroMQ
ZeroMQStoyan Zhekov ØMQ (ZeroMQ) provides a simple way to connect different codes across various transports like in-process, inter-process, TCP, and multicast. It uses a socket interface that supports common messaging patterns like request-reply, publish-subscribe, and task distribution. These sockets can be connected in a flexible topology to build scalable, concurrent applications that take advantage of multicore systems. ØMQ has language bindings for many languages and runs on most operating systems.
ZeroMQ: Super Sockets - by J2 Labs
ZeroMQ: Super Sockets - by J2 LabsJames Dennis ZeroMQ is a library for message passing between processes using sockets. It provides patterns for common messaging needs like publish-subscribe, request-reply, and push-pull. ZeroMQ supports multiple protocols including TCP and inter-process communication. It aims to be more flexible than traditional messaging systems by allowing decentralized architectures. Examples of projects using ZeroMQ include Mongrel2, a high-performance web server, and Brubeck, a Python web framework.
Zeromq anatomy & jeromq
Zeromq anatomy & jeromqDongmin Yu ZeroMQ is a messaging library that provides sockets that allow for various communication patterns like publish/subscribe. JeroMQ is a Java implementation of ZeroMQ that provides a compatible API with improved performance using Java NIO and other optimizations. It uses a multithreaded model with worker threads handling I/O and messaging and aims to reduce system calls for operations like receiving and sending data.
sshuttle VPN (2011-04)
sshuttle VPN (2011-04)apenwarr Sshuttle is a VPN that runs on top of ssh. It allows connecting to remote networks through any ssh server without requiring administrative access or special server software. Sshuttle uses transparent proxying instead of encapsulating traffic, avoiding issues with TCP-over-TCP. It also includes features like self-assembly, DNS remangling, automatic host and network discovery to simplify VPN configuration and usage.
Introduction to ZeroMQ - eSpace TechTalk
Introduction to ZeroMQ - eSpace TechTalkMahmoud Said ØMQ (ZeroMQ) is an open-source library for high-performance asynchronous messaging. It was created by Martin Sústrik and Pieter Hintjens to enable cheaper and faster connections between distributed applications. ØMQ provides common messaging patterns like request-reply, publish-subscribe, and push-pull without a centralized message broker. It has bindings for many languages and can handle millions of messages per second with low latency. The presentation demonstrated ØMQ patterns and use cases, and discussed why it may have been better implemented in C instead of C++.
Building scalable network applications with Netty (as presented on NLJUG JFal...
Building scalable network applications with Netty (as presented on NLJUG JFal...Jaap ter Woerds This document discusses building scalable network applications using Netty, an asynchronous programming framework. It covers key concepts such as Channel, ByteBuf, ChannelPipeline, and ChannelInitializer, providing insights on creating custom servers and handling IO events. The document also highlights Netty's capabilities for high concurrency and built-in support for protocols like HTTP and WebSockets.
GopherFest 2017 - Adding Context to NATS
GopherFest 2017 - Adding Context to NATSwallyqs This document discusses adding context support to the NATS client library. It begins with an overview of NATS and context in Go. It then describes enhancing the Subscription.NextMsg method to support context, avoiding blocking indefinitely. This allows building a RequestWithContext method for cancelling requests. The key steps are selecting on the subscription channel or context being done, and returning the context's error on cancellation. Learning from standard library patterns like validating contexts helps make the API clearer.
#2 (UDP)
#2 (UDP)Ghadeer AlHasan The document outlines the use of DatagramSockets in Java for network communication via UDP, highlighting its advantages in applications like live TV coverage and online gaming where speed is prioritized over reliability. It details the steps for creating DatagramSockets and DatagramPackets, and provides sample server and client code implementations for both unicast and multicast communication. Additionally, it includes references for further learning through YouTube and GitHub.
Stackless Python In Eve
Stackless Python In Eveguest91855c 1) Stackless Python is used extensively in EVE Online to support over 130,000 active players and 24,000 concurrent users on a single server cluster.
2) Stackless Python enables lightweight tasklets that can be scheduled cooperatively to improve concurrency without the overhead of OS threads.
3) Channels provide a synchronization mechanism that allows tasklets to communicate and block waiting for data in a way that enables efficient tasklet switching.
Building Netty Servers
Building Netty ServersDani Solà Lagares The document discusses Netty, an asynchronous event-driven network application framework for building high-performance protocol servers and clients. It outlines key concepts such as channels, message events, and channel handlers, as well as when to use Netty versus other tools for web applications. Additionally, it provides examples of implementing an echo server and a web service using Netty's basic API and threading model.
OSMC 2018 | Handling messages and notifications from software and gadgets wit...
OSMC 2018 | Handling messages and notifications from software and gadgets wit...NETWAYS The document discusses handling messages and notifications using MQTT and the MQTTwarn tool. It covers the features of MQTT for pub/sub messaging, various MQTT brokers, and practical applications for automation and alerting, including plugins for different notification services. Additionally, it provides examples of configuration for MQTTwarn and integrating with systems like Zabbix and XBMC.
Netty: asynchronous data transfer
Netty: asynchronous data transferVictor Cherkassky Netty is an asynchronous event-driven network application framework for Java. It provides an asynchronous model with non-blocking I/O based on Java NIO. To create an HTTP server with Netty, one sets up thread pools for handling connections and requests, provides a ChannelFactory and PipelineFactory, and puts it all together with a Bootstrap. The server can then be started to listen for connections. Custom handlers can be added to the pipeline to process requests. Channels are gathered and closed to release resources when the server is shut down. TCP options like keepAlive and noDelay can be configured but their effects should be measured for each application.
Python session.11 By Shanmugam
Python session.11 By ShanmugamNavaneethan Naveen This document discusses sending emails using Python's SMTP module. It explains that SMTP is used to send and route emails between servers. The smtplib module defines an SMTP client session object that can be used to send mail. It provides an example of using smtplib to send an email by specifying the sender, receivers, and message. It also shows how to send an HTML email by setting the MIME version, content type, and character set in the message.
Kickstart Kotlin
Kickstart KotlinZahidur Rahman Faisal The document is a tutorial on using Kotlin, highlighting its simple syntax, powerful features, and interoperability with Java. It includes examples of key language features such as null safety, data classes, extension functions, and various concise coding techniques. Resources and community links for further learning are also provided.
libpcap
libpcapmohan43u This document provides an overview of the libpcap packet capture library. It discusses installing libpcap, opening interfaces and capturing packets, parsing raw packets according to the OSI model, using filters with pcap_compile and pcap_setfilter, and introduces the pcapstreamer program for capturing packets using libpcap.
Asynchronous, Event-driven Network Application Development with Netty
Asynchronous, Event-driven Network Application Development with NettyErsin Er The document presents a comprehensive overview of asynchronous, event-driven network application development using Netty, focusing on its performance advantages over traditional blocking I/O. It discusses various Java I/O techniques, including blocking and non-blocking modes, while providing code examples that highlight key concepts. The session also covers the Netty ecosystem, including its core components, utilities, and related projects that leverage Netty's capabilities for building high-performance network applications.
Apachecon Eu 2008 Mina
Apachecon Eu 2008 MinaNiklas Gustavsson MINA is a Java API for developing network applications that is event-driven and asynchronous. It allows separation of concerns between wire protocols and business logic. The document discusses MINA's architecture, components like filters and handlers, and provides a simple chat server example. It recommends using MINA 2.0 and describes changes from earlier versions.
Java Course Day 11
Java Course Day 11Oleg Yushchenko This document provides an overview of key concepts related to Java mail including common protocols like SMTP, POP, IMAP, and security protocols TLS and SSL. It also asks how to send and receive email and introduces testing frameworks like JUnit including test cases, assertions, setup/teardown methods, and using mock objects and stubs with the best practice of one test per action.
OSMC 2014: MQTT for monitoring (and for the lo t) | Jan-Piet Mens
OSMC 2014: MQTT for monitoring (and for the lo t) | Jan-Piet MensNETWAYS The document provides an overview of MQTT, a lightweight messaging protocol suitable for unreliable networks, emphasizing its features such as security, quality of service, and various implementations like Mosquitto and HiveMQ. It includes details on functionalities like publishing/subscribing, CLI utilities, and practical applications in monitoring and automation. Additionally, it includes example code snippets for using the MQTT protocol with Python and highlights its use in real-time alerting and device communication.
Message queueing
Message queueingRichard Jones The document discusses using RabbitMQ for message queueing. It describes how RabbitMQ uses exchanges, queues, and bindings to route messages from producers to consumers. It provides examples of publishing and consuming messages using Pika and Kombu in Python. It also discusses issues with latency and packet loss and describes plugins like Shovel, STOMP, and Celery that extend RabbitMQ's capabilities.
Message Queueing - by an MQ noob
Message Queueing - by an MQ noobRichard Jones The document discusses the challenges and solutions in message queueing from the perspective of a telecom professional, highlighting the need for reliable message processing amidst network latency and packet loss. It compares various messaging systems, including RabbitMQ, Pika, Kombu, and Puka, and details their installation and usage for publish/subscribe mechanisms. Additionally, it touches upon error handling and configuration issues encountered with these systems.
More Related Content
What's hot (20)
zeromq
zeromqRajan Bhatt This document provides an overview of ZeroMQ, an open-source messaging library that provides sockets for various messaging patterns like request-reply, publish-subscribe, and push-pull. It discusses how ZeroMQ implements these patterns without a centralized broker through intelligent message batching and transport. Examples are given of how ZeroMQ is used in production systems and how it compares to brokered messaging systems. The document concludes with discussing other open-source messaging projects.
ZeroMQ
ZeroMQStoyan Zhekov ØMQ (ZeroMQ) provides a simple way to connect different codes across various transports like in-process, inter-process, TCP, and multicast. It uses a socket interface that supports common messaging patterns like request-reply, publish-subscribe, and task distribution. These sockets can be connected in a flexible topology to build scalable, concurrent applications that take advantage of multicore systems. ØMQ has language bindings for many languages and runs on most operating systems.
ZeroMQ: Super Sockets - by J2 Labs
ZeroMQ: Super Sockets - by J2 LabsJames Dennis ZeroMQ is a library for message passing between processes using sockets. It provides patterns for common messaging needs like publish-subscribe, request-reply, and push-pull. ZeroMQ supports multiple protocols including TCP and inter-process communication. It aims to be more flexible than traditional messaging systems by allowing decentralized architectures. Examples of projects using ZeroMQ include Mongrel2, a high-performance web server, and Brubeck, a Python web framework.
Zeromq anatomy & jeromq
Zeromq anatomy & jeromqDongmin Yu ZeroMQ is a messaging library that provides sockets that allow for various communication patterns like publish/subscribe. JeroMQ is a Java implementation of ZeroMQ that provides a compatible API with improved performance using Java NIO and other optimizations. It uses a multithreaded model with worker threads handling I/O and messaging and aims to reduce system calls for operations like receiving and sending data.
sshuttle VPN (2011-04)
sshuttle VPN (2011-04)apenwarr Sshuttle is a VPN that runs on top of ssh. It allows connecting to remote networks through any ssh server without requiring administrative access or special server software. Sshuttle uses transparent proxying instead of encapsulating traffic, avoiding issues with TCP-over-TCP. It also includes features like self-assembly, DNS remangling, automatic host and network discovery to simplify VPN configuration and usage.
Introduction to ZeroMQ - eSpace TechTalk
Introduction to ZeroMQ - eSpace TechTalkMahmoud Said ØMQ (ZeroMQ) is an open-source library for high-performance asynchronous messaging. It was created by Martin Sústrik and Pieter Hintjens to enable cheaper and faster connections between distributed applications. ØMQ provides common messaging patterns like request-reply, publish-subscribe, and push-pull without a centralized message broker. It has bindings for many languages and can handle millions of messages per second with low latency. The presentation demonstrated ØMQ patterns and use cases, and discussed why it may have been better implemented in C instead of C++.
Building scalable network applications with Netty (as presented on NLJUG JFal...
Building scalable network applications with Netty (as presented on NLJUG JFal...Jaap ter Woerds This document discusses building scalable network applications using Netty, an asynchronous programming framework. It covers key concepts such as Channel, ByteBuf, ChannelPipeline, and ChannelInitializer, providing insights on creating custom servers and handling IO events. The document also highlights Netty's capabilities for high concurrency and built-in support for protocols like HTTP and WebSockets.
GopherFest 2017 - Adding Context to NATS
GopherFest 2017 - Adding Context to NATSwallyqs This document discusses adding context support to the NATS client library. It begins with an overview of NATS and context in Go. It then describes enhancing the Subscription.NextMsg method to support context, avoiding blocking indefinitely. This allows building a RequestWithContext method for cancelling requests. The key steps are selecting on the subscription channel or context being done, and returning the context's error on cancellation. Learning from standard library patterns like validating contexts helps make the API clearer.
#2 (UDP)
#2 (UDP)Ghadeer AlHasan The document outlines the use of DatagramSockets in Java for network communication via UDP, highlighting its advantages in applications like live TV coverage and online gaming where speed is prioritized over reliability. It details the steps for creating DatagramSockets and DatagramPackets, and provides sample server and client code implementations for both unicast and multicast communication. Additionally, it includes references for further learning through YouTube and GitHub.
Stackless Python In Eve
Stackless Python In Eveguest91855c 1) Stackless Python is used extensively in EVE Online to support over 130,000 active players and 24,000 concurrent users on a single server cluster.
2) Stackless Python enables lightweight tasklets that can be scheduled cooperatively to improve concurrency without the overhead of OS threads.
3) Channels provide a synchronization mechanism that allows tasklets to communicate and block waiting for data in a way that enables efficient tasklet switching.
Building Netty Servers
Building Netty ServersDani Solà Lagares The document discusses Netty, an asynchronous event-driven network application framework for building high-performance protocol servers and clients. It outlines key concepts such as channels, message events, and channel handlers, as well as when to use Netty versus other tools for web applications. Additionally, it provides examples of implementing an echo server and a web service using Netty's basic API and threading model.
OSMC 2018 | Handling messages and notifications from software and gadgets wit...
OSMC 2018 | Handling messages and notifications from software and gadgets wit...NETWAYS The document discusses handling messages and notifications using MQTT and the MQTTwarn tool. It covers the features of MQTT for pub/sub messaging, various MQTT brokers, and practical applications for automation and alerting, including plugins for different notification services. Additionally, it provides examples of configuration for MQTTwarn and integrating with systems like Zabbix and XBMC.
Netty: asynchronous data transfer
Netty: asynchronous data transferVictor Cherkassky Netty is an asynchronous event-driven network application framework for Java. It provides an asynchronous model with non-blocking I/O based on Java NIO. To create an HTTP server with Netty, one sets up thread pools for handling connections and requests, provides a ChannelFactory and PipelineFactory, and puts it all together with a Bootstrap. The server can then be started to listen for connections. Custom handlers can be added to the pipeline to process requests. Channels are gathered and closed to release resources when the server is shut down. TCP options like keepAlive and noDelay can be configured but their effects should be measured for each application.
Python session.11 By Shanmugam
Python session.11 By ShanmugamNavaneethan Naveen This document discusses sending emails using Python's SMTP module. It explains that SMTP is used to send and route emails between servers. The smtplib module defines an SMTP client session object that can be used to send mail. It provides an example of using smtplib to send an email by specifying the sender, receivers, and message. It also shows how to send an HTML email by setting the MIME version, content type, and character set in the message.
Kickstart Kotlin
Kickstart KotlinZahidur Rahman Faisal The document is a tutorial on using Kotlin, highlighting its simple syntax, powerful features, and interoperability with Java. It includes examples of key language features such as null safety, data classes, extension functions, and various concise coding techniques. Resources and community links for further learning are also provided.
libpcap
libpcapmohan43u This document provides an overview of the libpcap packet capture library. It discusses installing libpcap, opening interfaces and capturing packets, parsing raw packets according to the OSI model, using filters with pcap_compile and pcap_setfilter, and introduces the pcapstreamer program for capturing packets using libpcap.
Asynchronous, Event-driven Network Application Development with Netty
Asynchronous, Event-driven Network Application Development with NettyErsin Er The document presents a comprehensive overview of asynchronous, event-driven network application development using Netty, focusing on its performance advantages over traditional blocking I/O. It discusses various Java I/O techniques, including blocking and non-blocking modes, while providing code examples that highlight key concepts. The session also covers the Netty ecosystem, including its core components, utilities, and related projects that leverage Netty's capabilities for building high-performance network applications.
Apachecon Eu 2008 Mina
Apachecon Eu 2008 MinaNiklas Gustavsson MINA is a Java API for developing network applications that is event-driven and asynchronous. It allows separation of concerns between wire protocols and business logic. The document discusses MINA's architecture, components like filters and handlers, and provides a simple chat server example. It recommends using MINA 2.0 and describes changes from earlier versions.
Java Course Day 11
Java Course Day 11Oleg Yushchenko This document provides an overview of key concepts related to Java mail including common protocols like SMTP, POP, IMAP, and security protocols TLS and SSL. It also asks how to send and receive email and introduces testing frameworks like JUnit including test cases, assertions, setup/teardown methods, and using mock objects and stubs with the best practice of one test per action.
OSMC 2014: MQTT for monitoring (and for the lo t) | Jan-Piet Mens
OSMC 2014: MQTT for monitoring (and for the lo t) | Jan-Piet MensNETWAYS The document provides an overview of MQTT, a lightweight messaging protocol suitable for unreliable networks, emphasizing its features such as security, quality of service, and various implementations like Mosquitto and HiveMQ. It includes details on functionalities like publishing/subscribing, CLI utilities, and practical applications in monitoring and automation. Additionally, it includes example code snippets for using the MQTT protocol with Python and highlights its use in real-time alerting and device communication.
Similar to Python Ireland 2012 - Message brokers and Python by Fernando Ciciliati (20)
Message queueing
Message queueingRichard Jones The document discusses using RabbitMQ for message queueing. It describes how RabbitMQ uses exchanges, queues, and bindings to route messages from producers to consumers. It provides examples of publishing and consuming messages using Pika and Kombu in Python. It also discusses issues with latency and packet loss and describes plugins like Shovel, STOMP, and Celery that extend RabbitMQ's capabilities.
Message Queueing - by an MQ noob
Message Queueing - by an MQ noobRichard Jones The document discusses the challenges and solutions in message queueing from the perspective of a telecom professional, highlighting the need for reliable message processing amidst network latency and packet loss. It compares various messaging systems, including RabbitMQ, Pika, Kombu, and Puka, and details their installation and usage for publish/subscribe mechanisms. Additionally, it touches upon error handling and configuration issues encountered with these systems.
RabbitMQ with python and ruby RuPy 2009
RabbitMQ with python and ruby RuPy 2009Paolo Negri The document discusses using RabbitMQ, an open-source message broker based on AMQP, for asynchronous messaging between Python and Ruby applications. It provides an overview of AMQP concepts like producers, consumers, exchanges and queues, and how RabbitMQ implements these using Erlang. Code examples are shown for sending and receiving messages asynchronously in Python and Ruby.
Life in a Queue - Using Message Queue with django
Life in a Queue - Using Message Queue with djangoTareque Hossain This document provides a comprehensive overview of message queues, highlighting their role in decoupling sender and receiver processes within web applications. It discusses the functionality, scenarios for use, implementation with RabbitMQ and Celery in Python, and practical coding examples for task management. Additionally, it covers best practices for configuration and task routing to enhance application performance.
High scale flavour
High scale flavourTomas Doran This document discusses various approaches for implementing message queueing in web applications. It describes using a message queue to decouple producers and consumers, improving load handling and allowing more pages to be served quicker. Common solutions discussed include using Gearman, STOMP, and AMQP. Gearman is recommended for simple job queueing, while STOMP provides a simple tried and tested jobs solution. AMQP offers more flexibility but has fewer proven Perl implementations.
The Art of Message Queues - TEKX
The Art of Message Queues - TEKXMike Willbanks The document discusses message queues and their uses. Message queues allow for asynchronous communication between applications and components. They decouple systems, allow for background processing, and improve scalability. Common use cases for message queues include processing email notifications, auto-scaling cloud applications, handling image/video processing, and interacting with services like Apple Push Notifications.
Inter-Process/Task Communication With Message Queues
Inter-Process/Task Communication With Message Queueswamcvey The document discusses various methods of inter-process communication using message queues, highlighting the challenges faced in coordinating long-running processes with web requests. It evaluates different message queuing systems, including Beanstalkd, Memcacheq, and AMQP protocols such as RabbitMQ, outlining their pros and cons. The author expresses a preference for Beanstalkc and RabbitMQ with Carrot API for robust message handling and process coordination solutions.
Plone, rabbit mq and messaging that just works
Plone, rabbit mq and messaging that just worksAsko Soukka This document discusses using RabbitMQ and message queues with Plone. It provides an overview of message queues and how they can provide reliable, scalable solutions for running asynchronous tasks and integrating services. It introduces AMQP and describes how collective.zamqp can be used to easily produce, consume, and handle messages with Plone. Examples are given of using collective.zamqp to implement publish/subscribe and request/response patterns between Plone sites.
Zeromq - Pycon India 2013
Zeromq - Pycon India 2013Srinivasan R ZeroMQ is a library for building distributed applications that provides patterns for request-reply, publish-subscribe, and pipelining between clients and services. It demonstrates using these patterns to build a hello world server and client, stock ticker publisher and subscriber, and parallel task processing pipeline. ZeroMQ supports multiple transport types and languages.
Rabbit MQ introduction
Rabbit MQ introductionSitg Yao Rabbit MQ is a message broker software that implements the Advanced Message Queuing Protocol (AMQP) standard. It allows for push-style communication where the server initiates transactions by sending messages to clients. Rabbit MQ supports publish/subscribe and queuing of messages across platforms. It provides reliability, security, and scalability for message delivery. Common uses of Rabbit MQ include notifications, messaging, and communication between services.
20120521 - zeroMQ
20120521 - zeroMQJamie (Taka) Wang This document discusses ZeroMQ, an open-source library for building distributed applications. It provides an overview of ZeroMQ licensing, installation instructions, common messaging patterns like request-reply and publish-subscribe, and resources for learning more. Example code is shown for communicating between a client and server using request-reply and between a publisher and subscriber.
Enterprise Messaging with RabbitMQ.pdf
Enterprise Messaging with RabbitMQ.pdfOrtus Solutions, Corp This document provides an overview of enterprise messaging with RabbitMQ presented by Luis Majano. It begins with introductions and then outlines the agenda which includes why messaging is useful, different messaging implementations and protocols like AMQP, and a demonstration of RabbitMQ. The bulk of the document discusses messaging paradigms and concepts like producers, consumers, exchanges and queues. It explains RabbitMQ exchanges like direct, fanout and topic in more detail and provides examples of how RabbitMQ can be used in different customer use cases.
The Future of Messaging: RabbitMQ and AMQP
The Future of Messaging: RabbitMQ and AMQP Eberhard Wolff RabbitMQ and AMQP provide a standardized messaging protocol that improves scalability and reliability over traditional RPC approaches. The document discusses the benefits of messaging including decoupling and asynchronous communication. It provides an overview of core AMQP concepts like exchanges, queues, bindings and routing. Spring AMQP and Spring's RabbitTemplate simplify working with RabbitMQ in Java by providing a common API and configuration support.
Message Queues : A Primer - International PHP Conference Fall 2012
Message Queues : A Primer - International PHP Conference Fall 2012Mike Willbanks Mike Willbanks gave a presentation on message queues. He defined message queues as software components used for interprocess or inter-thread communication. He discussed common message queue protocols like AMQP, STOMP, and XMPP. He also covered different message queue software like RabbitMQ, ActiveMQ, and Beanstalkd. Finally, he provided best practices for using message queues, such as choosing standards-based protocols, considering delivery and message policies, and using tools like Supervisord for process monitoring.
Message Queues a basic overview
Message Queues a basic overviewGeshan Manandhar Message queues facilitate inter-process communication and asynchronous messaging, allowing producers to send messages via a message broker for consumption by consumers. Key benefits include decoupling, scalability, and reliability, with RabbitMQ as a prominent implementation supporting various protocols. Effective logging and monitoring are essential for managing message queues and ensuring system performance.
Messaging with RabbitMQ and AMQP
Messaging with RabbitMQ and AMQPEberhard Wolff This document discusses messaging with AMQP and RabbitMQ. It provides an overview of why messaging is useful for decoupling systems and making them asynchronous and reliable. It then discusses why AMQP and RabbitMQ are good choices for messaging and covers some basic AMQP concepts like exchanges, queues, bindings and routing. It also discusses how Spring supports AMQP and RabbitMQ through its AMQP libraries and templates. Finally, it briefly covers how web messaging can be done through STOMP over websockets.
Queue Everything and Please Everyone
Queue Everything and Please EveryoneVaidik Kapoor Vaidik Kapoor presented on using message queues and task queues to improve the responsiveness of web applications. He discussed how queues can be used to offload processing tasks from the main request-response cycle to improve user experience. Some key points included:
- Message queues like RabbitMQ and Redis with libraries like HotQueue and PyRes can be used to asynchronously process tasks like data/media processing and cache updates.
- Celery is a popular task queue library that uses RabbitMQ and supports many frameworks. It allows distributing and managing cron-like tasks reliably.
- Proper integration of task processing with user interfaces is important using techniques like notifications, flashes, and polling to update users.
Polyglot Messaging with Apache ActiveMQ
Polyglot Messaging with Apache ActiveMQChristian Posta The document presents an overview of polyglot messaging using Apache ActiveMQ, highlighting its significance in integrating various programming languages and improving system communication. It discusses the benefits of using messaging protocols like STOMP and MQTT for asynchronous architectures and real-time data exchange across different platforms. Additionally, it introduces management tools like Hawtio for overseeing integration infrastructures, emphasizing the community and support available around ActiveMQ.
Massaging the Pony: Message Queues and You
Massaging the Pony: Message Queues and YouShawn Rider The document explains the concept of message queues as systems for asynchronous processing that offload tasks from servers, improve user experiences, and enhance the reliability of integrations. It discusses various solutions and protocols for implementing message queues, criteria for broker selection, and uses Celery with RabbitMQ for task management in Django applications. The document emphasizes the importance of developing message queue tasks in a controlled environment while maintaining robust functionality.
Architecture | The Future of Messaging: RabbitMQ and AMQP | Eberhard Wolff
Architecture | The Future of Messaging: RabbitMQ and AMQP | Eberhard WolffJAX London The document discusses the future of messaging using RabbitMQ and AMQP, highlighting their advantages over traditional remote method invocation (RMI) and SOAP web services. It emphasizes the need for a decoupled, asynchronous architecture for reliable distributed systems, as well as the benefits of using AMQP as an open standard protocol supporting multiple programming languages. Additionally, it covers RabbitMQ's implementation in Erlang for scalable, fault-tolerant systems, along with integration details using Spring framework for managing messaging resources.
Ad
More from Python Ireland (20)
Async I/O in Python
Async I/O in PythonPython Ireland The document discusses asynchronous I/O in Python, specifically addressing its complexities and strategies like using multiple processes, threads, or non-blocking I/O. It describes various frameworks for handling asynchronous operations, such as Eventlet, Twisted, and Tulip, each with different approaches to managing I/O events. The content also includes code examples demonstrating how to implement non-blocking socket communication and the use of coroutines and event loops.
Python Ireland - Who, how, what
Python Ireland - Who, how, whatPython Ireland The document outlines the history and growth of the Python Ireland user group, starting from its first successful meet-up in January 2004, led by Sean O'Donnell. After several successful events and an increase in participation, Python Ireland became one of the largest active Python user groups outside of Seattle by 2010. The group successfully hosted PyCon Ireland events, with plans for future conferences and collaborations with other tech communities in Dublin.
Object Orientation vs. Functional Programming in Python
Object Orientation vs. Functional Programming in PythonPython Ireland The document discusses object orientation and functional programming approaches in Python. It covers various object-oriented programming concepts like the template method pattern, abstract base classes, mixins, and composition. It also covers functional programming concepts like callbacks, higher-order functions, decorators, and partial function application. It concludes that Python supports both paradigms well and that depending on the situation, one approach may be more appropriate, but the tools can also complement each other.
What's the Scoop with Python 3?
What's the Scoop with Python 3?Python Ireland The document discusses the slow adoption of Python 3 in contrast to Python 2, emphasizing that Python 3 was not intended to immediately replace Python 2. It highlights several scenarios where developers might still be required to use Python 2 due to project dependencies or specific requirements. The author urges developers to start porting their code to Python 3, warning that Python 2 is becoming obsolete and will eventually no longer be supported.
Google App Engine in 40 minutes (the absolute essentials)
Google App Engine in 40 minutes (the absolute essentials)Python Ireland The document provides a step-by-step guide on using Google App Engine to deploy a scalable application using Python. It discusses creating a project, structuring data models, designing user interfaces, handling requests, and deploying the application to the cloud. The guide emphasizes best practices for development and integration with Google services.
Introduction to Erlang for Python Programmers
Introduction to Erlang for Python ProgrammersPython Ireland The document provides an introduction to Erlang, highlighting its characteristics as a functional, concurrent, and fault-tolerant programming language. It emphasizes the importance of learning Erlang to become a better programmer, how it excels at building robust systems, and the unique syntax that may present challenges to newcomers. Additionally, it includes practical guidance on using Erlang for process management and fault tolerance while mentioning resources for further learning.
Web-service based Mobile Geospatial Application Development using Python
Web-service based Mobile Geospatial Application Development using PythonPython Ireland The document discusses the development of mobile geospatial applications using Python to enable location- and orientation-aware services on smartphones. It covers topics such as spatial databases, geospatial information retrieval, and the challenges of information overload related to mobile location-based services. Various technologies and frameworks are mentioned, including RESTful web services, GDAL for elevation model generation, and Python bindings for geospatial analysis.
Utopia Kingdoms scaling case. From 4 users to 50.000+
Utopia Kingdoms scaling case. From 4 users to 50.000+Python Ireland This document summarizes the scaling of a fantasy strategy game called Utopia Kingdoms from 4 users to over 90,000 users. It discusses the technology stack including Python, CherryPy, Amazon SimpleDB, and frontend technologies. It also describes some performance issues encountered with the database and solutions attempted, such as migrating from SimpleDB to MongoDB and implementing caching, queueing actions, and optimizing database queries. The importance of ongoing measurement and monitoring to identify bottlenecks is emphasized.
The Larch - a visual interactive programming environment
The Larch - a visual interactive programming environmentPython Ireland The document presents the Larch Environment, a visual interactive programming interface for Python aimed at enhancing code comprehension through visual object presentations. It introduces concepts such as type coercion for visual representation, interactive worksheets for modular coding, and integrates principles from visual programming to facilitate code editing and debugging. The project is still in the research prototype phase and emphasizes a need for further documentation and improvements.
Python vs JLizard.... a python logging experience
Python vs JLizard.... a python logging experiencePython Ireland The document discusses log management as a service, emphasizing the exponential growth of log data and its challenges for organizations. It compares Python and Jlizard in the context of log management solutions, highlighting features of the Logentries agent and its capabilities. The need for effective logging is underscored by compliance requirements and the consequences of inadequate log management.
Vim and Python
Vim and PythonPython Ireland The document provides an overview of Vim and its integration with Python, emphasizing Vim's speed, portability, and configurability. It introduces basic concepts such as modes and commands, discusses various plugins for enhancing functionality, and mentions Vim's charity aspect. Additionally, it offers resources for further learning and suggests alternatives like Emacs for those who may not prefer Vim.
Python Ireland Nov 2009 Talk - Appengine
Python Ireland Nov 2009 Talk - AppenginePython Ireland Google App Engine provides a platform for building and hosting scalable web applications. It allows developers to write applications in Python, Java, Go or PHP and handle all the complexities of scaling an application. The document demonstrates building a simple Stack Overflow clone called App Overflow on App Engine, including adding user authentication, storing and querying data, and using services like Memcache, Images and Task Queue. It also discusses how App Engine handles scalability automatically through its distributed architecture and services.
Python Ireland May 2011 - What is Pyramid and where is it with respect to Dja...
Python Ireland May 2011 - What is Pyramid and where is it with respect to Dja...Python Ireland The document discusses the Pyramid framework in comparison to Django, outlining its objectives, use cases, and tutorials. It reviews aspects such as documentation, performance, community support, and IDE integration. Additionally, it emphasizes that while Pyramid lacks some third-party resources and stability compared to Django, it offers mechanisms for reuse and configuration advice.
Python Ireland Nov 2010 Talk: Unit Testing
Python Ireland Nov 2010 Talk: Unit TestingPython Ireland The document discusses unit testing in Python, emphasizing its importance in code design and refactoring. It includes practical code examples and implementation of unit tests, focusing on indexing lists of dictionaries by specific fields. Additionally, it provides further reading resources and insights into the initial challenges of unit testing.
Python Ireland Nov 2010 - RESTing with Django
Python Ireland Nov 2010 - RESTing with DjangoPython Ireland This document discusses building RESTful APIs with Django. It provides a quick overview of REST principles like resources, representations, and uniform interfaces using HTTP methods. It then outlines a general approach to building REST APIs with Django by mapping URLs and views to models. Specific HTTP methods like GET, POST, PUT, DELETE are mapped to CRUD operations. Tools like Firebug and SQLite Manager are recommended for testing and viewing REST responses. Overall it provides guidance on implementing RESTful APIs in Django following best practices.
Python Ireland Feb '11 Talks: Introduction to Python
Python Ireland Feb '11 Talks: Introduction to PythonPython Ireland The document serves as an introductory comparison of Python with other programming languages such as C, Java, and Ruby, highlighting Python's dynamic, interpreted, and multi-paradigm nature. It emphasizes key aspects including typing, memory management, speed, and flexibility, while referencing examples available on Rosetta Code. Overall, the document illustrates Python's versatility and community strengths in comparison to its counterparts.
Python Ireland Dec Talks - Windows Azure -- The Nuts and Bolts
Python Ireland Dec Talks - Windows Azure -- The Nuts and BoltsPython Ireland The document outlines Microsoft's commitment to openness in cloud computing, focusing on the Azure platform and its various components, including SQL Azure, AppFabric, and interoperability with other technologies. It highlights the growing impact of open source on Windows, with many open source applications and projects available for various Microsoft products. Additionally, it discusses Microsoft BizSpark, a program designed to support early-stage startups in software development.
Lambada
LambadaPython Ireland This short document introduces some basic Python concepts like PRINT, IF, and FOR statements in only 3 lines without providing much context or examples.
Python for cloud computing
Python for cloud computingPython Ireland Sept 2010 Talks @ The Science Gallery
Speaker: Alan Kennedy
(Level: Intermediate/Advanced)
Abstract:
Cloud computing is a growing force in business, with the principal benefit being reduction of the costs of providing business functionality to users. Dynamic languages are very popular on cloud computing platforms, offering rapid development and deployment cycles, which further reduce costs and decrease time to market. Python is one of the most popular dynamic languages for cloud computing, as evidenced by the support it garners from large cloud computing players such as Google and Microsoft. The purpose of this talk is to give you an overview what cloud computing options exist if you want to use cpython, jython or ironpython for your next cloud computing project, be it on Google AppEngine, Microsoft Azure, or other platforms.
More info: http://www.python.ie/meetup/2010/sept_2010_talks__the_science_gallery/
IPython: The awesome python shell
IPython: The awesome python shellPython Ireland The document discusses IPython, an enhanced interactive Python shell with features like custom magic commands and tools for parallel computing. It describes its architecture, including engines, controllers, and clients, and highlights functionalities like task management, data scattering and gathering, and dynamic load balancing. It also mentions challenges in setting up IPython clusters over the internet due to network configurations and I/O overhead.
Ad
Recently uploaded (20)
A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy.pdf
A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy.pdfPriyanka Aash A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdf
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdfPriyanka Aash Oh, the Possibilities - Balancing Innovation and Risk with Generative AI
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdf
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdfPriyanka Aash Cracking the Code - Unveiling Synergies Between Open Source Security and AI
cnc-processing-centers-centateq-p-110-en.pdf
cnc-processing-centers-centateq-p-110-en.pdfAmirStern2 מרכז עיבודים תעשייתי בעל 3/4/5 צירים, עד 22 החלפות כלים עם כל אפשרויות העיבוד הדרושות. בעל שטח עבודה גדול ומחשב נוח וקל להפעלה בשפה העברית/רוסית/אנגלית/ספרדית/ערבית ועוד..
מסוגל לבצע פעולות עיבוד שונות המתאימות לענפים שונים: קידוח אנכי, אופקי, ניסור, וכרסום אנכי.
"How to survive Black Friday: preparing e-commerce for a peak season", Yurii ...
"How to survive Black Friday: preparing e-commerce for a peak season", Yurii ...Fwdays We will explore how e-commerce projects prepare for the busiest time of the year, which key aspects to focus on, and what to expect. We’ll share our experience in setting up auto-scaling, load balancing, and discuss the loads that Silpo handles, as well as the solutions that help us navigate this season without failures.
Using the SQLExecutor for Data Quality Management: aka One man's love for the...
Using the SQLExecutor for Data Quality Management: aka One man's love for the...Safe Software The SQLExecutor is one of FME’s most powerful and flexible transformers. Pivvot maintains a robust internal metadata hierarchy used to support ingestion and curation of thousands of external data sources that must be managed for quality before entering our platform. By using the SQLExecutor, Pivvot can efficiently detect problems and perform analysis before data is extracted from our staging environment, removing the need for rollbacks or cycles waisted on a failed job. This presentation will walk through three distinct examples of how Pivvot uses the SQLExecutor to engage its metadata hierarchy and integrate with its Data Quality Management workflows efficiently and within the source postgres database. Spatial Validation –Validating spatial prerequisites before entering a production environment. Reference Data Validation - Dynamically validate domain-ed columns across any table and multiple columns per table. Practical De-duplication - Removing identical or near-identical well point locations from two distinct source datasets in the same table.
OpenPOWER Foundation & Open-Source Core Innovations
OpenPOWER Foundation & Open-Source Core InnovationsIBM penPOWER offers a fully open, royalty-free CPU architecture for custom chip design.
It enables both lightweight FPGA cores (like Microwatt) and high-performance processors (like POWER10).
Developers have full access to source code, specs, and tools for end-to-end chip creation.
It supports AI, HPC, cloud, and embedded workloads with proven performance.
Backed by a global community, it fosters innovation, education, and collaboration.
The Future of Product Management in AI ERA.pdf
The Future of Product Management in AI ERA.pdfAlyona Owens Hi, I’m Aly Owens, I have a special pleasure to stand here as over a decade ago I graduated from CityU as an international student with an MBA program. I enjoyed the diversity of the school, ability to work and study, the network that came with being here, and of course the price tag for students here has always been more affordable than most around.
Since then I have worked for major corporations like T-Mobile and Microsoft and many more, and I have founded a startup. I've also been teaching product management to ensure my students save time and money to get to the same level as me faster avoiding popular mistakes. Today as I’ve transitioned to teaching and focusing on the startup, I hear everybody being concerned about Ai stealing their jobs… We’ll talk about it shortly.
But before that, I want to take you back to 1997. One of my favorite movies is “Fifth Element”. It wowed me with futuristic predictions when I was a kid and I’m impressed by the number of these predictions that have already come true. Self-driving cars, video calls and smart TV, personalized ads and identity scanning. Sci-fi movies and books gave us many ideas and some are being implemented as we speak. But we often get ahead of ourselves:
Flying cars,Colonized planets, Human-like AI: not yet, Time travel, Mind-machine neural interfaces for everyone: Only in experimental stages (e.g. Neuralink).
Cyberpunk dystopias: Some vibes (neon signs + inequality + surveillance), but not total dystopia (thankfully).
On the bright side, we predict that the working hours should drop as Ai becomes our helper and there shouldn’t be a need to work 8 hours/day. Nobody knows for sure but we can require that from legislation. Instead of waiting to see what the government and billionaires come up with, I say we should design our own future.
So, we as humans, when we don’t know something - fear takes over. The same thing happened during the industrial revolution. In the Industrial Era, machines didn’t steal jobs—they transformed them but people were scared about their jobs. The AI era is making similar changes except it feels like robots will take the center stage instead of a human. First off, even when it comes to the hottest space in the military - drones, Ai does a fraction of work. AI algorithms enable real-time decision-making, obstacle avoidance, and mission optimization making drones far more autonomous and capable than traditional remote-controlled aircraft. Key technologies include computer vision for object detection, GPS-enhanced navigation, and neural networks for learning and adaptation. But guess what? There are only 2 companies right now that utilize Ai in drones to make autonomous decisions - Skydio and DJI.
PyCon SG 25 - Firecracker Made Easy with Python.pdf
PyCon SG 25 - Firecracker Made Easy with Python.pdfMuhammad Yuga Nugraha Explore the ease of managing Firecracker microVM with the firecracker-python. In this session, I will introduce the basics of Firecracker microVM and demonstrate how this custom SDK facilitates microVM operations easily. We will delve into the design and development process behind the SDK, providing a behind-the-scenes look at its creation and features. While traditional Firecracker SDKs were primarily available in Go, this module brings a simplicity of Python to the table.
Lessons Learned from Developing Secure AI Workflows.pdf
Lessons Learned from Developing Secure AI Workflows.pdfPriyanka Aash Lessons Learned from Developing Secure AI Workflows
Securing Account Lifecycles in the Age of Deepfakes.pptx
Securing Account Lifecycles in the Age of Deepfakes.pptxFIDO Alliance Securing Account Lifecycles in the Age of Deepfakes
9-1-1 Addressing: End-to-End Automation Using FME
9-1-1 Addressing: End-to-End Automation Using FMESafe Software This session will cover a common use case for local and state/provincial governments who create and/or maintain their 9-1-1 addressing data, particularly address points and road centerlines. In this session, you'll learn how FME has helped Shelby County 9-1-1 (TN) automate the 9-1-1 addressing process; including automatically assigning attributes from disparate sources, on-the-fly QAQC of said data, and reporting. The FME logic that this presentation will cover includes: Table joins using attributes and geometry, Looping in custom transformers, Working with lists and Change detection.
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure SolutionsMichele Leroux Bustamante Delivering solutions to Azure may involve a variety of architecture patterns involving your applications, APIs data and associated Azure resources that comprise the solution. This session will use reference architectures to illustrate the security considerations to protect your Azure resources and data, how to achieve Zero Trust, and why it matters. Topics covered will include specific security recommendations for types Azure resources and related network security practices. The goal is to give you a breadth of understanding as to typical security requirements to meet compliance and security controls in an enterprise solution.
OWASP Barcelona 2025 Threat Model Library
OWASP Barcelona 2025 Threat Model LibraryPetraVukmirovic Threat Model Library Launch at OWASP Barcelona 2025
https://owasp.org/www-project-threat-model-library/
AI vs Human Writing: Can You Tell the Difference?
AI vs Human Writing: Can You Tell the Difference?Shashi Sathyanarayana, Ph.D This slide illustrates a side-by-side comparison between human-written, AI-written, and ambiguous content. It highlights subtle cues that help readers assess authenticity, raising essential questions about the future of communication, trust, and thought leadership in the age of generative AI.
From Manual to Auto Searching- FME in the Driver's Seat
From Manual to Auto Searching- FME in the Driver's SeatSafe Software Finding a specific car online can be a time-consuming task, especially when checking multiple dealer websites. A few years ago, I faced this exact problem while searching for a particular vehicle in New Zealand. The local classified platform, Trade Me (similar to eBay), wasn’t yielding any results, so I expanded my search to second-hand dealer sites—only to realise that periodically checking each one was going to be tedious. That’s when I noticed something interesting: many of these websites used the same platform to manage their inventories. Recognising this, I reverse-engineered the platform’s structure and built an FME workspace that automated the search process for me. By integrating API calls and setting up periodic checks, I received real-time email alerts when matching cars were listed. In this presentation, I’ll walk through how I used FME to save hours of manual searching by creating a custom car-finding automation system. While FME can’t buy a car for you—yet—it can certainly help you find the one you’re after!
Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Smarter Aviation Data Management: Lessons from Swedavia Airports and SwecoSafe Software Managing airport and airspace data is no small task, especially when you’re expected to deliver it in AIXM format without spending a fortune on specialized tools. But what if there was a smarter, more affordable way?
Join us for a behind-the-scenes look at how Sweco partnered with Swedavia, the Swedish airport operator, to solve this challenge using FME and Esri.
Learn how they built automated workflows to manage periodic updates, merge airspace data, and support data extracts – all while meeting strict government reporting requirements to the Civil Aviation Administration of Sweden.
Even better? Swedavia built custom services and applications that use the FME Flow REST API to trigger jobs and retrieve results – streamlining tasks like securing the quality of new surveyor data, creating permdelta and baseline representations in the AIS schema, and generating AIXM extracts from their AIS data.
To conclude, FME expert Dean Hintz will walk through a GeoBorders reading workflow and highlight recent enhancements to FME’s AIXM (Aeronautical Information Exchange Model) processing and interpretation capabilities.
Discover how airports like Swedavia are harnessing the power of FME to simplify aviation data management, and how you can too.
Wenn alles versagt - IBM Tape schützt, was zählt! Und besonders mit dem neust...
Wenn alles versagt - IBM Tape schützt, was zählt! Und besonders mit dem neust...Josef Weingand IBM LTO10
Python Ireland 2012 - Message brokers and Python by Fernando Ciciliati
- 1. Message Brokers and Python Python Ireland Meetup - Jun/2012 Fernando Ciciliati [email protected]
- 2. Contents What sort of problems are we trying to solve? Messaging concepts A solution based on ActiveMQ ActiveMQ + Python: STOMP and Stomp.py ActiveMQ Queues and Topics Other ActiveMQ concepts Alternatives to ActiveMQ AMQP RabbitMQ ZeroMQ Others
- 3. Problems Time decoupling Scalability / Architecture flexibility Technology mix
- 4. Concepts Producer Consumer Message Control x Data x Hybrid Small x Large Durability Queue Message Broker
- 5. Apache ActiveMQ Disclaimer: Each broker has its own view of the world! Apache Project Written in Java Designed for high performance Flexible storage layer Multiple communication protocols Clustering capabilities Very active community -> constant evolution -> ... bugs
- 6. Apache ActiveMQ Web console on port 8161 let's have a look at it... STOMP is not enabled by default Configuration: activemq.xml Running? Check it with netstat -ltn
- 7. ActiveMQ and Python Easiest way (IMHO): STOMP Libraries stomp.py stompy twisted + stomper/stompest Our choice stomp.py
- 8. STOMP Simple (or Streaming) Text Orientated Messaging Protocol. in-band (like HTTP or SMTP) Headers + body Text, not binary Simple Let's telnet...
- 9. stomp.py Created by Jason Briggs Currently at version 3.x Supports Python 2 and Python 3 Has a CLI ! let's have a look at it...
- 10. More ActiveMQ Persistence Producer: Receipt Consumer: Ack/NoAck Exclusive Consumers Selectors Queues X Topics Prefetch
- 11. A simple Python producer def sendJMS(message, host, queue, port=61613, user='', password='', persistent=True): # Size of a buffer for storing MQServer STOMP answers to commands. bufsize = 200 # Establish a TCP connection t = socket.socket(socket.AF_INET, socket.SOCK_STREAM) t.connect ((host, port)) # Establish a STOMP connection frame = 'CONNECTnnx00' t.sendall(frame) resp = t.recv(bufsize) if resp[0:9] != 'CONNECTED': print ('sendJMS: Failed to connect to MQ server') return 1 # Send the message if persistent: persist="true" else: persist="false" frame = 'SENDndestination:%snpersistent:%snn%sx00' % (queue,persist,message) t.sendall(frame) # Disconnect STOMP frame = 'DISCONNECTnnx00' t.sendall(frame) # Disconnect TCP t.close() del(t) return 0
- 12. A simple stomp.py producer import time import sys import stomp USAGE = """ producer.py <destination> <message> <destination> should start by /queue or /topic <message> is the text to be sent as message body (blank spaces accepted). """ if len(sys.argv) < 3: print USAGE else: conn = stomp.Connection() # with default parameters conn.start() conn.connect() conn.send(' '.join(sys.argv[2:]), destination=sys.argv[1]) time.sleep(2) conn.disconnect()
- 13. A simple stomp.py consumer import sys import time import stomp class MyListener(object): def on_error(self, headers, message): print '*** received an error:n%sn***' % message def on_message(self, headers, message): print '*** received a message:n%sn***' % message conn = stomp.Connection() conn.set_listener('', MyListener()) conn.start() conn.connect() conn.subscribe(destination=sys.argv[1], ack='auto') try: while True: time.sleep(1) except KeyboardInterrupt: pass finally: print "nDisconnecting..." conn.disconnect()
- 14. AMQP """ OUR VISION: To become the standard protocol for interoperability between all messaging middleware """ OASIS working group
- 15. RabbitMQ Message broker written in Erlang Supports AMQP Concepts: Producers Messages Exchanges Queues Consumers
- 16. ZeroMQ A "brokerless" approach to messaging "The Intelligent Transport Layer" ØMQ zeromq: Ø The socket library that acts as a concurrency framework. Ø Faster than TCP, for clustered products and supercomputing. Ø Carries messages across inproc, IPC, TCP, and multicast. Ø Connect N-to-N via fanout, pubsub, pipeline, request-reply. Ø Asynch I/O for scalable multicore message-passing apps. Ø Large and active open source community. Ø 30+ languages including C, C++, Java, .NET, Python. Ø Most OSes including Linux, Windows, OS X. Ø LGPL free software with full commercial support from iMatix. (text from http://www.zeromq.org)
- 17. Even more questions? :) Thanks!