Parallel Computing Example with Raspberry Pi Cluster
2 likes707 views
This document discusses using a Raspberry Pi cluster to perform parallel computing tasks. Specifically, it describes setting up a small cluster with one Raspberry Pi 3 B as the master node and two Raspberry Pi 1 B nodes. It explains how to configure the operating system, connect the nodes, install MPI for communication between nodes, and run a distributed Python program across the nodes to perform parallel pathfinding using a bidirectional breadth-first search algorithm.
Parallel Computing Example with Raspberry Pi Cluster
- 1. Parallel Computing Example with Raspberry Pi Cluster
- 2. IBM’s Blue Gene Image source : https://en.wikipedia.org/wiki/Blue_Gene
- 3. Blue Gene’s Scaling Architecture Image source : https://en.wikipedia.org/wiki/Blue_Gene
- 4. Image source : https://www.element14.com/community/docs/DOC-80899/l/raspberry-pi-3-model-b-technical-specifications
- 5. A computer cluster consists of a set of loosely or tightly connected computers that work together so that, in many respects, they can be viewed as a single system.
- 7. Our poor cluster architecture (but works like a charm) pi00 pi01 pi02 Switch
- 8. A Raspberry Pi 3 B as Master + 2x Raspberry Pi 1 B as Nodes Each : - 700 (up to 1000) Mhz ARMv6 processor - 256 MB RAM - 16 GB flash storage - Ethernet - Other standart ports
- 9. Build steps - Minimal foot print operating system (minibian) - Connect them all in one subnet - Seamless SSH access across nodes - Install MPI library and its dependencies - Distribute the program to each node
- 10. mpi4py MPI (Message Passing Interface) binding for Python, one program to rule them all (distributed system). Some of the features : - Send - Receive - Broadcast - Scatter - Gather
- 11. Basic MPI code structure from mpi4py import MPI comm = MPI.COMM_WORLD # Initiate communitacor rank = comm.Get_rank() # Get the identity / label if rank == 0 : # I am master # Communicate to other nodes else : # Do something as worker # Communicate to other nodes
- 12. MPI execution across network root@pi00:~$ mpiexec -n 3 --host pi00,pi01,pi02 ./program.py Total node The node hostname, defined in /etc/hosts Parallel computing program
- 13. Artifical Intelligence Bread First Search Pathfinding
- 17. Scatter Master : Hei piSatu, kerjakan tugas, mulai dari titik A. Eh piDua, sini, kerjakan mulai dari titik Z. Tolong kerja sama yang baik!
- 18. Inter-node communication via master piSatu : Sudah sampai O belom? piDua : Beloman. Baru sampai R. piSatu : Aku sudah dekat O nih. piDua : Eh aku sudah sampai ke O. piSatu : Sip! Aku sudah di O juga. Stop!
- 19. Gather Master : Sudah? Sini kumpulin! piSatu : ABCDEFGHIJKLMO piDua : ZYXWVUTSRQPO Master : ABCDEFGHIJKLMNOPQRSTUVWXYZ
- 20. Thank you