Parallel Computing Example with Raspberry Pi Cluster

Parallel Computing Example with Raspberry Pi Cluster

• 1.
  Parallel Computing Example with RaspberryPi Cluster
• 2.
  IBM’s Blue Gene Image source: https://en.wikipedia.org/wiki/Blue_Gene
• 3.
  Blue Gene’s Scaling Architecture Image source: https://en.wikipedia.org/wiki/Blue_Gene
• 4.
  Image source :https://www.element14.com/community/docs/DOC-80899/l/raspberry-pi-3-model-b-technical-specifications
• 5.
  A computer clusterconsists of a set of loosely or tightly connected computers that work together so that, in many respects, they can be viewed as a single system.
• 6.
  Image source : http://www.zdnet.com/article/build-your-own-supercomputer-out-of-raspberry-pi-boards/
• 7.
  Our poor clusterarchitecture (but works like a charm) pi00 pi01 pi02 Switch
• 8.
  A Raspberry Pi3 B as Master + 2x Raspberry Pi 1 B as Nodes Each : - 700 (up to 1000) Mhz ARMv6 processor - 256 MB RAM - 16 GB flash storage - Ethernet - Other standart ports
• 9.
  Build steps - Minimalfoot print operating system (minibian) - Connect them all in one subnet - Seamless SSH access across nodes - Install MPI library and its dependencies - Distribute the program to each node
• 10.
  mpi4py MPI (Message PassingInterface) binding for Python, one program to rule them all (distributed system). Some of the features : - Send - Receive - Broadcast - Scatter - Gather
• 11.
  Basic MPI codestructure from mpi4py import MPI comm = MPI.COMM_WORLD # Initiate communitacor rank = comm.Get_rank() # Get the identity / label if rank == 0 : # I am master # Communicate to other nodes else : # Do something as worker # Communicate to other nodes
• 12.
  MPI execution acrossnetwork root@pi00:~$ mpiexec -n 3 --host pi00,pi01,pi02 ./program.py Total node The node hostname, defined in /etc/hosts Parallel computing program
• 13.
  Artifical Intelligence Bread FirstSearch Pathfinding
• 15.
  Bi-directional BFS Pathfinding
• 17.
  Scatter Master : HeipiSatu, kerjakan tugas, mulai dari titik A. Eh piDua, sini, kerjakan mulai dari titik Z. Tolong kerja sama yang baik!
• 18.
  Inter-node communication viamaster piSatu : Sudah sampai O belom? piDua : Beloman. Baru sampai R. piSatu : Aku sudah dekat O nih. piDua : Eh aku sudah sampai ke O. piSatu : Sip! Aku sudah di O juga. Stop!
• 19.
  Gather Master : Sudah?Sini kumpulin! piSatu : ABCDEFGHIJKLMO piDua : ZYXWVUTSRQPO Master : ABCDEFGHIJKLMNOPQRSTUVWXYZ
• 20.
  Thank you