This page is moving to a new website.
Mark Litwintschik has taken a large open source data set (1.1 billion taxi rides with data storage on the order of hundreds of gigabytes) and ran some benchmark queries on a variety of different systems. Perhaps the most humble of these systems is a cluster of three Raspberry Pi computers. This webpage talks about how he set up the software on this cluster. Continue reading
This page is moving to a new website.
If you want to learn cluster computing and you didn’t have easy access, you had two choices. You could simulate a cluster computer on your laptop, or you could buy time in the cloud. There’s a third approach, build your own cluster computer system using several Raspberry Pi computers. Continue reading
This page is moving to a new website.
The Python Software Foundation supports PyPA, the Python Packaging Authority, a group that maintains an easy to use infrastructure for distributing Python software packages. I’ve used one of their sites, PyPI, to download mpi4py, a way to run Message Passing Interface applications within Python. Continue reading
This page is moving to a new website.
I’ve been experimenting with connecting a small number of Raspberry Pi in a cluster computer, and a good place to start is MPI (Message Passing Interface). Unfortunately, many of the books and websites that I have looked at use examples in C and FORTRAN. These are fine languages, but ones that I am unlikely to need in the future. I want to explore MPI from with a newer programming language, Python. Here are some resources I have leaned on in getting this started. Continue reading
This page is moving to a new website.
I am working on creating a cluster computer using three Raspberry Pis. Once I get that working, I might see what I can do with the smaller model, the Raspberry Pi Zero. If I did, this interface would be a good start. It sits on top of a regular Pi and connects up to four Pi Zeros to it. Continue reading
This page is moving to a new website.
MPI (Message Passing Interface) is the grandfather of all parallel programming systems. It is a series of routines that you can call from FORTRAN or C++ programs, and was developed in the early 1990s. This tutorial is a slow and easy introduction to MPI. Continue reading