ziggurat_openmp, a FORTRAN77 code which explores how the ziggurat() library may be used, in conjunction with OpenMP, to compute random numbers efficiently and correctly.
The primary worry, when computing random numbers in OpenMP, occurs when the user calls a random number generator which may have some internal memory. In that case, the internal memory may become corrupted if multiple threads are invoking the code at the same time.
A safe way to compute random numbers is to ensure that the seed value, and any other data or tables needed by the computation, are stored externally, in the user program. That way, each thread can have a separate copy of the data, and multiple threads of random number calculations can be going along simultaneously without fear of overwriting or memory contention.
The program presented here is somewhat awkward, because it wishes to verify that OpenMP can compute exactly the same data as a sequential program. To do so, we need to create separate seeds for each threads, and ensure that the threads execute the loop iterations in some predictable sequence. When the sequential program goes through the same calculations, we again have to do some acrobatics to ensure that it is doing the same things that the parallel program did.
So some of the complications in this program are there to ensure that we can exhibit the same results sequentially and in parallel. Once you are convinced of that, and see how to go about this, your own program can be set up without some of the overhead and special instructions used in this demonstration.
On an Apple PowerPC G5 with two processors, the following results were observed:
| Threads | Test01 | Test02 | Test03 | Test04 |
|---|---|---|---|---|
| 1 | 0.454 s | 1.398 s | 1.317 s | 1.200 s |
| 2 | 0.228 s | 0.701 s | 0.663 s | 0.606 s |
| 4 | 0.229 s | 0.704 s | 0.693 s | 0.644 s |
In the BASH shell, the program could be run with 2 threads using the commands:
export OMP_NUM_THREADS=2
./ziggurat_openmp
The computer code and data files described and made available on this web page are distributed under the GNU LGPL license.
ziggurat_openmp is available in a C version and a C++ version and a FORTRAN77 version and a FORTRAN90 version.
dijkstra_openmp, a FORTRAN77 program which uses OpenMP to parallelize a simple example of Dijkstra's minimum distance algorithm for graphs.
FFT_OPENMP, a FORTRAN77 program which demonstrates the computation of a Fast Fourier Transform in parallel, using OpenMP.
HEATED_PLATE_OPENMP, a FORTRAN77 program which solves the steady (time independent) heat equation in a 2D rectangular region, using OpenMP to run in parallel.
HELLO_OPENMP, a FORTRAN77 program which prints out "Hello, world!" using the OpenMP parallel programming environment.
MANDELBROT_OPENMP, a FORTRAN77 program which generates an ASCII Portable Pixel Map (PPM) image of the Mandelbrot fractal set, using OpenMP for parallel execution.
MD_OPENMP, a FORTRAN77 program which carries out a molecular dynamics simulation using OpenMP.
MULTITASK_OPENMP, a FORTRAN77 program which demonstrates how to "multitask", that is, to execute several unrelated and distinct tasks simultaneously, using OpenMP for parallel execution.
MXM_OPENMP, a FORTRAN77 program which computes a dense matrix product C=A*B, using OpenMP for parallel execution.
MXV_OPENMP, a FORTRAN77 program which compares the performance of plain vanilla Fortran and the FORTRAN90 intrinsic routine MATMUL, for the matrix multiplication problem y=A*x, with and without parallelization by OpenMP.
OPENMP, FORTRAN77 programs which illustrate the use of the OpenMP application program interface for carrying out parallel computations in a shared memory environment.
POISSON_OPENMP, a FORTRAN77 program which computes an approximate solution to the Poisson equation in a rectangle, using the Jacobi iteration to solve the linear system, and OpenMP to carry out the Jacobi iteration in parallel.
PRIME_OPENMP, a FORTRAN77 program which counts the number of primes between 1 and N, using OpenMP for parallel execution.
QUAD_OPENMP, a FORTRAN77 program which approximates an integral using a quadrature rule, and carries out the computation in parallel using OpenMP.
RANDOM_MPI, a FORTRAN77 program which demonstrates one way to generate the same sequence of random numbers for both sequential execution and parallel execution under MPI.
RANDOM_OPENMP, a FORTRAN77 program which illustrates how a parallel program using OpenMP can generate multiple distinct streams of random numbers.
SATISFY_OPENMP, a FORTRAN77 program which demonstrates, for a particular circuit, an exhaustive search for solutions of the circuit satisfiability problem, using OpenMP for parallel execution.
SCHEDULE_OPENMP, a FORTRAN77 program which demonstrates the default, static, and dynamic methods of "scheduling" loop iterations in OpenMP to avoid work imbalance.
SGEFA_OPENMP, a FORTRAN77 program which reimplements the SGEFA/SGESL linear algebra routines from LINPACK for use with OpenMP.
ZIGGURAT, a FORTRAN77 program which generates points from a uniform, normal or exponential distribution, using the ziggurat method.