ZIGGURAT_OPENMP is a C library which explores how the ZIGGURAT library may be used, in conjunction with OpenMP, to compute random numbers efficiently and correctly.
The primary worry, when computing random numbers in OpenMP, occurs when the user calls a random number generator which may have some internal memory. In that case, the internal memory may become corrupted if multiple threads are invoking the code at the same time.
A safe way to compute random numbers is to ensure that the seed value, and any other data or tables needed by the computation, are stored externally, in the user program. That way, each thread can have a separate copy of the data, and multiple threads of random number calculations can be going along simultaneously without fear of overwriting or memory contention.
The program presented here is somewhat awkward, because it wishes to verify that OpenMP can compute exactly the same data as a sequential program. To do so, we need to create separate seeds for each threads, and ensure that the threads execute the loop iterations in some predictable sequence. When the sequential program goes through the same calculations, we again have to do some acrobatics to ensure that it is doing the same things that the parallel program did.
So some of the complications in this program are there to ensure that we can exhibit the same results sequentially and in parallel. Once you are convinced of that, and see how to go about this, your own program can be set up without some of the overhead and special instructions used in this demonstration.
On an Apple PowerPC G5 with two processors, the following results were observed:
| Threads | Test01 | Test02 | Test03 | Test04 |
|---|---|---|---|---|
| 1 | 0.477 s | 2.338 s | 1.213 s | 1.104 s |
| 2 | 0.237 s | 1.190 s | 0.608 s | 0.693 s |
| 4 | 0.248 s | 1.295 s | 0.620 s | 0.564 s |
In the BASH shell, the program could be run with 2 threads using the commands:
export OMP_NUM_THREADS=2
./ziggurat_openmp
The computer code and data files described and made available on this web page are distributed under the GNU LGPL license.
ZIGGURAT_OPENMP is available in a C version and a C++ version and a FORTRAN77 version and a FORTRAN90 version.
CVT, a C++ library which computes elements of a Centroidal Voronoi Tessellation.
DIJKSTRA_OPENMP, a C program which uses OpenMP to parallelize a simple example of Dijkstra's minimum distance algorithm for graphs.
FAURE, a C++ library which computes elements of a Faure quasirandom sequence.
FFT_OPENMP, a C program which demonstrates the computation of a Fast Fourier Transform in parallel, using OpenMP.
GRID, a C++ library which computes elements of a grid dataset.
HALTON, a C++ library which computes elements of a Halton quasirandom sequence.
HAMMERSLEY, a C++ library which computes elements of a Hammersley quasirandom sequence.
HEATED_PLATE_OPENMP, a C program which solves the steady (time independent) heat equation in a 2D rectangular region, using OpenMP to run in parallel.
HELLO_OPENMP, a C program which prints out "Hello, world!" using the OpenMP parallel programming environment.
HEX_GRID, a C++ library which computes elements of a hexagonal grid dataset.
IHS, a C++ library which computes elements of an improved distributed Latin hypercube dataset.
LATIN_CENTER, a C++ library which computes elements of a Latin Hypercube dataset, choosing center points.
LATIN_EDGE, a C++ library which computes elements of a Latin Hypercube dataset, choosing edge points.
LATIN_RANDOM, a C++ library which computes elements of a Latin Hypercube dataset, choosing points at random.
LCVT, a C++ library which computes a latinized Centroidal Voronoi Tessellation.
MANDELBROT_OPENMP, a C program which generates an ASCII Portable Pixel Map (PPM) image of the Mandelbrot fractal set, using OpenMP for parallel execution.
MD_OPENMP, a C program which carries out a molecular dynamics simulation using OpenMP.
MULTITASK_OPENMP, a C program which demonstrates how to "multitask", that is, to execute several unrelated and distinct tasks simultaneously, using OpenMP for parallel execution.
MXM_OPENMP, a C program which computes a dense matrix product C=A*B, using OpenMP for parallel execution.
MXV_OPENMP, a C program which compares the performance of plain vanilla Fortran and the FORTRAN90 intrinsic routine MATMUL, for the matrix multiplication problem y=A*x, with and without parallelization by OpenMP.
NIEDERREITER2, a C++ library which computes elements of a Niederreiter quasirandom sequence with base 2.
NORMAL, a C library which computes elements of a sequence of pseudorandom normally distributed values.
OPENMP, C programs which illustrate the use of the OpenMP application program interface for carrying out parallel computations in a shared memory environment.
POISSON_OPENMP, a C program which computes an approximate solution to the Poisson equation in a rectangle, using the Jacobi iteration to solve the linear system, and OpenMP to carry out the Jacobi iteration in parallel.
PRIME_OPENMP, a C program which counts the number of primes between 1 and N, using OpenMP for parallel execution.
QUAD_OPENMP, a C program which approximates an integral using a quadrature rule, and carries out the computation in parallel using OpenMP.
RANDOM_MPI, a C program which demonstrates one way to generate the same sequence of random numbers for both sequential execution and parallel execution under MPI.
RANDOM_OPENMP, a C program which illustrates how a parallel program using OpenMP can generate multiple distinct streams of random numbers.
RBOX, a C program which generates a set of points in a region, selected at random according to a given distribution.
SATISFY_OPENMP, a C program which demonstrates, for a particular circuit, an exhaustive search for solutions of the circuit satisfy problem, using OpenMP for parallel execution.
SCHEDULE_OPENMP, a C program which demonstrates the default, static, and dynamic methods of "scheduling" loop iterations in OpenMP to avoid work imbalance.
SGEFA_OPENMP, a C program which reimplements the SGEFA/SGESL linear algebra routines from LINPACK for use with OpenMP.
SOBOL, a C++ library which computes elements of a Sobol quasirandom sequence.
UNIFORM, a C library which computes elements of uniform pseudorandom sequence.
VAN_DER_CORPUT, a C++ library which computes elements of a van der Corput quasirandom sequence.
ZIGGURAT, a C program which generates points from a uniform, normal or exponential distribution, using the ziggurat method.
ZIGGURAT_LOCAL_GCC compiles, links, loads and runs the program using 1, 2 and 4 threads, the local interactive environment, and the GNU GCC compiler.
ZIGGURAT_LOCAL_ICC compiles, links, loads and runs the program using 1, 2 and 4 threads, the local interactive environment, and the Intel ICC compiler.
ZIGGURAT_ITHACA_GCC compiles, links, loads and runs the program using 1, 2 and 4 threads, using the PBS queueing system on Virginia Tech's Ithaca cluster, and the GNU GCC compiler.
ZIGGURAT_ITHACA_ICC compiles, links, loads and runs the program using 1, 2 and 4 threads, using the PBS queueing system on Virginia Tech's Ithaca cluster, and the Intel ICC compiler.
You can go up one level to the C source codes.