Benchmark of C++ Parallel Standard Library Algorithms (STL)

To setup Intel's C++ Standard Parallel Algorithms on Linux, the following are needed:

• (Windows) OneAPI
• (Linux) Threading Building Blocks (TBB)

To install g++ which supports C++17:

sudo apt update
sudo apt upgrade
# reboot the machine
sudo apt install build-essential

To update gcc to support c++17 standard, which uses Intel's Threading Building Blocks (TBB) for C++ Parallel Standard Algorithms:

sudo apt install libtbb-dev

To build, use g++ command and not gcc. The order of the following arguments matters!

g++ /mnt/c/repos/ParallelSTL/src/main.cpp -ltbb -std=c++17 -O3 -o benchmark_parallel_std

To setup NVidia's compiler on Linux follow these instructions: https://developer.nvidia.com/blog/accelerating-standard-c-with-gpus-using-stdpar/

To setup NVidia's compiler and C++ Standard parallel algorithms on Linux

curl https://developer.download.nvidia.com/hpc-sdk/ubuntu/DEB-GPG-KEY-NVIDIA-HPC-SDK | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-hpcsdk-archive-keyring.gpg
echo 'deb [signed-by=/usr/share/keyrings/nvidia-hpcsdk-archive-keyring.gpg] https://developer.download.nvidia.com/hpc-sdk/ubuntu/amd64 /' | sudo tee /etc/apt/sources.list.d/nvhpc.list
sudo apt-get update -y
sudo apt-get install -y nvhpc-23-5

To compile Benchmark using NVidia's compiler targetting Intel multicore CPU

nvc++ /mnt/c/repos/ParallelSTL/src/main.cpp -stdpar=multicore -O3 -o benchmark_nvc

In Windows/ParallelSTL sub-directory a Visual Studio 2022 solution/project can be used to build an executable using either Microsoft's compiler or Intel compiler. Microsoft implements Parallel standard algorithms, but not all of them. Intel implements more standard parallel algorithms with higher performance as show in C++ Parallel STL Benchmark.

Intel OneAPI must be installed to obtain Intel's implementation of C++ Parallel Standard Algorithms. If Intel implementations are not desired, then comment out "#define DPL_ALGORITHMS" at the top of "main.cpp".

Both compilers (Microsoft or Intel) can be used to build this project, with or without Intel's algorithms. To switch between compilers, select "Project/Intel-Compiler" from Visual Studio 2022 menu.

The following book provides examples, explanations, and a free code repository for developing your own parallel algorithms:

• Practical Parallel Algorithms in C++ and C#: Part 1: Sorting on Multicore CPUs
• C++ open source repository of parallel algorithms for the above book

Related blogs to improve performance of C++ Standard Parallel Algorithms:

• Sorting 19X Faster than C++ Parallel Sort
• Can C++ Paralllel Standard Algorithms Accelerate, Even Small Arrays
• Improving Parallel Performance for Small Arrays