One performance optimization that was introduced in the Radix Selection algorithm can also be applied to the MSD Radix Sort – combining counting with the permutation phase. This optimization cannot be done during the first digit pass, since counting must be performed first to figure out the bins to permute the data into. However, during […]
Read more "MSD Radix Sort Optimization"In my previous blog post on Radix Selection, the algorithm which returns the k-th largest value from an unsorted array was shown to be significantly faster than sorting, because it performs less work. In this blog, I’ll explore further optimizations to make Radix Sort even faster. More Bits Per Digit Radix Sort (LSD and MSD […]
Read more "Radix Selection Optimizations"I’ve written many blogs and a book on sorting. There is a closely related algorithm called Selection, which provides the k-th element from an unsorted array. For example, a 17-th highest test score from a college Physics class, or a 91-st most popular book at the library. One way to accomplish Selection is to sort […]
Read more "Radix Selection Algorithm"The Power Usage of Algorithms in C# blog presents power usage and efficiency of several C# sequential (single core) algorithms is shown. In this blog power usage and efficiency of parallel algorithms is explored. Power Measurement Setup The same setup is used as in Power Usage of Algorithms in C#. Parallel Sorting An array of […]
Read more "Power Usage of Parallel Algorithms in C#"Algorithms power the world – from search to streaming to AI. Each algorithmic domain has a variety of algorithms to choose from, with different run times and characteristics. But how much power do algorithms use? Does power usage vary between algorithms? Are some algorithms more power efficient than others? This blog answers these questions by […]
Read more "Power Usage of Algorithms in C#"Unit testing and integration testing are ubiquitous for software development and chip design. Unit testing consists of numerous test cases which test various aspects of the unit/device under test. Typically, unit test cases make sure that all required behaviors are performed by the unit under test. One problem that comes up time and time again […]
Read more "Testing the Tester"Parallel programming frameworks like C++ Threading Building Blocks (TBB) and C# Task Parallel Library (TPL) are good at handling large work items using multi-core processors. Both provide mechanisms to break a large problem into smaller pieces (grains), to provide work for multiple cores in parallel, gaining performance acceleration. With 20-core laptops widely available along with […]
Read more "Parallel Pattern of Bundling Small Work Items"Professor Blelloch and his team at Carnegie Mellon University have designed and developed a parallel algorithms library over the last decade – ParlayLib. It provides numerous parallel algorithms targeting shared-memory multicore processors. It is similar to Intel’s Threading Building Blocks (TBB), providing a works-stealing scheduler, but also goes beyond with support for additional parallel primitives […]
Read more "ParlayLib Parallel Algorithms Library"In my previous blog Standard C++ Sort was benchmarked running on a single core of an Intel processor at 11 million 32-bit integers per second. Its parallel version scaled up to 93 million integers per second on a 48-core Xeon processor AWS node (C5.24xlarge) – providing 8X speedup. Also, my implementation of Parallel Merge Sort […]
Read more "Sorting 19X Faster Than C++ Parallel Sort"In my previous blogs, Standard C++ Parallel Algorithms were shown to accelerate well on multi-core processors for large arrays, but slowed performance down for small arrays. In this blog, let’s explore a way to increase performance for small arrays. Data Parallelism Many Standard C++ Algorithms support several execution modes. C++ standard supports four modes: seq, […]
Read more "Improving Parallel Performance for Small Arrays"
Algorithm Performance 