News: 0001503953

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Intel Releases x86-simd-sort 6.0 For Speedy AVX2/AVX-512 Sorting, PyTorch Now Using It

([Intel] 4 Hours Ago x86-simd-sort 6.0)


The [1]x86-simd-sort project from Intel has been an interesting open-source software effort for [2]much faster number sorting by using AVX-512 . There's been [3]lightning fast number sorting with AVX-512 and [4]AVX2 code paths also added to broaden the appeal in helping CPUs without AVX-512. Projects like Numpy have been making use of this library while today x86-simd-sort 6.0 was released and also comes a few days after PyTorch has begun using this library too.

The x86-simd-sort 6.0 release adds support for qselect and partial sort for key-value data types, accelerating key-value sort using OpenMP pragmas, AVX2 support for key-value sort / partial sort / objsort methods, Intel LLVM compiler support, and support for descending order sort for all the sort routines. There is also better performance expected when working on daa with few unique values.

Downloads and more details on all of the x86-simd-sort 6.0 changes via [5]GitHub .

Opened back in June was [6]this merge request to PyTorch to begin making use of x86-simd-sort for faster sorting on x86/x86_64. A 10x speed-up was cited for large arrays. As of last week that code was [7]merged to PyTorch for much faster sorting on systems with AVX2 or AVX-512. The torch.sort and torch.argsort functions stand to benefit with the up to 10x gains.



[1] https://www.phoronix.com/search/x86-simd-sort

[2] https://www.phoronix.com/news/Intel-AVX-512-Quicksort-Numpy

[3] https://www.phoronix.com/news/Intel-x86-simd-sort-2.0

[4] https://www.phoronix.com/news/Intel-x86-simd-sort-4.0

[5] https://github.com/intel/x86-simd-sort/releases/tag/v6.0

[6] https://github.com/pytorch/pytorch/pull/127936

[7] https://github.com/pytorch/pytorch/commit/7e650604105ee74529f6352f9a81cc68f32c2d56



JEBjames

Michael

Some people say a front-engine car handles best. Some people say a
rear-engine car handles best. I say a rented car handles best.
-- P. J. O'Rourke