News: 0001463498

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Intel Takes Open-Source Hyperscan Development To Proprietary Licensed Software

([Intel] 114 Minutes Ago Hyperscan Going Closed-Source)


While Intel can be praised for their dozens (or likely by now, hundreds) of open-source projects they maintain and countless other existing open-source software projects they actively contribute to and are covered by Phoronix on a near-daily basis, not everything there is open-source. Intel is a wonderful and leading open-source promoter but occasionally there are closed-source blobs or questionable moves such as today: Intel is taking their Hyperscan library development from BSD-licensed open-source software to now the Intel Proprietary License moving forward.

Hyperscan has been developed by Intel for many years... It's been open-source since the Hyperscan 4.0 release in 2016. This is a high performance regular expression matching library optimized for Intel processors from Atom/embedded type systems all the way through Xeon Scalable. Hyperscan is further described on the [1]Hyperscan.io project site as:

"Hyperscan is a high performance regular expression matching library from Intel that runs on x86 platforms and offers support for Perl Compatible Regular Expressions (PCRE) syntax, simultaneous matching of groups of regular expressions, and streaming operations. It is released as open source software under a BSD license. Hyperscan presents a flexible C API and a number of different modes of operation to ensure its applicability in real networking scenarios. Moreover, a focus on efficient algorithms and the use of IntelĀ® Streaming SIMD Extensions (IntelĀ® SSE) enables Hyperscan to achieve high matching performance. It is suitable for usage scenarios such as deep packet inspection (DPI), intrusion detection systems (IDS), intrusion prevention system (IPS), and firewalls, and has been deployed in network security solutions worldwide. Hyperscan has also been integrated into widely used open-source IDS and IPS products like Snort* and Suricata*."

The most recent tagged release was [2]Hyperscan 5.4.2 last year under a BSD 3-Clause license. GitHub activity since then has dried up. It turns out Hyperscan has gone proprietary.

It was pointed out today on [3]the Fedora mailing list that the Hyperscan package is being retired from that distribution. That's being done due to Hyperscan 5.5+ going under a proprietary/closed-source license.

The [4]Intel Hyperscan documentation indeed confirms that Hyperscan is now developed as closed-source software under the Intel Proprietary License:

Well, that's an open-source disappointment... And it's a freaking regular expression matching library that Intel is now making closed-source.

The Hyperscan project page also mentions its new proprietary nature in being available via Intel sales reps:

"Intel has an upgraded library version that is available through your Intel sales representative."

Now that's even worse than being just proprietary software but if it were at least freely available to download... So now Hyperscan is just for Intel customers.

Fedora for their part is looking at packaging [5]Vectorscan given Hyperscan going closed-source. Vectorscan is a fork from Hyperscan 5.4 while adding in ARM NEON/ASIMD and PowerVSX support among other non-Intel platform improvements. Vectorscan was started as a fork of Hyperscan after Intel engineers rejected open-source pull requests for enhancing the ARM support.

While Intel does immense good for the open-source and Linux ecosystems and have been doing so for many years, taking Hyperscan proprietary is a rather strange change of pace and hopefully isn't going to be part of any broader software trends at the company. Again, it's just a regular expression matching library (and one that performs best on Intel platforms already) that they now feel the need to make closed-source/proprietary and gated behind a sales rep after eight years as an open-source project...



[1] https://www.hyperscan.io/

[2] https://github.com/intel/hyperscan/releases/tag/v5.4.2

[3] https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org/thread/UZD4BLRMHPQY27IMYQZ76TXCBULHALFJ/

[4] https://networkbuilders.intel.com/docs/networkbuilders/accelerate-snort-performance-with-hyperscan-and-intel-xeon-processors-on-public-clouds-1680176363.pdf

[5] https://github.com/VectorCamp/vectorscan



Kjell

geerge

Volta

sandain

For three years, the young attorney had been taking his brief
vacations at this country inn. The last time he'd finally managed an
affair with the innkeeper's daughter. Looking forward to an exciting
few days, he dragged his suitcase up the stairs of the inn, then stopped
short. There sat his lover with an infant on her lap!
"Helen, why didn't you write when you learned you were pregnant?"
he cried. "I would have rushed up here, we could have gotten married,
and the baby would have my name!"
"Well," she said, "when my folks found out about my condition,
we sat up all night talkin' and talkin' and finally decided it would be
better to have a bastard in the family than a lawyer."