News: 0001492575

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

OpenVINO 2024.4 Prepares For Core Ultra Series 2, New Gen AI Models

([Intel] 3 Hours Ago OpenVINO 2024.4)


Intel engineers today released OpenVINO 2024.4 as the newest version of their open-source AI toolkit. OpenVINO 2024.4 prepares for upcoming Intel Core Ultra Series 2 "Lunar Lake" processors, supports newer Gen AI models, now supports Python 3.12, and finally adds official support for Red Hat Enterprise Linux 9.

OpenVINO 2024.4 adds support for the GLM-4-9B Chat, MiniCPM-1B, Llama 3 and 3.1, Phi-3-Mini, Phi-3-Medium and YOLOX-s models.

OpenVINO 2024.4 also expands its large language model (LLM) support with run-time optimizations for Xe Matrix Extensions (XMX) systolic arrays, memory sharing for Lunar Lake CPUs, a new PagedAttention feature for discrete GPUs, production-quality support for the OpenAI-compatible API, improved performance and memory consumption, Python 3.12 support, and support for RHEL9.

Downloads and more details on the new OpenVINO 2024.4 AI toolkit release via [1]GitHub .



[1] https://github.com/openvinotoolkit/openvino/releases/tag/2024.4.0


phoronix

Meantime, in the slums below Ronnie's Ranch, Cynthia feels as if some one
has made voodoo boxen of her and her favorite backplanes. On this fine
moonlit night, some horrible persona has been jabbing away at, dragging
magnets over, and surging these voodoo boxen. Fortunately, they seem to
have gotten a bit bored and fallen asleep, for it looks like Cynthia may
get to go home. However, she has made note to quickly put together a totem
of sweaty, sordid static straps, random bits of wire, flecks of once meaningful
oxide, bus grant cards, gummy worms, and some bits of old pdp backplane to
hang above the machine room. This totem must be blessed by the old and wise
venerable god of unibus at once, before the idolatization of vme, q and pc
bus drive him to bitter revenge. Alas, if this fails, and the voodoo boxen
aren't destroyed, there may be more than worms in the apple. Next, the
arrival of voodoo optico transmitigational magneto killer paramecium, capable
of teleporting from cable to cable, screen to screen, ear to ear and hoof
to mouth...