Crimson Hat, a supplier of open supply options, has unveiled updates to Crimson Hat AI, its portfolio of services and products designed to assist speed up the event and deployment of AI options throughout the hybrid cloud.
Crimson Hat AI offers an enterprise AI platform for mannequin coaching and inference that delivers elevated effectivity, a simplified expertise and the flexibleness to deploy anyplace throughout a hybrid cloud atmosphere.
At the same time as companies search for methods to cut back the prices of deploying giant language fashions (LLMs) at scale to handle a rising variety of use circumstances, they’re nonetheless confronted with the problem of integrating these fashions with their proprietary knowledge that drives these use circumstances whereas additionally with the ability to entry this knowledge wherever it exists, whether or not in a knowledge centre, throughout public clouds and even on the edge.
Encompassing each Crimson Hat OpenShift AI and Crimson Hat Enterprise Linux AI (RHEL AI), Crimson Hat AI addresses these considerations by offering an enterprise AI platform that permits customers to undertake extra environment friendly and optimised fashions, tuned on business-specific knowledge and that may then be deployed throughout the hybrid cloud for each coaching and inference on a wide-range of accelerated compute architectures.
Crimson Hat OpenShift AI
Crimson Hat OpenShift AI offers an entire AI platform for managing predictive and generative AI (gen AI) lifecycles throughout the hybrid cloud, together with machine studying operations (MLOps) and LLMOps capabilities. The platform offers the performance to construct predictive fashions and tune gen AI fashions, together with instruments to simplify AI mannequin administration, from knowledge science and mannequin pipelines and mannequin monitoring to governance and extra.
Crimson Hat OpenShift AI 2.18, the most recent launch of the platform, provides new updates and capabilities to help Crimson Hat AI’s intention of bringing higher optimised and extra environment friendly AI fashions to the hybrid cloud. Key options embrace:
- Distributed serving: Delivered by means of the vLLM inference server, distributed serving permits IT groups to separate mannequin serving throughout a number of graphical processing items (GPUs). This helps reduce the burden on any single server, hastens coaching and fine-tuning and makes extra environment friendly use of computing sources, all whereas serving to distribute providers throughout nodes for AI fashions.
- An end-to-end mannequin tuning expertise: Utilizing InstructLab and Crimson Hat OpenShift AI knowledge science pipelines, this new function helps simplify the fine-tuning of LLMs, making them extra scalable, environment friendly and auditable in giant manufacturing environments whereas additionally delivering manageability by means of the Crimson Hat OpenShift AI dashboard.
- AI Guardrails: Crimson Hat OpenShift AI 2.18 helps enhance LLM accuracy, efficiency, latency and transparency by means of a know-how preview of AI Guardrails to watch and higher safeguard each consumer enter interactions and mannequin outputs. AI Guardrails presents further detection factors in serving to IT groups determine and mitigate doubtlessly hateful, abusive or profane speech, personally identifiable data, aggressive data or different knowledge restricted by company insurance policies.
- Mannequin analysis: Utilizing the language mannequin analysis (lm-eval) element to supply necessary data on the mannequin’s total high quality, mannequin analysis permits knowledge scientists to benchmark the efficiency of their LLMs throughout a wide range of duties, from logical and mathematical reasoning to adversarial pure language and extra, in the end serving to to create more practical, responsive and tailor-made AI fashions.
RHEL AI
A part of the Crimson Hat AI portfolio, RHEL AI is a basis mannequin platform to extra constantly develop, check and run LLMs to energy enterprise purposes. RHEL AI offers prospects with Granite LLMs and InstructLab mannequin alignment instruments which might be packaged as a bootable Crimson Hat Enterprise Linux server picture and could be deployed throughout the hybrid cloud.
Launched in February 2025, RHEL 1.4 added a number of new enhancements together with:
- Granite 3.1 8B mannequin help for the most recent addition to the open source-licensed Granite mannequin household. The mannequin provides multilingual help for inference and taxonomy/data customisation (developer preview) together with a 128k context window for improved summarisation outcomes and retrieval-augmented era (RAG) duties.
- A brand new graphical consumer interface for abilities and data contributions, out there as a developer preview, to simplify knowledge ingestion and chunking in addition to how customers add their very own abilities and contributions to an AI mannequin.
- Doc Data-bench (DK-bench) for simpler comparisons of AI fashions fine-tuned on related, non-public knowledge with the efficiency of the identical un-tuned base fashions.
Crimson Hat AI InstructLab on IBM Cloud
More and more, enterprises are on the lookout for AI options that prioritise accuracy and knowledge safety, whereas additionally preserving prices and complexity as little as doable. Crimson Hat AI InstructLab deployed as a service on IBM Cloud is designed to simplify, scale and assist enhance the safety footprint for the coaching and deployment of AI fashions. By simplifying InstructLab mannequin tuning, organisations can construct extra environment friendly fashions tailor-made to the organisations’ distinctive wants whereas retaining management of their knowledge.
No-cost AI Foundations coaching
AI is a transformative alternative that’s redefining how enterprises function and compete. To help organisations on this dynamic panorama, Crimson Hat now presents AI Foundations on-line coaching programs without charge. Crimson Hat is offering two AI studying certificates which might be designed for skilled senior leaders and AI novices alike, serving to educate customers of all ranges on how AI may also help rework enterprise operations, streamline decision-making and drive innovation. The AI Foundations coaching guides customers on learn how to apply this data when utilizing Crimson Hat AI.
Crimson Hat AI InstructLab on IBM Cloud will likely be out there quickly. AI Foundations coaching from Crimson Hat is out there to prospects now.
Joe Fernandes, VP and normal supervisor, AI Enterprise Unit, Crimson Hat, mentioned: “Crimson Hat is aware of that enterprises will want methods to handle the rising value of their generative AI deployments, as they carry extra use circumstances to manufacturing and run at scale. In addition they want to handle the problem of integrating AI fashions with non-public enterprise knowledge and be capable to deploy these fashions wherever their knowledge could dwell. Crimson Hat AI helps enterprises tackle these challenges by enabling them to leverage extra environment friendly, purpose-built fashions, educated on their knowledge and allow versatile inference throughout on-premises, cloud and edge environments.”
Régis Lesbarreres, superior analytics and AI innovation supervisor, digital innovation, Airbus Helicopters, mentioned: “On the outset of our AI journey, Airbus Helicopters was seeking to combine AI into our present structure, scale back shadow IT, unite our knowledge scientists beneath a singular AI platform and optimise prices at scale. With Crimson Hat OpenShift AI, we’ve been capable of accomplish all of those objectives, which led to our first enterprise use case for AI. Crimson Hat’s imaginative and prescient for AI aligns with our enterprise targets and permits us to fulfill them whereas sustaining flexibility, accessibility and transparency.”
Javier Olaizola Casin, world managing associate, hybrid cloud and knowledge, IBM Consulting, mentioned: “Companies are more and more making use of AI to remodel core enterprise processes, and so they want AI options which might be versatile, cost-effective and tuned with trusted enterprise knowledge to fulfill their distinctive wants. Crimson Hat AI brings the consistency, reliability and velocity that organisations want to construct and deploy AI fashions and purposes throughout hybrid cloud eventualities. Combining IBM Consulting’s area, know-how and trade experience with Crimson Hat’s AI applied sciences, we’re serving to our shoppers drive ROI from their know-how investments.”
Torsten Volks, principal analyst, utility modernisation, ESG, mentioned: “Main organisations harness AI-driven, data-centric resolution making throughout groups and enterprise items. Subsequently, the flexibility to quickly and cheaply develop, deploy, combine, scale and govern AI-based capabilities throughout the enterprise turns into a important success issue. Establishing this functionality requires an open and extensible AI basis that ensures seamless integration with present techniques and processes, operational agility and steady governance. Enabling employees and prospects to learn from AI capabilities sooner and in a extra complete method is essential for continued enterprise success.”
Anand Swamy, govt VP and world head of ecosystems, HCLTech, mentioned: “With a purpose to realise the total potential of generative AI, organisations have to prioritise agile and versatile infrastructure. By combining the capabilities of Crimson Hat AI, encompassing RHEL AI and Crimson Hat OpenShift AI to ship an end-to-end AI utility platform, with HCLTech’s main AI experience and cognitive infrastructure providers, part of HCLTech AI Foundry resolution, prospects get a streamlined path to unlocking AI innovation, serving to them overcome frequent challenges akin to knowledge safety, scaling AI workloads and minimising infrastructure prices.”
Wish to be taught extra about cybersecurity and the cloud from trade leaders? Try Cyber Security & Cloud Expo happening in Amsterdam, California, and London.
Discover different upcoming enterprise know-how occasions and webinars powered by TechForge here.
