Arm Mali G2-Ultra NX GPU:具备 AI 原生图形处理能力的桌面级移动游戏体验
Arm Mali G2-Ultra NX GPU: desktop-class mobile gameplay with AI-native graphics

原始链接: https://newsroom.arm.com/blog/arm-mali-g2-ultra-nx-ai-native-mobile-graphics

Arm 推出了 **Mali G2-Ultra NX**,这是其首款原生 AI GPU,旨在弥合桌面级视觉保真度与移动设备严格功耗限制之间的差距。通过将神经网络加速直接集成到着色器核心中,该 GPU 实现了“神经图形学”——即利用 AI 进行图像重建、帧放大以及光线追踪场景的降噪处理。 主要功能包括: * **神经技术:** 神经超采样(NSS)、神经帧率放大(NFRU)和降噪技术(NSSD)不仅能实现更流畅的 120 FPS 游戏体验和更清晰的视觉效果,还能显著降低 GPU 和内存负载。 * **架构升级:** 全新的执行引擎将寄存器容量提升了 2 倍;同时,由不透明度微贴图(Opacity Micromaps)增强的第三代光线追踪技术,进一步提高了光照和几何处理的效率。 * **开发者生态:** 为确保快速普及,Arm 提供了全面的神经图形开发套件(Neural Graphics Development Kit)。这使开发者无需专门的研究基础设施,即可将原生 AI 功能集成到现有流水线(如虚幻引擎)中。 通过将神经网络加速与传统渲染相结合,Mali G2-Ultra NX 使开发者能够在移动设备的功耗范围内提供更丰富、响应更迅速的游戏体验,有效地树立了移动图形性能的新标准。

ARM 发布了全新的 Mali G2-Ultra NX GPU,主打桌面级移动游戏与 AI 原生图形处理。 Hacker News 上的讨论集中在 ARM 的 Mali 架构在安卓市场的统治地位上,特别是在 Imagination Technologies 的 PowerVR 逐渐淡出联发科的产品路线图,而高通的 Adreno 仍专注于高端市场的情况下。 评论者对该 GPU 的软件生态持复杂态度。尽管用户对其对比竞争对手的性能表现感到好奇,但讨论很快转向了 Mesa 缺乏开源支持的问题。参与者批评硬件供应商将专有软件栈视为“护城河”,认为这种限制性壁垒只会让消费者感到沮丧并阻碍普及,而非真正有效的竞争优势。普遍共识是,在出现更好的逆向工程支持或官方开源驱动程序(或许能得到 Valve 等机构的帮助)之前,该硬件在发烧友眼中的潜力仍然受限。
相关文章

原文

Demands from mobile users continue to grow. They want richer visuals, smoother frame rates, and increasingly immersive experiences. For developers the challenge is complex, as they aim to meet these expectations while staying within the strict power, thermal, and bandwidth limits of mobile devices.

Traditional rendering can deliver high image quality, but reaching desktop-class visual fidelity within mobile constraints demands greater efficiency. Neural graphics offers another path, using AI to reconstruct detail, generate intermediate frames, and refine images while reducing GPU demands and overall system workload.

However, bringing neural graphics into mainstream mobile experiences requires deep integration across the GPU architecture and developer ecosystem. With more than 14 billion Mali GPUs shipped to date, Arm has the scale and experience to make these capabilities accessible across the next generation of mobile devices.

That shift is at the heart of the Arm Mali G2-Ultra NX GPU. As the first AI-native Mali GPU, it integrates neural acceleration directly into the graphics pipeline, helping developers deliver richer, more responsive visual experiences within the mobile power envelope and bring neural graphics into production faster.

An AI-native GPU for neural graphics

Mali G2-Ultra NX is built for neural graphics from the ground up, with neural accelerators tightly integrated into the shader cores, allowing neural graphics workloads to run alongside graphics and compute workloads. The tight integration reuses the GPU memory system, coherent caches, and control structures, helping reduce data movement and improve efficiency across the pipeline.

Overview of Arm Mali G2-Ultra NX highlighting its tightly integrated Neural Accelerator, new execution engine, third-generation Ray Tracing Unit, open software stack and ecosystem enablement.
Mali G2-Ultra NX combines dedicated neural acceleration, a new execution engine and third-generation ray tracing to enable AI-native graphics on mobile.

Three neural technologies that are part of Mali G2-Ultra NX demonstrate what this enables:

  • Neural Super Sampling (NSS) reconstructs higher-resolution images from lower-resolution renders, reducing the amount of conventional rendering work needed to produce a high-quality final image.
  • Neural Frame Rate Upscaling (NFRU) generates intermediate frames to increase frame rates and deliver smoother gameplay.
  • Neural Super Sampling and Denoising (NSSD) combines neural upscaling with denoising to improve image quality in demanding ray-traced scenes with complex lighting and shadows.
Diagram of Neural Super Sampling showing low-resolution color, motion and depth inputs feeding a neural network, which reconstructs detail and produces an anti-aliased, upscaled output using temporal frame history.
NSS reconstructs higher-resolution images from lower-resolution inputs, combining temporal data and integrated anti-aliasing to improve image quality efficiently on mobile.
Diagram of Neural Frame Rate Upscaling showing two rendered frames, depth and motion inputs feeding a neural network that generates an intermediate AI frame, with hardware-accelerated optical flow supporting motion estimation.
NFRU uses motion, depth and rendered-frame data to generate high-quality intermediate frames for smoother mobile gameplay.

Neural Dawn, developed by Arm and Sumo Digital, showcases how developers can integrate NFRU and NSSD into a production game pipeline, delivering up to 4x higher performance efficiency and up to 70 percent lower external memory traffic compared with native rendering. These gains can make advanced techniques such as Unreal Engine MegaLights practical on mobile devices.

Explaining how NFRU and NSSD work together in the Neural Dawn game to improve mobile graphics.

By combining traditional rendering and neural graphics, developers can preserve image quality while reducing GPU and system-level workloads. For players, that means sharper images, smoother frame rates, richer scenes, and more responsive gameplay within the constraints of a mobile device.

A new execution engine increases the graphics budget

Alongside neural acceleration, Mali G2-Ultra NX introduces a new execution engine – the biggest Mali GPU instruction set architecture upgrade in seven generations – which is designed to handle increasingly complex graphics workloads while improving performance. It provides up to 2x more registers per wrap, helping the GPU handle increasingly demanding scenes more efficiently. This gives developers greater headroom for richer visuals and more complex effects, while maintaining consistent frame rates.

Architecture diagram showing a Neural Accelerator integrated within the Mali G2-Ultra NX shader core alongside the execution engine, memory system and control structures, with support for INT8 and INT16 processing, optical flow acceleration and shared GPU resources.
Mali G2-Ultra NX integrates dedicated neural acceleration directly within the shader core, sharing GPU memory and control structures to improve efficiency for neural graphics workloads.

The architectural improvements translate into up to 24 percent higher benchmark performance and 14 percent higher non-AI gaming performance compared with the previous generation. Combining the architectural improvements with neural acceleration through NFRU supports longer mobile gaming sessions at up to 120 FPS for smoother, more responsive gameplay.

Third-generation ray tracing unit delivers richer lighting and shadows more efficiently

Mali G2-Ultra NX introduces Arm’s third generation of hardware ray tracing, supporting more complex lighting, shadows, reflections and geometry on mobile devices. The new GPU architecture delivers up to 13 percent lower DRAM traffic on leading ray tracing benchmarks, reducing memory pressure as scene complexity increases.

Meanwhile, hardware support for Opacity Micromaps helps handle intricate transparent geometry more efficiently,  enabling richer foliage, more detailed fabrics, layered surfaces, and other complex scene elements on mobile devices. In one Arm demo, using Opacity Micromaps increased frame rates by 30 percent and reduced the ray tracing workload by up to 70 percent, demonstrating how the technology can make complex geometry more practical on mobile.

Neural graphics complement these advances in ray tracing. Combining new ray tracing hardware with neural technologies, such as NFRU, helps deliver richer visual detail more efficiently within mobile rendering constraints.

Giving developers a practical path to bring neural graphics to production faster

However, new graphics hardware only delivers value when developers can access it through familiar tools and workflows. Arm started preparing the software ecosystem two years before Mali G2-Ultra NX with Arm Neural Technology and an open development kit for neural graphics. These gave content developers, tools developers, and game engine providers early access to neural techniques, so they could begin integrating them into existing workflows before the hardware arrived.

Tencent Games and Unity China explain how they are bringing neural graphics into familiar development workflows and helping move AI-native mobile graphics from technology to production.

Today, the Arm Neural Graphics Development Kit provides the software and tools needed to move that work toward production across established graphics APIs, game engines, and custom workflows. The developer stack includes NSS and NFRU, along with machine learning extensions for Vulkan and plug-ins for leading game engines, including Unreal Engine. An SDK supports custom-engine integration, while profiling, graphics optimization, training, and model-optimization tools help developers evaluate and fine-tune neural graphics workloads.

All these resources provide a path from experimentation to production without requiring studios to build bespoke research infrastructure or change the development workflows they already use.

As Keli Zhou, Engine Lead for Where Winds Meet, says, “Through our collaboration with Arm, we are integrating Arm Neural Technology into the Messiah Engine and bringing it into real-world game development. Where Winds Meet will be among the first games to bring Arm Neural Technology to players, marking an important step from engine-level integration to real-world deployment. Together, we are paving the way for broader developer adoption of neural graphics across the gaming ecosystem.” 

The AI-native graphics foundation for Arm CSS for Mobile 2

Advanced mobile graphics require optimization across the entire system, not just the GPU. Within Arm CSS for Mobile 2, Mali G2-Ultra NX brings AI-native graphics together with compute, memory, software and implementation optimizations to help silicon partners manage increasingly demanding workloads within mobile power and thermal constraints.

Combined with an ecosystem ready to put these capabilities into production, this raises the ceiling for mobile graphics, enabling richer visuals, and smoother experiences delivered to billions of mobile devices.

Arm Mali G2-Ultra NX

Advancing mobile graphics by integrating neural accelerators directly into the graphics pipeline.

联系我们 contact @ memedata.com