XBOX Project Helix Gets New Neural Rendering Technologies

Project Helix is expected to bring changes beyond the performance gains of next-generation Xbox consoles. The next generation is also expected to focus on new rendering technologies, machine learning, ray tracing, path tracing, memory compression, and how developers use these technologies.

Microsoft has already shared information about several technologies planned for the next-generation XBOX. Project Helix will play XBOX console and PC games. Microsoft has presented this as part of its next-generation XBOX console plans. It remains unclear whether this means that Steam games, or games from other stores, will also be available on the console.

Project Helix and Next-Generation XBOX Innovation

Some PC games will run on the XBOX console. That provides another part of the next-generation XBOX strategy. The AMD SoC, known as the Magnus chip, will use a chiplet design. That means the chip will be built from smaller blocks. The design may allow different configurations for different machines.

Microsoft has already talked about an XBOX family of devices. The chiplet design could allow different chips to be built for different Xbox-licensed devices. Project Helix is being co-designed for the next generation of DirectX. The current generation uses DirectX 12, which has seen several improvements and multiple versions. 

DirectX12 Ultimate is the latest version mentioned here, but it is not known whether the next generation will use another version of DirectX12 or a completely new version. More information will be needed before that can be confirmed. Next-generation ray tracing performance and capabilities will depend on the hardware, including additional units, shaders, and compute units.

Next-Generation Ray Tracing and GPU Work Graphs

GPU-directed work-graph execution is another technology covered in the presentation. According to the information discussed, work graph execution is a Direct3D12 feature that allows the GPU to autonomously schedule, generate, and execute its own rendering and compute workloads without constantly waiting for or relying on the CPU.

Moving work from the CPU to the GPU can provide another way to handle workloads. The technology is not entirely new, as there have already been attempts to offload certain commands from the CPU to the GPU. This could be another step in that direction.

Project Helix is also being built for the next generation of neural rendering. The technology has already been discussed, and some sources suggest it could provide more in-depth rendering than DLSS5. Neural rendering is a different way to render games using machine learning. How it will work and what it will change still needs more information.

Examples and discussions of the technology exist, but more documentation is needed. Next-generation neural rendering could make games look more realistic, but it may take time to implement if it represents a different approach to rendering.

The next-generation Xbox is also expected to support machine-learning upscaling.

This could be FSR4.1, a future version of FSR, or another implementation. The key point is that machine-learning-based upscaling is coming to Xbox. Machine-learning-based multi-frame generation is also part of the plans. This represents an implementation of frame generation.

Some Xbox Series X games have already used frame generation, though not the machine-learning-based version. Next-generation ray tracing and path tracing are also included. This means better reflections and other lighting effects. Path tracing is being developed as a future direction in lighting.

A Minecraft demo running on the Xbox Series X previously showcased path tracing, though it was never released publicly. For the next generation, path tracing is expected to be available in at least some games.