The Higress cloud gateway has been updated to support the Gateway API standard and now includes specialized features for working with artificial intelligence models.
AI: Events
How AMD and Qwen Optimized MI300X GPUs for Peak Performance
Technical context • Infrastructure
The Qwen team optimized their models to effectively run on AMD MI300X GPUs, achieving a response latency as low as 15 ms per token and full image generation in just 0.4 seconds.
AI: Events
Training Language Models with Feedback: verl Now Runs on AMD GPUs
Technical context • Infrastructure
The verl framework for training large language models with reinforcement learning has received support for AMD ROCm 7.0.0 and expanded scaling capabilities.
Hugging Face researchers have demonstrated a method for testing the ability of language models to use tools directly in a real-world environment, rather than in isolated settings.
AI: Events
Can Superconductors Cool Data Centers? Microsoft Experiments with an Unconventional Solution
Infrastructure
Microsoft is testing high-temperature superconductors to power servers: the technology could reduce energy losses and simplify data center infrastructure.
AI: Events
UModel: How Alibaba Transforms IT System Monitoring into a Unified Digital Model
Infrastructure
Alibaba Cloud has unveiled the UModel approach – a system that unites disparate data on IT infrastructure into a single ontology. The project operates as a digital twin, allowing companies to see a holistic picture of their technological landscape instead of a collection of isolated metrics.
Oracle's AI data centers utilize a closed-loop cooling system where water circulates without evaporation or refills: it is filled just once.
The AnalyticDB team has introduced StreamingView – an engine for handling constantly updating data that eliminates the need to recalculate the entire dataset every time something changes.
AMD has demonstrated technology for simulating robotic operations locally on a PC using its own GPUs – without relying on cloud servers or expensive computing farms.