Intellectual hub of the topic
AI: Events
Infrastructure
The new NVIDIA GB300 NVL72 server, paired with the SGLang framework, has demonstrated a 25x performance boost when running language models.
AI: Events
Technical context • Infrastructure
AMD has explained how to run distributed ML tasks on GPUs using Ray and ROCm 7 – from model training to creating agent-based systems.
Mistral Document AI is now integrated into Microsoft Foundry. This solution aims to automate the processing of complex documents, supporting multiple languages and formats.
Qualcomm has introduced a comprehensive infrastructure for running large AI models, featuring a server rack, expansion cards, and a management system as a single integrated solution.
NeuroBlog
Artificial intelligence • AI Development
Neural networks are given away for free, but the price of this gift is the invisible currency of our thoughts, words, and habits – one that is making corporations the gods of a new world.
Perplexity has released two new models for semantic search – designed to quickly and accurately find information across billions of documents.
AI: Events
Infrastructure
AMD has explained how to run a trillion-parameter language model on a cluster of consumer devices – without the cloud or server farms.
AI: Events
Technical context • Infrastructure
An exploration of how TunableOp technology enables the pre-selection of optimal parameters for neural networks, and why this is a valuable practice.
AI: Events
Technical context • Infrastructure
Alibaba Cloud has introduced a precise request routing mechanism for language models that significantly boosts caching efficiency in distributed inference.
Don’t miss a single experiment!
Subscribe to our Telegram channel —
we regularly post announcements of new books, articles, and interviews.