Intellectual hub of the topic
Objective evaluation of technological advancement requires metrics that go beyond marketing slogans. In this collection, we gather materials dedicated to testing methodologies, standardized datasets, and performance measurement tools for neural network models. We analyze how modern benchmarks are shaped – from linguistic tests and logic puzzles to the assessment of ethical constraints and algorithmic energy efficiency.
AI: Events
Products
LightOn has released the open-source model LightOnOCR-2, which surpasses leading commercial AI solutions in the task of extracting tables from documents.
Red Hat and NVIDIA have jointly achieved leading results in the independent MLPerf Inference v6.0 test, which covers image recognition, speech, and reasoning tasks.
Researchers have developed a specialized test for AI systems used in architecture, engineering, and construction. The results were quite sobering.
Hcompany has introduced Holo3, an agent model that set a record on a key computer operation benchmark and is designed for autonomous work in corporate environments.
AI: Events
Technical context • Infrastructure
AMD has presented its MLPerf Inference 6.0 results, showcasing new performance records, the first video generation tests, and scaling up to the cluster level on the Instinct MI355X GPU.
AI: Events
Infrastructure
Red Hat AI has secured top spots in the latest round of the MLPerf Inference v6.0 benchmark, testing three models on both NVIDIA and AMD GPUs.
Researchers have introduced EvoClaw, an AI agent testing system that assesses the agents' ability to work with constantly evolving projects.
Scale AI has launched Voice Showdown, a benchmark for evaluating voice AI models based on real human preferences and live speech.
Researchers have created a specialized safety test for language models that accounts for the nuances of Thai language and culture. This project has already been accepted into a major AI workshop.
Want to know about new
experiments first?
Subscribe to our Telegram channel — we share all the latest
and exciting updates from NeuraBooks.