AI: Events
How to Train AI on Million-Token Texts: A Game-Changing Idea
Technical context • Infrastructure
Researchers have proposed a method for distributing the processing of ultra-long texts across multiple GPUs, allowing models to be trained on contexts of up to one million tokens.