Published on April 8, 2026

GPA: How New Automation Learns from Real User Actions

Show It Once and You're Done: How a New Approach to Automation Learns from Humans the First Time

The new GPA interface automation method memorizes user actions from a single demonstration and reproduces them precisely and reliably – without the cloud or data leaks.

Products 4 – 6 minutes min read
Event Source: Salesforce 4 – 6 minutes min read

Some tasks seem simple at first glance: logging into a system, filling out a form, copying data from one application to another, and clicking the 'Save' button. But when this scenario has to be repeated hundreds of times a day – in accounting, in a warehouse, or in a call center – it's no longer a trivial matter. It's about time, money, and employee fatigue.

This is precisely where graphical user interface automation comes in – an approach where a program takes over routine actions in everyday applications: clicking, typing text, and switching between windows. It sounds convenient. In practice, however, it's often a hassle.

Why Traditional Interface Automation Failed

Why Interface Automation Didn't Work Properly for So Long

Traditional automation tools require lengthy setup. A specialist has to manually script every step: click a button with a specific name, find a field with a particular identifier, wait for something to load. The moment a developer slightly changes the interface, the entire script breaks. Maintaining such systems becomes a full-time job in itself.

Another problem is the reliance on cloud services. When automation is built on large language models, requests are often sent to external servers. For companies that handle sensitive customer data or confidential documents, this is unacceptable.

Simply put: old tools are either fragile, insecure, or require too many resources to maintain.

How GPA Automates Tasks by Demonstrating Them Once

Show It Once, and the System Remembers

A new approach called GPA (GUI Process Automation) offers a different logic. You only need to perform the desired scenario once in normal mode, and the system will memorize the sequence of actions. After that, it can reproduce them on its own, accurately and reliably, without human intervention.

The key phrase here is just once. No need to write scripts, no need to delve into the technical details of the interface. You simply have to show the system what to do.

Moreover, GPA works differently from approaches based on language models that 'think' about how to perform a task each time. It uses a deterministic playback mechanism: the system doesn't reinterpret the situation but follows the recorded script precisely. This makes its behavior predictable – something that is critical in a corporate environment where an error in an automated process can be very costly.

Key Capabilities and Advantages of GPA Automation

What Exactly Can GPA Do?

During a demonstration, the system doesn't just record clicks and keystrokes. It analyzes the interface structure: what is a button, what is a text field, which element is responsible for what. This allows it to remain functional even with minor interface changes – for example, if a button moves slightly or changes color.

Confidentiality is also a key issue. GPA operates locally, without sending data to external servers. For businesses in highly regulated industries – finance, medicine, law – this isn't just a convenience, it's a fundamental requirement.

Another aspect is scalability. Once a script is recorded, it can be run in parallel across multiple workstations. One employee demonstrates the process, and the system then replicates it without any extra effort.

Who Benefits from GPA Process Automation and Why

Who Needs This and Why?

GPA is primarily aimed at the corporate sector. Typical use cases include data entry, processing applications, and filling out forms in legacy systems that lack an API for integration. Large companies still have many such systems; they haven't been replaced for years because doing so would be too costly or risky.

Instead of rebuilding the infrastructure, GPA allows automation of work with these systems 'as is' – through the same interface a human employee uses.

To put it simply, if there's a task that a person repeats every day following the same algorithm, GPA can take it over. And it can do so without lengthy setup, without the risk of data leaks, and without constant maintenance from developers.

Why Reliability is Key in Corporate Automation with GPA Methods

Reliability as the Main Argument

Interestingly, the emphasis in the GPA concept is not on the system's intelligence, but on its reliability. In corporate automation, this is often more important: a business doesn't need a system that gets it right 'almost always.' It needs a system that gets it right always – or clearly signals when something has gone wrong.

This is precisely why a deterministic approach, where the system reproduces a script without creative interpretation, is preferable for many corporate tasks. AI models are good where flexibility and contextual understanding are needed. Where precision and reproducibility are required, strict logic works better.

GPA, judging by the description of the approach, attempts to combine the best of both worlds: the simplicity of learning from a demonstration (like modern AI systems) and the rigor of playback (like classic scripts). How stable this combination will prove to be in practice, only time and real-world application in corporate settings will tell.

Original Title: From One Demo to Reliable Automation: How GPA Reimagines GUI Process Automation
Publication Date: Apr 7, 2026
Salesforce www.salesforce.com An international company integrating AI into enterprise platforms and data management systems.
Previous Article Elevators for People: How AI Is Changing the Approach to Design Next Article Google Releases Gemma 4: Open AI Models That Run Directly on Your Smartphone

Related Publications

You May Also Like

Explore Other Events

Events are only part of the bigger picture. These materials help you see more broadly: the context, the consequences, and the ideas behind the news.

From Source to Analysis

How This Text Was Created

This material is not a direct retelling of the original publication. First, the news item itself was selected as an event important for understanding AI development. Then a processing framework was set: what needs clarification, what context to add, and where to place emphasis. This allowed us to turn a single announcement or update into a coherent and meaningful analysis.

Neural Networks Involved in the Process

We openly show which models were used at different stages of processing. Each performed its own role — analyzing the source, rewriting, fact-checking, and visual interpretation. This approach maintains transparency and clearly demonstrates how technologies participated in creating the material.

1.
Claude Sonnet 4.6 Anthropic Analyzing the Original Publication and Writing the Text The neural network studies the original material and generates a coherent text

1. Analyzing the Original Publication and Writing the Text

The neural network studies the original material and generates a coherent text

Claude Sonnet 4.6 Anthropic
2.
Gemini 2.5 Pro Google DeepMind step.translate-en.title

2. step.translate-en.title

Gemini 2.5 Pro Google DeepMind
3.
Gemini 2.5 Flash Google DeepMind Text Review and Editing Correction of errors, inaccuracies, and ambiguous phrasing

3. Text Review and Editing

Correction of errors, inaccuracies, and ambiguous phrasing

Gemini 2.5 Flash Google DeepMind
4.
DeepSeek-V3.2 DeepSeek Preparing the Illustration Description Generating a textual prompt for the visual model

4. Preparing the Illustration Description

Generating a textual prompt for the visual model

DeepSeek-V3.2 DeepSeek
5.
FLUX.2 Pro Black Forest Labs Creating the Illustration Generating an image based on the prepared prompt

5. Creating the Illustration

Generating an image based on the prepared prompt

FLUX.2 Pro Black Forest Labs

Want to dive deeper into the world
of neuro-creativity?

Be the first to learn about new books, articles, and AI experiments
on our Telegram channel!

Subscribe