Meet Coal-1: Most Agent Warrior Program including GUI regulations with direct murder of proprievision

A group of researchers from the USC, Salesce Force Ai and the University of Washington has sent a coc-1, a pioneer agent – using the agent (cua) that puts the key leasper in the operating company. By lifting collect In the first step-on-parting action-Coal-Coal-1, it defeats the challenges and reliability of complex, long-minzon computer. In Osworld Benchmark, Cocc-1 sets a new gold measure, to find a State-of-The-Art (SOTA) Success of 60.76%Making it the first agent of Cua than 60% mark.

Why is integration – 1? Closing the active gap on computer usage agents

General agencies in cua depends only on Pixel-based communication with Pixel Gui-helping people users by clicking, typing, as well as navigation. While this approaches user's operations, it proves weakness and unemployment in complex, or most complex OS operations, or the complex operating activities of OS, or complex operations of OS, or complex operations of OS, or complex operations of OS, or complex operations of OS, or complex operating functions of OS, or complex OS, or complex operations of OS, or sophisticated OS operations such as unwholesome errors can remove all the workouts.

Efforts to reduce these issues has embarked guides with the higher-agents, as reflected in programs such as GTA-1 and Modar Agent programs. However, these methods cannot escape the Gui-Centric Action Cafete, eventually reduces efficiency and stability.

Coal-1: Hybrid structure with code as an action

Cocce-1 takes different methods separately by combining three special agents:

• Orchestrator: A higher rate editor of complex activities and promotes each subtask services in any operator or gui operator based on job requirements.
• Program: Deleting BackDunder Operations-File Management, Data Configuration, Environmental Configuration – Directly With Python or Bash
• GUI operator: Use the Vision-language model to participate with the visual sites where the voltage of UI as a person is very important.

This a hybrid model It enables Coals-1 to the low-level integration and the long-mouse-for-confy keyboard operations, reliable code killing, while it is still in need of gui.

Examination in Osworld: Establishment of Records

Osworld – The leading Benchmark with 369 workers in the office to produce, the browsers, the file submission, and various work travel – proves the continuation of the Agentic program. Each Real-Real-World Limis language and assessment is a granular ruler scong program.

Result

• SOUTHODUCTION OF SOUTH SOUTH: To achieve 1 60.76% In section 100+First aga agent to cross a 60 point limit. This comes out GTA-1 (53.10%), Opelai Cua 4o (31.40%), Tars-1.5 (29.60%), and other leading structures.
• Working for permission: A total of 100 steps, Coals-1 59.93% points, and earns all competitors.
• Efficiency: Completed tasks at a rate of 10.15 Steps for Each WorkCompared to 15.22 GTA-1, 14.90 on 1 UI-1, and more successful than Openai Cua 4o, despite a few steps (6.14%.

Breakdown

Cocce-1 returns to job types, for having the largest benefits of the beneficiary of the murder of the code:

• Multi-App: 47.88% (vs. GTA-1's 38.34%)
• OS activities: 75,00%
• VLC: 66.07%
• In Doordicity and Ide Domain (Libreoffice Calc, author, VSCode), it is consistent or binding with a sota.

Key Insights: What drives to meet

• Codes of entering Codes return to GUI: For activities such as Batch Image Vizising or Shortal File Depression, one text is a large number of colvys grabbed to errors, reducing both steps and the risk of failing.
• Transfer of Mandla: Variable orchestrator's assignment confirms good use of codes vs vs vs gui verbs.
• Improvement with strong backbones: The best configuration using Openai Cua 4o of the GUI Operator, One O3 of Orchestrator, and the O4-Ministry of Program, reaches the top 60.76% points. Systems use only small or lower backbones with very low ability.
• Working well links honesty: A few steps highlight the likelihood of the mistake – a solid predictor of successful completion.

Conclusion: Shipment forward to a regular computer automation

By making codes of codes The act of the first system Next to GUI Manipulation, COAL-1 Bring both Quantum Leggy in success and effective functioning, and shows a practical approach to scalount, Autonomous Computer Agents. The construction of the Hybrid and LoGic for Dynamic Perceric Set a new CUA fields, a stronger development of the Real-World Automation.

Look Paper including Technical information. Feel free to look our GITHUB page for tutorials, codes and letters of writing. Also, feel free to follow it Sane and don't forget to join ours 100K + ml subreddit Then sign up for Our newspaper.

Asphazzaq is a Markteach Media Inc. According to a View Business and Developer, Asifi is committed to integrating a good social intelligence. His latest attempt is launched by the launch of the chemistrylife plan for an intelligence, MarktechPost, a devastating intimate practice of a machine learning and deep learning issues that are clearly and easily understood. The platform is adhering to more than two million moon visits, indicating its popularity between the audience.