activities
latest
false
UiPath logo, featuring letters U and I in white
UI Automation Activities
Last updated Nov 25, 2024

About the UI Automation activities

Overview

UI automation activities enable you to interact with graphical user interface elements in software applications. These activities include clicking buttons, typing into text boxes, selecting from dropdown menus, and more. This is done by using UiPath Robots that perform tasks the same way a human user would, making it easier to automate complex business processes and repetitive tasks.

When automating user inferfaces, the initial phase consists in understanding the logical sequence of steps that a human user would take. Then the next phase consists in translating these steps into activities and configuring them. UI automation activities can serve as containers, input, output, and synchronization activities, while the activity properties determine how the UiPath Robots perform an action.

The UI Automation activities include the following packages:

  • UI Automation
  • Computer Vision Local Server
  • Mobile Automation
  • Terminal

Project compatibility

Use the following table to identify the compatibility between the platform and the activity packages:

Activity packageWindows - Legacy Studio projectsWindows (Modern) Studio projectsCross-platform Studio projects
UI Automation

available

available

available

Computer Vision Local Server

available

available

not available

Mobile Automation

available

available

not available

Terminal

available

available

not available

About the UI Automation activity package

The UI Automation activity package offers an extensive range of capabilities that simulate human behavior. It provides powerful and comprehensive features designed to enhance productivity by building user interface automations, saving time and minimizing errors. Some of the most common use cases are:

  • Business process automation, such as customer service, accounting, order processing, employee onboarding, etc.
  • Web scraping, such as customer feedback analysis, price comparison, lead generation, product review scraping, etc.
  • Automated testing on user interfaces to ensure the applications function correctly

To learn more, go to the UI Automation package section.

About the Computer Vision Local Server package

The Computer Vision Local Server package contains no activities, but once installed in a project, enables you to use a local AI Computer Vision server.

AI Computer Vision is an AI skill that allows all UiPath Robots to capture the screen and visually identify all the UI elements, rather than relying on selectors or images. It is an algorithm that enables human-like recognition of user interfaces, using a mix of AI, OCR, text fuzzy-matching, and an anchoring system to tie it all together.

To learn more, go to the Computer Vision Local Server package section.

About the Mobile Automation activity package

The Mobile Automation activity package offers a robust set of activities for automating mobile application testing and interaction. It provides tools for testing Android and iOS applications, allowing actions like tapping, swiping, entering text, and validating mobile elements, among others. Key features of the activity package include:

  • Multi-platform mobile automation - automate mobile applications across Android and iOS platforms
  • Mobile element interaction - perform actions like tapping, swiping, scrolling, and entering text on target mobile elements
  • Mobile validation and verification - validate mobile element properties, verify expected values, and handle specific scenarios
  • Mobile device management - capture device information, manage device orientation, control network connectivity, install and uninstall applications, and handle device-specific settings
Get started with Mobile Automation

About the Terminal activity package

The Terminal activity package enables you to connect to a wide range of terminal environments using a direct connection or terminal emulators.

You can then use activities to perform actions such as retrieving text, colors, fields, or screen positions, sending keys, moving the cursor, or waiting for certain text or fields to appear as triggers.

To learn more, go to the Terminal package section.

Was this page helpful?

Get The Help You Need
Learning RPA - Automation Courses
UiPath Community Forum
Uipath Logo White
Trust and Security
© 2005-2024 UiPath. All rights reserved.