- Overview
- UI Automation
- Applications and technologies automated with UI Automation
- Project compatibility
- UI-ANA-016 - Pull Open Browser URL
- UI-ANA-017 - ContinueOnError True
- UI-ANA-018 - List OCR/Image Activities
- UI-DBP-006 - Container Usage
- UI-DBP-013 - Excel Automation Misuse
- UI-DBP-030 - Forbidden Variables Usage In Selectors
- UI-PRR-001 - Simulate Click
- UI-PRR-002 - Simulate Type
- UI-PRR-003 - Open Application Misuse
- UI-PRR-004 - Hardcoded Delays
- UI-REL-001 - Large Idx in Selectors
- UI-SEC-004 - Selector Email Data
- UI-SEC-010 - App/Url Restrictions
- UI-USG-011 - Non Allowed Attributes
- UX-SEC-010 - App/Url Restrictions
- UX-DBP-029 - Insecure Password Use
- UI-PST-001 - Audit Log Level in Project Settings
- UiPath Browser Migration Tool
- Clipping region
- Computer Vision Recorder
- Activate
- Anchor Base
- Attach Browser
- Attach Window
- Block User Input
- Callout
- Check
- Click
- Click Image
- Click Image Trigger
- Click OCR Text
- Click Text
- Click Trigger
- Close Application
- Close Tab
- Close Window
- Context Aware Anchor
- Copy Selected Text
- Element Attribute Change Trigger
- Element Exists
- Element Scope
- Element State Change Trigger
- Export UI Tree
- Extract Structured Data
- Find Children
- Find Element
- Find Image
- Find Image Matches
- Find OCR Text Position
- Find Relative Element
- Find Text Position
- Get Active Window
- Get Ancestor
- Get Attribute
- Get Event Info
- Get From Clipboard
- Get Full Text
- Get OCR Text
- Get Password
- Get Position
- Get Source Element
- Get Text
- Get Visible Text
- Go Back
- Go Forward
- Go Home
- Google Cloud Vision OCR
- Hide Window
- Highlight
- Hotkey Trigger
- Hover
- Hover Image
- Hover OCR Text
- Hover Text
- Image Exists
- Indicate On Screen
- Inject .NET Code
- Inject Js Script
- Invoke ActiveX Method
- Key Press Trigger
- Load Image
- Maximize Window
- Microsoft Azure Computer Vision OCR
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- Minimize Window
- Monitor Events
- Mouse Trigger
- Move Window
- Navigate To
- OCR Text Exists
- On Element Appear
- On Element Vanish
- On Image Appear
- On Image Vanish
- Open Application
- Open Browser
- Refresh Browser
- Replay User Event
- Restore Window
- Save Image
- Select Item
- Select Multiple Items
- Send Hotkey
- Set Clipping Region
- Set Focus
- Set Text
- Set To Clipboard
- Set Web Attribute
- Show Window
- Start Process
- System Trigger
- Take Screenshot
- Tesseract OCR
- Text Exists
- Tooltip
- Type Into
- Type Secure Text
- Use Foreground
- Wait Attribute
- Wait Element Vanish
- Wait Image Vanish
- Application Event Trigger
- Check/Uncheck
- Check App State
- Check Element
- Click
- Click Event Trigger
- Close Popup
- Drag and Drop
- Extract Table Data
- For Each UI Element
- Get Attribute
- Get Browser Data
- Get Text
- Get URL
- Go to URL
- Highlight
- Hover
- Inject Js Script
- Keyboard Shortcuts
- Keypress Event Trigger
- Mouse Scroll
- Navigate Browser
- Select Item
- Set Browser Data
- Set Runtime Browser
- Set Text
- Take Screenshot
- Type Into
- Use Application/Browser
- Perform browser search and retrieve results using UI Automation APIs
- Web Browsing
- Find Images
- Click Images
- Trigger and Monitor Events
- Create and Override Files
- HTML Pages: Extract and Manipulate Information
- Window Manipulation
- Automated List Selection
- Find and Manipulate Window Elements
- Manage Text Automation
- Load and Process Images
- Manage Mouse Activated Actions
- Automate Application Runtime
- Automated Run of a Local Application
- Browser Navigation
- Web Automation
- Trigger Scope Example
- Computer Vision Local Server
- Mobile Automation
- Release notes
- Project compatibility
- Get Log Types
- Get Logs
- Get Page Source
- Get Device Orientation
- Get Session Identifier
- Install App
- Manage Current App
- Manage Other App
- Open DeepLink
- Open URL
- Mobile Device Connection
- Directional Swipe
- Draw Pattern
- Positional Swipe
- Press Hardware Button
- Set Device Orientation
- Take Screenshot
- Take Screenshot Part
- Element Exists
- Execute Command
- Get Attribute
- Get Selected Item
- Get Text
- Set Selected Item
- Set Text
- Swipe
- Tap
- Type Text
- Terminal
v22.4
Release date: August 8, 2024
Release date: October 5, 2023
-
Fixed the broken Active Accessibility support for web pages containing IFrame elements or PDFs in Chrome and Edge version 117, which caused
<ctrl />
selectors to fail.Also added the option to pass extra command-line arguments to the browser opened using the Open Browser / Use Browser activities. This can be done by setting the appropriate environment variable using the Set Environment Variable activity:UIPATH_EXTRA_CMD_ARGS_CHROME
UIPATH_EXTRA_CMD_ARGS_EDGE
UIPATH_EXTRA_CMD_ARGS_FIREFOX
Release date: August 2, 2023
- For MV3 extensions, the browser loads the extension later, after the web pages
have loaded. To solve this kind of issues, we added the
UIPATH_OPEN_BROWSER_TIMEOUT_SECONDS
environment variable that allows configuring the Open Browser timeout. - A "Value does not fall within the expected range" error occurred when using the Data Scraping wizard (Extract Structured Data activity) in Microsoft Edge in IE Mode.
- An error occurred when using the Data Scraping wizard (Extract Structured Data activity) on a table with an empty column header.
- We added support for the CTable component of the Clarity Java application.
Release date: June 8, 2023
Release date: January 27, 2023
- Fixed a bug which caused selector validation to fail in a Citrix application when two Citrix client windows were available, but only one of them actually matched a remote window.
- Support for Chrome/Edge running in App Mode is now available in the self-hosted MV2 browser extension installed via Group Policy Offline.
- Fixed a bug that was causing, in some cases, the CV Extract Table activity to stop before the first scroll event when extracting scrollable tables.
Release date: August 3, 2022
Release date: June 23, 2022
Release date: May 23, 2022
Release date: May 9, 2022
The new UiPath Extension for Chrome, based on Chrome's Manifest v3 standard, has been released. This extension is fully backwards compatible, and we highly recommend you to upgrade and use it with your automation processes.
In light of the new cross-platform project type, the UI Automation package has gone through changes and now has a multitude of activities tailored to this new project type. You can read all about it here. Also, to increase the capabilities of the cross-platform projects, the new Extension for Chrome is also available on Mac
Extension management in Studio is now better than ever! The entire user experience has been revamped, offering a smoother interaction overall.
The new For Each UI Element activity enables you to iterate through a set of actions for each UI element you have specified.
The new Inject Js Script Modern activity now offers you full JavaScript capabilities when using the Modern design experience.
A new activity, Drag and Drop has been created to enable you to perform the common drag and drop action, aiding in completing the pallete of actions that simulate human interaction.
A new Project Setting is now available, Runtime browser, enabling you to specify the browser type you want to use at runtime with the Use Application/Browser activity.
You can now use the Use Application/Browser activity with the WebDriver protocol via a new property.
The UI Automation Modern activities package now supports both design time and run time automation in multiple Windows Desktops.
One of the most highly requested features: scroll in Selection Screen, is finally here. Now, when indicating an element, you can scroll the target application without having to pause the selection using F2.
When using the Capture All Elements feature, you can now indicate a specific section of the application you are automating and extract only the elements in that area.
The Capture All Elements feature now only detects the tab in the browser you are indicating, so that toolbars and other additional, unrelated elements displayed in your browser are no longer captured.
The Take Screenshot activity can now be used outside of an Use App/Browser activity, so you can use it to take screenshots of your desktop at any time.
Object Repository now is able to display more than 5 results for multiple screens that have the same selector.
When dropping an Object Repository item over the plus sign in Studio, you are now prompted to automatically create variables based on that object.
The Mouse Scroll activity now supports adding key modifiers to the scroll action via the new Key modifiers property.
items
attribute
if the indicated element supports it.
The Click, Type Into, Check/Uncheck, and Select Item activities now have a new property field, Alter disabled element, which specifies whether you want to interact with UI elements that are disabled in the UI but can still be accessed by the Robot. Also, a new project setting has been added to the Modern activities enabling you to control this property project-wide.
A new project setting has been introduced, called Log audit information, which disables any logs generated by the Use Application/Browser activity. Also, the default logging level of the Use Application/Browser activity is now set to Verbose.
You can now switch between the available frameworks when using the Table Extraction Wizard by using the F4 hotkey.
In the Selection Screen, you can now simply click to select or deselect a highlighted target or anchor, and if you click on an empty area while outside of the add-anchor mode, you can deselect the current selection and view the helper.
The Timeout property of the Use Application/Browser activity is now automatically set to 60 seconds when indicating a window in a Remote Desktop environment.
The Select Item activity can now interact with Salesforce Lightning grouped combo boxes, as well as menu combo boxes.
visibleInnerText
, which reflects the actual innerText of the underlying HTML element, was added to UI Explorer.
Chrome Debugger API can now be used to send input to browser tab objects.
.exe
name.
We've added support for Azure Windows Virtual Desktop client, which means you can now natively automate Azure Virtual Desktops with UI Automation activities by using the UiPath Remote Runtime and the RDP extension.
URLs can now be extracted from HTML tables. This was possible before only for structured data.
HTML elements with tag name 'HTML' are visible in UI Explorer for Chrome.
.jnlp
type applications.
Added new injection mechanism for the UiPath extension for Java to facilitate the interaction with the application.
Improved support for Java Konsis and the custom Java Framework McBeans.
The UI Automation activities package now supports automating in nested CitrixApps.
Improved error messages for Setup Extensions and SAP WinGUI.
Implemented automatic fallback to alternative selection methods (AA for Google Chrome or Microsoft Edge and UIA for Firefox) when indicating a special tab in each of these browsers.
The Delayed Restore option from UI Explorer is now enabled by default.
Java versions 16 and 17 are now officially supported by the UI Automation activity package.
The CV Extract Table activity now has two new properties. Scroll specifies whether you want to extract a scrollable table, and DelayScreenshotAfterScroll, which enables the activity to wait for a specific amount of time after performing a scroll action before taking a screenshot of the target table. The latter is useful for tables that load extra items when scrolling down. Also, when using the CV Extract Table activity, you can now use cell targeting by column and row indexes without the need to hold down the Shift key anymore.
Hitting Delete in the CV Selection Screen now deletes the current selection for quicker workflow building.
The CV Recorder no longer requires an API Key if Interactive Sign-In is used in Studio.
Computer Vision activities can now be used in StudioX by enabling the Show Developer filter.
When using CV Screen Scope, you can now toggle between Window, Element and Region Selection Types by using F3.
A new activity meant to help you identify any cell inside SAP ALV Hierarchical Table is available: Expand ALV Hierarchical Table. After you identify the cell, this activity can be used with all typical UI activities.
All SAP WinGUI activities support Object Repository integration.
A new project setting, Enforce hard timeout, is now available, enabling you to enforce a hard timeout for all activities performing SAP WinGUI automation.
- Starting with this version, sending modifier keys with the Click activity when the Input mode property is set to Simulate also sends the modifier keys using Simulate. In previous versions, the modifier keys were sent by using Hardware Events, regardless of the configuration of the Input Mode property, so please note that workflows created with previous versions might suffer breaking changes.
- Fixed a bug that caused a Chromium-based custom browser to be recognized as a regular Windows application after upgrading to UiPath Studio v2019.x.
- Fixed a bug for Internet Explorer with Developer Tools opened that caused multiple console windows to spawn when opening UI Explorer.
- Fixed a bug for the Send Hotkey activity
that was causing the text not to be pasted into
cmd.exe
when changing the keyboard. - Generating
GetHtmlAncestryInfo
selectors timed out on a specific UI element from a large table. - Fixed a bug that caused some buttons not to be
clicked or validated in Java Desktop Application
by adding a new java attribute,
hasTableAncestor
, which is used to bypass tables when searching elements that have the attribute value set to 0. - Fixed a bug in Internet Explorer 8 for the Type Into activity with Simulate as input mode that prevented the keycode 8 from being typed into a search box.
- Fixed a bug that prevented you from indicating the empty ViewPort space.
- Fixed a bug that prevented you from reading the correct state of a checkbox inside a table in Java applications.
- To clear the text from web pages elements, you can use empty strings with the Set Text activity again, just like in UI Automation v18.4.
- Fixed a bug that caused the UiPath Executor to crash while indicating elements in a Java application that opens another application, which uses native libraries to draw elements on the screen.
- Fixed a bug that prevented you from capturing the selectors from Chrome when in full screen mode.
- Fixed a bug in Data Scraping that was throwing a timeout error when extracting extremely large HTML tables.
- Fixed a bug that was causing the job to stop due
to searching for
<ctrl>
selectors in parallel. - Fixed a bug that was crashing the target application in specific cases when trying to capture a selector using Active Accessibility.
- Fixed a bug that prevented you from identifying certain parts of a Java application.
- Fixed a bug in Internet Explorer that was causing the Activate Window event to fail with a timeout error, after applying the Microsoft Update KB5005031.
- Fixed a bug in Firefox support, that caused SalesForce attributes to not appear on selector nodes and on default selectors.
- Fixed a bug that prevented you from automating
certain web pages rendered in Edge/IE mode, when
the URL contains space characters
%20
. - Fixed a bug that prevented you from capturing onscreen values from a Java application.
- Fixed a bug for Internet Explorer mode on Edge that caused the selector validation to fail.
- Fixed a bug that was throwing a
SelectorNotFound
exception in the Maestro Java application when the structure of the page is very heavy with UI elements. - Data Scraping did not generate an Extract Structured Data activity when working with certain applications.
- Fixed an issue which caused the Type Into
activity to be unable to type the letter
E
on certain web pages. - Fixed an issue which caused Studio to freeze when indicating an anchor in certain apps.
- Detection did not work on Microsoft Edge and Google Chrome opened in App Mode.
- Trying to interact with certain Excel files caused Citrix Remote Runtime to crash.
- Using a Click OCR Text activity with an invalid ApiKey caused a timeout error.
- When taking multiple screenshots with the Take Screenshot activity, the naming convention was used starting with the second screenshot.
- The runtime browser switcher failed to work as expected on browsers via an RDP connection when using certain activities.
- When using Computer Vision activities, after editing a Descriptor, the change was not reflected neither in the informative screenshot or the Selection Screen.
- When using CV Screen Scope, indicating the full window for some Windows Native apps was very difficult because CV was using Element as Selection Type.
- Fixed an issue which caused the CV Extract Table activity to stop working when the maximum height limit was surpassed when extracting scrollable tables.
- Fixed an issue which caused certain Salesforce attributes to be unavailable in Firefox and Chrome.
- When using Image activities in Chrome, if the same image existed both inside and outside the specified clipping area, the wrong image was sometimes used.
- To indicate an individual cell or sheet name in Excel 2016, you need to manually set AA as the selection mode. In v19.5.0, the default visual selection used AA. Starting with v21.10.4, the default visual selection uses UIA.
- When automating Chrome with the latest Extension for Chrome, the Modern Click activity used with the Simulate input method fails on specific form elements. As a workaround, you can use the Hardware Events or Chromium API input methods.
- Some selectors generated at design time with UI Automation v20.10 for SAP Fiori and the newest Chrome Extension can have some extra attributes which cause them to stop working when run with older versions of the Chrome Extension at runtime. As a workaround, the newest Chrome Extension should also be used at runtime, or the Selectors should be generated with at least UI Automation v21.10 at design time.
- Events are not detected when monitoring selectors from SAP NetWeaver Business Client to SAP Fiori, both locally and over Remote Desktop connections, or selectors from SAP NetWeaver Business Client to SAP GUI over Remote Desktop connections.