- Overview
- UI Automation
- Applications and technologies automated with UI Automation
- Project compatibility
- UI-ANA-016 - Pull Open Browser URL
- UI-ANA-017 - ContinueOnError True
- UI-ANA-018 - List OCR/Image Activities
- UI-DBP-006 - Container Usage
- UI-DBP-013 - Excel Automation Misuse
- UI-DBP-030 - Forbidden Variables Usage In Selectors
- UI-PRR-001 - Simulate Click
- UI-PRR-002 - Simulate Type
- UI-PRR-003 - Open Application Misuse
- UI-PRR-004 - Hardcoded Delays
- UI-REL-001 - Large Idx in Selectors
- UI-SEC-004 - Selector Email Data
- UI-SEC-010 - App/Url Restrictions
- UI-USG-011 - Non Allowed Attributes
- UX-SEC-010 - App/Url Restrictions
- UX-DBP-029 - Insecure Password Use
- UI-PST-001 - Audit Log Level in Project Settings
- UiPath Browser Migration Tool
- Clipping region
- Computer Vision Recorder
- Activate
- Anchor Base
- Attach Browser
- Attach Window
- Block User Input
- Callout
- Check
- Click
- Click Image
- Click Image Trigger
- Click OCR Text
- Click Text
- Click Trigger
- Close Application
- Close Tab
- Close Window
- Context Aware Anchor
- Copy Selected Text
- Element Attribute Change Trigger
- Element Exists
- Element Scope
- Element State Change Trigger
- Export UI Tree
- Extract Structured Data
- Find Children
- Find Element
- Find Image
- Find Image Matches
- Find OCR Text Position
- Find Relative Element
- Find Text Position
- Get Active Window
- Get Ancestor
- Get Attribute
- Get Event Info
- Get From Clipboard
- Get Full Text
- Get OCR Text
- Get Password
- Get Position
- Get Source Element
- Get Text
- Get Visible Text
- Go Back
- Go Forward
- Go Home
- Google Cloud Vision OCR
- Hide Window
- Highlight
- Hotkey Trigger
- Hover
- Hover Image
- Hover OCR Text
- Hover Text
- Image Exists
- Indicate On Screen
- Inject .NET Code
- Inject Js Script
- Invoke ActiveX Method
- Key Press Trigger
- Load Image
- Maximize Window
- Microsoft Azure Computer Vision OCR
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- Minimize Window
- Monitor Events
- Mouse Trigger
- Move Window
- Navigate To
- OCR Text Exists
- On Element Appear
- On Element Vanish
- On Image Appear
- On Image Vanish
- Open Application
- Open Browser
- Refresh Browser
- Replay User Event
- Restore Window
- Save Image
- Select Item
- Select Multiple Items
- Send Hotkey
- Set Clipping Region
- Set Focus
- Set Text
- Set To Clipboard
- Set Web Attribute
- Show Window
- Start Process
- System Trigger
- Take Screenshot
- Tesseract OCR
- Text Exists
- Tooltip
- Type Into
- Type Secure Text
- Use Foreground
- Wait Attribute
- Wait Element Vanish
- Wait Image Vanish
- Application Event Trigger
- Check/Uncheck
- Check App State
- Check Element
- Click
- Click Event Trigger
- Drag and Drop
- Extract Table Data
- For Each UI Element
- Get Attribute
- Get Browser Data
- Get Text
- Get URL
- Go to URL
- Highlight
- Hover
- Inject Js Script
- Keyboard Shortcuts
- Keypress Event Trigger
- Mouse Scroll
- Navigate Browser
- Select Item
- Set Browser Data
- Set Runtime Browser
- Set Text
- Take Screenshot
- Type Into
- Use Application/Browser
- Perform browser search and retrieve results using UI Automation APIs
- Web Browsing
- Find Images
- Click Images
- Trigger and Monitor Events
- Create and Override Files
- HTML Pages: Extract and Manipulate Information
- Window Manipulation
- Automated List Selection
- Find and Manipulate Window Elements
- Manage Text Automation
- Load and Process Images
- Manage Mouse Activated Actions
- Automate Application Runtime
- Automated Run of a Local Application
- Browser Navigation
- Web Automation
- Trigger Scope Example
- Enable UI Automation support in DevExpress
- Computer Vision Local Server
- Mobile Automation
- Release notes
- Project compatibility
- Get Log Types
- Get Logs
- Get Page Source
- Get Device Orientation
- Get Session Identifier
- Install App
- Manage Current App
- Manage Other App
- Open DeepLink
- Open URL
- Mobile Device Connection
- Directional Swipe
- Draw Pattern
- Positional Swipe
- Press Hardware Button
- Set Device Orientation
- Take Screenshot
- Take Screenshot Part
- Element Exists
- Execute Command
- Get Attribute
- Get Selected Item
- Get Text
- Set Selected Item
- Set Text
- Swipe
- Tap
- Type Text
- Terminal
v23.4
Release date: April 3, 2024
For traceability and debugging speed purposes for Computer Vision runtime analysis, DesignTime ScreenId is now sent in the header of the HTTP request.
Release date: October 26, 2023
Release date: October 5, 2023
-
Fixed the broken Active Accessibility support for web pages containing IFrame elements or PDFs in Chrome and Edge version 117, which caused
<ctrl />
selectors to fail.Also added the option to pass extra command-line arguments to the browser opened using the Open Browser / Use Browser activities. This can be done by setting the appropriate environment variable using the Set Environment Variable activity:UIPATH_EXTRA_CMD_ARGS_CHROME
UIPATH_EXTRA_CMD_ARGS_EDGE
UIPATH_EXTRA_CMD_ARGS_FIREFOX
These variables can be used to force-enable the Active Accessibility support in Chrome and Edge to avoid issues like the broken Chrome/Edge Active Accessibility support from versions 114 and 117.
For Chrome, set the environment variableUIPATH_EXTRA_CMD_ARGS_CHROME
with the value--force-renderer-accessibility=complete
.For Edge, set the environment variableUIPATH_EXTRA_CMD_ARGS_EDGE
with the value--force-renderer-accessibility=complete
.
Release date: August 2, 2023
- Fixed a bug for the Send Hotkey activity that caused the .xaml file to be shown as unsaved.
- Fixed a bug for the Use Application/Browser activity that threw an exception at design time in StudioX due to the asterisk indicating that a property field is required.
- We added support for the CTable component of the Clarity Java application.
Release date: June 7, 2023
Release date: 7 June 2023
Release date: April 27, 2023
UI Automation Browser Connections can now be used in Cross-platform projects.
You can create and edit a connection only in Studio Web (currently in preview) and consume it both in Studio Web and Studio Desktop.
The feature can be run only with Serverless Automation Cloud™ Robots; attempting to run the feature with local robots results in failure.
For further information, please refer to the dedicated UI Automation Browser Connection documentation page.
Release date: April 27, 2023
- UiPath.UIAutomation.Activities - design time package
- UiPath.UIAutomation.Activities.Runtime - runtime package; targets Windows and Windows-Legacy projects
- UiPath.UIAutomation.Activities.Runtime.Portable - runtime for portable package; targets Cross-platform projects
UIPATH_OPEN_BROWSER_TIMEOUT_SECONDS
environment variable.
You can now use the Open Application and Use Application/Browser activities to open the Power BI Desktop application.
We added Check support for more browser checkboxes.
We improved the Select Item activity to support complex HTML dropdowns, like non-native and non-Sap Fiori/Salesforce dropdowns.
UiPathRemoteRuntime.msi
version.
The UI Explorer selector no longer includes the hidden root for tree nodes.
UI Explorer no longer restores Studio window after indicating an element.
Modifiers
field for event data is now mapped to the
NKeyModifier
enum and returns a string (such as Shift, Alt, or
Ctrl) instead of an integer when the toString()
method is called.
If a Modern activity is used in a project, this information is now included in the published package, and is then available in Orchestrator. This feature requires Studio 2023.4 or later.
webRequest
permission to the Chrome and Edge extensions to
allow using the webRequest
API. The Chrome and Edge extensions v2023.4
were published on the Web Stores with new extension IDs. The self-hosted extensions,
used for Group Policy Offline installations, have also been updated with this
permission, but they keep the same extension ID.
When installing extensions using the Native Host Only method, the file for the self-hosted extension is also generated, so that it can be added to the ExtensionInstallForceList policy.
Improved support for Chromium-based embedded browsers
We improved support for Chromium-based embedded browsers (Electron, CEF 103+) and added support for orphaned WebView2 windows.
We added support for Chromium Native versions 108, 109, and 110.
Cross-origin call forwarding for Chromium Native embedded browsers is now supported. This applies to CEF-native and Electron web controls.
We added support to automate CefSharp widgets embedded in applications with multiple UI threads.
We improved support for Electron applications that create multiple BrowserViews inside a single BrowserWindow. Each view can now be automated.
<wnd>
and
<ctrl>
tags, Web with <webctrl>
tags,
and Java with <java>
tags. The events are available through the
new Application Event Trigger activity, which helps set up a trigger based on a
native event for any type of UI element.
Also in the context of trigger-based attended automation, we have migrated the most used Classic triggers to the Modern framework. The new Click Event Trigger and Keypress Event Trigger modern activities are designed to identify the elements via a unified target concept, use an Object Repository element and offer a friendlier user interface.
An important reason we provide them as part of the trigger-based attended automation solution is that these triggers can block the original event and replay it later, or simply ignore it. This specific capability allows implementation scenarios like a form submission being stopped until all the fields are correctly filled in.
The old classic activities Click Trigger and Key Press Trigger are still visible in this version of the package if the Classic filter is added in Activities tab.
- When the activity is inside of a Trigger Scope, the activity doesn’t display the Scheduling mode and Enabled properties. In this case, the Scheduling mode property is available in the Trigger Scope activity.
- When the activity is added without a Trigger Scope, the Trigger Scope is automatically generated and the Scheduling mode and Enabled properties are displayed for the trigger activity.
- Hotkey Trigger
- Mouse Trigger
- Click Image Trigger
- System Trigger
- SAP Session Attributes Changed Trigger
- Element State Change Trigger
- Element Attribute Change Trigger
The Element State Change Trigger and Element Attribute Change Trigger activities, however, are now hidden from the activity package. If they are found in the workflow, they can be used, but they can no longer be added to the canvas.
The Set Text activity just got a modern version which can identify targets with the unified target concept and it can use an Object Repository stored element. Moreover, it can cache the target element to increase the execution speed when executing repeatedly, for example, when synchronizing text between multiple UI elements.
WPF applications can be automated through Active Accessibility, which works out of the box unless accessibility support is disabled for that application. For example, accessibility support can be lost following an application update, in which case you might not be able to target individual elements in specific areas.
<wpf>
attributes, resilient to change.
This feature is available through a new Project Setting: UI Automation Modern > Targeting methods - Desktop applications > Generate native WPF selectors (Preview). The default value for this option is False.
In v2023.4 this feature is under the Preview flag, as future versions may introduce breaking changes.
The Inject JS Script activities, both Classic and Modern, have a new Execution world property field, which allows you to set the JavaScript world for a script to execute within. The Isolated option is for the activity's previous functionality, allowing the content script to make changes to its JavaScript environment without conflicting with the page. The new Page option allows the script to interact with the page as well.
Another modern activity that was added to the activity package is Check Element. You can now check the state of enabled or disabled elements in a curated way and perform actions based on their state, for example, when creating an automation that navigates a multi-page application to scrape data and you reach the last page, the next page button gets disabled and you need to stop scraping.
UiElement
as
input. So, all Modern activities have been updated accordingly.
Added support for writing a list of elements when using the Get Attribute activity in StudioX and saving it to Excel.
Improved matching for the Image selector by using the scale factor ratio (design time over runtime).
Improved the return of object types for the Get Attribute activity based on the selected attributes.
Added a red indicator for duplicate column names in the Table Extraction recorder.
sapweb-ls
(for LightSpeed controls) or sapweb-
(for SAP Scripting controls), and the ability to reliably use UI Automation activities
with Hardware Events (Click, Type Into, Select Item, etc.). In this
release, we added specific support for the following elements: SAP buttons (icons, push
buttons, and radio buttons), SAP input fields, SAP dropdown lists, and SAP checkboxes.
We added specific support for SAP Fiori Calendars. Now, with the Select Dates in Calendar activity, you can easily automate calendars for all SAP Fiori-based systems, such as SAP S/4HANA or SAP SuccessFactors.
ui5c-
prefix and are represented in the JSON format. Note
that the content of the new attributes is persistent, but the strings aren't reliable.
For example, you could have {“a”:”value1”, “b”:”value2”}
for the first
call, and {“b”:”value2”, “a”:”value1”}
for the next call.
Computer Vision is now part of the Unified Target solution to help you reduce the complexity of building UI-based automations when you need both selectors and Computer Vision descriptors.
Adding Computer Vision to Unified Target increases the reliability and resilience to changes in UI-based automation: often, you do not control application UI changes; the UiPath robots must deal with these situations out of the box and not break, remaining uninfluenced by the UI deterministic changes.
Computer Vision can be a deep drill for targeting UI elements in the rare cases where the driver fails to ‘see’ certain UI elements or sometimes it can be the only viable technology like in the case of VDI automation. Other use cases of using Computer Vision span everywhere between these mentioned scenarios.
In terms of portability, any automation indicated in Native Windows can be reused in Remote Desktop environments by replacing the window selector.
In Project Settings > UI Automation Modern, the happy path for Computer Vision is to be enabled by default for Desktop applications, Java, and Web browsers and disabled by default for SAP as the happy path for SAP is using the strict selectors.
Computer Vision can be enabled as well from the Selection Options Helper new vertical bar design and it also has a keyboard shortcut (F8) to do so.
The CV Refresh activity is hidden from the package and can no longer be used in new projects.
If the Enable WebView2 Native Automation setting (from Project Settings > UI Automation Classic > Browser) is set to True, web selectors are generated by default for trigger activities. Because the UI Automation trigger activities don't currently support embedded browser apps, the events aren't triggered if default generated selectors (web selectors) are used. As a workaround, AA selectors can be used by changing the UI Framework from Default to Active Accessibility while indicating the target UI Element. Support for embedded browser apps for UI Automation trigger activities will be added in a future version.
Click
and Mouse released
events triggered for the
middle and right buttons when used from the Application Event Trigger monitoring
activity, as follows: an action with the middle button, without modifiers, reports an
alt
modifier; however, the same action executed with the middle
button and an alt
modifier reports correctly. An action with the right
button, without modifiers, reports a win/meta
modifier; the same action
executed with the right button and a win/meta
modifier reports
correctly.
SendWindowMessages
for WPF native is not currently supported.
- You can now automate Acrobat Reader with version newer than 2022.003.20258 even if you have the Enable Protected Mode option enabled by default. For details, see Security Option in Adobe Reader DC.
- The Click activity failed on specific form elements when used with the Simulate input method. Now you can use the Enable workaround for simulate click with MV3 extension option in Project Settings.
- With some websites, selector validation failed in Edge IE Mode. This issue occurred when a web page URL opened in Edge IE Mode was redirected to another URL compared to the one in Edge Chromium.
- Browser automation activities intermittently failed to communicate with the Chrome extension, causing the following error: "Cannot communicate with the browser, please check the UiPath extension." This issue occurred on slower machines or machines with a high CPU load. To overcome this, the Chromium browser communication timeout was increased to 30 seconds.
- Fixed a bug that prevented you from indicating tab elements in the Internet Explorer Developer Tools window.
- With the UIAutomation Classic
> Browser > Enable WebView2 Native Automation Project Setting set
to True, in certain SAP Fiori pages opened inside SAP Business Client,
WND
andCTRL
selectors were generated instead ofHTML
andWEBCTRL
. - Fixed a bug that caused selector generation to fail for Remote Desktop when the Remote Desktop Client was published as a RemoteApp.
- Fixed a bug that caused the UiPath Executor to crash when using a Get Visible Text activity on a Java application.
- For Java Runtime Environment
versions 13 to 19, indicating a table cell when the cell editor is opened at
that cell now returns a valid element, with the role corresponding to the editor
(such as
text
). Before, the resulting element was unusable. - Fixed an issue which caused the Click Trigger activity to slow down the target application when opening a web page in Edge IE mode with Protected Mode turned off.
- Fixed an issue with Table
Extraction which prevented extracting values from an input field. Before
the fix, the default
text
attribute generated in the metadata used theinnerText
HTML property to retrieve the text. Starting with v2023.4, newly generated workflows and activities usefulltext
as the default attribute. This new attribute uses the same approach as the full-text scraping method. To use theinnerText
property in new activities, you can manually edit the metadata and change the attribute name fromfulltext
to text. - Fixed a bug in Data Scraping that was causing the Join data table wizard to fail with ‘column not found’ error message due to column index being incorrectly marked as column name.
- Fixed a bug that was causing, in some cases, the CV Extract Table activity to stop before the first scroll event when extracting scrollable tables.
- Fixed a bug for the Click activity that was causing the activity to get stuck on a specific element when Input mode was set on Simulate. To solve the problem, the new UnblockInput property has been added to the classic Click activity, which should be used when Click triggers a modal dialog box or other blocking UI.
- Fixed a bug for Modern activities that was causing them not to work properly when culture info interpreted comma as decimal separator.
- Fixed a bug for the Attach Browser activity that was generating a memory leak when using a Browser variable.
- Fixed a bug for the Find OCR Text Position activity that was causing the activity to find an incorrect position when the text includes a special character, such as %.
- Fixed a bug in Object Repository that was causing the Design Data attribute not to be updated correctly when editing a target.
- Fixed a bug for the Type Into,
Keyboard Shortcuts, and Mouse Scroll activities that was throwing
an invalid warning stating
Click Offset is not supported on Simultate Input mode
. - Fixed a bug in CV Screen Scope that was causing the local server to keep returning OCR boxes even when UiPath Screen OCR was removed from the activity card or from Project Settings.
- v23.4.11
- Improvements
- Bug fixes
- v23.4.10
- Improvements
- v23.4.9
- Bug fixes
- v23.4.8
- Bug fixes
- v23.4.7
- Bug fixes
- v23.4.6
- Improvements
- v23.4.5
- New features and improvements
- v23.4.4
- General improvements
- Browser extensions
- Trigger-based attended automation
- Native WPF support
- UI Automation Modern
- SAP
- Computer Vision
- Known issues
- Bug fixes