Select from UI Elements

Description

Outputs a bounding box of x, y, width, height and text from the list of input bounding boxes that match the input operation options and matching value. Generally used with Detect UI Elements command

Input Ports

Name	dataType	sourceType	required	description
Operations	text	manual-only	true	The operation you wish to find the box with, you can select multiple operations
Text Operation	text	manual-only	false	The operation that should be used to find the text in the screenshot
Match Position	position	manual-only	false	The position of the box that should be targeted
Match size	size	manual-only	false	The size of the box that should be targeted
Match text	text	manual-only	false	The text of the box that should be targeted
UI Element boxes	box-list	link-only	true	The boxes that was detected using the Detect UI elements command
Screenshot URL	text	link-manual	false	The path to the screenshot that needs to be synced
Screenshot	position	link-manual	false	The size the screenshot must be cropped to

Scenarios

• The user wants to select a box element from a screenshot

Sync

• You are required to atleast run the command once to sync data into state which will allow you to choose the UI Element boxes on the screenshot.
  

Synced settings

Use case

It is required to make use of the Detect UI Elements command.

Inputs

• Operations: [Text]
• Text operation: equal
• Match text: Message
• Screenshot URL: /bucket-content/ad3acf564664467e93b58356f1dd14b0401164432f12bded8ca893ee58cff3ca.png
• Screenshot X: 1440
• Screenshot Y: 1024

Experienced tips

• If the operation is text and the process could not find any text on the image that matches the text provide, the process will stop and provide you with the following error. No UI Element matched
• Using any operation, you can click a box on the screenshot in the settings to set the value, the selected box will be indicated with green borders

Output

Search Tags

Select element from UI Element boxes