You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the app allows image-based targeting for click actions but restricts drag gestures to fixed coordinates. This feature proposes extending image recognition capabilities to drag operations, enabling users to:
Define drag start positions using detected images
Define drag end positions using detected images
Optional coordinate fallback if image matching fails
This should behave similarly to existing click-image targeting, but for swipe/drag actions. The controls should appear in the drag gesture configuration section, with visual previews of detected image matches during setup.
Detecting the source folder icon as drag start
Detecting the destination folder icon as drag end
Concrete Example 2: Social Media
Automate Instagram Stories browsing (https://instagram.com):
Detect the right-side edge "hot zone" as drag start
Detect left-side edge as drag end for back-swipe
Activity