SPONSORS:






User Tag List

Thanks Thanks:  0
Likes Likes:  0
Dislikes Dislikes:  0
Results 1 to 8 of 8
  1. #1
    SQA Knight
    Join Date
    Sep 2001
    Location
    Bangalore,India
    Posts
    2,579
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Anybody tried sikuli or any other image based tool along with TestComplete

    Hi All,
    Trying to automate a legacy desktop application. Certain tabs are identified as single window and unable to retrieve the childrent objects. Planning to use image based tool like Sikuli. Anybody tried and any suggestions..?
    Thanks & Regards,
    Palani.
    http://tips-testing.blogspot.com/index.html
    Quote: Donít hesitate to initiate!

  2. #2
    SQA Knight
    Join Date
    May 2006
    Location
    Playa Del Rey, California, United States
    Posts
    2,647
    Post Thanks / Like
    Mentioned
    17 Post(s)
    Tagged
    1 Thread(s)
    Total Downloaded
    0
    Quote Originally Posted by tmpalaniselvam View Post
    Hi All,
    Trying to automate a legacy desktop application. Certain tabs are identified as single window and unable to retrieve the childrent objects. Planning to use image based tool like Sikuli. Anybody tried and any suggestions..?
    The two I've tried was sikuli, sikuli boards, and egg plant. In the applications I've worked in, which is a combination of heavy form based applications (data heavy) and rapidly changing applications. Image based object recognition does not work so well.

    Pros and cons

    Pros:
    - works well with custom controls. Generally these are hard to work with with most automation tools.
    - good mixed platform applications. For example, a flash control living inside a web app, living inside an windows application thin client.
    - Probably few classes of tools that works with thin clients. (like citrix, remote access desktops, etc...)
    - Is sensitive to rendering errors. (for example, say a button text runs outside the button's boundaries, a visual recognition tool will fail on this, while a tool using automation hooks will not fail this.

    Cons:
    - Not good with data heavy apps. Although most has OCR capabilities, they have not proved consistently accurate over 100's of runs. (which is why I haven't used it beyond trials)
    - Hard to maintain when doing heavy platform combination testing. (ex: all supported browsers across all supported OS, mobile and desktop and tablet.)
    - Performance - generally slower and cannot run tests in parallel.
    - Harder to deploy in unsupervised CI. You end up having to mess with VMs and a lot of initialization code to ensure a clean environment.
    - Bad at handling unexpected events. Say for example, you are waiting for a log in window, then a error window unexpectedly pops up in front of that window. You'll have to wait for the call for the login window to timeout before you can handle the error window.

    My impression is the best use case for Visual recognition tools are for things that have a very customized UI and non-standard controls, such as games.
    David Lai
    SDET / Consultant
    LinkedIn profile

  3. #3
    SQA Knight
    Join Date
    May 2006
    Location
    Playa Del Rey, California, United States
    Posts
    2,647
    Post Thanks / Like
    Mentioned
    17 Post(s)
    Tagged
    1 Thread(s)
    Total Downloaded
    0
    BTW.. as for recognizing things that appear to be single windows. One of the best remedies of it is to add MSAA hooks into the UI. MSAA is an interface to allow UI object to be recognized by screen readers for the blind. (translates your UI text to braille)

    This documentation is very technical, but worth the read if you're doing heavy windows automation.
    UI Automation and Microsoft Active Accessibility

    Basically this is the interfaced used for implementing automation friendly UI components.
    David Lai
    SDET / Consultant
    LinkedIn profile

  4. #4
    SQA Knight
    Join Date
    Sep 2001
    Location
    Bangalore,India
    Posts
    2,579
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0
    Hi David,

    Thanks for your reply. I want to use image based recognition for the worst case..

    Using UIA Verify, able to recognize the child elements and need to check out Test complete settings & configurations for the same...
    Thanks & Regards,
    Palani.
    http://tips-testing.blogspot.com/index.html
    Quote: Donít hesitate to initiate!

  5. #5
    Member
    Join Date
    Oct 2002
    Location
    amsterdam
    Posts
    98
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

  6. #6
    SQA Knight
    Join Date
    May 2006
    Location
    Playa Del Rey, California, United States
    Posts
    2,647
    Post Thanks / Like
    Mentioned
    17 Post(s)
    Tagged
    1 Thread(s)
    Total Downloaded
    0
    Quote Originally Posted by tmpalaniselvam View Post
    Hi David,

    Thanks for your reply. I want to use image based recognition for the worst case..

    Using UIA Verify, able to recognize the child elements and need to check out Test complete settings & configurations for the same...
    In terms of implementation. You'll find that TestComplete although supports bunch of different languages, it's all still the same CRL runtime platform which is largely based on windows CRL. For incorporating tools such as Sikuli, best way to do it is to write shell commands that return the status as an exit code and use wshell object to wrap the commands.

    WshShell Object | TestComplete Documentation
    David Lai
    SDET / Consultant
    LinkedIn profile

  7. #7
    SQA Knight
    Join Date
    Sep 2001
    Location
    Bangalore,India
    Posts
    2,579
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0
    Thanks David.. Will consider, If goes for Image based object recognition..
    Thanks & Regards,
    Palani.
    http://tips-testing.blogspot.com/index.html
    Quote: Donít hesitate to initiate!

  8. #8
    Member
    Join Date
    Oct 2002
    Location
    amsterdam
    Posts
    98
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0
    Before worst case is needed I would suggest bitblt function to get multiple pixels at once and analyse picture yourself
    Using BitBlt to Copy and Paste Graphics - CodeProject
    Find BMP in another BMP (imagesearch) - AutoIt Example Scripts - AutoIt Forums

 

 

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Search Engine Optimisation provided by DragonByte SEO v2.0.40 (Pro) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.
Resources saved on this page: MySQL 12.00%
vBulletin Optimisation provided by vB Optimise v2.7.1 (Pro) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.
User Alert System provided by Advanced User Tagging v3.3.0 (Pro) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.
vBNominate (Lite) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.
Feedback Buttons provided by Advanced Post Thanks / Like (Pro) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.
Username Changing provided by Username Change (Free) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.
BetaSoft Inc.
Digital Point modules: Sphinx-based search
All times are GMT -8. The time now is 02:59 AM.

Copyright BetaSoft Inc.