Running a large complex content website with frequent code deployments and content updates. We do have manual testing in place, but I would like to add some automated testing.
Things I'll want to test:
* pages loading properly without errors
* module-based content shows (as in excerpt of latest blog posts show on the home page etc.)
* page modules like accordions and carousels function properly
* navigation functions properly
* forms submit (might have to forego this one as most forms depend on recaptcha submission)
What I have looked at:
Selenium -- the firefox ide seems a bit buggy
Katalon studio -- the files it produces are not fully compatible with Selenium (last time I checked).
We do have Ruby experience so also considering watir although not much experience with it. IDE-based test creation would be much faster though.
What do you use for website testing? I am interested not only in tooling , but also process: how do you create the tests, what do you test, how often, how do you audit the results?
How do you maintain the tests (content changes frequently).
Thank you.
How do you go about? Pretty simple. Define criteria, run Chrome Headless against it, and check results. Jest is a nice add on in your toolchain!
As there are many use cases and a million criteria to test agains, coming up with a one size fits all solution is difficult. Katalon is perhaps closest to it, but it has many shortcomings.
Some food for thought. Rely more on screenshots and compare them with what you expect. I'm writing a simple downtime checker as we speak and one of the key features is very basic analytics that compares screenshot to blank screens, generic error pages, parked domain landing pages, etc.