My top "problems", in some shape or form, from existing products:
- Be faster to complete builds
- Have fewer false positives (or do accurate self-healing magic)
- Be easier to get started with (or be optionally codeless like Selenium IDE)
- Don't be a walled garden (what if I want to run the same logical 'test' across Playwright and Cypress)
- Help me write better tests (or be difficult to write bad tests within)
- Emulate mobile devices better than just viewport modification
What do the HN folks think?
I don't want this in a testing tool. If something isn't working the way I built a test for then I want to know, even if it still technically works for the user.
Don't be a walled garden (what if I want to run the same logical 'test' across Playwright and Cypress)
This isn't important. It's fine to say "You'll need two copies of your test", and it's not that hard to write tests to be 'isomorphic' so they'll run in multiple places. The fact is the number of people who run multiple test tools, or even move from one tool to another, is tiny.
Being open is great, but there's no reason to change the design of your tool to make it easier to move. Just make it good, and leave porting tests between tools to the user.