We need to test our native iOS and native Android app on a lot of different devices and have it done automatically or at least semi-automatically.
So we're looking for a good QA freelancer to write a lot of great tests and setup a ready-to-go test account with a good and not-to-expensive testing farm. It should show screenshots of the tests (preferable also video) and have simple easy-to-read test reports.
I'm not sure which test farm to use but I have looked at some very user-friendly ones like:
1) http://www.monkop.com/index.html (doesn't have iOS yet - but will soon)
2) https://testobject.com/ (looks VERY user friendly - and uses test in Robotium, Espresso and Appium)
3) http://testdroid.com/ (looks fine - but doesn't have video playback, iThink)
... and I don't know if AWS device farm is a good way to go? Or perhaps you have better suggestions?
I (no-coder) need to be able to figure out how it works and navigate the test farm platform and start tests and read test reports. So it needs to be simple and manageable for no-coders, too.
ABOUT THE APP:
The app (Android + iOS) is a social quiz game where players can play against each from their own devices. It utilizes:
- Custom login
- Facebook login
- Game invites
- Push messages
- Video ads
- Interstitials ads
- Chat area
- Turns going back and forth between 2 users
The apps are very dependent on the API functioning properly also. So as the apps are tested, the API is automatically tested, too.
Please notice, that somehow we actually also need to test gameplay somehow. That the right thing happens on user 2's device when user 1 has done something. So it needs to be able to test app vs. app.
You can see a bit about the app here: www.ipassionapp.com and download it here:
Please try out the app before making a proposal/bid to make sure that you completely understand the testing requirements.
Please bid on a complete initial set of tests that test as many crucial things as possible. And it should include setup - so it's easy for us to use.
After the project, you'll be asked to maintain and upgrade the tests based on hourly fee (for when we make changes, new features etc.)