HN Explorer

What tools do you use to aggregate test results?

1 points by ickyforce ↗ HN
I'm looking for a tool which would present results of automated system tests that talk to a real environment via API. Think E2E but without UI. Ideally I'd like to use a standard framework for such tests (like junit, jest, rspec) and upload the results somewhere. Devs would be able to browse them, filter by environment, version and other tags, view logs or attached comments, see execution history for a single test and maybe some basic reports.

I've found https://reportportal.io/ which seems like an ideal fit but will be complex to manage (microservices + postgres + rabbit + elasticsearch). TestRail might be good, will need to evaluate it, although it's more expensive than I would expect. I think that TeamCity has a decent view of test results but it's a full-blown CI system, more than I need.

Is there some other tool that you'd suggest? Preferably a managed offering.

3 comments

[ 3.5 ms ] story [ 22.0 ms ] thread
jordhy
SauceLabs, TestNG, etc
forgotmypw17
what about, now wait, hear me out:

   test_results/timestamp/framework/enviro/version/log.txt
example:

    test_results/1610687003/junit/prod1/1234abcd/log.txt
You can browse, filter, view logs and comments, see history for a single tests.

If you want to build reporting on top of text files, pick one of out of a million tools which accept them as input.

No management, no microservices, no database, and easy to archive and compress, de-archive.

ickyforce
> If you want to build reporting on top of text files

The thing is - I don't want to build it (in this case a bunch of scripts that would parse and manage these logs). I want to use something that exists.