* spawn an arangosh that checks cluster nodes are responsive
* attempting to kill 0 may end up bad for us, prohibit it
* don't trip over this optional stuff.
* fix killing of spectator
* only write one line per minute
* fix function name
* print sHitlist of tests, add resource usage
* fix lint
* start refactoring result processing into its own library
* /proc reading only works on linux
* new result processing library
* clean up test loading flow, remove unused blacklist implementation
* measure SUT start/stop + test time
* lint
* more non-test variables
* improve test runner naming
* finish gathering statistics about start/run/stop
* use internal stats code for external processes too
* fix status in sample testcase
* tell that procdump is gone - it seems this happenes in reality without coredumps being written
* refactor test result analyzing, add utility to work with analyzers of json dumps from CI systems
* fix testcase error handling
* also run watcher for agency
* lint
* fix default options for test added default options
* if arguments occur multiple times, update value to an array
* start implementing some test analyzers
* fix color
* write json report unconditional
* add analyzer that searches for long setup/teardown tests
* enable thread dump; log error if we fail to acquire the threads
* disable procdump for the agency
* output error if we fail to get process stats
* fix json invocation
* add debug logging
* only add buildType if that directory actually exists
* trap sleepers
* trap sleepers
* trap sleepers
* trap sleepers
* trap sleepers
* disable thread counting on the wintendo
* disable thread counting on the wintendo
* more measurements
* more measurements
* one more place
* one more place
* remove debugging code
* Update js/client/modules/@arangodb/process-utils.js
Co-Authored-By: Dan Larkin-York <danielhlarkin@users.noreply.github.com>
* Update js/client/modules/@arangodb/process-utils.js
Co-Authored-By: Dan Larkin-York <danielhlarkin@users.noreply.github.com>
* Apply suggestions from code review
Co-Authored-By: Dan Larkin-York <danielhlarkin@users.noreply.github.com>
* rename as sugested by @dan
* undo debug changes
* lint, make cluster health monitor optional per default
* fix spawning of active failover SUT, fix cluster health monitor shutdown
* use std::find_if (as @dan sugested), fix log ids
* fix scope of before-time
* migrate mochaGrep into --testCase parametrizing
* fix filter forwarding for spawned arangoshs - add mocha version
* sometimes we have the string undefined to ignore
* apply filters before starting the server, so we can detect whether no test would be executed
* skipTimecritial and skipNondeterministic also qualify for non-errnous empty testcase
* simplify code, if is issued no matching testcase is an error
* Update test-utils.js
* make rspec timeouteable (on windows for now)
* add timeout state, fix windows implementation
* abort testrun if a timeout in rspec occured
* lint
* fix scope of procdump stopper
* fix include scope
* fix invokation
* use proper variable to wait for
* preserve the instance shutdown state, and if its bad, don't clean up the test directory
* Update js/client/modules/@arangodb/testing.js
Co-Authored-By: Tobias Gödderz <github@tobias.goedderz.info>
* Update js/client/modules/@arangodb/testsuites/permissions_server.js
Co-Authored-By: Tobias Gödderz <github@tobias.goedderz.info>
* Update js/client/modules/@arangodb/testsuites/permissions_server.js
Co-Authored-By: Tobias Gödderz <github@tobias.goedderz.info>
* Update js/client/modules/@arangodb/testsuites/single.js
Co-Authored-By: Tobias Gödderz <github@tobias.goedderz.info>
* fix handling in custom start/stop handlers
* remove shutdown state from reporting structure
* fix shutdown of second instance
* one more to adjust
* only add jwt if we run the agency with authentification
* lint
* Re-Add the now optional method to automatically analyze crashes
* the user or CI may now specify `--coreCheck true` if the testsuite
should perform automatic core analysis for him.
* improve english, fix object member to address as pointed out by @dan
Wilfried Goesgens
KVS85
jsteemann
Andrey Abramov
Frank Celler
Tobias Gödderz
Jan Christoph Uhde
Frank Celler
Simon
Jan
Vasiliy