1
0
Fork 0
Commit Graph

61 Commits

Author SHA1 Message Date
Wilfried Goesgens d9057ad695 fix runInArangosh result evaluation (#9589) 2019-07-29 15:56:22 +03:00
Wilfried Goesgens 9781b9890c Bug fix 3.5/connect mocha results to testing js (#9493)
* connect the mocha testresults if we run it in an extra arangosh instance

* fix status handling, lint

* sometimes we have the string undefined to ignore

* fix filter forwarding for spawned arangoshs - add mocha version

* migrate mochaGrep into --testCase parametrizing
2019-07-18 19:49:03 +03:00
Wilfried Goesgens 623048aff8 fix 6561f21536 - only abort on timeout, not regular exit failures (#9434)
* fix 6561f21536 - only abort on timeout, not regular exit failures

* make pre-check exception distinguishable, its got no ready existing test status
2019-07-10 18:48:46 +03:00
Andrey Abramov b3690fc24f
bug-fix/internal-issue-#595 (#9440)
* address ASAN failures in tests

* Add --isAsan for testing.js

* Fix typo
2019-07-10 01:11:22 +03:00
Wilfried Goesgens c2b645062b if there is no testcase, we still 'splitted' the bucket (#9425) 2019-07-08 16:44:54 +03:00
Wilfried Goesgens 3599aedda1 Don't wait eternaly; don't unload collections with rocksdb (#9415) 2019-07-05 17:13:24 +02:00
Wilfried Goesgens 3f9b85967d apply filters before starting the server, so we can detect whether no test would be executed (#9387)
* apply filters before starting the server, so we can detect whether no test would be executed

* skipTimecritial and skipNondeterministic also qualify for non-errnous empty testcase

* simplify code, if  is issued no matching testcase is an error

* Update test-utils.js
2019-07-03 14:13:16 +02:00
Wilfried Goesgens 6561f21536 Feature/make rspec timeouteable (#9354)
* make rspec timeouteable (on windows for now)

* add timeout state, fix windows implementation

* abort testrun if a timeout in rspec occured

* lint

* fix scope of procdump stopper

* fix include scope

* fix invokation

* use proper variable to wait for
2019-06-28 15:01:04 +02:00
Wilfried Goesgens f947954f6c fix the option to specify a ruby executeable from the outside in instead of leaning on rspec.bat to do its job (#9315) 2019-06-24 20:39:30 +02:00
Frank Celler 7dbb26c0c0 added missing semicolon 2019-05-29 22:58:56 +02:00
Tobias Gödderz bdfa6c6951 Collect all tests that are skipped due to a previous crash (#9011) 2019-05-29 15:32:57 +02:00
Wilfried Goesgens 065b87f9a8 preserve the instance shutdown state, and if its bad, don't clean up the test directory (#9122)
* preserve the instance shutdown state, and if its bad, don't clean up the test directory

* Update js/client/modules/@arangodb/testing.js

Co-Authored-By: Tobias Gödderz <github@tobias.goedderz.info>

* Update js/client/modules/@arangodb/testsuites/permissions_server.js

Co-Authored-By: Tobias Gödderz <github@tobias.goedderz.info>

* Update js/client/modules/@arangodb/testsuites/permissions_server.js

Co-Authored-By: Tobias Gödderz <github@tobias.goedderz.info>

* Update js/client/modules/@arangodb/testsuites/single.js

Co-Authored-By: Tobias Gödderz <github@tobias.goedderz.info>

* fix handling in custom start/stop handlers

* remove shutdown state from reporting structure

* fix shutdown of second instance

* one more to adjust

* only add jwt if we run the agency with authentification

* lint
2019-05-29 15:59:34 +03:00
Jan Christoph Uhde 677a79026c Foxx Security (#8845) 2019-04-25 09:56:29 +02:00
Frank Celler 6eb986825e
grey only (#8786)
* grey only

* Update testing.js
2019-04-17 19:29:36 +02:00
Simon 2b594bdab5 Reduce # of memcpy from storage engine layer (#8685) 2019-04-08 22:43:29 +02:00
Wilfried Goesgens 9c0fb4a97e Feature/sort buckets dump agency allways (#8677) 2019-04-04 14:50:04 +02:00
Wilfried Goesgens b1440755fc improve timeout behaviour of test utils (#8614) 2019-03-28 17:01:44 +01:00
KVS85 4ea1675e74 Allow replication suite filtering (#8586) 2019-03-26 20:25:14 +03:00
Wilfried Goesgens c2042c86e9 abort testing if we fail to get the currently available collections during server startup (#8442) 2019-03-18 15:14:08 +01:00
Jan f7d94daba2
port some changes from 3.4 (#8011) 2019-01-29 09:26:57 +01:00
Jan fb04c1c602
Bug fix/forward port missing changes (#7706) 2018-12-10 12:51:20 +01:00
Wilfried Goesgens a905b2ca35 Bugfix/fix recovery testsuite (#7396) 2018-11-22 11:18:28 +01:00
Wilfried Goesgens 270301b312 when checking for test leftovers catch dead server connections and abort tests cleanly (#7283) 2018-11-20 10:42:55 +01:00
Frank Celler a6e4c844ad Feature-3.4/whiteblacklist (#7259)
* add blacklist

* added --skipGrey
2018-11-08 00:01:29 +01:00
Wilfried Goesgens ecade47aaf don't spawn additional arangosh processes to run the tests (#7185) 2018-11-02 13:08:04 +01:00
Wilfried Goesgens 55a45f1a84 properly check wether the replication follower instance is still alive (#6938) 2018-10-17 14:14:09 +02:00
Wilfried Goesgens d1b3a1ee98 Don't talk to a server when we know its dead. Print current testsuite on Falure. (#6879) 2018-10-15 14:29:16 +02:00
Wilfried Goesgens 676f61805e Make procdump abort on std::bad_cast; kill SUT if it occurs; Make procdump optional. (#6602) 2018-10-10 17:55:53 +02:00
Wilfried Goesgens 056ee7064c Feature/log timestamp on test start (#6759) 2018-10-08 16:18:04 +02:00
Frank Celler ca34956f3c fixed wrong result code 2018-09-01 16:16:29 +02:00
Jan 494764b95c
Bug fix/fiddle version string into test paths (#6267) 2018-08-28 14:58:35 +02:00
Jan 0a73e64b0b Bug fix/fiddle version string into test paths (#6266)
* fiddle version string into test paths
2018-08-28 09:27:32 +02:00
Vasiliy a291f6dcfa issue 431.1: remove error generation for empty jSON (#6007) 2018-07-26 19:03:35 +03:00
Wilfried Goesgens 93f9da4078 set the disableCores parameter properly (#5965) 2018-07-24 17:50:33 +02:00
Wilfried Goesgens 5e296cb0c9 add ability to filter jsunity testsuites by testcase (#5807) 2018-07-12 13:35:29 +02:00
jsteemann 0e59b674cc execute enterprise tests again 2018-06-22 19:27:00 +02:00
Wilfried Goesgens eb9bf93c98 Feature/cleanup rspec integration (#5517) 2018-06-07 11:47:46 +02:00
Wilfried Goesgens b2777c41bd Re-Add the now optional method to automatically analyze crashes (#5435)
* Re-Add the now optional method to automatically analyze crashes

* the user or CI may now specify `--coreCheck true` if the testsuite
  should perform automatic core analysis for him.

* improve english, fix object member to address as pointed out by @dan
2018-06-06 17:32:12 +02:00
Wilfried Goesgens 991be0cb40 introduce target to locate the testsuite for a given testcase filename (#5482) 2018-06-01 17:23:33 +02:00
Simon 272859c5fd Replacing js upgrade logic (#4061) 2018-03-08 13:57:30 +01:00
Andrey Abramov a1cfb3d72b Feature iresearch (#4105) 2018-01-19 14:23:58 +01:00
Jan 2a96df5ca5
Feature iresearch (#4071) 2017-12-18 15:04:59 +01:00
Wilfried Goesgens 2833bd6185 Bugfix/cleanup graphs (#3250)
* when running against an external server also setup the proper connection

* cleanup grahs after testing
2017-09-15 14:20:21 +02:00
Jan 5165155ed1 Bug fix/fixes 0609 (#3227)
* do not use V8 variant of AQL functions in early optimization stage when a C++ variant is available

* additionally, simplify AQL function definitions and aliases

* warn when more than 90% of max mappings are in use

* added C++ variant of replication catchup

* added `--log.role` option

* updated CHANGELOG

* removed non-existing scheduler.threads option from config

* removed useless __FILE__, __LINE__ invocations

* updated CHANGELOG

* allow a priority V8 context

* remove TRI_CORE_MEM_ZONE

* try to fix Windows errors & warnings

* cleanup

* removed memory zones altogether

* exclude system collections from collection tests
2017-09-13 16:28:21 +02:00
jsteemann f8d8a561a4 fix various issues 2017-09-13 09:03:28 +02:00
Wilfried Goesgens 9457395b80 workaround cluster not allowing to drop system collections 2017-09-13 00:02:30 +02:00
Wilfried Goesgens 5b131450a2 revalidate that tests clean up properly. 2017-09-12 14:49:06 +02:00
Frank Celler ba276467c0 cloned options (#2819) 2017-07-17 17:36:24 +02:00
Frank Celler a692577f5b Feature/auth context (#2815) 2017-07-16 09:39:03 +02:00
Wilfried Goesgens 03e5e68993 revalidate bucket options - throw if this testcase doesn't support it. 2017-05-09 17:08:25 +02:00