1
0
Fork 0
Commit Graph

383 Commits

Author SHA1 Message Date
Frank Celler 6eb986825e
grey only (#8786)
* grey only

* Update testing.js
2019-04-17 19:29:36 +02:00
Wilfried Goesgens c271c59e90 Reduce test leftovers on disk (#8707) 2019-04-11 11:43:30 +02:00
Jan 6b9b9b0946
Bug fix/fix test muell (#8703) 2019-04-09 11:27:53 +02:00
KVS85 a7090f30e9 fix typo (#8470) 2019-03-20 18:14:55 +03:00
Wilfried Goesgens b1a1edb205 add default values and documentation missing for this parameter (#8303) 2019-03-01 14:11:48 +01:00
Wilfried Goesgens ea44f8394d try checking whether _admin/shutdown is received, print sockstats of arangod processes (#7677) 2018-12-06 15:52:46 +01:00
Wilfried Goesgens e890bdc01a add bucket to test summary, so you can determine which logfile to look at (#7661) 2018-12-06 14:23:42 +01:00
Wilfried Goesgens a905b2ca35 Bugfix/fix recovery testsuite (#7396) 2018-11-22 11:18:28 +01:00
Frank Celler a6e4c844ad Feature-3.4/whiteblacklist (#7259)
* add blacklist

* added --skipGrey
2018-11-08 00:01:29 +01:00
Dan Larkin-York b447f98a7a Upgrade old MMFiles collections for compatibility with ArangoSearch. (#7248) 2018-11-07 15:52:37 +01:00
Wilfried Goesgens d1b3a1ee98 Don't talk to a server when we know its dead. Print current testsuite on Falure. (#6879) 2018-10-15 14:29:16 +02:00
Wilfried Goesgens 676f61805e Make procdump abort on std::bad_cast; kill SUT if it occurs; Make procdump optional. (#6602) 2018-10-10 17:55:53 +02:00
Wilfried Goesgens ad31b31096 print when we mark a build crashy (#6769)
LGTM
2018-10-09 16:47:16 +02:00
Jan 03ea6b929b
fix "auto" test (#6224) 2018-08-24 10:45:31 +02:00
jsteemann 89edebaeae also make RocksDB the default engine when testing 2018-07-26 18:25:43 +02:00
Wilfried Goesgens 5e296cb0c9 add ability to filter jsunity testsuites by testcase (#5807) 2018-07-12 13:35:29 +02:00
Andrey Abramov 5eef6cd618
Feature/test iresearch (#5610)
* start implementing arangosearch cluster tests.

* backport: ensure view lookup is done via collectionNameResover, ensure updateProperties returns current view properties

* first attempt to fix failing tests

* refactor cluster wide view creation logic

* if view is not found in the new plan then check the old plan too

* ensure the cluster-wide view is looked up in vocbase as well on startup/recovery

* do not store cluster-wide IResearchView in vocbase

* move stale view cleanup to the shared pointer deleter, address test failures

* do not print warning

* enable arangosearch tests by default

* fix catch tests

* address icorrect return value for cluster-wide links

* address some issues with test failures due to cluster-view allocated within TRI_vocbase_t

* simplify per-cid view name, address 'catch' test failures

* ensure IResearchViewNode volatility is properly calculated in cluster

* invoke callbacks directly in AgencyMock instead of waiting for timeout

* ensure view updates via JavaScript always use the latest view definition

* pass a list of shards to `IResearchViewDBServer::snapshot`

* extend cluster aql tests

* fixes after merge

* fix class/struct inconsistencies

* comment failing tests

* remove debug logging

* add debug function

* tests cleanup

* simplify upcoming merge: pass resolver from a side

* backport: move all transaction status callback logic to Methods

* add changes missed from previous commit

* fix js and ruby tests

* more tests for IResearchViewNode

* pass transaction to IResearchViewDBServer::snapshot, address IResearchViewDBServer tests segfault

* pass transaction to IResearchView::snapshot instead of transaction state

* temporarily add trace log output to tests to try to find the cause of the core dump on Jenkins

* add more temporary debug output to trace down the segfault on Jenkins

* add even more temporary debug output to trace down the segfault on Jenkins

* ensure Vieew related maps are cleared during shutdown

* reset ClusterInfo::instance() before DatabaseFeature::unprepare()

* remove extraneous debug output

* missed line from previous commit

* uncomment required line

* add nullptr checks to RocksDBIndexFactory::prepareIndexes(...) similar to the ones in MMFilesIndexFactory::prepareIndexes(...)

* attempt to fix deadlock in tests

* add comment as per reviewer request

* fix aql test suite name

* add some debug logging

* address deadlock between ClusterInfo::loadPlan() and CollectionNameResolver::localNameLookup(...)

* eplicitly state which index definition failed in the log message

* use vocbase from shard-view isntead just in case

* explicitly state which index definition failed in the log message

* do not create shard-view instances from cluster-link instances (only register existing ones)

* add some tests
2018-06-21 20:35:04 +03:00
Wilfried Goesgens 0470f945fa Bug fix/improve test status handling (#5591)
* add missing documentation about argument handled in unittest.js

* improve error handling on fs.write

* fix option name

* improve result handling

- add exception handling
- write status bad even before we start the test so we really know when
  something went wrong.

* SYS exceptions will already handle system exceptions

* rethrow

* only return true if the file object has no error bit set

* don't double-close on error.

* add note that we disable exceptions explicitely
2018-06-13 14:10:44 +02:00
Wilfried Goesgens eb9bf93c98 Feature/cleanup rspec integration (#5517) 2018-06-07 11:47:46 +02:00
Wilfried Goesgens b2777c41bd Re-Add the now optional method to automatically analyze crashes (#5435)
* Re-Add the now optional method to automatically analyze crashes

* the user or CI may now specify `--coreCheck true` if the testsuite
  should perform automatic core analysis for him.

* improve english, fix object member to address as pointed out by @dan
2018-06-06 17:32:12 +02:00
Wilfried Goesgens 991be0cb40 introduce target to locate the testsuite for a given testcase filename (#5482) 2018-06-01 17:23:33 +02:00
Simon fad4c0f9f4 Moving out more from #5066 (#5124) 2018-04-17 16:55:19 +02:00
Simon 272859c5fd Replacing js upgrade logic (#4061) 2018-03-08 13:57:30 +01:00
Simon 345fc3c0b7 Refactor Authentication Layer (devel) (#4592)
* Cherry Picking LDAP changes

* Adding missing merges

* Fixing remaining mentions of FeatureCacheFeature

* Fix jslint

* Fixing some failed tests

* Fixing cluster authentication issue, red tests

* Fixing ldap testsuite, adding trace logging

* Fixint ldap tesuite setup and LDAP recognition

(cherry picked from commit 686d28a779)

* Fixing wrong assert

* Adding changelog entry, making requested changes from code review

* Fixing dump_authentication, fix typos

* improvements found during code review

* oops

* more use of sessionstorage

* fix tests

* Fixing broken handling, disallowing adding of local users when disabled

* Fixing testInvalidGrants

* Removing undefined auth level externally

* Fixing previous commit

* added tests for ldap search mode

* intentionally removed `after` methods from tests

because they are executed before the tests start
no cleanup is performed right now after the authentication tests
however, a cleanup is done at start of every test

* ldap tests all modes

* forward port changes from 3.3

* added generated files

* forward port missing changes for web UI

* added generated files

* added generated files
2018-02-28 13:24:28 +01:00
Andrey Abramov a1cfb3d72b Feature iresearch (#4105) 2018-01-19 14:23:58 +01:00
Jan 2a96df5ca5
Feature iresearch (#4071) 2017-12-18 15:04:59 +01:00
Jan 4ceaf2ce1c
add minPort and maxPort to testing.js help output (#4042) 2017-12-15 10:26:41 +01:00
Frank Celler 179ae83cbc
Feature/encrypted dump (#3768) 2017-11-22 15:59:02 +01:00
Simon Grätzer 0e485f7441 Fixing collection name collection handling in Syncer (#3710) 2017-11-17 16:36:57 +01:00
Wilfried Goesgens 5b131450a2 revalidate that tests clean up properly. 2017-09-12 14:49:06 +02:00
Andreas Streichardt 7d2ab6055f Merge with latest changes in improve-jenkins
stashing should work better now
2017-08-31 17:53:48 +02:00
Jan 2f05b0ffeb jslint (#3167) 2017-08-30 11:28:51 +02:00
Wilfried Goesgens c662dfc863 Cleanup after each testrun (#3109)
* Cleanup after each testrun

 - add a success testsuite next to the fail testsuite
 - create temporary directories in the fail & success testsuites
 - add a function to cleanup the last unshifted directory
 - don't say we're crashed when exiting with the help message

* Specify temp path for SUT so its files will be removed after cleanup.

 - cleanup
 - don't use getTempFile(), it will create another subdirectory that we don't clean up afterwards...

* Fix temp path usage

 - creating a 'bundles' directory wherein we would keep our temporary bundle files would collide if we'd clean it up.
 - create 'bundles-tmpxxxx' instead so its individual to us and we can remove it when done without problems.

* properly create & pass in a temporary directory - as we now require this.

* Remove intermediate directory recursive - for some unknown reason there may be temp files created.

* we need to unify tempfilenames here too.

* use individual suite names

* use the standart performTests to run the backup tests - so we have the proper directory and server handling from the infrastructure.

* fix temporary directory handling in the recovery tests.

* script to build debugging debian packages

* Improve test shutdown

 - handle a set of options globally per testsuite, so they don't need to clone them inside.
 - properly cleanup the slave instance of the replication tests after each run.
 - The per testsuite options vector will fix the behaviour that after one failed testsuite
   all other suites won't be cleaned up anymore.

* don't call the overal cleanup if anything failed.

* fix cleaning up of directories.

* cleanup, fix directory creation / deletion / dummy creation.

* cleanup, fix directory creation / deletion / dummy creation.

* fix tempdir handling for the recovery tests
2017-08-30 10:48:24 +02:00
Wilfried Goesgens 2a82cf8667 when running the client tests on an already running server we have to specify the server root directory. (#3102) 2017-08-24 17:05:51 +02:00
Andreas Streichardt 6527c8ceed Revert "Unwurst results"
This reverts commit 8312c64f60.
2017-05-02 19:05:48 +02:00
Andreas Streichardt 525a9a0d4c Revert "Fail lint"
This reverts commit 59df82c975.
2017-05-02 19:05:40 +02:00
Andreas Streichardt 59df82c975 Fail lint 2017-05-02 18:26:27 +02:00
Andreas Streichardt 8312c64f60 Unwurst results 2017-05-02 18:21:16 +02:00
Wilfried Goesgens 4c82acd5e7 only print real errors to the fail file 2017-04-27 16:29:39 +02:00
Wilfried Goesgens 0b7e07f096 fix writing of crash summary textfile 2017-04-26 11:08:21 +02:00
Wilfried Goesgens d36a91e694 fix output of result yaml, but we only want it if extreme verbosity is set. 2017-04-18 15:25:01 +02:00
Wilfried Goesgens 7507f0d756 one more place to choose the propper directory for unittest result files. 2017-04-06 14:54:09 +02:00
Wilfried Goesgens bf3f68ee26 BUGFIX: when we don't start the server we mustn't try to attempt to clean up its db directories 2017-04-06 11:43:11 +02:00
Wilfried Goesgens 476befc9d0 refactor testing.js
- split utility functionality into its own file
 - add module loader so we can have modules
 - move all testsuites into own files
 - remove complicated testcase joining / splitting methods
2017-03-28 16:29:51 +02:00
Andreas Streichardt f32256e5a7 Normalize test resultstructure (hopefully) 2017-03-28 14:15:08 +02:00
jsteemann a5013733a2 force recovery tests to fail when not compiled with failure-tests 2017-03-28 09:47:52 +02:00
jsteemann a684bd6152 fix recovery tests 2017-03-28 09:34:59 +02:00
Wilfried Goesgens 6940aa6ec1 alias boost to catch 2017-03-27 19:44:06 +02:00
Wilfried Goesgens eb4c2ed8e4 fix arangosh test 2017-03-27 19:42:24 +02:00
Wilfried Goesgens f09ee72d65 start splitting testing.js into handy bits. 2017-03-27 19:00:21 +02:00