1
0
Fork 0
Commit Graph

78 Commits

Author SHA1 Message Date
Matthew Von-Maszewski 015f59f0b9
Feature 3.4: Use ManagedDirectory class to add gzip and encryption to import/export (#9472)
* preview code I dropped on jackie today.  only supports document collections.

* saving work in progress

* update arangoexport to fully use ManagedDirectory object (arangoimport still needs work).

* migrate remainder of import to using ManagedDirectory objects

* correct spelling within activateEncryption(): encription to encryption

* forgot to fix up graphExport for managed directory.  luckily unittest noticed.

* add test read of gzip json file

* add readGzip to our fs object

* add TRI_SlurpGzipFile function

* add code to bridge javascript fs.readGzip to TRI_SlurpGzipFile

* correct the return type used by JS_ReadGzip

* add gzip test for jsonl type export

* add remain gzip versions of existing export tests

* add import tests of gzip files

* activate encryption in enterprise to enable fs.readDecrypt()

* bug fix: allow encryption to enable in empty directory if EncryptionFeature active.

* add JS_ReadDecrypt to enterprise build.  Current used for unit tests.

* enterprise build needs EncryptionFeature added to build to support TRI_SlurpDecryptFile()

* add TRI_SlurpDecryptFile() to aid in unit test of encrypted stuff

* missing newline at end of file.

* add fs.readDecrypt when available

* add test of encrypted json array export

* correct progress meter when gzip involved

* move from using ManagedDirectory::File to ManagedDirectory::readableFile calls

* create version of readableFile that uses file descriptor as param
2019-07-23 14:58:34 -04:00
KVS85 a1959fd485
wait .25, then check whether procdump successfully starts, and if not, properly abort the operation (#9343) 2019-06-27 10:47:27 +02:00
KVS85 68493ef7ef
add a function that will use procdump to generate a core before (#9330) 2019-06-26 11:16:00 +02:00
Wilfried Goesgens fa9460c927 Reduce test leftovers on disk (#8708) 2019-04-11 11:42:27 +02:00
Jan 96d6949731
Bug fix 3.4/increase test shutdown timeout to 60s (#8720) 2019-04-10 08:27:51 +02:00
Jan 22d572c543
Bug fix 3.4/fix test muell (#8704) 2019-04-09 11:27:07 +02:00
Wilfried Goesgens 8103561c1d Feature 3.4/sort buckets dump agency allways (#8679) 2019-04-04 14:50:44 +02:00
KVS85 d38b231f43 Backport testing improvement from devel 29.03.2019 (#8629) 2019-03-29 23:33:45 +01:00
Frank Celler 84802fdc0f Feature/maskings (#8006) 2019-01-28 15:04:23 +01:00
Wilfried Goesgens 656fd89bcf Bug fix 3.4/wait for procdump (#7753)
* wait for procdump to exit too.

* move running process check up, propagate status. First check whether processes are still running before attempting to force kill them

* only list processes, don't change their state

* add stopping procdump in all places
2018-12-12 18:06:48 +01:00
Michael Hackstein 75f89ed74b
Bug fix/update foxx services after restore (#6774) (#7455)
* Bug fix/update foxx services after restore (#6774)

* triggers foxx queue update which leads to the internal selfHeal function of a foxx app to make foxx apps publicy visible after a foxx app is restored

* this will also add the recognition of imported foxx services

* Testing JS refactoring

* Added test case for Foxx dump -> restore cases

* Fixed check, sth- i tries to contact to the foxx service. Test is red now.

* Fixed tests for dump / restore using Foxx. Also first draft to fix the fox side. Blocked by sth. fixed in the Main Repositorx already

* Fixed typo in dump/restore testsuite

* Removed old version of the fix

* Fixed JSLint

* Removed debug-log output from foxx manager
2018-11-26 13:22:50 +01:00
Wilfried Goesgens c9490bd83f re-connect force terminate mechanism on test timeout (#7424) (#7433) 2018-11-23 18:48:01 +01:00
Wilfried Goesgens ed31545a5c Bugfix/fix recovery testsuite (#7396) (#7412) 2018-11-23 13:55:09 +01:00
Wilfried Goesgens 44de986023 make our tools output their log messages (#7404) 2018-11-21 16:49:54 +01:00
Wilfried Goesgens be556b7262 backport testing changes (#7127) 2018-10-30 19:04:11 +01:00
Wilfried Goesgens a5042e44a6 Bugfix 3.4/backport testing fixes (#6961) 2018-10-23 14:31:53 +02:00
Wilfried Goesgens 9cd98b69ee Feature 3.4/log timestamp on test start (#6761) 2018-10-08 16:20:09 +02:00
Simon 1b1fbde2c8 Copy installation files on startup (#6494) 2018-09-14 11:14:50 +02:00
Jan 0a73e64b0b Bug fix/fiddle version string into test paths (#6266)
* fiddle version string into test paths
2018-08-28 09:27:32 +02:00
Wilfried Goesgens 2b063cada8 properly feed the crash analyzer function, so arangosh crashes will be analyzed too (if) (#6238) 2018-08-24 11:47:44 +02:00
jsteemann efa5e8faa3 better status information on shutdown 2018-07-30 19:27:19 +02:00
Jan 2a416f2e33
Bug fix/3007 (#6019) 2018-07-30 17:16:47 +02:00
Wilfried Goesgens 93f9da4078 set the disableCores parameter properly (#5965) 2018-07-24 17:50:33 +02:00
jsteemann fb7ab6d0d0 fixed magic number 2018-07-24 17:48:45 +02:00
Wilfried Goesgens c463bda0d7 Rework shutdown & crash detection
- make sure we only check exactly _once_ for the exit status of a server
  that is no longer running
- don't do a separate loop about Coordinator/DB-Server shutdown
- output the instance type after naming it being shut down
- as before, shut down DBserver and Coordinators first, then the agency.
2018-07-24 11:37:42 +02:00
Wilfried Goesgens 0a3da65cfd Merge branch 'devel' of github.com:arangodb/ArangoDB into bug-fix/only-test-once-for-exit 2018-07-24 11:16:26 +02:00
Jan b1fab04296
issue a call to /_admin/cluster/maintenance before shutdown (#5945) 2018-07-24 09:34:57 +02:00
Wilfried Goesgens c1484d08a0 when shutdownArangod() already stopped arangods, don't look for the status again 2018-07-23 10:41:40 +02:00
Simon 545561e9a9 Read only server (#5652) 2018-07-03 09:58:16 +02:00
Wilfried Goesgens da3b222ebc disable circumventing of coredumps for windows (#5583)
* disable circumventing of coredumps for windows
* this is a local variable now.
* fix argument count
2018-06-13 13:54:24 +02:00
Wilfried Goesgens eb9bf93c98 Feature/cleanup rspec integration (#5517) 2018-06-07 11:47:46 +02:00
Wilfried Goesgens b2777c41bd Re-Add the now optional method to automatically analyze crashes (#5435)
* Re-Add the now optional method to automatically analyze crashes

* the user or CI may now specify `--coreCheck true` if the testsuite
  should perform automatic core analysis for him.

* improve english, fix object member to address as pointed out by @dan
2018-06-06 17:32:12 +02:00
Simon 45fbed497b Supervision Job for Active Failover (#5066) 2018-04-23 12:49:41 +02:00
Simon fad4c0f9f4 Moving out more from #5066 (#5124) 2018-04-17 16:55:19 +02:00
Simon 35136a89c0 Fix some problems with active failover (#4540) 2018-02-09 15:11:53 +01:00
Jan Christoph Uhde bddadda0ee add 'create database' to 'import feature' (#4278) 2018-01-15 15:15:31 +01:00
Jan 6040b4ae9f
add ignore-missing option to arangoimport (#4129) 2017-12-22 11:29:10 +01:00
Dan Larkin 9cd8c47eb7 Renamed arangoimp to arangoimport (with alias for compatibility.) (#4040) 2017-12-14 21:31:21 +01:00
Frank Celler 179ae83cbc
Feature/encrypted dump (#3768) 2017-11-22 15:59:02 +01:00
Simon Grätzer 0e485f7441 Fixing collection name collection handling in Syncer (#3710) 2017-11-17 16:36:57 +01:00
Jan Christoph Uhde e13ebbb128 fix path for catch tests in process-utils.js (#3592) 2017-11-08 08:55:53 +01:00
Simon Grätzer 7c31960cf2 Feature/async failover (#3451) 2017-10-18 23:59:29 +02:00
Max Neunhoeffer 3a4cf41270 Revert "Revert "rework process handling (#3322)""
This reverts commit d2b62c99d6.
2017-09-28 15:53:19 +02:00
Max Neunhoeffer d2b62c99d6 Revert "rework process handling (#3322)"
This reverts commit c56e4949b9.
2017-09-28 15:25:05 +02:00
Wilfried Goesgens c56e4949b9 rework process handling (#3322)
- migrate the process handling to c++ where appropriate
- move code definition / usage closer together
- add function to portably detect external processes (not spawned by us) and whether we may
- send them signals
- add portable code to send signals to processes
- for linux match what impact a signal will have on the process we send it
- check the status of the process we sent the signal, and return if its non-deadly or the process terminated
- after 8 retries with 1 second sleep send a hard kill.
- killExternal() now returns the same structure as statusExternal()
- don't block signals on spawned processes
2017-09-28 13:35:54 +02:00
Max Neunhoeffer 78ec0ec469 Revert "Bugfix/fix test arangod shutdown command (#3260)"
This reverts commit 3afebaed42.
2017-09-27 09:18:39 +02:00
Wilfried Goesgens c37143b070 During the startup of arangod the client will fail to connect. (#3302)
Since we retry anyways, silence the error message for the first tries
to reduce meaningless log output of testing.js
2017-09-26 14:54:59 +02:00
Wilfried Goesgens 3afebaed42 Bugfix/fix test arangod shutdown command (#3260)
* If our arango-object claims its got a connection to the arangodb server, use it to send a shutdown signal to the server.

If not, fall back to using a download http request.

* don't use kill to shut down the server, we now can use the regular shutdown command.
2017-09-26 14:46:30 +02:00
Wilfried Goesgens 2c29822afe if we successfully deleted the directory don't re-attempt. (#3288) 2017-09-19 18:16:04 +02:00
Wilfried Goesgens adeb926065 Work around windows processes not releasing resources (#3284)
- add retry for cleanup when deleting of directory fails
- if we fail 5 times, let the final cleanup handle it.
2017-09-19 12:17:50 +02:00