1
0
Fork 0
Commit Graph

2256 Commits

Author SHA1 Message Date
Wilfried Goesgens 629f1f9695 Fix windows path handling not to slip into UNC lookup (#10073) (#10085)
* Fix windows path handling not to slip into UNC lookup (#10073)

* make sure that we don't get more than one leading directory separator in front of the path, so windows doesn't mistakenly look it up as a UNC.

* make sure we don't build paths that start with two \'s

* fix condition
2019-10-09 18:37:21 +03:00
Jan 6bbcb1c934 fixed issue #10193 (#10196) 2019-10-09 16:39:57 +03:00
Max Neunhöffer 59544d5b83 Add more strong references to pthread stuff. (#10046)
* Add more strong references to pthread stuff.
* Circumvent libgcc/libmusl mistake in multi-threaded detection.
2019-09-20 12:40:53 +03:00
Tobias Gödderz dc2e27db6c [3.4] Feature/rebootid notice changes, backport of #9523 (#9685)
* Feature/rebootid notice changes, backport of #9523

* Move to 3.4 and C++11-compatible code (except for test code)

* Backported tests/Mocks/Servers.{h,cpp}

* Rebuilt errorfiles

* Ported CallbackGuardTest from gtest to catch

* Ported RebootTrackerTest from gtest to catch

* Make sure the state method is called, so the overridden method is used during tests

* Fixed test to work with the old scheduler

* release version 3.4.8

* [3.4] fix agency lockup when removing 404-ed callbacks (#9839)

* Update arangod/Cluster/ServerState.cpp

Co-Authored-By: Markus Pfeiffer <markuspf@users.noreply.github.com>

* Instantiate the scheduler during ::prepare()

* Fix test crash introduced during backport

* Fix a compile error on Windows (thanks, V8)
2019-09-19 15:03:39 +03:00
Max Neunhöffer 59a90f28c0 Fix a shutdown busy loop after main if two exceptions collide. (#9984) 2019-09-13 13:27:54 +03:00
Jan Christoph Uhde 5b2e3f041b disable-foxx 3.4 (#9593) 2019-07-31 10:58:42 +02:00
Matthew Von-Maszewski 015f59f0b9
Feature 3.4: Use ManagedDirectory class to add gzip and encryption to import/export (#9472)
* preview code I dropped on jackie today.  only supports document collections.

* saving work in progress

* update arangoexport to fully use ManagedDirectory object (arangoimport still needs work).

* migrate remainder of import to using ManagedDirectory objects

* correct spelling within activateEncryption(): encription to encryption

* forgot to fix up graphExport for managed directory.  luckily unittest noticed.

* add test read of gzip json file

* add readGzip to our fs object

* add TRI_SlurpGzipFile function

* add code to bridge javascript fs.readGzip to TRI_SlurpGzipFile

* correct the return type used by JS_ReadGzip

* add gzip test for jsonl type export

* add remain gzip versions of existing export tests

* add import tests of gzip files

* activate encryption in enterprise to enable fs.readDecrypt()

* bug fix: allow encryption to enable in empty directory if EncryptionFeature active.

* add JS_ReadDecrypt to enterprise build.  Current used for unit tests.

* enterprise build needs EncryptionFeature added to build to support TRI_SlurpDecryptFile()

* add TRI_SlurpDecryptFile() to aid in unit test of encrypted stuff

* missing newline at end of file.

* add fs.readDecrypt when available

* add test of encrypted json array export

* correct progress meter when gzip involved

* move from using ManagedDirectory::File to ManagedDirectory::readableFile calls

* create version of readableFile that uses file descriptor as param
2019-07-23 14:58:34 -04:00
Jan 2d9ee2281c
fix leak in thread shutdown (#9527) 2019-07-22 09:40:04 +02:00
Jan c655a89db6
make sure all errors are prefixed with ERROR_ @fceller @kvs85 (#9383) 2019-07-02 18:06:52 +02:00
Wilfried Goesgens 8e0ebb00c6 Bugfix/backport fs changes (#9024) 2019-05-23 12:46:47 +02:00
Kaveh Vahedipour abbba376ad [3.4] clean up container madness (#8791) 2019-05-23 12:43:39 +02:00
Michael Hackstein 4d4c23c302
Bug fix 3.4/collection babies (#9033)
* Prepare API to create multiple collections in a single request to ClusterMethods to improve speedup

* Added counter on how many collections are successfully created

* Allow multi collection creation one level higher

* CollectionMethods now allow batch createion of Collections

* Improved array size assertions

* Now a graph is createad within a single roundtrip in the agency.

* Added new header files

* Insert collections in the AGENCY with TTL and a isBuilding flag, collections with this flag should not be visisible in the coordinator

* Added forgotten C++ file

* Fixed a rare race condition, and the failing IResearch Tests

* readded callback on DONE, otherwise lists are out of sync

* Fixed assertions to let mocked tests pass...

* Fixed community cluster
2019-05-21 08:41:12 +02:00
Jan 4d86dd5fa8
handle incomplete reads (#9019) 2019-05-17 11:17:51 +02:00
Simon 3f44a9bba6 fix the pregel code (#8741) 2019-04-12 10:07:16 +02:00
Dan Larkin-York 455b6b6518 Fix bug in thread creation failure handling. (#8616) 2019-03-28 18:46:00 +01:00
Jan cf517d0cb6
add AQL functions CRC32 and FNV64 (#8599) 2019-03-27 21:05:56 +01:00
Jan 3f3f0c6fe3
Feature 3.4/ncc1701 (#8441) 2019-03-21 14:53:28 +01:00
jsteemann f437b83832 add thread name to messages 2019-03-07 11:42:58 +01:00
Jan 8e3fb5dfc7
Feature 3.4/improve replication speed (#8268) 2019-02-28 14:37:40 +01:00
Max Neunhöffer b87f362f27
The big supervision fix. (#8243)
* Updated CleanoutServerTests. Exclude servers in ToBeCleanedServers. Allow bad servers as new follower.
* Prefer good servers.
* Removed copy, sort and binary_search for a list of ~10 elements.
* Fix move shard bug with compare.
* MoveShard fixes, expansion of doForAllShards
* Count only GOOD servers in actualReplicationFactor.
* Make RemoveFollower remove broken servers.
* Precondition on Plan Version for updating Current as leader.
* CleanupServer to evict server from ToBeCleaned, when aborting
* cleanoutserver with payload in finish
* Use static string for ToBeCleanedOut.
* Fixed typo in log message.
* Change warning level. If a MoveShard job is aborted and we can no longer roll back, then we issue a WARNING rather than a DEBUG log message.
* Another typo and log level.
* Start to fix unit tests.
* Does not make sense for AddFollowerTest to have a FAILED leader.
* Only count GOOD followers in AddFollower.
* Fix AddFollowerTest.
* Report precondition failed in MoveShard follower case.
* Add CHANGELOG.
2019-02-25 08:12:18 -05:00
Frank Celler 84802fdc0f Feature/maskings (#8006) 2019-01-28 15:04:23 +01:00
Jan 15852cb491
Bug fix 3.4/address jenkins fails (#7985) 2019-01-22 12:32:17 +01:00
Jan 3c828347dc
do not simplify non-deterministic conditions (#7927) 2019-01-19 18:52:17 +01:00
KVS85 dfad8906d9 Bug fix/active failover fix windows 3.4 (#7959)
* Backport active-failover fix for Windows into 3.4

* Backport stop/resume for Windows from devel

* Backport changes from devel into tests also

* Fix tests

* Remove forgotten whitespaces
2019-01-16 11:08:48 +01:00
Jan d5592def42
fix issue #7933: Regression on ISO8601 string compatibility in AQL (#7934) 2019-01-14 13:50:50 +01:00
Matthew Von-Maszewski 474f0cde31 Bug fix 3.4/scheduler empty reformat (#7872)
* added check for empty scheduler

* removed log, old is 1 not 0

* require running in this thread

* test

* added isDirect to callback

* signature fixed

* added drain

* added allowDirectHandling

* disabled for testing

* Add ExecContextScope object to direct call.

* try alternate initialization of ExecContextScope

* remove ExecContextScope, no help.  try _fifoSize as part of direct decision.

* strand management to minimize reuse of same strand per listen socket

* blind attempt to address Jenkins shutdown lock up.  may remove quickly.

* add filename and line to existing error log message

* Adjust queueOperation() to stop accepting items once isStopping() becomes true.

* revert previous check-in to MMFilesCollectorThread.cpp

* big reformat

* fixed merge conflicts

* Add CHANGELOG entry.
2019-01-08 20:39:42 +01:00
Frank Celler 9477af198b big reformat 2018-12-26 00:57:05 +01:00
Frank Celler 8b294742b1 added new clang style and reformat script for clang-format 6.0 2018-12-26 00:55:17 +01:00
Jan 0574393d52
fixed issue #7757 (#7806) 2018-12-19 14:06:11 +01:00
Wilfried Goesgens 7fa0cdc41b Feature/drop before win7 support in compiler (#6681) (#7751) 2018-12-17 12:06:53 +01:00
jsteemann b2c9d80d29 add virtual dtor 2018-12-12 22:00:33 +01:00
Wilfried Goesgens 656fd89bcf Bug fix 3.4/wait for procdump (#7753)
* wait for procdump to exit too.

* move running process check up, propagate status. First check whether processes are still running before attempting to force kill them

* only list processes, don't change their state

* add stopping procdump in all places
2018-12-12 18:06:48 +01:00
Jan 9dbbd1cc9f
Bug fix 3.4/fix thread shutdown (#7729) 2018-12-11 22:17:17 +01:00
hellower fa0e1c438c Update messages.h (#7360)
Korean bye message
2018-12-08 01:44:01 +01:00
Wilfried Goesgens d5a64629f8 Feature 3.4/kill em all (#7590) 2018-12-04 09:03:39 +01:00
Jan 92616c1dca
fix path normalization for Windows (#7565) 2018-11-30 16:21:13 +01:00
Jan ffc823e1c8
Bug fix 3.4/backport optimizations (#7434) 2018-11-26 19:16:05 +01:00
jsteemann 9658300f11 revert Scheduler changes 2018-11-26 09:54:41 +01:00
Jan b363372c63
Bug fix 3.4/remove shutdown assertion (#7387) 2018-11-22 15:36:06 +01:00
Jan 19dc2ca0b7
yet more micro optimizations (#7399) 2018-11-21 17:09:16 +01:00
Simon ef239cbe4e Make recovery more reliable (#7297) (#7367) 2018-11-21 16:51:38 +01:00
Kaveh Vahedipour 860fa21219 Bug fix 3.4/index readiness (#6716)
* backport of test data generation for maintenance from devel
* 3.4 working
* fixing index use in cluster while still being built
* fixed broken views
* correct 200 for ensureIndex
* merge with 3.4
* agency comm to handle replace in array
* supervision changes
* cluster info's exsureIndex
* 3.4 ready
* timeout
* missing files from origin
* neunhoef complaints
* bogus entry
* no need to wait for current once again
* no longer necessary. done in IndexFactory now
* correct comments
* left overs
* dead code revived
* Move CHANGELOG entry to the right place.
2018-11-21 14:41:36 +01:00
Jan d27c4cc113
Bug fix 3.4/aql speedup (#7378) 2018-11-20 16:08:16 +01:00
Max Neunhöffer 805f7a7621
Fix timeout in cluster operation in create and drop collections. (#7300)
* Fix loophole.
* Fix inquiry case of id not found: 404.
* Also handle correctly in AgencyComm.
* Fix agency tests.
* Fix error handling in dropCollectionOnCoordinator.
2018-11-14 10:02:26 +01:00
jsteemann 046dac4234 fix define name 2018-11-12 13:09:48 +01:00
Wilfried Goesgens ccc43cd932 Bug fix 3.4/remove enterprise goto (#7274)
* add more information when timeout failing the index creation tests

* rather use null-pointers than try/catch for control flow
2018-11-08 16:27:51 +01:00
Dan Larkin-York e5243f9254 [3.4] Upgrade old MMFiles collections for compatibility with ArangoSearch (#7133) 2018-11-06 11:12:54 +01:00
Frank Celler 07ee9c48e1 release version 3.4.0-rc.4 2018-11-05 00:12:28 +01:00
Jan 8f1ce5b396
fix issues found by codescan (#7198) 2018-11-02 18:53:34 +01:00
Jan 8420f21376
add GE goodbye (#7206) 2018-11-02 16:23:21 +01:00