1
0
Fork 0
Commit Graph

16952 Commits

Author SHA1 Message Date
Lars Maier 5b41e5a5c8 [3.4] Scheduler Logging (#9028)
* Log when queues become filled up or are completly filled.
* Added latency for pushing.
* lowered log level.
* clever logging. and mutex. :(
* Reset local clock.
* Try to fix mac compile.
* Improve logging logic for half full and full queue.
* CHANGELOG.
2019-05-20 16:30:52 +02:00
Jan 8925edc131
fix crash in async request handling when request queue is full (#9029) 2019-05-17 16:28:43 +02:00
Jan 4d86dd5fa8
handle incomplete reads (#9019) 2019-05-17 11:17:51 +02:00
Max Neunhöffer e53966c843
Try to fix agency problems with snapshots. (#8947)
* Try to fix agency problems with snapshots.
* Abort MoveShards jobs that have the failed server as fromServer.
* Report aborts.
2019-05-16 14:41:39 +02:00
Simon 30e785537a Bug fix 3.4/pregel gr (#9007) 2019-05-15 18:38:22 +02:00
Tobias Gödderz 398129f1d0 [3.4] Let only on shard per collection, not per DBServer, be responsible for initialize cursor (and shutdown) (#8952)
* Let only on shard per collection, not per DBServer, be responsible for initialize cursor (and shutdown)

Reverted assertion

Changed parameter to const&

* Fixed erroneous merge

* Style correction
2019-05-15 11:21:32 +02:00
Lars Maier 3c9cba32ae Retry updating user collection. (#8999) 2019-05-14 17:39:00 +02:00
Simon f20e3713d2 prgl switcheroo (#8995) 2019-05-14 17:18:08 +02:00
Jan c6f2fc5eb3
fix sortedness of sorted results returned by RETURN DISTINCT (#8934) 2019-05-09 20:10:43 +02:00
jsteemann 36b55e796f fix compile warning 2019-05-09 19:19:36 +02:00
Simon aae758fe53 fix issues with pregel (#8948) 2019-05-09 18:58:27 +02:00
Lars Maier 287dc8c223 Do not skip the check if there is only a single agent. (#8937)
* Do not skip the check if there is only a single agent.
* Updated changelog.
2019-05-09 11:37:23 +02:00
Simon 185c8724a3 Pregel various fixes (#8879) 2019-05-07 09:53:18 +02:00
Jan 4ea195f6a2
less locking for ClusterSelectivityEstimates (#8891) 2019-05-06 13:23:33 +02:00
Lars Maier a1bae63cf1 [3.4] Verbose Abort Reason (#8878)
* Added reason to job abort method.

* Additional abort that is not in devel.
2019-05-01 13:54:47 +02:00
Lars Maier 1c13296f86 [3.4] ClientID Agency Transaction (#8651)
* Changed clientId to format <serverid>:<uuid>.
* Changed behavior if id is not known.
2019-04-30 10:35:34 +02:00
Simon 11aa075747 Backport fix for truncate selectivity (#8863) 2019-04-29 17:10:02 +02:00
Jan 885c473ad7 fix assertion failure during documentation generation (#8858)
* fix assertion

* @mchacki
2019-04-29 13:29:36 +03:00
Jan 71d405915c fix invalid usage of VPackSlice (#8864) 2019-04-27 17:25:43 -04:00
Simon b58bf82871 Fix tick overflow (#8840) (#8856) 2019-04-26 19:20:38 +02:00
jsteemann 5b66fa7aa0 RocksDB returns certain statistics values as strings. honor that 2019-04-26 19:05:58 +02:00
Jan 1b36a68742
fix misleading instruction in error message (#8821) 2019-04-26 11:40:01 +02:00
Jan ddcb904acf
overload all document-producing functions in EmptyIndexIterator with noops (#8780) 2019-04-17 15:54:04 +02:00
Kaveh Vahedipour 60b49bb08b [3.4] db servers reported none slice in agency for newly created database (#8755)
* probably fixed a bug, where db servers reported none slice in agency for newly created databases

* exempt none case from user experience

* also harden local ]collection lookups
2019-04-17 13:17:37 +02:00
Jan 53f4a84e76 don't reveal secrets via log or to JavaScript apps (#8762) 2019-04-15 19:05:41 +02:00
Max Neunhöffer e234713f43
Avoid delays caused by invalidateCurrent and invalidatePlan. (#8747)
* Avoid delays caused by invalidateCurrent and invalidatePlan.
* Do loadPlan and loadCurrent asynchronously in the background.
* Reload server mappings on Plan Version change.
2019-04-15 17:42:32 +02:00
Jan 0133f3c48d
increase the timeout for more reliable test results (#8735) 2019-04-15 10:16:42 +02:00
jsteemann ae62cce45b initialize member 2019-04-12 10:17:28 +02:00
Simon 3f44a9bba6 fix the pregel code (#8741) 2019-04-12 10:07:16 +02:00
Dan Larkin-York ce82a512d1 [3.4] Fix RocksDB recovery ticks (#8654) 2019-04-11 11:37:29 +02:00
Jan 7a28877522
Bug fix 3.4/fix prune memleak (#8716) 2019-04-10 00:10:01 +02:00
jsteemann e3ca0c252b fix wrong assertion 2019-04-09 17:52:53 +02:00
Max Neunhöffer f97997ea0f
Port back timestamp replication from devel. (#8649)
* Port back timestamp replication from devel.
* Some more very minor backports from devel to 3.4.
* CHANGELOG.
2019-04-09 17:09:33 +02:00
Max Neunhöffer e5908fd384
Don't hesitate for fewish shards between phase 1 and phase 2. (#8702)
* Only hesitate between phase 1 and 2 if phase 1 took long.
* Get rid of warning in agency (_id attribute filtered out).
* Resolve externals.
* CHANGELOG.
2019-04-09 17:05:11 +02:00
Jan 22d572c543
Bug fix 3.4/fix test muell (#8704) 2019-04-09 11:27:07 +02:00
Jan bf2141b96a
finally fix AQL error messages in all contexts, so that they are usable (#8705) 2019-04-09 09:17:53 +02:00
Jan a540b795b5
this addresses an issue described in ES-260, and is a forward-port of https://github.com/facebook/rocksdb/pull/5160 (#8697) 2019-04-08 18:20:50 +02:00
Jan a3c2e88fc9
preserve smart-join attribute in DC2DC as well (#8686) 2019-04-08 08:45:38 +02:00
jsteemann 4e93000fcf added debugging variables 2019-04-04 10:18:37 +02:00
Max Neunhöffer 6ceb86acc7
Remove ttl when key overwritten without ttl. (#8667)
* Fix ttl deleted when overwritten without ttl.
* Fix the agency test.
* CHANGELOG.
2019-04-03 12:04:12 +02:00
Jan 17669474c2
Bug fix 3.4/replication fuzz debugging (#8668) 2019-04-03 11:43:36 +02:00
Jan b814a62f5d
optimize lookups by shard key for smart vertex collections (#8640) 2019-04-03 11:39:34 +02:00
Max Neunhöffer 0acb19b18a
Better logic for AddFollower/RemoveFollower scheduling. (#8655)
* Fail a MoveShard job to a FAILED server.
* Better logic for AddFollower/RemoveFollower scheduling.
* Abort MoveShard (leader) in case of a FAILED server in Plan.
* Wait for statistics collections before doing stuff in tests.

cleanOutServer, moveShard, failover and the like.

* Abort MoveShard for follower if FAILED server in Plan.
* Take resigned servers into account when checking for health.
* CHANGELOG.
2019-04-02 23:34:27 +02:00
Jan d29d65face
Bug fix 3.4/cleanup 31032019 (#8633) 2019-04-01 17:02:00 +02:00
Max Neunhöffer 54f84cab92 Performance tuning for many shards. (#8577) 2019-03-29 21:34:45 +01:00
Jan 3631d55146
prevent PregelFeature from shutting down while its workers are running (#8627) 2019-03-29 18:22:37 +01:00
Heiko 6b1d56a62c fixed smg collections within the transaction, added gharial decoding (#8621) 2019-03-29 11:10:36 +01:00
Jan 86599ee2fc acquire mutex when serializing conductor state (#8619) 2019-03-29 09:22:49 +01:00
KVS85 c88c4d1416 Remove USE_IRESEARCH definition and usage (#8612) 2019-03-28 17:22:11 +01:00
Jan cf517d0cb6
add AQL functions CRC32 and FNV64 (#8599) 2019-03-27 21:05:56 +01:00
Kaveh Vahedipour a8ad22f206 assertion failures in store on restarting following agents (#8562) 2019-03-26 10:38:18 +01:00
Jan Christoph Uhde abeca4568c Feature 3.4/better aql error message (#8559) 2019-03-25 18:29:14 +01:00
Kaveh Vahedipour 799652d6d5 [3.4] precondition plan / version in compaction / store TTL removal (#8526)
* precondition plan / version in compaction / store TTL removal independent of local _ttl set
* Agency init loops break when shutting down.
2019-03-25 08:49:49 +01:00
Dan Larkin-York ea6a854b45 Add RocksDB background error listener. (#8537) 2019-03-23 20:46:07 +01:00
Max Neunhöffer 31b63a007b Avoid duplicate keys in agency callbacks. (#8531) 2019-03-22 18:30:03 +01:00
Jan Christoph Uhde a0394c4d3b better AQL error messages (#8505) 2019-03-22 17:50:14 +01:00
Simon 89a7591d00 Bug fix 3.4/rocksdb truncate asan (#8525) 2019-03-22 17:15:03 +01:00
Jan abd09e2e2c
fix /_api/cluster/endpoints URL for active failover (#8518) 2019-03-22 16:47:32 +01:00
Simon 776c0c0f22 Fix edge index selectivity (#8499) 2019-03-22 05:18:34 +01:00
jsteemann ccf2a1e59d fix two minor issues reported by cppcheck 2019-03-21 19:42:40 +01:00
Jan e8f4446c24
prevent assertion failures when creating smart graphs with invalid options (#8500) 2019-03-21 16:25:02 +01:00
Andrey Abramov 73cf9eb1f3
[3.4] bug-fix/issue-#8294 (#8430)
* fix invalid optimizations for multi-valued attributes

* fix broken optimizations for multivalued attributes

* adjust tests

* add `IN_RANGE` function

* add tests

* add some shallow integration tests

* fix optimization for IN operator
2019-03-21 18:23:12 +03:00
Max Neunhöffer 1365eebfac
Make AddFollower and RemoveFollower less aggressive. (#8477)
* Make AddFollower and RemoveFollower less aggressive.
* Adjust comment
* Early exit in count loop.
* Adjust comment in 2nd place.
* CHANGELOG.
2019-03-21 15:27:22 +01:00
Kaveh Vahedipour 8b851c35e3 [3.4] fix multimap to vpack agency store (#8481)
* fix store dump invalid json bug
* hitting ttl should also remove corresponding node
* fix ttl from disk
2019-03-21 15:21:40 +01:00
Kaveh Vahedipour 6529b38240 Feature 3.4/coordinator do full agency dumps (#8131)
* adding agent functionality
* agency route working
* coordinator route to acquiring agency dumps
* remove logging remains and add superuser requirements to API
* Update State.cpp
* guard route
* change we can believe in
2019-03-21 14:58:38 +01:00
Jan 3f3f0c6fe3
Feature 3.4/ncc1701 (#8441) 2019-03-21 14:53:28 +01:00
Jan dbfa483374
add RocksDB options `--rocksdb.allow-fallocate` and `--rocksdb.limit-open-files-at-startup` (#8492) 2019-03-21 12:05:57 +01:00
Jan db7fcdce7a
don't run compact() on a collection after a truncate() was done in the same transaction (#8471)
running compact() in the same transaction will only increase the data size on disk due to
  RocksDB not being able to remove any documents physically due to the snapshot that is
  taken at transaction start.

  This change also exposes db.<collection>.compact() in the arangosh, in order to manually
  run a compaction on the data range of a collection should it be needed for maintenance.
2019-03-20 17:44:06 +01:00
Kaveh Vahedipour ab3206486d [3.4] job must not copy snapshots (#8406)
* job must not copy snapshots
* Node correct empty children
* checked all hasAsChildren sites
* No copy in operator() for node.
* Don't spam log.
* const operator too
* full path to missing key in agency
* the key is missing
* Another info level to DEBUG from INFO.
* Increase timeouts of MoveShard and CleanOutServer agency jobs.
* CHANGELOG.
2019-03-20 17:03:19 +01:00
Jan 1c54830310
don't attempt to remove non-existing WAL files, because such attempt will trigger unnecessary error log messages in the RocksDB library (#8476) 2019-03-20 17:02:34 +01:00
Kaveh Vahedipour fbb9c3d75d [3.4] leader check needs to sit inside waitfor loop (#8444)
* leader check needs to sit inside waitfor loop
* Do not wait in Supervision for commits of new writes.
* CHANGELOG.
2019-03-20 13:16:00 +01:00
Kaveh Vahedipour 432bc2d26e [3.4] address compile warnings (#8343)
* warnings building
* from 3.4 a merge
2019-03-20 13:07:31 +01:00
Jan f621fe6076
revert a previous change that caused existing system collections on a slave to be truncated instead of being deleted (#8443)
truncating instead of deleting introduced the possibility of the collection's indexes continuing to exist with different ids on the slave than on the master, leading to potential follow-up problems
2019-03-18 20:56:50 +01:00
Wilfried Goesgens 68ce741b13 Bug fix 3.4/arrayindex unique update (#8422) 2019-03-14 18:13:05 +01:00
Jan 02d170e4c2
make geo-index-optimizer rule work with multiple loops (#8353) (#8360) 2019-03-13 13:22:12 +01:00
Kaveh Vahedipour bd8cf1e9ea supervision must check for leadership, when waiting for progess (#8401) 2019-03-13 13:01:14 +01:00
jsteemann 27e23f9236 make sure some tick invariants always hold true 2019-03-12 19:29:52 +01:00
Jan 30ddb98659
try an incremental sync when restarting a follower in active failover mode (#8364) 2019-03-12 15:28:00 +01:00
Max Neunhöffer 54c533c5f6
Some more agency fixes. (#8377)
* Ignore satellite collections in shrinkCluster in agency.
* Abort RemoveFollower job if not enough in-sync followers or leader failure.
* Break quick wait loop in supervision if leadership is lost.
* In case of resigned leader, set isReady=false in clusterInventory.
* Fix catch tests.
2019-03-12 14:09:56 +01:00
Lars Maier dbfcbdfe32 [3.4] Agency Failed leader crash (#8356)
* Check if transaction failed before accessing the result.
* FailedFollower had the same bug.
2019-03-12 11:18:07 +01:00
Jan 13148e661a simplify internal struct for edge index lookups (#8367) 2019-03-11 16:23:14 +01:00
Jan cd5c9edce1
various replication improvements (#8300) 2019-03-11 13:07:43 +01:00
Kaveh Vahedipour 3240185bf6 Bug fix 3.4/agency compaction overwrite (#8344)
* agents need to be able to update a compacted state, when wrong entry exists

* Do not compact a potentially wrong log.
2019-03-08 10:34:53 +01:00
Michael Hackstein fb956ccc67 PRUNE in AQL Traversal (#8286) 2019-03-07 21:13:26 +01:00
Jan 7e1a74c6c0
fix an assertion failure when plans are shut down in an invalid state (#8333) 2019-03-07 13:15:54 +01:00
Jan 6941eb941c
added option `--console.history` to arangosh (#8328) 2019-03-07 13:14:51 +01:00
Kaveh Vahedipour 1be2404297 [3.4] failed follower needs reporting aborts too (#8323)
* forgotten abort
* fix waitFor trap in supervision
2019-03-05 23:30:08 +01:00
Max Neunhöffer 46e479376d
Further supervision fixes. (#8259)
* Do not schedule Coordinators in Plan.

* Finish failed server when server is no longer in health.

* Fix removeServer checks.

Check that server is no longer in use before removing it. Give 60s
waiting time for condition to be met. Also observer agency lock.

* Finish FailedFollower job if server no longer follower.

This can happen because RemoveFollower was faster.

* Only use GOOD servers as replacement followers.

* Fix AddFollower for satellite collections.

* Fix RemoveServer for satellite collections.

* MoveShard handles moves from leader to followers

* Prepare CleanoutServer and FailedServer for satellite collections.

* More sorting out of AddFollower and RemoveFollower.

* Fix RemoveFollower job w.r.t. choice of follower to remove.

* Fix message.

* kill you own sub jobs, please

* Added preconditions to payloads for supervision's job finishers

* Improve logging.

* Add agency diagnostics to failed move shard test, start.

* Add coordinator agency diagnostics.

* Remove warning.

* Add changelog entry.

* Add agency diagnostics if things go sour with move shard.

* Add agency diags when things go wrong 2.

* API /_api/agency/state: back to old format.

* Fix Windows compilation.

* handle aborts in supervision and wait for the last Raft log to be committed

* tests compiling, 2 failing for valid reasons

* Correctly report TRI_ERROR_CLUSTER_CONNECTION_LOST as 503.

* FailedLeader /FailedFollower cannot continue, when aborting blocks
2019-03-04 11:43:35 +01:00
Vasiliy e536f2ab1f issue 525.1: backport 3.4: ensure RocksDB CreateIndex/DropIndex WAL markers are properly written during recovery (#8279)
* issue 525.1: backport 3.4: ensure RocksDB CreateIndex/DropIndex WAL markers are properly writen during recovery

* backport: skip writing DropIndex marker in recovery
2019-03-01 15:57:42 +03:00
Simon 9e7eb470b4 Fix Pregel nullptr checks (#8276) 2019-03-01 13:34:05 +01:00
Jan ca53f5b503
abort ongoing transactions in all cases (#8290) 2019-02-28 14:41:22 +01:00
Jan 8e3fb5dfc7
Feature 3.4/improve replication speed (#8268) 2019-02-28 14:37:40 +01:00
Michael Hackstein 3e02a726ee
Bug fix/clustercomm queue cleanup (#8191) (#8277)
Cleanup of unused queues in ClusterComm
2019-02-28 09:11:25 +01:00
Andrey Abramov 5815a7a2a8
Fix bug #8213 (#8262)
* properly process ArangoSearch view nodes located inside subqueries

* extend tests to cover failing case

* add integration tests
2019-02-26 18:50:46 +03:00
Simon a52e6fa3d3 Sync Foxx Queues (#8254) 2019-02-25 17:16:26 +01:00
Max Neunhöffer b87f362f27
The big supervision fix. (#8243)
* Updated CleanoutServerTests. Exclude servers in ToBeCleanedServers. Allow bad servers as new follower.
* Prefer good servers.
* Removed copy, sort and binary_search for a list of ~10 elements.
* Fix move shard bug with compare.
* MoveShard fixes, expansion of doForAllShards
* Count only GOOD servers in actualReplicationFactor.
* Make RemoveFollower remove broken servers.
* Precondition on Plan Version for updating Current as leader.
* CleanupServer to evict server from ToBeCleaned, when aborting
* cleanoutserver with payload in finish
* Use static string for ToBeCleanedOut.
* Fixed typo in log message.
* Change warning level. If a MoveShard job is aborted and we can no longer roll back, then we issue a WARNING rather than a DEBUG log message.
* Another typo and log level.
* Start to fix unit tests.
* Does not make sense for AddFollowerTest to have a FAILED leader.
* Only count GOOD followers in AddFollower.
* Fix AddFollowerTest.
* Report precondition failed in MoveShard follower case.
* Add CHANGELOG.
2019-02-25 08:12:18 -05:00
Jan 30c61a5c82
improve error messages when restoring from invalid JSON data (#8211) 2019-02-20 18:34:43 +01:00
Heiko 1ae99f08be do not allow edge definitions with empty from or to arrays, added als… (#8200) 2019-02-20 18:33:06 +01:00
Jan 68b112e45a
fixed issue #8165 (#8195) 2019-02-19 18:08:39 +01:00
Tobias Gödderz a83d42d0e9 [3.4] Forbid ambiguous casts to and from ResultT (#7368)
* Forbid ambiguous casts to and from ResultT

* Reformat

* Changed enabled_if checks to check for implicit casts to Result

* Added comments
2019-02-19 12:50:39 +01:00
Jan 304948f30d
when creating a new database with an initial user, set the database p… (#8185) 2019-02-18 16:16:23 +01:00
Jan fbc1e5b35f
use PutUntracked (#8126) 2019-02-13 16:04:27 +01:00
Simon 51734e363f Properly translate cluster comm errors (#8152)
(cherry picked from commit 9151921b4524f2775ae5c69cae3f49fa4f9d703b)
2019-02-12 18:07:43 +01:00
Jan e640e3f52a
issue #8137: NULL input field generates U_ILLEGAL_ARGUMENT_ERROR (#8139) 2019-02-12 17:56:38 +01:00
Jan 078e1d9b9d
fixed issue #8108 (#8111) 2019-02-05 15:50:47 +01:00
Kaveh Vahedipour e8d39666fd fixing failedserver/leader/follower chain for mishap (#8089)
* fixing failedserver/leader/follower chain for mishap
* change log mention
2019-02-05 13:55:19 +01:00
Jan 4ee7ff1932
yet some more replication tests adjustments (#8101) 2019-02-04 16:53:15 +01:00
Tobias Gödderz db70847ab1 [3.4] Sorted COLLECT: avoid nullptr deref when skipping and fix non-invalidated input variables (#8037)
* Added 2 regression tests

* Fixed test expected data

* Fix nullptr dereference

* Fix handling of non-invalidated input variables

* Try a less implicit fix

* Updated CHANGELOG
2019-02-04 16:38:26 +01:00
Jan 8a16a4b3ae update velocypack (#8075) 2019-01-31 17:31:54 +01:00
Jan 05bcb3d7d1
Bug fix 3.4/streaming cursors v8 issues (#8080) 2019-01-31 17:25:28 +01:00
Jan 675bb78552
more debugging for replication (#8062) 2019-01-30 21:23:00 +01:00
Jan 4a1f25ed46
use JobGuard when querying users from DB in cluster (#8057)
* use JobGuard when querying users from DB in cluster

* fix test crashes
2019-01-30 12:00:50 +01:00
Frank Celler 84802fdc0f Feature/maskings (#8006) 2019-01-28 15:04:23 +01:00
Simon 1c77bc37d6 Reduce timeout for write-lock (#8036) 2019-01-28 09:23:52 +01:00
Simran 79c3a34d6b Doc - Deprecate --server.jwt-secret startup option (3.4) (#7961) 2019-01-28 09:12:43 +01:00
Jan 75ab4ac3dc
Bug fix 3.4/misc issues (#8012)
* added missing return statements

* only spend up to 10 seconds for initially fetching the list of collections in arangosh

fetching the list of collections is a blocking operation, and the default timeout for this is very high.
If the server is blocked by whatever reason, then the shell is unusable until the collections list request returns.
To avoid this, the initial request is limited to 10 seconds, so the shell can be used afterwards.

* if an index cannot be used for sorting, its sort

cost was previously returned as 0. this will in fact favor
indexes that can be used for filtering but not for sorting
over indexes that can be used for both.

this change is to report the sort cost for indexes that
cannot be used for sorting to n * log(n), where n is the
number of documents that optimizer expects to come out of the
index after filtering
2019-01-28 08:55:06 +01:00
Jan 15852cb491
Bug fix 3.4/address jenkins fails (#7985) 2019-01-22 12:32:17 +01:00
Jan d394a6b988
fix scrambling of AstNodes that were in use multiple times (#7978) 2019-01-19 18:54:08 +01:00
Jan 3c828347dc
do not simplify non-deterministic conditions (#7927) 2019-01-19 18:52:17 +01:00
Jan 244eed0710
added "peakMemoryUsage" in query results figures, (#7981) 2019-01-19 18:50:55 +01:00
Simon 1f86b7a2b5 Fix stream cursor bug (#7958) 2019-01-16 13:27:57 +01:00
KVS85 dfad8906d9 Bug fix/active failover fix windows 3.4 (#7959)
* Backport active-failover fix for Windows into 3.4

* Backport stop/resume for Windows from devel

* Backport changes from devel into tests also

* Fix tests

* Remove forgotten whitespaces
2019-01-16 11:08:48 +01:00
Tobias Gödderz d48495c195 [3.4] Foxx queue jobs hanging after Foxxmaster crash (#7921)
* Fixed bug where the Foxxmaster doesn't reset jobs after a crash when it should, or a non-master coordinator removes jobs in progress during startup

* Added a regression test

* Removed foxxmaster test from greylist

* Updated CHANGELOG

* Fixed non-maintainer compile
2019-01-14 16:06:48 +01:00
Jan d5592def42
fix issue #7933: Regression on ISO8601 string compatibility in AQL (#7934) 2019-01-14 13:50:50 +01:00
Kaveh Vahedipour 7b37922f92 releveling logging in maintenance module (#7925) 2019-01-10 12:15:48 +01:00
Matthew Von-Maszewski 474f0cde31 Bug fix 3.4/scheduler empty reformat (#7872)
* added check for empty scheduler

* removed log, old is 1 not 0

* require running in this thread

* test

* added isDirect to callback

* signature fixed

* added drain

* added allowDirectHandling

* disabled for testing

* Add ExecContextScope object to direct call.

* try alternate initialization of ExecContextScope

* remove ExecContextScope, no help.  try _fifoSize as part of direct decision.

* strand management to minimize reuse of same strand per listen socket

* blind attempt to address Jenkins shutdown lock up.  may remove quickly.

* add filename and line to existing error log message

* Adjust queueOperation() to stop accepting items once isStopping() becomes true.

* revert previous check-in to MMFilesCollectorThread.cpp

* big reformat

* fixed merge conflicts

* Add CHANGELOG entry.
2019-01-08 20:39:42 +01:00
Kaveh Vahedipour 536f5f22a7 [3.4] fix create collection timeouts test agent (#7831)
* should not neglect the initial async request for read lock acquisition

* fixed nullptr

* correct timeout

* corrected error  handling in getReadLock

* reverted "test fix"

* should remove async request from ClusterCom
2019-01-08 17:02:24 +01:00
Lars Maier bc9f9ed14d Bug fix 3.4/jwt base64url encoded (#7904)
* Use base64url encoding and decoding for jwt header and body as specified in the rfc.

* Added changelog.
2019-01-08 16:55:17 +01:00
Jan 9c099ba5da
multiplex REPLICATION-APPLIER-STATE files for RocksDB engine (#7897) 2019-01-08 14:26:09 +01:00
Jan adf76491b0
added AQL function CHECK_DOCUMENT (#7841) 2019-01-04 15:33:20 +01:00
Jan a4a7867451
Bug fix 3.4/arangorestore add cleanup duplicate attributes (#7876) 2019-01-04 15:26:11 +01:00
Lars Maier e1dcad0153 Feature 3.4/jwt keyfile (#7864)
* Added jwt-keyfile option and warning for old option.
* CHANGELOG
* Add trimming to --auth.jwt-secret-keyfile
* Adjust some comments.
2019-01-02 21:45:18 +01:00
Jan a14f6dd573
prevent duplicate attributes being generated by AQL queries (#7836) 2019-01-02 12:37:47 +01:00
Jan 762c0fd7c6
fixed issue #7834 (#7845) 2019-01-02 11:09:06 +01:00
Frank Celler 9477af198b big reformat 2018-12-26 00:57:05 +01:00
Dan Larkin-York 05d158a689 Fix issue with geo iterator reset. (#7838) 2018-12-23 00:41:37 +01:00
Jan 7c42430f95
suppress a warning message about non-optimal MMFiles collection data structures while doing WAL recovery, not just while upgrading. (#7812) 2018-12-20 16:52:02 +01:00
Tobias Gödderz b8c2d0d01a [3.4] Fix heartbeat thread hanging during shutdown (#7678)
* Abort registering agency callbacks when stopping

* Reduce diff

* Reduce diff

* Added two nullptr checks
2018-12-20 16:40:58 +01:00
Simon 1498c08084 fix restrictCollections parameter on database level replication (#7808) 2018-12-19 18:00:10 +01:00
Jan b5e844fe33
fixed issue #7749 (#7797) 2018-12-19 14:17:54 +01:00
Jan 0574393d52
fixed issue #7757 (#7806) 2018-12-19 14:06:11 +01:00
Jan f1b0a803eb
do not use an internal error for JSON parse errors (#7800) 2018-12-19 12:54:20 +01:00
Jan f39c58e06c
fixed issue #7763 (#7796) 2018-12-19 09:56:05 +01:00
Andrey Abramov edb2ca4800
update ArangoSearch consolidation policy (#7801) (#7802) 2018-12-19 02:34:17 +03:00
Andrey Abramov 50bed56766
fix issue and add test (#7790) 2018-12-18 17:33:08 +03:00
Wilfried Goesgens 7fa0cdc41b Feature/drop before win7 support in compiler (#6681) (#7751) 2018-12-17 12:06:53 +01:00
Kaveh Vahedipour 9e83e1696d [3.4] allow for quicker start of actions when previusly completed (#7736)
* shard versioning
* one incompatible call fixed
2018-12-17 10:36:50 +01:00
Max Neunhöffer 1c4430afdf
Adjust two error codes (TRI_ERROR_SHUTTING_DOWN). (#7779) 2018-12-17 09:50:53 +01:00
Kaveh Vahedipour 92b7df5a1d [3.4] equalising devel and 34 (#7754)
* equalising devel and 3.4 in agency/cluster
* missing header
2018-12-17 09:06:35 +01:00
Michael Hackstein ddd5226d13
Feature3.4/improve edgeindex covered (#7750)
* Allow the RocksDB edge index to return the already covered opposite vertex.

* Updated tests
2018-12-12 22:03:47 +01:00