1
0
Fork 0
Commit Graph

16825 Commits

Author SHA1 Message Date
jsteemann ae62cce45b initialize member 2019-04-12 10:17:28 +02:00
Simon 3f44a9bba6 fix the pregel code (#8741) 2019-04-12 10:07:16 +02:00
Dan Larkin-York ce82a512d1 [3.4] Fix RocksDB recovery ticks (#8654) 2019-04-11 11:37:29 +02:00
Jan 7a28877522
Bug fix 3.4/fix prune memleak (#8716) 2019-04-10 00:10:01 +02:00
jsteemann e3ca0c252b fix wrong assertion 2019-04-09 17:52:53 +02:00
Max Neunhöffer f97997ea0f
Port back timestamp replication from devel. (#8649)
* Port back timestamp replication from devel.
* Some more very minor backports from devel to 3.4.
* CHANGELOG.
2019-04-09 17:09:33 +02:00
Max Neunhöffer e5908fd384
Don't hesitate for fewish shards between phase 1 and phase 2. (#8702)
* Only hesitate between phase 1 and 2 if phase 1 took long.
* Get rid of warning in agency (_id attribute filtered out).
* Resolve externals.
* CHANGELOG.
2019-04-09 17:05:11 +02:00
Jan 22d572c543
Bug fix 3.4/fix test muell (#8704) 2019-04-09 11:27:07 +02:00
Jan bf2141b96a
finally fix AQL error messages in all contexts, so that they are usable (#8705) 2019-04-09 09:17:53 +02:00
Jan a540b795b5
this addresses an issue described in ES-260, and is a forward-port of https://github.com/facebook/rocksdb/pull/5160 (#8697) 2019-04-08 18:20:50 +02:00
Jan a3c2e88fc9
preserve smart-join attribute in DC2DC as well (#8686) 2019-04-08 08:45:38 +02:00
jsteemann 4e93000fcf added debugging variables 2019-04-04 10:18:37 +02:00
Max Neunhöffer 6ceb86acc7
Remove ttl when key overwritten without ttl. (#8667)
* Fix ttl deleted when overwritten without ttl.
* Fix the agency test.
* CHANGELOG.
2019-04-03 12:04:12 +02:00
Jan 17669474c2
Bug fix 3.4/replication fuzz debugging (#8668) 2019-04-03 11:43:36 +02:00
Jan b814a62f5d
optimize lookups by shard key for smart vertex collections (#8640) 2019-04-03 11:39:34 +02:00
Max Neunhöffer 0acb19b18a
Better logic for AddFollower/RemoveFollower scheduling. (#8655)
* Fail a MoveShard job to a FAILED server.
* Better logic for AddFollower/RemoveFollower scheduling.
* Abort MoveShard (leader) in case of a FAILED server in Plan.
* Wait for statistics collections before doing stuff in tests.

cleanOutServer, moveShard, failover and the like.

* Abort MoveShard for follower if FAILED server in Plan.
* Take resigned servers into account when checking for health.
* CHANGELOG.
2019-04-02 23:34:27 +02:00
Jan d29d65face
Bug fix 3.4/cleanup 31032019 (#8633) 2019-04-01 17:02:00 +02:00
Max Neunhöffer 54f84cab92 Performance tuning for many shards. (#8577) 2019-03-29 21:34:45 +01:00
Jan 3631d55146
prevent PregelFeature from shutting down while its workers are running (#8627) 2019-03-29 18:22:37 +01:00
Heiko 6b1d56a62c fixed smg collections within the transaction, added gharial decoding (#8621) 2019-03-29 11:10:36 +01:00
Jan 86599ee2fc acquire mutex when serializing conductor state (#8619) 2019-03-29 09:22:49 +01:00
KVS85 c88c4d1416 Remove USE_IRESEARCH definition and usage (#8612) 2019-03-28 17:22:11 +01:00
Jan cf517d0cb6
add AQL functions CRC32 and FNV64 (#8599) 2019-03-27 21:05:56 +01:00
Kaveh Vahedipour a8ad22f206 assertion failures in store on restarting following agents (#8562) 2019-03-26 10:38:18 +01:00
Jan Christoph Uhde abeca4568c Feature 3.4/better aql error message (#8559) 2019-03-25 18:29:14 +01:00
Kaveh Vahedipour 799652d6d5 [3.4] precondition plan / version in compaction / store TTL removal (#8526)
* precondition plan / version in compaction / store TTL removal independent of local _ttl set
* Agency init loops break when shutting down.
2019-03-25 08:49:49 +01:00
Dan Larkin-York ea6a854b45 Add RocksDB background error listener. (#8537) 2019-03-23 20:46:07 +01:00
Max Neunhöffer 31b63a007b Avoid duplicate keys in agency callbacks. (#8531) 2019-03-22 18:30:03 +01:00
Jan Christoph Uhde a0394c4d3b better AQL error messages (#8505) 2019-03-22 17:50:14 +01:00
Simon 89a7591d00 Bug fix 3.4/rocksdb truncate asan (#8525) 2019-03-22 17:15:03 +01:00
Jan abd09e2e2c
fix /_api/cluster/endpoints URL for active failover (#8518) 2019-03-22 16:47:32 +01:00
Simon 776c0c0f22 Fix edge index selectivity (#8499) 2019-03-22 05:18:34 +01:00
jsteemann ccf2a1e59d fix two minor issues reported by cppcheck 2019-03-21 19:42:40 +01:00
Jan e8f4446c24
prevent assertion failures when creating smart graphs with invalid options (#8500) 2019-03-21 16:25:02 +01:00
Andrey Abramov 73cf9eb1f3
[3.4] bug-fix/issue-#8294 (#8430)
* fix invalid optimizations for multi-valued attributes

* fix broken optimizations for multivalued attributes

* adjust tests

* add `IN_RANGE` function

* add tests

* add some shallow integration tests

* fix optimization for IN operator
2019-03-21 18:23:12 +03:00
Max Neunhöffer 1365eebfac
Make AddFollower and RemoveFollower less aggressive. (#8477)
* Make AddFollower and RemoveFollower less aggressive.
* Adjust comment
* Early exit in count loop.
* Adjust comment in 2nd place.
* CHANGELOG.
2019-03-21 15:27:22 +01:00
Kaveh Vahedipour 8b851c35e3 [3.4] fix multimap to vpack agency store (#8481)
* fix store dump invalid json bug
* hitting ttl should also remove corresponding node
* fix ttl from disk
2019-03-21 15:21:40 +01:00
Kaveh Vahedipour 6529b38240 Feature 3.4/coordinator do full agency dumps (#8131)
* adding agent functionality
* agency route working
* coordinator route to acquiring agency dumps
* remove logging remains and add superuser requirements to API
* Update State.cpp
* guard route
* change we can believe in
2019-03-21 14:58:38 +01:00
Jan 3f3f0c6fe3
Feature 3.4/ncc1701 (#8441) 2019-03-21 14:53:28 +01:00
Jan dbfa483374
add RocksDB options `--rocksdb.allow-fallocate` and `--rocksdb.limit-open-files-at-startup` (#8492) 2019-03-21 12:05:57 +01:00
Jan db7fcdce7a
don't run compact() on a collection after a truncate() was done in the same transaction (#8471)
running compact() in the same transaction will only increase the data size on disk due to
  RocksDB not being able to remove any documents physically due to the snapshot that is
  taken at transaction start.

  This change also exposes db.<collection>.compact() in the arangosh, in order to manually
  run a compaction on the data range of a collection should it be needed for maintenance.
2019-03-20 17:44:06 +01:00
Kaveh Vahedipour ab3206486d [3.4] job must not copy snapshots (#8406)
* job must not copy snapshots
* Node correct empty children
* checked all hasAsChildren sites
* No copy in operator() for node.
* Don't spam log.
* const operator too
* full path to missing key in agency
* the key is missing
* Another info level to DEBUG from INFO.
* Increase timeouts of MoveShard and CleanOutServer agency jobs.
* CHANGELOG.
2019-03-20 17:03:19 +01:00
Jan 1c54830310
don't attempt to remove non-existing WAL files, because such attempt will trigger unnecessary error log messages in the RocksDB library (#8476) 2019-03-20 17:02:34 +01:00
Kaveh Vahedipour fbb9c3d75d [3.4] leader check needs to sit inside waitfor loop (#8444)
* leader check needs to sit inside waitfor loop
* Do not wait in Supervision for commits of new writes.
* CHANGELOG.
2019-03-20 13:16:00 +01:00
Kaveh Vahedipour 432bc2d26e [3.4] address compile warnings (#8343)
* warnings building
* from 3.4 a merge
2019-03-20 13:07:31 +01:00
Jan f621fe6076
revert a previous change that caused existing system collections on a slave to be truncated instead of being deleted (#8443)
truncating instead of deleting introduced the possibility of the collection's indexes continuing to exist with different ids on the slave than on the master, leading to potential follow-up problems
2019-03-18 20:56:50 +01:00
Wilfried Goesgens 68ce741b13 Bug fix 3.4/arrayindex unique update (#8422) 2019-03-14 18:13:05 +01:00
Jan 02d170e4c2
make geo-index-optimizer rule work with multiple loops (#8353) (#8360) 2019-03-13 13:22:12 +01:00
Kaveh Vahedipour bd8cf1e9ea supervision must check for leadership, when waiting for progess (#8401) 2019-03-13 13:01:14 +01:00
jsteemann 27e23f9236 make sure some tick invariants always hold true 2019-03-12 19:29:52 +01:00