1
0
Fork 0
Commit Graph

15599 Commits

Author SHA1 Message Date
Jan 15d21ced0b
Bug fix 3.3/proper shutdown of throttle (#4250) 2018-01-10 00:08:17 +01:00
Jan 402ed9a99d ensure proper shutdown of throttle (#4233) 2018-01-05 14:56:52 +01:00
Jan b8c043945f
try to not fail hard when a collection is dropped while the WAL is tailed (#4225) 2018-01-04 16:31:17 +01:00
Jan b2e3a6614a fixed issue #4197: AQL statement not working in 3.3.1 when upgraded from 3.2.10 (#4207) 2018-01-04 00:06:41 +01:00
Jan 75953d69e8 do not reuse collection ids when restoring (#4218) 2018-01-03 23:48:47 +01:00
Max Neunhöffer f58301ed8c
clusterInventory: distinguish between isReady and allInSync. (#4214) 2018-01-03 22:18:15 +01:00
Kaveh Vahedipour 56a9ad69b1 Bug fix 3.3/supervision no longer fails to remove server from failed when back to good (#4210)
* let's not miss failedserver removal
* remove resetting of FailedServers in test code
* Only call abortRequestsToFailedServers at most every 3 seconds.
2018-01-03 21:55:01 +01:00
Jan 1bcab5628d
Bug fix 3.3/fix issue 4199 (#4201) 2018-01-03 21:32:49 +01:00
Jan d80daeb450
Bug fix 3.3/pre release woes (#4084) 2018-01-03 16:02:30 +01:00
Matthew Von-Maszewski 41d1bfce23 create independent executeLockedRead and executeLockedWrite to speed performance (#4178) 2017-12-29 13:36:48 +01:00
Kaveh Vahedipour d6ce7a1301 Agency read write locks ported from devel (#4175) 2017-12-28 11:28:11 +01:00
Matthew Von-Maszewski 392ddde251 Bug fix 3.3: Fix supervisor thread crash (#4165)
* port devel branch to 3.3 of supervisor thread death fix
2017-12-27 22:34:29 +01:00
Max Neunhöffer ef8fcd101c
Port to 3.3 of various fixes around leadership preparation in agency. (#4150)
* Add logging for _earliestPackage in Agent.
* Really enforce the hidden option --server.maximal-threads if given.
* Switch off --log.force-direct in scripts/startStandAloneAgency.sh
* Lower the timeout for sending AppendEntriesRPC to 150s.
* Erase _earliestPackage when becoming a leader.
* Challenge leadership in agent main loop.
* Use steady_clock for _earliestPackage.
* Change _lastAcked and _leaderSince to steady_clock as well.
* time difference calculations based on old readSystemClock to steadyClockToDouble
* All system_clock transitioned to steady_clock in Agent. Remaining system_clock are user input / output or timestamps
* Inception system_clock to steady_clock
2017-12-27 16:47:16 +01:00
Matthew Von-Maszewski d35ebbe6a1 move from devel to 3.3 the dynamic chooseTimeout() feature. (#4166) 2017-12-27 16:36:42 +01:00
Jan 60ecfcfce4
fix wrong lock usage (did not have any effect except misleading the reader of the code) (#4086) 2017-12-23 00:19:46 +01:00
Jan cfe94a0913
add `--ignore-missing` option to arangoimp (#4128)
this option allows importing lines with less fields than specified in the CSV
header line
2017-12-22 11:09:03 +01:00
Jan e804f1d861
fix nullptr access (#4143)
* fix nullptr access

* fix compile error
2017-12-22 10:56:01 +01:00
Matthew Von-Maszewski f35215ea51 Have twice seen coordinator go into long loop on shutdown. Added two tests for isStopping() to break the loops. (#4139) 2017-12-21 20:56:14 +01:00
Jan 8b873bdf4a
prefer unique equality lookups, as they do not have O(log(n)) complexity (#4096) 2017-12-21 20:41:10 +01:00
Jan Christoph Uhde c91cfecded remove superfluous decrease memory usage (#4132) 2017-12-21 20:15:03 +01:00
Jan f83a1a0394
Feature 3.3/add recovery tests for intermediate commits (#4106)
* added several recovery tests that check intermediate commits

* small fixes

* fix tests
2017-12-20 09:46:12 +01:00
Jan 5230df9f72
Feature 3.3/fulltext optimizations (#3925) 2017-12-19 21:40:12 +01:00
Jan b7ee607312
Bug fix 3.3/integer overflow when calculating waits in constituent (#4090)
* integer overflow in Constituent could seize operation of Agency

* less likely integer overflow on double conversion

* less likely integer overflow on double conversion

* changed comparison to integer comparison as suggested by @neunhoef
2017-12-19 10:10:05 +01:00
Simon Grätzer 90e6c78845 Make sure recalculated counts are actually stored (#4079)
(cherry picked from commit ab9faf56ce81a214a20683f7512db063ef9b063b)
2017-12-18 22:39:04 +01:00
jsteemann f9a86e6cca remove debug message 2017-12-16 15:22:54 +01:00
Jan 08de96ffee
fixed issue #4056 (#4058)
* fixed issue #4056

* fix over eager santiation
2017-12-16 15:10:29 +01:00
Jan d78f4601ba
don't make the syncer fail when it is restarted (#4030) 2017-12-14 10:23:35 +01:00
Jan 5b392c027a
forgotten fix for globallyUniqueId (#4033) 2017-12-14 10:05:28 +01:00
Jan d0021ac71a
fix issue #planning/1511 (#4029) 2017-12-13 22:09:46 +01:00
Jan 9c5893e7a7
fix premature unlock (#3802) (#4027)
* fix some deadlocks found by evil lock manager (tm)

* fix duplicate lock

* fix indentation

* ensure proper lock dependencies

* fix lock acquisition

* removed useless comment

* do not lock twice

* create either a V8 transaction context or a standalone transaction context, depending on if we are called from within V8 or not

* AQL micro optimizations

* use explicit constructor

* only use V8DealerFeature's ConditionLocker for acquiring a free V8 context

entering and exiting the selected context is then done later on without having to hold the ConditionLocker

* remove some recursive locks

* Disable custom deadlock detection when Thread Sanitizer is enabled

* Changing ifdef's

* grr

* broke gcc

* Using atomic for ApplicationServer::_server

* fix premature unlock

* add some asserts

* honor collection locking in cluster

* yet one more lock fix

* removed assertion

* some more bugfixes

* Fixing assert

(cherry picked from commit 1155df173bfb67303077fbe04ee8d909517bfd21)
2017-12-13 18:46:14 +01:00
Jan e7f93d8b9d
potentially fix send request timeout (#4025)
* potentially fix send request timeout

* fix globallyUniqueIds
2017-12-13 18:45:31 +01:00
Simon Grätzer 3287d8706a Use uuid in initalsync to ensure proper collection mapping (#3972) 2017-12-13 14:29:21 +01:00
Simon Grätzer cfd500c53c Fixing an issue with intermediate commits (#4006)
* Fixing an issue with intermediate commits

(cherry picked from commit 7f61fb9be0f22904be21e9dd26c3870035a5b318)

* Only check collection counts without intermediate commits

* Fixing assert
2017-12-12 23:15:41 +01:00
Jan d080350afa
make replication abortable (#4015) 2017-12-12 23:15:22 +01:00
Jan 7af86685e3
when upgrading from 3.1 LastHeartBeatAcked could also have been missing, when the 3.1 cluster had not run for long enough (#3974) 2017-12-08 17:33:37 +01:00
Jan 3caa4c47bb
add a test for replication applier restarts (#3750) (#3933) 2017-12-08 15:48:15 +01:00
jsteemann e0b3917380 fix failing test on MSVC 2017-12-07 16:25:31 +01:00
Wilfried Goesgens 3a940eccdc release version 3.3.rc7 2017-12-07 14:48:38 +01:00
Jan 6ce073c2d5 fixed issue #3640: limit in subquery (#3903) 2017-12-07 10:41:46 +01:00
Jan 5f142fb601 fix issue #3745: Invalid result when using OLD object with array attribute in UPSERT statement (#3904)
* fix issue #3745: Invalid result when using OLD object with array attribute in UPSERT statement

* updated CHANGELOG
2017-12-07 10:40:59 +01:00
Jan 29d81302ce Bug fix 3.3/agency transactions (#3936)
* Added 503/0 inquire tests to resilience tests (#3839)

* replaced all AgencyGeneralTransactions by AgencyWriteTransaction (#3841)
2017-12-07 10:39:36 +01:00
Jan 08f9326eed make sure we do not dereference a nullptr (#3906) 2017-12-07 10:36:13 +01:00
Jan 291df05e08 Resolving externals before using them with VelocyPackHelper::VPackHash (#3907) 2017-12-07 10:35:25 +01:00
Jan 1789977d51 fix heap sort in GatherBlock (#3908) 2017-12-07 10:34:44 +01:00
Jan 7aed168a0d added missing guard object (#3910) 2017-12-07 10:34:17 +01:00
Jan bec83181be Bug fix 3.3/add security check end with failover (#3911)
* Add security check in AgencyComm::sendWithFailover.

* some cleanup

* added some more tests

* add typeName() to AgencyCommTransaction to make the transaction type printable in debug messages

* improve debuggability
2017-12-07 10:33:59 +01:00
Jan ad8de0e6bf allow passing a serverId value of "none" to replication APIs (#3912) 2017-12-07 10:33:14 +01:00
Jan 4397ebf3c7 improve compatibility when replicating from a 3.2 (#3915) 2017-12-07 10:30:27 +01:00
Jan ba729150bf backporting inquire fixes (#3920) 2017-12-07 10:27:41 +01:00
Jan 631b2dcb11 fix multiple binds to the same ip/port on Windows (#3923) 2017-12-07 10:26:25 +01:00
Jan 21e275d1a1 Propagate commit errors to AQL (#3831) (#3932) 2017-12-07 10:20:04 +01:00
Michael Hackstein f986a5f06c Improved the cost estimation of traversals to be independent from max search depth. This fixes #3917 (#3944)
LGTM
2017-12-07 10:05:35 +01:00
Matthew Von-Maszewski f6cdbcd4e8 add defensive coding and logging in response to a divide by zero. ColumnFamilyData::RecalculateWriteStallConditions() called SetBytePerSecond() with some value less than four. Could have been a race condition due to our SetThrottle() called without db mutex. No proof, just likely. (#3950) 2017-12-07 09:25:44 +01:00
Jan 4104296fd3 fix revision id vs local document id usage in incremental sync (#3916) 2017-12-07 09:24:20 +01:00
jsteemann b91e6da52e fix replication context locking 2017-12-04 12:09:57 +01:00
Frank Celler 75a494dc74 Merge branch 'devel' of github.com:arangodb/arangodb into 3.3 2017-11-28 12:49:25 +01:00
Kaveh Vahedipour f7b4150b64 no clientId anymore in send/sendWithFailOver SPIs (#3819) 2017-11-28 10:47:36 +01:00
Kaveh Vahedipour c300eee5f0 minor (#3813) 2017-11-27 18:22:13 +01:00
Jan 4eab985e90 fix wrong ifdefs (#3803) 2017-11-27 14:20:04 +01:00
Kaveh Vahedipour 27cd691bbf Bug fix/agencycomm validate methods broken (#3805) 2017-11-27 14:18:25 +01:00
Frank Celler a54da92fc7 Merge branch 'devel' of github.com:arangodb/arangodb into 3.3 2017-11-24 12:29:19 +01:00
Michael Hackstein 99b7b5080b Fixed CAS in AuthInfo update in cluster. Should now be more reliable. (#3787) 2017-11-24 11:47:24 +01:00
Jan bd1a2d6cce fix shutdown deadlock (#3796) 2017-11-24 11:42:09 +01:00
Kaveh Vahedipour 2beaef41ff Bug fix/agencycomm validate methods broken (#3784) 2017-11-24 10:31:07 +01:00
Frank Celler 0b609dc65e Merge branch 'devel' of github.com:arangodb/arangodb into 3.3 2017-11-22 16:11:52 +01:00
Matthew Von-Maszewski 50012d1ed8 Throttle adjustments for high speed arrays (#3755) 2017-11-22 12:03:55 +01:00
Michael Hackstein 7d95de46e8
Fixed a dead-lock issue in authinfo (#3764) 2017-11-22 10:33:39 +01:00
Frank Celler e963a4c39b Merge branch 'devel' of github.com:arangodb/arangodb into 3.3 2017-11-20 10:30:42 +01:00
Matthew Von-Maszewski 874e1d8eb0 correct stupid mistake: was erasing iterator in middle of same iterators loop (#3740) 2017-11-20 10:24:53 +01:00
Frank Celler cf742d984c Merge branch 'devel' of github.com:arangodb/arangodb into 3.3 2017-11-17 22:57:43 +01:00
Matthew Von-Maszewski 0558b4372d Improve ClusterComm::wait() (#3722) 2017-11-17 22:46:54 +01:00
Simon Grätzer 0e485f7441 Fixing collection name collection handling in Syncer (#3710) 2017-11-17 16:36:57 +01:00
Simon Grätzer 987daca85b Handle invalid endpoints in AgencyComm (#3729) 2017-11-17 16:35:59 +01:00
Jan 86ef7d4018 Bug fix/fixes 1711 obi (#3730) 2017-11-17 16:34:33 +01:00
m0ppers 75e1bf31cd Feature/allow access to configured 🔐 in readonly mode (#3698)
* Special method to access configured access levels as opposed to only getting the effective access level
* Add integration test
* Allow grants on collection level
2017-11-17 16:11:22 +01:00
Kaveh Vahedipour 7b80deb5cc Fixed object assignment operator for agency's key value store (#3701)
* Fixed object assignment operator for agency's key value store
* Node's toJson is now actually toJson. getString should be used for string extractions
* adjust agency's documentation (clarify precondition)
2017-11-17 15:49:40 +01:00
jsteemann 5394cc27a6 disable potentially unsafe socket option 2017-11-17 11:21:03 +01:00
Kaveh Vahedipour 255d90d26a cherry pick from 3.2 pull request for bug-fix/supervision-thread-exists-on-pre3.2-agency (#3709)
This is the HealthRecord upgrade patch.
2017-11-17 10:14:14 +01:00
Jan b4f6ee9273 Feature/improved index api for unique constraints and replication (#3715) 2017-11-16 21:02:01 +01:00
Jan 4a199e2fe3 make truncate a bit less obstrusive (#3721) 2017-11-16 20:28:33 +01:00
Jan Christoph Uhde 6f6d19b1b9 Stricter normalization for filter and sort conditions (#3718)
Moves attribute accesses to the LHS when using <,>,<=,>=
2017-11-16 19:17:12 +01:00
Jan 7eaaeaf392 fix some compile warnings (#3720) 2017-11-16 18:18:28 +01:00
Jan fce593b724 removed `--recycle-ids` option for arangorestore (#3713) 2017-11-16 14:25:54 +01:00
Jan 5abf0c1185 Bug fix/fixes 1511 (#3711) 2017-11-16 14:18:51 +01:00
Matthew Von-Maszewski 97944f012e Fix issues due to throttle started with too small a flush (#3707) 2017-11-16 09:13:08 +01:00
Jan Christoph Uhde 987aea2af3 implement heap merge for cluster blocks (#3617) 2017-11-15 18:05:43 +01:00
Jan 3b0a8a9cdf make the replication applier auto-start for the RocksDB engine if con… (#3647) 2017-11-15 12:02:37 +01:00
Max Neunhoeffer bc1891dfd0
Comment out RocksDBThrottle. 2017-11-14 16:53:42 +01:00
Michael Hackstein 3911a6a722 Fixed minor issue in shard distribution reporter thanks to @danielhlarkin for spotting (#3695) 2017-11-14 16:47:25 +01:00
Jan 15ad2fbd99 do not complain about missing datafile statistics (#3688) 2017-11-14 16:42:31 +01:00
Max Neunhöffer 766ab7c8cf
Fix agency shutdown bug. (#3683)
* Fix agency shutdown bug.
* Remove precondition that was not needed in AgencyComm::removeValues.
* Fail fatally if threads do not shut down.
2017-11-14 16:33:46 +01:00
Jan cc1fc716a4 Bug fix/fix server mode test side effects (#3674) 2017-11-14 15:19:00 +01:00
Jan 8ece5914a3 do not warn when the user attempts to drop a non-existing index (#3682) 2017-11-13 17:47:57 +01:00
Simon Grätzer c6fe726901 Removing unsafe asserts in wal tailing v3.3 (#3672) 2017-11-13 17:41:57 +01:00
Jan ba9bc41457 fix some typos in code and docs (#3671) 2017-11-13 17:33:36 +01:00
Matthew Von-Maszewski bbce4caefa Feature/mv basho smoothing1 (#3384) 2017-11-13 15:43:44 +01:00
Jan 03daf9e9c9 make incremental sync replication API check if the client passed an "offset" request parameter (#3669)
if yes, the server may dynamically adapt the size of the response, in order to ensure that
HTTP responses do not get out of hand size-wise. This is a new feature in devel, and this
commit now makes it optional so that older clients do not need to be changed.
2017-11-13 15:08:31 +01:00
Jan e1ecc6b02c fix some threading issues (#3659) 2017-11-12 22:34:51 +01:00
Frank Celler 813f5c8541
fixed output (#3668) 2017-11-12 18:06:56 +01:00
Kaveh Vahedipour c9621ff230 Feature/new agency checks for preconditions (#3612) 2017-11-11 22:48:23 +01:00