1
0
Fork 0
Commit Graph

643 Commits

Author SHA1 Message Date
Tobias Gödderz bdc031f3e6 [3.4] Bugfix of DFS path uniqueness implementation (#9098)
* Backport of https://github.com/arangodb/arangodb/pull/9041

* Use 3.4-compatible getResponsibleShard
2019-05-27 15:04:23 +03:00
Simon e1fdc04193 Bug fix 3.4/jobs indexes (#9099) 2019-05-27 11:43:05 +02:00
KVS85 d9c0566a90 Mark all timecritical and nondeterministic as greylisted (#9048) 2019-05-24 11:52:28 +02:00
Wilfried Goesgens 8e0ebb00c6 Bugfix/backport fs changes (#9024) 2019-05-23 12:46:47 +02:00
jsteemann 764280df8c make test more robust 2019-05-21 18:34:00 +02:00
Jan 7ef180c71e
fix crash (#9059) 2019-05-21 18:32:46 +02:00
Jan ac5d7efcb0
fix handling of initial `null` values in AQL function `MIN` (#9052) 2019-05-21 17:32:45 +02:00
Jan 8925edc131
fix crash in async request handling when request queue is full (#9029) 2019-05-17 16:28:43 +02:00
Simon 30e785537a Bug fix 3.4/pregel gr (#9007) 2019-05-15 18:38:22 +02:00
Simon f20e3713d2 prgl switcheroo (#8995) 2019-05-14 17:18:08 +02:00
Jan c6f2fc5eb3
fix sortedness of sorted results returned by RETURN DISTINCT (#8934) 2019-05-09 20:10:43 +02:00
Simon aae758fe53 fix issues with pregel (#8948) 2019-05-09 18:58:27 +02:00
KVS85 26ade91a95 Small speedup of setup in dump suite (3.4) 2019-05-07 23:50:09 +02:00
Simon 185c8724a3 Pregel various fixes (#8879) 2019-05-07 09:53:18 +02:00
Lars Maier a1bae63cf1 [3.4] Verbose Abort Reason (#8878)
* Added reason to job abort method.

* Additional abort that is not in devel.
2019-05-01 13:54:47 +02:00
Simon 11aa075747 Backport fix for truncate selectivity (#8863) 2019-04-29 17:10:02 +02:00
Jan 885c473ad7 fix assertion failure during documentation generation (#8858)
* fix assertion

* @mchacki
2019-04-29 13:29:36 +03:00
Simon b58bf82871 Fix tick overflow (#8840) (#8856) 2019-04-26 19:20:38 +02:00
KVS85 44849f4e57 Backport testing changes from devel 2019-04-22 12:24:09 +02:00
Max Neunhöffer e234713f43
Avoid delays caused by invalidateCurrent and invalidatePlan. (#8747)
* Avoid delays caused by invalidateCurrent and invalidatePlan.
* Do loadPlan and loadCurrent asynchronously in the background.
* Reload server mappings on Plan Version change.
2019-04-15 17:42:32 +02:00
Dan Larkin-York ce82a512d1 [3.4] Fix RocksDB recovery ticks (#8654) 2019-04-11 11:37:29 +02:00
Jan bf2141b96a
finally fix AQL error messages in all contexts, so that they are usable (#8705) 2019-04-09 09:17:53 +02:00
Max Neunhöffer 6ceb86acc7
Remove ttl when key overwritten without ttl. (#8667)
* Fix ttl deleted when overwritten without ttl.
* Fix the agency test.
* CHANGELOG.
2019-04-03 12:04:12 +02:00
Jan 17669474c2
Bug fix 3.4/replication fuzz debugging (#8668) 2019-04-03 11:43:36 +02:00
Max Neunhöffer 0acb19b18a
Better logic for AddFollower/RemoveFollower scheduling. (#8655)
* Fail a MoveShard job to a FAILED server.
* Better logic for AddFollower/RemoveFollower scheduling.
* Abort MoveShard (leader) in case of a FAILED server in Plan.
* Wait for statistics collections before doing stuff in tests.

cleanOutServer, moveShard, failover and the like.

* Abort MoveShard for follower if FAILED server in Plan.
* Take resigned servers into account when checking for health.
* CHANGELOG.
2019-04-02 23:34:27 +02:00
Jan d29d65face
Bug fix 3.4/cleanup 31032019 (#8633) 2019-04-01 17:02:00 +02:00
Frank Celler c11274cf6b greylisted repair-distribute-shards-like-spec-grey.js 2019-03-30 17:25:35 +01:00
Frank Celler 96626abb4e grey listed shell-foxx-legacy-model-grey.js 2019-03-29 21:40:32 +01:00
Max Neunhöffer 54f84cab92 Performance tuning for many shards. (#8577) 2019-03-29 21:34:45 +01:00
KVS85 c88c4d1416 Remove USE_IRESEARCH definition and usage (#8612) 2019-03-28 17:22:11 +01:00
Jan cf517d0cb6
add AQL functions CRC32 and FNV64 (#8599) 2019-03-27 21:05:56 +01:00
jsteemann 79f9a9d3ae don't make frompresent tests fail when there was an error. this is _expected_ in some cases 2019-03-27 14:15:07 +01:00
KVS85 f0aaaf373d Allow replication suite filtering (#8587) 2019-03-26 20:25:51 +03:00
Heiko abfe61de33 Bug fix 3.4/foxx auth req object (#8361)
* code now fits to the documentation of the arangoUser object inside the foxx request object

* more tests
2019-03-26 08:09:45 +01:00
Jan Christoph Uhde abeca4568c Feature 3.4/better aql error message (#8559) 2019-03-25 18:29:14 +01:00
KVS85 80ab68f6f9 Greylist tests/js/server/replication/replication-fuzz.js (#8558) 2019-03-25 18:09:54 +01:00
Kaveh Vahedipour 799652d6d5 [3.4] precondition plan / version in compaction / store TTL removal (#8526)
* precondition plan / version in compaction / store TTL removal independent of local _ttl set
* Agency init loops break when shutting down.
2019-03-25 08:49:49 +01:00
Andrey Abramov 73cf9eb1f3
[3.4] bug-fix/issue-#8294 (#8430)
* fix invalid optimizations for multi-valued attributes

* fix broken optimizations for multivalued attributes

* adjust tests

* add `IN_RANGE` function

* add tests

* add some shallow integration tests

* fix optimization for IN operator
2019-03-21 18:23:12 +03:00
Jan 35f7fd2126
attempt to make replication fuzz tests more stable (#8498) 2019-03-21 15:51:23 +01:00
Jan db7fcdce7a
don't run compact() on a collection after a truncate() was done in the same transaction (#8471)
running compact() in the same transaction will only increase the data size on disk due to
  RocksDB not being able to remove any documents physically due to the snapshot that is
  taken at transaction start.

  This change also exposes db.<collection>.compact() in the arangosh, in order to manually
  run a compaction on the data range of a collection should it be needed for maintenance.
2019-03-20 17:44:06 +01:00
KVS85 85481b2cb0 Add bucket number info to testfailures output (3.4) (#8473) 2019-03-20 15:56:16 +01:00
KVS85 2d4bf38240 Add testTemplateStringBuilderEmptyInlines test for https://github.com/arangodb/arangodb/pull/8142 (#8207) 2019-03-20 11:03:01 +01:00
Kaveh Vahedipour 472d83eb87 also compaction step size test grey listed (#8434) 2019-03-18 11:17:48 +01:00
Wilfried Goesgens 68ce741b13 Bug fix 3.4/arrayindex unique update (#8422) 2019-03-14 18:13:05 +01:00
Kaveh Vahedipour 9c130b4e38 remove log compaction test in agency from main line. test needs fixing. (#8418) 2019-03-14 11:57:40 +01:00
Jan 54ff79d884
use requireFromPresent and barriers in more cases (#8399) 2019-03-13 15:16:13 +01:00
Jan 02d170e4c2
make geo-index-optimizer rule work with multiple loops (#8353) (#8360) 2019-03-13 13:22:12 +01:00
Max Neunhöffer 54c533c5f6
Some more agency fixes. (#8377)
* Ignore satellite collections in shrinkCluster in agency.
* Abort RemoveFollower job if not enough in-sync followers or leader failure.
* Break quick wait loop in supervision if leadership is lost.
* In case of resigned leader, set isReady=false in clusterInventory.
* Fix catch tests.
2019-03-12 14:09:56 +01:00
Jan 68eee5b4a9
fix connection shutdown in arangosh (#8375) 2019-03-12 12:22:16 +01:00
Jan cd5c9edce1
various replication improvements (#8300) 2019-03-11 13:07:43 +01:00
Michael Hackstein fb956ccc67 PRUNE in AQL Traversal (#8286) 2019-03-07 21:13:26 +01:00
Max Neunhöffer 46e479376d
Further supervision fixes. (#8259)
* Do not schedule Coordinators in Plan.

* Finish failed server when server is no longer in health.

* Fix removeServer checks.

Check that server is no longer in use before removing it. Give 60s
waiting time for condition to be met. Also observer agency lock.

* Finish FailedFollower job if server no longer follower.

This can happen because RemoveFollower was faster.

* Only use GOOD servers as replacement followers.

* Fix AddFollower for satellite collections.

* Fix RemoveServer for satellite collections.

* MoveShard handles moves from leader to followers

* Prepare CleanoutServer and FailedServer for satellite collections.

* More sorting out of AddFollower and RemoveFollower.

* Fix RemoveFollower job w.r.t. choice of follower to remove.

* Fix message.

* kill you own sub jobs, please

* Added preconditions to payloads for supervision's job finishers

* Improve logging.

* Add agency diagnostics to failed move shard test, start.

* Add coordinator agency diagnostics.

* Remove warning.

* Add changelog entry.

* Add agency diagnostics if things go sour with move shard.

* Add agency diags when things go wrong 2.

* API /_api/agency/state: back to old format.

* Fix Windows compilation.

* handle aborts in supervision and wait for the last Raft log to be committed

* tests compiling, 2 failing for valid reasons

* Correctly report TRI_ERROR_CLUSTER_CONNECTION_LOST as 503.

* FailedLeader /FailedFollower cannot continue, when aborting blocks
2019-03-04 11:43:35 +01:00
Michael Hackstein 3e02a726ee
Bug fix/clustercomm queue cleanup (#8191) (#8277)
Cleanup of unused queues in ClusterComm
2019-02-28 09:11:25 +01:00
Andrey Abramov 5815a7a2a8
Fix bug #8213 (#8262)
* properly process ArangoSearch view nodes located inside subqueries

* extend tests to cover failing case

* add integration tests
2019-02-26 18:50:46 +03:00
Max Neunhöffer b87f362f27
The big supervision fix. (#8243)
* Updated CleanoutServerTests. Exclude servers in ToBeCleanedServers. Allow bad servers as new follower.
* Prefer good servers.
* Removed copy, sort and binary_search for a list of ~10 elements.
* Fix move shard bug with compare.
* MoveShard fixes, expansion of doForAllShards
* Count only GOOD servers in actualReplicationFactor.
* Make RemoveFollower remove broken servers.
* Precondition on Plan Version for updating Current as leader.
* CleanupServer to evict server from ToBeCleaned, when aborting
* cleanoutserver with payload in finish
* Use static string for ToBeCleanedOut.
* Fixed typo in log message.
* Change warning level. If a MoveShard job is aborted and we can no longer roll back, then we issue a WARNING rather than a DEBUG log message.
* Another typo and log level.
* Start to fix unit tests.
* Does not make sense for AddFollowerTest to have a FAILED leader.
* Only count GOOD followers in AddFollower.
* Fix AddFollowerTest.
* Report precondition failed in MoveShard follower case.
* Add CHANGELOG.
2019-02-25 08:12:18 -05:00
Heiko 1ae99f08be do not allow edge definitions with empty from or to arrays, added als… (#8200) 2019-02-20 18:33:06 +01:00
Jan 68b112e45a
fixed issue #8165 (#8195) 2019-02-19 18:08:39 +01:00
Jan 304948f30d
when creating a new database with an initial user, set the database p… (#8185) 2019-02-18 16:16:23 +01:00
Tobias Gödderz 7ee560f2d7 [3.4] Resilience tests with data (#7193)
* Begin work on repair-dsl suite to run with data, too

* Use and check data in all tests

* Fixed jslint errors

* Added data to moving-shards-cluster test

* Added additional asserts during createBrokenClusterState()

* Improved failure messages

* Minor cleanup

* Greylist affected tests

* Un-greylist resilience tests, as the fix for moving leaders is now merged

* Prevent "Duplicate testsuite" error

* Added missing require
2019-02-15 12:50:11 +01:00
Jan e640e3f52a
issue #8137: NULL input field generates U_ILLEGAL_ARGUMENT_ERROR (#8139) 2019-02-12 17:56:38 +01:00
Jan 078e1d9b9d
fixed issue #8108 (#8111) 2019-02-05 15:50:47 +01:00
Jan 4ee7ff1932
yet some more replication tests adjustments (#8101) 2019-02-04 16:53:15 +01:00
Tobias Gödderz db70847ab1 [3.4] Sorted COLLECT: avoid nullptr deref when skipping and fix non-invalidated input variables (#8037)
* Added 2 regression tests

* Fixed test expected data

* Fix nullptr dereference

* Fix handling of non-invalidated input variables

* Try a less implicit fix

* Updated CHANGELOG
2019-02-04 16:38:26 +01:00
KVS85 e59edce206 Update shell-database-{rocksdb|mmfiles}-noncluster.js 3.4 (#8084) 2019-01-31 22:35:50 +01:00
Jan 05bcb3d7d1
Bug fix 3.4/streaming cursors v8 issues (#8080) 2019-01-31 17:25:28 +01:00
Jan 675bb78552
more debugging for replication (#8062) 2019-01-30 21:23:00 +01:00
Frank Celler 84802fdc0f Feature/maskings (#8006) 2019-01-28 15:04:23 +01:00
Frank Celler 2c03d9a4f9 blacklisted test 2019-01-24 11:41:30 +01:00
Jan 15852cb491
Bug fix 3.4/address jenkins fails (#7985) 2019-01-22 12:32:17 +01:00
KVS85 562e80c53d Backport tests from devel (#7987) 2019-01-21 11:17:32 +01:00
Jan d394a6b988
fix scrambling of AstNodes that were in use multiple times (#7978) 2019-01-19 18:54:08 +01:00
Jan 3c828347dc
do not simplify non-deterministic conditions (#7927) 2019-01-19 18:52:17 +01:00
Jan 244eed0710
added "peakMemoryUsage" in query results figures, (#7981) 2019-01-19 18:50:55 +01:00
Simon 1f86b7a2b5 Fix stream cursor bug (#7958) 2019-01-16 13:27:57 +01:00
KVS85 dfad8906d9 Bug fix/active failover fix windows 3.4 (#7959)
* Backport active-failover fix for Windows into 3.4

* Backport stop/resume for Windows from devel

* Backport changes from devel into tests also

* Fix tests

* Remove forgotten whitespaces
2019-01-16 11:08:48 +01:00
Frank Celler beb67f0b44 greylisted foxxmaster.js 2019-01-16 09:52:58 +01:00
Frank Celler e2c480c01c greylisted shell-foxx-api-spec.js 2019-01-15 11:52:26 +01:00
Frank Celler d64b356dba greylisted corrupted-crc-mmfiles 2019-01-14 16:44:05 +01:00
Tobias Gödderz d48495c195 [3.4] Foxx queue jobs hanging after Foxxmaster crash (#7921)
* Fixed bug where the Foxxmaster doesn't reset jobs after a crash when it should, or a non-master coordinator removes jobs in progress during startup

* Added a regression test

* Removed foxxmaster test from greylist

* Updated CHANGELOG

* Fixed non-maintainer compile
2019-01-14 16:06:48 +01:00
Jan d5592def42
fix issue #7933: Regression on ISO8601 string compatibility in AQL (#7934) 2019-01-14 13:50:50 +01:00
jsteemann 37473e29bf increase test timeouts 2019-01-11 14:21:02 +01:00
Simon 49da84e941 improve assertions (#7829) 2019-01-09 10:29:36 +01:00
Matthew Von-Maszewski 474f0cde31 Bug fix 3.4/scheduler empty reformat (#7872)
* added check for empty scheduler

* removed log, old is 1 not 0

* require running in this thread

* test

* added isDirect to callback

* signature fixed

* added drain

* added allowDirectHandling

* disabled for testing

* Add ExecContextScope object to direct call.

* try alternate initialization of ExecContextScope

* remove ExecContextScope, no help.  try _fifoSize as part of direct decision.

* strand management to minimize reuse of same strand per listen socket

* blind attempt to address Jenkins shutdown lock up.  may remove quickly.

* add filename and line to existing error log message

* Adjust queueOperation() to stop accepting items once isStopping() becomes true.

* revert previous check-in to MMFilesCollectorThread.cpp

* big reformat

* fixed merge conflicts

* Add CHANGELOG entry.
2019-01-08 20:39:42 +01:00
Jan adf76491b0
added AQL function CHECK_DOCUMENT (#7841) 2019-01-04 15:33:20 +01:00
Jan 1ad9ae3115 added arangorestore options `--number-of-shards` and `--replication-f… (#7868)
* added arangorestore options `--number-of-shards` and `--replication-factor`

* updated documentation

* added version numbers
2019-01-03 11:07:32 +01:00
Jan a14f6dd573
prevent duplicate attributes being generated by AQL queries (#7836) 2019-01-02 12:37:47 +01:00
Jan 762c0fd7c6
fixed issue #7834 (#7845) 2019-01-02 11:09:06 +01:00
KVS85 2b56eabcba Add http_server test for creating view with links (#7853) 2018-12-26 19:30:27 +03:00
Simon 1498c08084 fix restrictCollections parameter on database level replication (#7808) 2018-12-19 18:00:10 +01:00
Jan b5e844fe33
fixed issue #7749 (#7797) 2018-12-19 14:17:54 +01:00
Jan 0574393d52
fixed issue #7757 (#7806) 2018-12-19 14:06:11 +01:00
Jan f39c58e06c
fixed issue #7763 (#7796) 2018-12-19 09:56:05 +01:00
Andrey Abramov 50bed56766
fix issue and add test (#7790) 2018-12-18 17:33:08 +03:00
Wilfried Goesgens 7fa0cdc41b Feature/drop before win7 support in compiler (#6681) (#7751) 2018-12-17 12:06:53 +01:00
Kaveh Vahedipour 9e83e1696d [3.4] allow for quicker start of actions when previusly completed (#7736)
* shard versioning
* one incompatible call fixed
2018-12-17 10:36:50 +01:00
Michael Hackstein ddd5226d13
Feature3.4/improve edgeindex covered (#7750)
* Allow the RocksDB edge index to return the already covered opposite vertex.

* Updated tests
2018-12-12 22:03:47 +01:00
Jan 3fa3170462
fix invalid handling of `_lastValue` in case of multiple coordinators (#7735) 2018-12-12 12:22:52 +01:00
Kaveh Vahedipour 8557fdaf22 agency failed to start in log level trace (#7687) 2018-12-10 15:31:38 +01:00
Kaveh Vahedipour 1b75220a1b [3.4] Early sort out system collections for maintenance (#7589) 2018-12-10 15:16:35 +01:00
Tobias Gödderz a1b925c655 Added tests for parseVersion (#7676) 2018-12-10 12:47:20 +01:00