1
0
Fork 0
Commit Graph

239 Commits

Author SHA1 Message Date
Simon b58bf82871 Fix tick overflow (#8840) (#8856) 2019-04-26 19:20:38 +02:00
KVS85 44849f4e57 Backport testing changes from devel 2019-04-22 12:24:09 +02:00
Jan bf2141b96a
finally fix AQL error messages in all contexts, so that they are usable (#8705) 2019-04-09 09:17:53 +02:00
Max Neunhöffer 6ceb86acc7
Remove ttl when key overwritten without ttl. (#8667)
* Fix ttl deleted when overwritten without ttl.
* Fix the agency test.
* CHANGELOG.
2019-04-03 12:04:12 +02:00
Jan 17669474c2
Bug fix 3.4/replication fuzz debugging (#8668) 2019-04-03 11:43:36 +02:00
Max Neunhöffer 0acb19b18a
Better logic for AddFollower/RemoveFollower scheduling. (#8655)
* Fail a MoveShard job to a FAILED server.
* Better logic for AddFollower/RemoveFollower scheduling.
* Abort MoveShard (leader) in case of a FAILED server in Plan.
* Wait for statistics collections before doing stuff in tests.

cleanOutServer, moveShard, failover and the like.

* Abort MoveShard for follower if FAILED server in Plan.
* Take resigned servers into account when checking for health.
* CHANGELOG.
2019-04-02 23:34:27 +02:00
Frank Celler c11274cf6b greylisted repair-distribute-shards-like-spec-grey.js 2019-03-30 17:25:35 +01:00
Frank Celler 96626abb4e grey listed shell-foxx-legacy-model-grey.js 2019-03-29 21:40:32 +01:00
Jan cf517d0cb6
add AQL functions CRC32 and FNV64 (#8599) 2019-03-27 21:05:56 +01:00
jsteemann 79f9a9d3ae don't make frompresent tests fail when there was an error. this is _expected_ in some cases 2019-03-27 14:15:07 +01:00
KVS85 f0aaaf373d Allow replication suite filtering (#8587) 2019-03-26 20:25:51 +03:00
Heiko abfe61de33 Bug fix 3.4/foxx auth req object (#8361)
* code now fits to the documentation of the arangoUser object inside the foxx request object

* more tests
2019-03-26 08:09:45 +01:00
Jan Christoph Uhde abeca4568c Feature 3.4/better aql error message (#8559) 2019-03-25 18:29:14 +01:00
KVS85 80ab68f6f9 Greylist tests/js/server/replication/replication-fuzz.js (#8558) 2019-03-25 18:09:54 +01:00
Kaveh Vahedipour 799652d6d5 [3.4] precondition plan / version in compaction / store TTL removal (#8526)
* precondition plan / version in compaction / store TTL removal independent of local _ttl set
* Agency init loops break when shutting down.
2019-03-25 08:49:49 +01:00
Andrey Abramov 73cf9eb1f3
[3.4] bug-fix/issue-#8294 (#8430)
* fix invalid optimizations for multi-valued attributes

* fix broken optimizations for multivalued attributes

* adjust tests

* add `IN_RANGE` function

* add tests

* add some shallow integration tests

* fix optimization for IN operator
2019-03-21 18:23:12 +03:00
Jan 35f7fd2126
attempt to make replication fuzz tests more stable (#8498) 2019-03-21 15:51:23 +01:00
KVS85 2d4bf38240 Add testTemplateStringBuilderEmptyInlines test for https://github.com/arangodb/arangodb/pull/8142 (#8207) 2019-03-20 11:03:01 +01:00
Kaveh Vahedipour 472d83eb87 also compaction step size test grey listed (#8434) 2019-03-18 11:17:48 +01:00
Wilfried Goesgens 68ce741b13 Bug fix 3.4/arrayindex unique update (#8422) 2019-03-14 18:13:05 +01:00
Kaveh Vahedipour 9c130b4e38 remove log compaction test in agency from main line. test needs fixing. (#8418) 2019-03-14 11:57:40 +01:00
Jan 54ff79d884
use requireFromPresent and barriers in more cases (#8399) 2019-03-13 15:16:13 +01:00
Jan 02d170e4c2
make geo-index-optimizer rule work with multiple loops (#8353) (#8360) 2019-03-13 13:22:12 +01:00
Jan cd5c9edce1
various replication improvements (#8300) 2019-03-11 13:07:43 +01:00
Michael Hackstein fb956ccc67 PRUNE in AQL Traversal (#8286) 2019-03-07 21:13:26 +01:00
Max Neunhöffer 46e479376d
Further supervision fixes. (#8259)
* Do not schedule Coordinators in Plan.

* Finish failed server when server is no longer in health.

* Fix removeServer checks.

Check that server is no longer in use before removing it. Give 60s
waiting time for condition to be met. Also observer agency lock.

* Finish FailedFollower job if server no longer follower.

This can happen because RemoveFollower was faster.

* Only use GOOD servers as replacement followers.

* Fix AddFollower for satellite collections.

* Fix RemoveServer for satellite collections.

* MoveShard handles moves from leader to followers

* Prepare CleanoutServer and FailedServer for satellite collections.

* More sorting out of AddFollower and RemoveFollower.

* Fix RemoveFollower job w.r.t. choice of follower to remove.

* Fix message.

* kill you own sub jobs, please

* Added preconditions to payloads for supervision's job finishers

* Improve logging.

* Add agency diagnostics to failed move shard test, start.

* Add coordinator agency diagnostics.

* Remove warning.

* Add changelog entry.

* Add agency diagnostics if things go sour with move shard.

* Add agency diags when things go wrong 2.

* API /_api/agency/state: back to old format.

* Fix Windows compilation.

* handle aborts in supervision and wait for the last Raft log to be committed

* tests compiling, 2 failing for valid reasons

* Correctly report TRI_ERROR_CLUSTER_CONNECTION_LOST as 503.

* FailedLeader /FailedFollower cannot continue, when aborting blocks
2019-03-04 11:43:35 +01:00
Andrey Abramov 5815a7a2a8
Fix bug #8213 (#8262)
* properly process ArangoSearch view nodes located inside subqueries

* extend tests to cover failing case

* add integration tests
2019-02-26 18:50:46 +03:00
Heiko 1ae99f08be do not allow edge definitions with empty from or to arrays, added als… (#8200) 2019-02-20 18:33:06 +01:00
Jan 68b112e45a
fixed issue #8165 (#8195) 2019-02-19 18:08:39 +01:00
Jan 304948f30d
when creating a new database with an initial user, set the database p… (#8185) 2019-02-18 16:16:23 +01:00
Tobias Gödderz 7ee560f2d7 [3.4] Resilience tests with data (#7193)
* Begin work on repair-dsl suite to run with data, too

* Use and check data in all tests

* Fixed jslint errors

* Added data to moving-shards-cluster test

* Added additional asserts during createBrokenClusterState()

* Improved failure messages

* Minor cleanup

* Greylist affected tests

* Un-greylist resilience tests, as the fix for moving leaders is now merged

* Prevent "Duplicate testsuite" error

* Added missing require
2019-02-15 12:50:11 +01:00
Jan e640e3f52a
issue #8137: NULL input field generates U_ILLEGAL_ARGUMENT_ERROR (#8139) 2019-02-12 17:56:38 +01:00
Jan 078e1d9b9d
fixed issue #8108 (#8111) 2019-02-05 15:50:47 +01:00
Jan 4ee7ff1932
yet some more replication tests adjustments (#8101) 2019-02-04 16:53:15 +01:00
Tobias Gödderz db70847ab1 [3.4] Sorted COLLECT: avoid nullptr deref when skipping and fix non-invalidated input variables (#8037)
* Added 2 regression tests

* Fixed test expected data

* Fix nullptr dereference

* Fix handling of non-invalidated input variables

* Try a less implicit fix

* Updated CHANGELOG
2019-02-04 16:38:26 +01:00
KVS85 e59edce206 Update shell-database-{rocksdb|mmfiles}-noncluster.js 3.4 (#8084) 2019-01-31 22:35:50 +01:00
Jan 05bcb3d7d1
Bug fix 3.4/streaming cursors v8 issues (#8080) 2019-01-31 17:25:28 +01:00
Jan 675bb78552
more debugging for replication (#8062) 2019-01-30 21:23:00 +01:00
Frank Celler 84802fdc0f Feature/maskings (#8006) 2019-01-28 15:04:23 +01:00
Jan 15852cb491
Bug fix 3.4/address jenkins fails (#7985) 2019-01-22 12:32:17 +01:00
KVS85 562e80c53d Backport tests from devel (#7987) 2019-01-21 11:17:32 +01:00
Jan d394a6b988
fix scrambling of AstNodes that were in use multiple times (#7978) 2019-01-19 18:54:08 +01:00
Jan 3c828347dc
do not simplify non-deterministic conditions (#7927) 2019-01-19 18:52:17 +01:00
Jan 244eed0710
added "peakMemoryUsage" in query results figures, (#7981) 2019-01-19 18:50:55 +01:00
Simon 1f86b7a2b5 Fix stream cursor bug (#7958) 2019-01-16 13:27:57 +01:00
KVS85 dfad8906d9 Bug fix/active failover fix windows 3.4 (#7959)
* Backport active-failover fix for Windows into 3.4

* Backport stop/resume for Windows from devel

* Backport changes from devel into tests also

* Fix tests

* Remove forgotten whitespaces
2019-01-16 11:08:48 +01:00
Frank Celler beb67f0b44 greylisted foxxmaster.js 2019-01-16 09:52:58 +01:00
Frank Celler e2c480c01c greylisted shell-foxx-api-spec.js 2019-01-15 11:52:26 +01:00
Frank Celler d64b356dba greylisted corrupted-crc-mmfiles 2019-01-14 16:44:05 +01:00
Tobias Gödderz d48495c195 [3.4] Foxx queue jobs hanging after Foxxmaster crash (#7921)
* Fixed bug where the Foxxmaster doesn't reset jobs after a crash when it should, or a non-master coordinator removes jobs in progress during startup

* Added a regression test

* Removed foxxmaster test from greylist

* Updated CHANGELOG

* Fixed non-maintainer compile
2019-01-14 16:06:48 +01:00
Jan d5592def42
fix issue #7933: Regression on ISO8601 string compatibility in AQL (#7934) 2019-01-14 13:50:50 +01:00
jsteemann 37473e29bf increase test timeouts 2019-01-11 14:21:02 +01:00
Simon 49da84e941 improve assertions (#7829) 2019-01-09 10:29:36 +01:00
Jan adf76491b0
added AQL function CHECK_DOCUMENT (#7841) 2019-01-04 15:33:20 +01:00
Jan 1ad9ae3115 added arangorestore options `--number-of-shards` and `--replication-f… (#7868)
* added arangorestore options `--number-of-shards` and `--replication-factor`

* updated documentation

* added version numbers
2019-01-03 11:07:32 +01:00
Jan a14f6dd573
prevent duplicate attributes being generated by AQL queries (#7836) 2019-01-02 12:37:47 +01:00
Jan 762c0fd7c6
fixed issue #7834 (#7845) 2019-01-02 11:09:06 +01:00
Simon 1498c08084 fix restrictCollections parameter on database level replication (#7808) 2018-12-19 18:00:10 +01:00
Jan b5e844fe33
fixed issue #7749 (#7797) 2018-12-19 14:17:54 +01:00
Jan 0574393d52
fixed issue #7757 (#7806) 2018-12-19 14:06:11 +01:00
Jan f39c58e06c
fixed issue #7763 (#7796) 2018-12-19 09:56:05 +01:00
Michael Hackstein ddd5226d13
Feature3.4/improve edgeindex covered (#7750)
* Allow the RocksDB edge index to return the already covered opposite vertex.

* Updated tests
2018-12-12 22:03:47 +01:00
Jan 3fa3170462
fix invalid handling of `_lastValue` in case of multiple coordinators (#7735) 2018-12-12 12:22:52 +01:00
Jan d894986cd9
do not optimize away sort clauses when it is unsafe to do so (#7694) 2018-12-07 16:23:13 +01:00
Jan 2f48d03c19
speed up remove ops for RocksDB engine (#7638)
* speed up remove ops for RocksDB engine

* add more tests and improve queries a bit for single remote AQL operations
2018-12-06 17:48:42 +01:00
Max Neunhöffer 3a7df19189 Fix super user JWT token behaviour with non-ex. db. (#7656) 2018-12-05 16:50:41 +01:00
Frank Celler 6e2cbe2d1e greylisted 2018-12-04 09:28:00 +01:00
Max Neunhöffer ceb1018af4
Wait for 5 dbservers before starting resilience tests. (#7541)
* Wait for 5 dbservers before starting test.
* Fix jslint.
2018-12-03 13:15:56 +01:00
Frank Celler fb3a8b6b39 sleep before check 2018-12-02 21:44:16 +01:00
Jan 2c3542d41e
fixed issue #7522 (#7554) 2018-11-29 19:26:42 +01:00
Dan Larkin-York 00c060c884 [3.4] Fix end condition (hasMore) for EnumerateViewNode. (#7278)
* Fix end condition (hasMore) for EnumerateViewNode.

* Fix crashes.

* Some more fixes.

* eliminate code duplication
2018-11-27 00:41:29 +03:00
Max Neunhöffer 6bd61760f2
Fix moving of shard leaders. (#7446)
* Ungreylist move shard test.
* Move leader shard: wait until all but the old leader are in sync.
* Increate moveShard timeout to 10000 seconds.
* Add CHANGELOG.
* Fix compilation.
* Fix a misleading comment.
2018-11-26 15:05:56 +01:00
Wilfried Goesgens eb41c6afcc Bug fix 3.4 /resync test (#7435) 2018-11-26 14:05:33 +01:00
Michael Hackstein 75f89ed74b
Bug fix/update foxx services after restore (#6774) (#7455)
* Bug fix/update foxx services after restore (#6774)

* triggers foxx queue update which leads to the internal selfHeal function of a foxx app to make foxx apps publicy visible after a foxx app is restored

* this will also add the recognition of imported foxx services

* Testing JS refactoring

* Added test case for Foxx dump -> restore cases

* Fixed check, sth- i tries to contact to the foxx service. Test is red now.

* Fixed tests for dump / restore using Foxx. Also first draft to fix the fox side. Blocked by sth. fixed in the Main Repositorx already

* Fixed typo in dump/restore testsuite

* Removed old version of the fix

* Fixed JSLint

* Removed debug-log output from foxx manager
2018-11-26 13:22:50 +01:00
Simon 96346a12d0 switch default message for requireFromPresent (#7439) (#7450)
(cherry picked from commit f90b48f792)
2018-11-26 09:16:48 +01:00
Andrey Abramov 822e15e770
issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes (#7370) (#7451)
* issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes

* backport: add test to ensure views are dropped when database is dropped from plan, fix some issues in ClusterInfo

* optimize primary key lookups in ArangoSearch

* fix test

* Add JS tests

* temporary comment optimizations

# Conflicts:
#	arangod/Cluster/ClusterInfo.cpp
2018-11-26 00:33:58 +03:00
Simon ebad3c3c83 Fix restore of views, add --view option (#7425) (#7427)
(cherry picked from commit c584527d79)
2018-11-23 09:11:33 +01:00
Max Neunhöffer 7bf63cdb95
Make error handling in move shard tests more robust. (#7418)
* Make getCleanedOutServers error handling more robust.

* Fix two more instances of getCleanedOutServers.
2018-11-22 22:53:07 +01:00
Jan a6cb178b86
add some more intermediate commit tests (#7417) 2018-11-22 15:29:08 +01:00
Frank Celler ef5ffbef61 greyed foxxmaster.js because it is not stable 2018-11-22 12:55:26 +01:00
Simon ef239cbe4e Make recovery more reliable (#7297) (#7367) 2018-11-21 16:51:38 +01:00
Simon 5124633e6a Faster index creation (#7348) 2018-11-20 13:41:01 +01:00
Max Neunhöffer 256c167155
Another place with a resigned leader. (#7350) 2018-11-19 11:41:43 +01:00
Jan 812c9223fe
fix queries that refer to COLLECT variables from inside COLLECT (#7333) 2018-11-15 15:10:56 +01:00
Max Neunhöffer 805f7a7621
Fix timeout in cluster operation in create and drop collections. (#7300)
* Fix loophole.
* Fix inquiry case of id not found: 404.
* Also handle correctly in AgencyComm.
* Fix agency tests.
* Fix error handling in dropCollectionOnCoordinator.
2018-11-14 10:02:26 +01:00
Jan 8bcb1a310c
fix failing non-deterministic query-stream test (#7296) 2018-11-13 11:37:09 +01:00
Alan Plum 1ea6374511 Fix Foxx Queues infinite maxFailures (#7224) 2018-11-12 13:21:12 +01:00
jsteemann 7a2314a32b remove reference to non-existing deriveTestSuite function 2018-11-12 11:33:40 +01:00
Frank Celler 10ceaf2391 moved to grey 2018-11-08 21:05:16 +01:00
Max Neunhöffer d21a0f8bca
Greylist moving-shards-with-arangosearch-view-cluster. (#7272)
* Greylist moving-shards-with-arangosearch-view-cluster.

* Add documentation for greylisted tests.
2018-11-08 16:25:52 +01:00
Wilfried Goesgens d33ffab6d8 add more information when timeout failing the index creation tests (#7266) 2018-11-08 12:44:28 +01:00
KVS85 0822677a0c Fix update-view-arangosearch-spec tests (#7246) 2018-11-07 00:30:40 +03:00
KVS85 38d127cc5a Add view profiling tests (#7230) 2018-11-06 17:15:31 +03:00
Tobias Gödderz 8401f0e36c Fix teardown, improved assertion & error message (#7218) 2018-11-06 13:10:08 +01:00
Dan Larkin-York e5243f9254 [3.4] Upgrade old MMFiles collections for compatibility with ArangoSearch (#7133) 2018-11-06 11:12:54 +01:00
Simon 9c53d045be Server stream cursor (#7186) (#7210) 2018-11-03 20:17:52 +01:00
Jan eb3deb578f
smaller changes for replication (#7201) 2018-11-02 15:47:49 +01:00
Vasiliy 850919178f issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca (#7167)
* issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca

* address merge issue

* backport: remove code causing nullptr access

* invalidate payload for each field in FieldIterator before setting a value

* address compilation issues
2018-11-01 23:12:39 +03:00
Jan 023ca6dc33
Bug fix 3.4/patch slave collection count (#7156) 2018-10-31 17:20:46 +01:00
Jan aa385c2bbc
increase the maximum allowed number of collections in an AQL query (#7155) 2018-10-31 10:08:32 +01:00