1
0
Fork 0
Commit Graph

215 Commits

Author SHA1 Message Date
Michael Hackstein fb956ccc67 PRUNE in AQL Traversal (#8286) 2019-03-07 21:13:26 +01:00
Max Neunhöffer 46e479376d
Further supervision fixes. (#8259)
* Do not schedule Coordinators in Plan.

* Finish failed server when server is no longer in health.

* Fix removeServer checks.

Check that server is no longer in use before removing it. Give 60s
waiting time for condition to be met. Also observer agency lock.

* Finish FailedFollower job if server no longer follower.

This can happen because RemoveFollower was faster.

* Only use GOOD servers as replacement followers.

* Fix AddFollower for satellite collections.

* Fix RemoveServer for satellite collections.

* MoveShard handles moves from leader to followers

* Prepare CleanoutServer and FailedServer for satellite collections.

* More sorting out of AddFollower and RemoveFollower.

* Fix RemoveFollower job w.r.t. choice of follower to remove.

* Fix message.

* kill you own sub jobs, please

* Added preconditions to payloads for supervision's job finishers

* Improve logging.

* Add agency diagnostics to failed move shard test, start.

* Add coordinator agency diagnostics.

* Remove warning.

* Add changelog entry.

* Add agency diagnostics if things go sour with move shard.

* Add agency diags when things go wrong 2.

* API /_api/agency/state: back to old format.

* Fix Windows compilation.

* handle aborts in supervision and wait for the last Raft log to be committed

* tests compiling, 2 failing for valid reasons

* Correctly report TRI_ERROR_CLUSTER_CONNECTION_LOST as 503.

* FailedLeader /FailedFollower cannot continue, when aborting blocks
2019-03-04 11:43:35 +01:00
Andrey Abramov 5815a7a2a8
Fix bug #8213 (#8262)
* properly process ArangoSearch view nodes located inside subqueries

* extend tests to cover failing case

* add integration tests
2019-02-26 18:50:46 +03:00
Heiko 1ae99f08be do not allow edge definitions with empty from or to arrays, added als… (#8200) 2019-02-20 18:33:06 +01:00
Jan 68b112e45a
fixed issue #8165 (#8195) 2019-02-19 18:08:39 +01:00
Jan 304948f30d
when creating a new database with an initial user, set the database p… (#8185) 2019-02-18 16:16:23 +01:00
Tobias Gödderz 7ee560f2d7 [3.4] Resilience tests with data (#7193)
* Begin work on repair-dsl suite to run with data, too

* Use and check data in all tests

* Fixed jslint errors

* Added data to moving-shards-cluster test

* Added additional asserts during createBrokenClusterState()

* Improved failure messages

* Minor cleanup

* Greylist affected tests

* Un-greylist resilience tests, as the fix for moving leaders is now merged

* Prevent "Duplicate testsuite" error

* Added missing require
2019-02-15 12:50:11 +01:00
Jan e640e3f52a
issue #8137: NULL input field generates U_ILLEGAL_ARGUMENT_ERROR (#8139) 2019-02-12 17:56:38 +01:00
Jan 078e1d9b9d
fixed issue #8108 (#8111) 2019-02-05 15:50:47 +01:00
Jan 4ee7ff1932
yet some more replication tests adjustments (#8101) 2019-02-04 16:53:15 +01:00
Tobias Gödderz db70847ab1 [3.4] Sorted COLLECT: avoid nullptr deref when skipping and fix non-invalidated input variables (#8037)
* Added 2 regression tests

* Fixed test expected data

* Fix nullptr dereference

* Fix handling of non-invalidated input variables

* Try a less implicit fix

* Updated CHANGELOG
2019-02-04 16:38:26 +01:00
KVS85 e59edce206 Update shell-database-{rocksdb|mmfiles}-noncluster.js 3.4 (#8084) 2019-01-31 22:35:50 +01:00
Jan 05bcb3d7d1
Bug fix 3.4/streaming cursors v8 issues (#8080) 2019-01-31 17:25:28 +01:00
Jan 675bb78552
more debugging for replication (#8062) 2019-01-30 21:23:00 +01:00
Frank Celler 84802fdc0f Feature/maskings (#8006) 2019-01-28 15:04:23 +01:00
Jan 15852cb491
Bug fix 3.4/address jenkins fails (#7985) 2019-01-22 12:32:17 +01:00
KVS85 562e80c53d Backport tests from devel (#7987) 2019-01-21 11:17:32 +01:00
Jan d394a6b988
fix scrambling of AstNodes that were in use multiple times (#7978) 2019-01-19 18:54:08 +01:00
Jan 3c828347dc
do not simplify non-deterministic conditions (#7927) 2019-01-19 18:52:17 +01:00
Jan 244eed0710
added "peakMemoryUsage" in query results figures, (#7981) 2019-01-19 18:50:55 +01:00
Simon 1f86b7a2b5 Fix stream cursor bug (#7958) 2019-01-16 13:27:57 +01:00
KVS85 dfad8906d9 Bug fix/active failover fix windows 3.4 (#7959)
* Backport active-failover fix for Windows into 3.4

* Backport stop/resume for Windows from devel

* Backport changes from devel into tests also

* Fix tests

* Remove forgotten whitespaces
2019-01-16 11:08:48 +01:00
Frank Celler beb67f0b44 greylisted foxxmaster.js 2019-01-16 09:52:58 +01:00
Frank Celler e2c480c01c greylisted shell-foxx-api-spec.js 2019-01-15 11:52:26 +01:00
Frank Celler d64b356dba greylisted corrupted-crc-mmfiles 2019-01-14 16:44:05 +01:00
Tobias Gödderz d48495c195 [3.4] Foxx queue jobs hanging after Foxxmaster crash (#7921)
* Fixed bug where the Foxxmaster doesn't reset jobs after a crash when it should, or a non-master coordinator removes jobs in progress during startup

* Added a regression test

* Removed foxxmaster test from greylist

* Updated CHANGELOG

* Fixed non-maintainer compile
2019-01-14 16:06:48 +01:00
Jan d5592def42
fix issue #7933: Regression on ISO8601 string compatibility in AQL (#7934) 2019-01-14 13:50:50 +01:00
jsteemann 37473e29bf increase test timeouts 2019-01-11 14:21:02 +01:00
Simon 49da84e941 improve assertions (#7829) 2019-01-09 10:29:36 +01:00
Jan adf76491b0
added AQL function CHECK_DOCUMENT (#7841) 2019-01-04 15:33:20 +01:00
Jan 1ad9ae3115 added arangorestore options `--number-of-shards` and `--replication-f… (#7868)
* added arangorestore options `--number-of-shards` and `--replication-factor`

* updated documentation

* added version numbers
2019-01-03 11:07:32 +01:00
Jan a14f6dd573
prevent duplicate attributes being generated by AQL queries (#7836) 2019-01-02 12:37:47 +01:00
Jan 762c0fd7c6
fixed issue #7834 (#7845) 2019-01-02 11:09:06 +01:00
Simon 1498c08084 fix restrictCollections parameter on database level replication (#7808) 2018-12-19 18:00:10 +01:00
Jan b5e844fe33
fixed issue #7749 (#7797) 2018-12-19 14:17:54 +01:00
Jan 0574393d52
fixed issue #7757 (#7806) 2018-12-19 14:06:11 +01:00
Jan f39c58e06c
fixed issue #7763 (#7796) 2018-12-19 09:56:05 +01:00
Michael Hackstein ddd5226d13
Feature3.4/improve edgeindex covered (#7750)
* Allow the RocksDB edge index to return the already covered opposite vertex.

* Updated tests
2018-12-12 22:03:47 +01:00
Jan 3fa3170462
fix invalid handling of `_lastValue` in case of multiple coordinators (#7735) 2018-12-12 12:22:52 +01:00
Jan d894986cd9
do not optimize away sort clauses when it is unsafe to do so (#7694) 2018-12-07 16:23:13 +01:00
Jan 2f48d03c19
speed up remove ops for RocksDB engine (#7638)
* speed up remove ops for RocksDB engine

* add more tests and improve queries a bit for single remote AQL operations
2018-12-06 17:48:42 +01:00
Max Neunhöffer 3a7df19189 Fix super user JWT token behaviour with non-ex. db. (#7656) 2018-12-05 16:50:41 +01:00
Frank Celler 6e2cbe2d1e greylisted 2018-12-04 09:28:00 +01:00
Max Neunhöffer ceb1018af4
Wait for 5 dbservers before starting resilience tests. (#7541)
* Wait for 5 dbservers before starting test.
* Fix jslint.
2018-12-03 13:15:56 +01:00
Frank Celler fb3a8b6b39 sleep before check 2018-12-02 21:44:16 +01:00
Jan 2c3542d41e
fixed issue #7522 (#7554) 2018-11-29 19:26:42 +01:00
Dan Larkin-York 00c060c884 [3.4] Fix end condition (hasMore) for EnumerateViewNode. (#7278)
* Fix end condition (hasMore) for EnumerateViewNode.

* Fix crashes.

* Some more fixes.

* eliminate code duplication
2018-11-27 00:41:29 +03:00
Max Neunhöffer 6bd61760f2
Fix moving of shard leaders. (#7446)
* Ungreylist move shard test.
* Move leader shard: wait until all but the old leader are in sync.
* Increate moveShard timeout to 10000 seconds.
* Add CHANGELOG.
* Fix compilation.
* Fix a misleading comment.
2018-11-26 15:05:56 +01:00
Wilfried Goesgens eb41c6afcc Bug fix 3.4 /resync test (#7435) 2018-11-26 14:05:33 +01:00
Michael Hackstein 75f89ed74b
Bug fix/update foxx services after restore (#6774) (#7455)
* Bug fix/update foxx services after restore (#6774)

* triggers foxx queue update which leads to the internal selfHeal function of a foxx app to make foxx apps publicy visible after a foxx app is restored

* this will also add the recognition of imported foxx services

* Testing JS refactoring

* Added test case for Foxx dump -> restore cases

* Fixed check, sth- i tries to contact to the foxx service. Test is red now.

* Fixed tests for dump / restore using Foxx. Also first draft to fix the fox side. Blocked by sth. fixed in the Main Repositorx already

* Fixed typo in dump/restore testsuite

* Removed old version of the fix

* Fixed JSLint

* Removed debug-log output from foxx manager
2018-11-26 13:22:50 +01:00
Simon 96346a12d0 switch default message for requireFromPresent (#7439) (#7450)
(cherry picked from commit f90b48f792)
2018-11-26 09:16:48 +01:00
Andrey Abramov 822e15e770
issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes (#7370) (#7451)
* issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes

* backport: add test to ensure views are dropped when database is dropped from plan, fix some issues in ClusterInfo

* optimize primary key lookups in ArangoSearch

* fix test

* Add JS tests

* temporary comment optimizations

# Conflicts:
#	arangod/Cluster/ClusterInfo.cpp
2018-11-26 00:33:58 +03:00
Simon ebad3c3c83 Fix restore of views, add --view option (#7425) (#7427)
(cherry picked from commit c584527d79)
2018-11-23 09:11:33 +01:00
Max Neunhöffer 7bf63cdb95
Make error handling in move shard tests more robust. (#7418)
* Make getCleanedOutServers error handling more robust.

* Fix two more instances of getCleanedOutServers.
2018-11-22 22:53:07 +01:00
Jan a6cb178b86
add some more intermediate commit tests (#7417) 2018-11-22 15:29:08 +01:00
Frank Celler ef5ffbef61 greyed foxxmaster.js because it is not stable 2018-11-22 12:55:26 +01:00
Simon ef239cbe4e Make recovery more reliable (#7297) (#7367) 2018-11-21 16:51:38 +01:00
Simon 5124633e6a Faster index creation (#7348) 2018-11-20 13:41:01 +01:00
Max Neunhöffer 256c167155
Another place with a resigned leader. (#7350) 2018-11-19 11:41:43 +01:00
Jan 812c9223fe
fix queries that refer to COLLECT variables from inside COLLECT (#7333) 2018-11-15 15:10:56 +01:00
Max Neunhöffer 805f7a7621
Fix timeout in cluster operation in create and drop collections. (#7300)
* Fix loophole.
* Fix inquiry case of id not found: 404.
* Also handle correctly in AgencyComm.
* Fix agency tests.
* Fix error handling in dropCollectionOnCoordinator.
2018-11-14 10:02:26 +01:00
Jan 8bcb1a310c
fix failing non-deterministic query-stream test (#7296) 2018-11-13 11:37:09 +01:00
Alan Plum 1ea6374511 Fix Foxx Queues infinite maxFailures (#7224) 2018-11-12 13:21:12 +01:00
jsteemann 7a2314a32b remove reference to non-existing deriveTestSuite function 2018-11-12 11:33:40 +01:00
Frank Celler 10ceaf2391 moved to grey 2018-11-08 21:05:16 +01:00
Max Neunhöffer d21a0f8bca
Greylist moving-shards-with-arangosearch-view-cluster. (#7272)
* Greylist moving-shards-with-arangosearch-view-cluster.

* Add documentation for greylisted tests.
2018-11-08 16:25:52 +01:00
Wilfried Goesgens d33ffab6d8 add more information when timeout failing the index creation tests (#7266) 2018-11-08 12:44:28 +01:00
KVS85 0822677a0c Fix update-view-arangosearch-spec tests (#7246) 2018-11-07 00:30:40 +03:00
KVS85 38d127cc5a Add view profiling tests (#7230) 2018-11-06 17:15:31 +03:00
Tobias Gödderz 8401f0e36c Fix teardown, improved assertion & error message (#7218) 2018-11-06 13:10:08 +01:00
Dan Larkin-York e5243f9254 [3.4] Upgrade old MMFiles collections for compatibility with ArangoSearch (#7133) 2018-11-06 11:12:54 +01:00
Simon 9c53d045be Server stream cursor (#7186) (#7210) 2018-11-03 20:17:52 +01:00
Jan eb3deb578f
smaller changes for replication (#7201) 2018-11-02 15:47:49 +01:00
Vasiliy 850919178f issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca (#7167)
* issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca

* address merge issue

* backport: remove code causing nullptr access

* invalidate payload for each field in FieldIterator before setting a value

* address compilation issues
2018-11-01 23:12:39 +03:00
Jan 023ca6dc33
Bug fix 3.4/patch slave collection count (#7156) 2018-10-31 17:20:46 +01:00
Jan aa385c2bbc
increase the maximum allowed number of collections in an AQL query (#7155) 2018-10-31 10:08:32 +01:00
Simon 9271a11441 RocksDB replication thread safety (#7088) (#7131) 2018-10-30 11:24:17 +01:00
Vasiliy e6a6025818 backport: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion (#7106)
* backport: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion

* backport: ensure arangosearch links get exported in the dump

* backport: ensure view is created during restore on the coordinator

* Updates for ArangoSearch DDL tests, IResearchView unregistration and known issues

* Add fix for internal issue 483
2018-10-30 12:50:29 +03:00
Max Neunhöffer 568f5ee8bf
Consider case of resigned leader. (#7038) 2018-10-29 09:19:17 +01:00
Frank Celler 5db8528beb more debug output 2018-10-25 17:27:48 +02:00
Michael Hackstein 94a793fe61
Removed incorrect skipping of Batches in RocksDB Tailing syncer (#7021)
* Removed incorrect skipping of Batches in RocksDB Tailing syncer. This caused issues, whenever one transaction was spiltted.

* Added a test for Splitting a large transaction in RocksDB

* Reactivated skipping in RocksDB Wal Tailing (reverts initial fix)

* Actually include lastScannedTick in CollectionFinalize. Proper fix, kudos to @jsteemann.

* Fixed healFollower task in split-large-transaction test
2018-10-25 14:13:40 +02:00
KVS85 29d5e2d0e1 Execute all ArangoSearch DDL tests on both cluster and single (#7054) 2018-10-24 22:17:46 +03:00
Alan Plum e821ed6923 Fix Foxx API handling of broken services (#6459) (#7013)
* Add tests for service failing on mount

* Don't install broken services

* Restore error page for broken services

* Prefer JSON error pages

* Expose service upsert in API

* Add Foxx fixes to CHANGELOG

* Update CHANGELOG

Typo
2018-10-24 15:29:31 +02:00
jsteemann 149e7e9034 fixed jslint 2018-10-23 11:24:31 +02:00
Tobias Gödderz 183f9194f1 [3.4] Fixed optimize-traversals and added a regression test (#6975)
* Fixed optimize-traversals and added a regression test

* Updated CHANGELOG
2018-10-23 09:46:59 +02:00
Jan 3d01c09ea2
Bug fix 3.4/fix array sorting (#6988) 2018-10-22 12:30:47 +02:00
Jan 1002928b5f
fix https://github.com/arangodb/release-3.4/issues/99 (#6951) 2018-10-19 15:26:23 +02:00
Simon c0455e9c60 Add engine specific collection APIs (#6962) 2018-10-19 15:23:55 +02:00
Tobias Gödderz b18fd77137 Removed debug log output, fixed errorNum check (again), added asserts that the views are properly created (#6948) 2018-10-19 14:18:04 +02:00
Simon c2b6fb99ba Propper commit Sequence Numbers (#6958) 2018-10-18 18:25:34 +02:00
jsteemann b4a4ed3bc8 attempt to make test more reliable 2018-10-17 20:32:35 +02:00
Heiko b5ff5080ff merge conf. (#6882) 2018-10-17 15:57:39 +02:00
Jan 13a9a0c12b
Bug fix 3.4/use proper log topic for replication test messages (#6920) 2018-10-17 15:40:59 +02:00
Tobias Gödderz 4bcb3b755c Fixed error num comparison (#6941) 2018-10-17 14:14:43 +02:00
Dan Larkin-York fa6680a252 [3.4] Fix issues with ArangoSearch link permissions in cluster mode (#6726) 2018-10-16 20:43:01 +02:00
Tobias Gödderz a5373d6697 Ignore errors caused by an admissible race (#6899) 2018-10-16 14:24:09 +02:00
Wilfried Goesgens 83498d94a0 Feature 3.4/better recovery resulthandling (#6859) 2018-10-16 09:28:49 +02:00
Jan 738c00814a
added waitForSync option to make tests more deterministic (#6886) 2018-10-15 17:37:44 +02:00
Andrey Abramov 4ef4e1119a
backport new arangosearch to 3.4 (#6874)
* backport new arangosearch

* backport tests

* backport another test

* backport changes in cmake
2018-10-13 01:27:31 +03:00
Tobias Gödderz 9717c94a43 Added waitForEstimatorSync() (#6867) 2018-10-12 19:17:41 +02:00