1
0
Fork 0
Commit Graph

643 Commits

Author SHA1 Message Date
Michael Hackstein fb956ccc67 PRUNE in AQL Traversal (#8286) 2019-03-07 21:13:26 +01:00
Max Neunhöffer 46e479376d
Further supervision fixes. (#8259)
* Do not schedule Coordinators in Plan.

* Finish failed server when server is no longer in health.

* Fix removeServer checks.

Check that server is no longer in use before removing it. Give 60s
waiting time for condition to be met. Also observer agency lock.

* Finish FailedFollower job if server no longer follower.

This can happen because RemoveFollower was faster.

* Only use GOOD servers as replacement followers.

* Fix AddFollower for satellite collections.

* Fix RemoveServer for satellite collections.

* MoveShard handles moves from leader to followers

* Prepare CleanoutServer and FailedServer for satellite collections.

* More sorting out of AddFollower and RemoveFollower.

* Fix RemoveFollower job w.r.t. choice of follower to remove.

* Fix message.

* kill you own sub jobs, please

* Added preconditions to payloads for supervision's job finishers

* Improve logging.

* Add agency diagnostics to failed move shard test, start.

* Add coordinator agency diagnostics.

* Remove warning.

* Add changelog entry.

* Add agency diagnostics if things go sour with move shard.

* Add agency diags when things go wrong 2.

* API /_api/agency/state: back to old format.

* Fix Windows compilation.

* handle aborts in supervision and wait for the last Raft log to be committed

* tests compiling, 2 failing for valid reasons

* Correctly report TRI_ERROR_CLUSTER_CONNECTION_LOST as 503.

* FailedLeader /FailedFollower cannot continue, when aborting blocks
2019-03-04 11:43:35 +01:00
Michael Hackstein 3e02a726ee
Bug fix/clustercomm queue cleanup (#8191) (#8277)
Cleanup of unused queues in ClusterComm
2019-02-28 09:11:25 +01:00
Andrey Abramov 5815a7a2a8
Fix bug #8213 (#8262)
* properly process ArangoSearch view nodes located inside subqueries

* extend tests to cover failing case

* add integration tests
2019-02-26 18:50:46 +03:00
Max Neunhöffer b87f362f27
The big supervision fix. (#8243)
* Updated CleanoutServerTests. Exclude servers in ToBeCleanedServers. Allow bad servers as new follower.
* Prefer good servers.
* Removed copy, sort and binary_search for a list of ~10 elements.
* Fix move shard bug with compare.
* MoveShard fixes, expansion of doForAllShards
* Count only GOOD servers in actualReplicationFactor.
* Make RemoveFollower remove broken servers.
* Precondition on Plan Version for updating Current as leader.
* CleanupServer to evict server from ToBeCleaned, when aborting
* cleanoutserver with payload in finish
* Use static string for ToBeCleanedOut.
* Fixed typo in log message.
* Change warning level. If a MoveShard job is aborted and we can no longer roll back, then we issue a WARNING rather than a DEBUG log message.
* Another typo and log level.
* Start to fix unit tests.
* Does not make sense for AddFollowerTest to have a FAILED leader.
* Only count GOOD followers in AddFollower.
* Fix AddFollowerTest.
* Report precondition failed in MoveShard follower case.
* Add CHANGELOG.
2019-02-25 08:12:18 -05:00
Heiko 1ae99f08be do not allow edge definitions with empty from or to arrays, added als… (#8200) 2019-02-20 18:33:06 +01:00
Jan 68b112e45a
fixed issue #8165 (#8195) 2019-02-19 18:08:39 +01:00
Jan 304948f30d
when creating a new database with an initial user, set the database p… (#8185) 2019-02-18 16:16:23 +01:00
Tobias Gödderz 7ee560f2d7 [3.4] Resilience tests with data (#7193)
* Begin work on repair-dsl suite to run with data, too

* Use and check data in all tests

* Fixed jslint errors

* Added data to moving-shards-cluster test

* Added additional asserts during createBrokenClusterState()

* Improved failure messages

* Minor cleanup

* Greylist affected tests

* Un-greylist resilience tests, as the fix for moving leaders is now merged

* Prevent "Duplicate testsuite" error

* Added missing require
2019-02-15 12:50:11 +01:00
Jan e640e3f52a
issue #8137: NULL input field generates U_ILLEGAL_ARGUMENT_ERROR (#8139) 2019-02-12 17:56:38 +01:00
Jan 078e1d9b9d
fixed issue #8108 (#8111) 2019-02-05 15:50:47 +01:00
Jan 4ee7ff1932
yet some more replication tests adjustments (#8101) 2019-02-04 16:53:15 +01:00
Tobias Gödderz db70847ab1 [3.4] Sorted COLLECT: avoid nullptr deref when skipping and fix non-invalidated input variables (#8037)
* Added 2 regression tests

* Fixed test expected data

* Fix nullptr dereference

* Fix handling of non-invalidated input variables

* Try a less implicit fix

* Updated CHANGELOG
2019-02-04 16:38:26 +01:00
KVS85 e59edce206 Update shell-database-{rocksdb|mmfiles}-noncluster.js 3.4 (#8084) 2019-01-31 22:35:50 +01:00
Jan 05bcb3d7d1
Bug fix 3.4/streaming cursors v8 issues (#8080) 2019-01-31 17:25:28 +01:00
Jan 675bb78552
more debugging for replication (#8062) 2019-01-30 21:23:00 +01:00
Frank Celler 84802fdc0f Feature/maskings (#8006) 2019-01-28 15:04:23 +01:00
Frank Celler 2c03d9a4f9 blacklisted test 2019-01-24 11:41:30 +01:00
Jan 15852cb491
Bug fix 3.4/address jenkins fails (#7985) 2019-01-22 12:32:17 +01:00
KVS85 562e80c53d Backport tests from devel (#7987) 2019-01-21 11:17:32 +01:00
Jan d394a6b988
fix scrambling of AstNodes that were in use multiple times (#7978) 2019-01-19 18:54:08 +01:00
Jan 3c828347dc
do not simplify non-deterministic conditions (#7927) 2019-01-19 18:52:17 +01:00
Jan 244eed0710
added "peakMemoryUsage" in query results figures, (#7981) 2019-01-19 18:50:55 +01:00
Simon 1f86b7a2b5 Fix stream cursor bug (#7958) 2019-01-16 13:27:57 +01:00
KVS85 dfad8906d9 Bug fix/active failover fix windows 3.4 (#7959)
* Backport active-failover fix for Windows into 3.4

* Backport stop/resume for Windows from devel

* Backport changes from devel into tests also

* Fix tests

* Remove forgotten whitespaces
2019-01-16 11:08:48 +01:00
Frank Celler beb67f0b44 greylisted foxxmaster.js 2019-01-16 09:52:58 +01:00
Frank Celler e2c480c01c greylisted shell-foxx-api-spec.js 2019-01-15 11:52:26 +01:00
Frank Celler d64b356dba greylisted corrupted-crc-mmfiles 2019-01-14 16:44:05 +01:00
Tobias Gödderz d48495c195 [3.4] Foxx queue jobs hanging after Foxxmaster crash (#7921)
* Fixed bug where the Foxxmaster doesn't reset jobs after a crash when it should, or a non-master coordinator removes jobs in progress during startup

* Added a regression test

* Removed foxxmaster test from greylist

* Updated CHANGELOG

* Fixed non-maintainer compile
2019-01-14 16:06:48 +01:00
Jan d5592def42
fix issue #7933: Regression on ISO8601 string compatibility in AQL (#7934) 2019-01-14 13:50:50 +01:00
jsteemann 37473e29bf increase test timeouts 2019-01-11 14:21:02 +01:00
Simon 49da84e941 improve assertions (#7829) 2019-01-09 10:29:36 +01:00
Matthew Von-Maszewski 474f0cde31 Bug fix 3.4/scheduler empty reformat (#7872)
* added check for empty scheduler

* removed log, old is 1 not 0

* require running in this thread

* test

* added isDirect to callback

* signature fixed

* added drain

* added allowDirectHandling

* disabled for testing

* Add ExecContextScope object to direct call.

* try alternate initialization of ExecContextScope

* remove ExecContextScope, no help.  try _fifoSize as part of direct decision.

* strand management to minimize reuse of same strand per listen socket

* blind attempt to address Jenkins shutdown lock up.  may remove quickly.

* add filename and line to existing error log message

* Adjust queueOperation() to stop accepting items once isStopping() becomes true.

* revert previous check-in to MMFilesCollectorThread.cpp

* big reformat

* fixed merge conflicts

* Add CHANGELOG entry.
2019-01-08 20:39:42 +01:00
Jan adf76491b0
added AQL function CHECK_DOCUMENT (#7841) 2019-01-04 15:33:20 +01:00
Jan 1ad9ae3115 added arangorestore options `--number-of-shards` and `--replication-f… (#7868)
* added arangorestore options `--number-of-shards` and `--replication-factor`

* updated documentation

* added version numbers
2019-01-03 11:07:32 +01:00
Jan a14f6dd573
prevent duplicate attributes being generated by AQL queries (#7836) 2019-01-02 12:37:47 +01:00
Jan 762c0fd7c6
fixed issue #7834 (#7845) 2019-01-02 11:09:06 +01:00
KVS85 2b56eabcba Add http_server test for creating view with links (#7853) 2018-12-26 19:30:27 +03:00
Simon 1498c08084 fix restrictCollections parameter on database level replication (#7808) 2018-12-19 18:00:10 +01:00
Jan b5e844fe33
fixed issue #7749 (#7797) 2018-12-19 14:17:54 +01:00
Jan 0574393d52
fixed issue #7757 (#7806) 2018-12-19 14:06:11 +01:00
Jan f39c58e06c
fixed issue #7763 (#7796) 2018-12-19 09:56:05 +01:00
Andrey Abramov 50bed56766
fix issue and add test (#7790) 2018-12-18 17:33:08 +03:00
Wilfried Goesgens 7fa0cdc41b Feature/drop before win7 support in compiler (#6681) (#7751) 2018-12-17 12:06:53 +01:00
Kaveh Vahedipour 9e83e1696d [3.4] allow for quicker start of actions when previusly completed (#7736)
* shard versioning
* one incompatible call fixed
2018-12-17 10:36:50 +01:00
Michael Hackstein ddd5226d13
Feature3.4/improve edgeindex covered (#7750)
* Allow the RocksDB edge index to return the already covered opposite vertex.

* Updated tests
2018-12-12 22:03:47 +01:00
Jan 3fa3170462
fix invalid handling of `_lastValue` in case of multiple coordinators (#7735) 2018-12-12 12:22:52 +01:00
Kaveh Vahedipour 8557fdaf22 agency failed to start in log level trace (#7687) 2018-12-10 15:31:38 +01:00
Kaveh Vahedipour 1b75220a1b [3.4] Early sort out system collections for maintenance (#7589) 2018-12-10 15:16:35 +01:00
Tobias Gödderz a1b925c655 Added tests for parseVersion (#7676) 2018-12-10 12:47:20 +01:00
Jan d894986cd9
do not optimize away sort clauses when it is unsafe to do so (#7694) 2018-12-07 16:23:13 +01:00
Jan 2f48d03c19
speed up remove ops for RocksDB engine (#7638)
* speed up remove ops for RocksDB engine

* add more tests and improve queries a bit for single remote AQL operations
2018-12-06 17:48:42 +01:00
Max Neunhöffer 3a7df19189 Fix super user JWT token behaviour with non-ex. db. (#7656) 2018-12-05 16:50:41 +01:00
Frank Celler 6e2cbe2d1e greylisted 2018-12-04 09:28:00 +01:00
Max Neunhöffer ceb1018af4
Wait for 5 dbservers before starting resilience tests. (#7541)
* Wait for 5 dbservers before starting test.
* Fix jslint.
2018-12-03 13:15:56 +01:00
Frank Celler fb3a8b6b39 sleep before check 2018-12-02 21:44:16 +01:00
Jan 92616c1dca
fix path normalization for Windows (#7565) 2018-11-30 16:21:13 +01:00
Jan 2c3542d41e
fixed issue #7522 (#7554) 2018-11-29 19:26:42 +01:00
jsteemann 7e4a93d161 move commit out of assertion 2018-11-29 14:23:55 +01:00
Simon 933ca8a775 Bug fix/restore index refactor (#7470) (#7491)
(cherry picked from commit d0efd95a37)
2018-11-29 14:08:29 +01:00
Jan 2d4b38600f
prevent operations from overtaking each other (#7498) 2018-11-28 14:30:54 +01:00
Vasiliy 3caed3eb9a issue 506.3: backport 3.4: issue 506.3: use camel-case configuration parameter names consistntly, add a configuration version property to iresearch view meta (#7476)
* issue 506.3: backport 3.4: issue 506.3: use camel-case configuration parameter names consistntly, add a configuration version property to iresearch view meta

* backport: ensure meta version is supported

* backport: hide 'version' property from non-persistence json
2018-11-27 18:35:34 +03:00
Vasiliy f701c6d681 issue 506.2: backport 3.4: add optimization to not reexecute a primary-key filter if a match was already found (#7461)
* issue 506.2: backport 3.4: add optimization to not reexecute a primary-key filter if a match was already found

* backport: explicitly check type of instance of the primary-key filter

* backport: return non-null prepared filter and convert check to assert
2018-11-27 18:29:41 +03:00
Dan Larkin-York 00c060c884 [3.4] Fix end condition (hasMore) for EnumerateViewNode. (#7278)
* Fix end condition (hasMore) for EnumerateViewNode.

* Fix crashes.

* Some more fixes.

* eliminate code duplication
2018-11-27 00:41:29 +03:00
Jan ffc823e1c8
Bug fix 3.4/backport optimizations (#7434) 2018-11-26 19:16:05 +01:00
Max Neunhöffer 6bd61760f2
Fix moving of shard leaders. (#7446)
* Ungreylist move shard test.
* Move leader shard: wait until all but the old leader are in sync.
* Increate moveShard timeout to 10000 seconds.
* Add CHANGELOG.
* Fix compilation.
* Fix a misleading comment.
2018-11-26 15:05:56 +01:00
Wilfried Goesgens eb41c6afcc Bug fix 3.4 /resync test (#7435) 2018-11-26 14:05:33 +01:00
Michael Hackstein 75f89ed74b
Bug fix/update foxx services after restore (#6774) (#7455)
* Bug fix/update foxx services after restore (#6774)

* triggers foxx queue update which leads to the internal selfHeal function of a foxx app to make foxx apps publicy visible after a foxx app is restored

* this will also add the recognition of imported foxx services

* Testing JS refactoring

* Added test case for Foxx dump -> restore cases

* Fixed check, sth- i tries to contact to the foxx service. Test is red now.

* Fixed tests for dump / restore using Foxx. Also first draft to fix the fox side. Blocked by sth. fixed in the Main Repositorx already

* Fixed typo in dump/restore testsuite

* Removed old version of the fix

* Fixed JSLint

* Removed debug-log output from foxx manager
2018-11-26 13:22:50 +01:00
Simon 96346a12d0 switch default message for requireFromPresent (#7439) (#7450)
(cherry picked from commit f90b48f792)
2018-11-26 09:16:48 +01:00
Andrey Abramov 822e15e770
issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes (#7370) (#7451)
* issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes

* backport: add test to ensure views are dropped when database is dropped from plan, fix some issues in ClusterInfo

* optimize primary key lookups in ArangoSearch

* fix test

* Add JS tests

* temporary comment optimizations

# Conflicts:
#	arangod/Cluster/ClusterInfo.cpp
2018-11-26 00:33:58 +03:00
Simon ebad3c3c83 Fix restore of views, add --view option (#7425) (#7427)
(cherry picked from commit c584527d79)
2018-11-23 09:11:33 +01:00
Max Neunhöffer 7bf63cdb95
Make error handling in move shard tests more robust. (#7418)
* Make getCleanedOutServers error handling more robust.

* Fix two more instances of getCleanedOutServers.
2018-11-22 22:53:07 +01:00
Frank Celler 085e6706ea updated for failed foxxmaster 2018-11-22 19:01:29 +01:00
Jan a6cb178b86
add some more intermediate commit tests (#7417) 2018-11-22 15:29:08 +01:00
Frank Celler ef5ffbef61 greyed foxxmaster.js because it is not stable 2018-11-22 12:55:26 +01:00
Simon ef239cbe4e Make recovery more reliable (#7297) (#7367) 2018-11-21 16:51:38 +01:00
Simon 5124633e6a Faster index creation (#7348) 2018-11-20 13:41:01 +01:00
Tobias Gödderz 3d1c643e23 [3.4] MMFiles replication: get followers under lock (#7298)
* Fix resign order

* Fixed a typo

* Get followers later, add TODOs

* Added a callback parameter to collection insert methods

* Get followers under the lock if necessary

* Extracted the replication of inserts into a separate method

* Move shortcut into replicate method

* Added callbacks for remove, replace and update

* Added missing overrides

* Extracted replication code from modifyLocal and removeLocal

* Update followers under lock also during replace, update, remove

* Fix changes from the last commit for update/replace

* Update comments, add asserts

* Remove changes for document-level locks that will be done in another PR

* Unify replication

* Adapt log messages to the devel ones

* Move common methods from its descendants to TransactionCollection, fix Mock on the way

* More IResearch test / mock fixes

* Relax asserts for nested transactions

* Reformat

* Fix non-babies remove and modify replication
2018-11-19 13:03:07 +01:00
Max Neunhöffer 256c167155
Another place with a resigned leader. (#7350) 2018-11-19 11:41:43 +01:00
Jan 812c9223fe
fix queries that refer to COLLECT variables from inside COLLECT (#7333) 2018-11-15 15:10:56 +01:00
Andrey Abramov 2a1542fdc2
Feature/arangosearch pk endianness (#7306) (#7312)
* refactor arangosearch pks

* minor refactoring

* store PK as BigEndian since it leads to more compact index representation

* force iresearch to not to use libbfd

* fix tests
2018-11-14 15:56:40 +03:00
Max Neunhöffer 805f7a7621
Fix timeout in cluster operation in create and drop collections. (#7300)
* Fix loophole.
* Fix inquiry case of id not found: 404.
* Also handle correctly in AgencyComm.
* Fix agency tests.
* Fix error handling in dropCollectionOnCoordinator.
2018-11-14 10:02:26 +01:00
Jan 8bcb1a310c
fix failing non-deterministic query-stream test (#7296) 2018-11-13 11:37:09 +01:00
Alan Plum 1ea6374511 Fix Foxx Queues infinite maxFailures (#7224) 2018-11-12 13:21:12 +01:00
jsteemann 7a2314a32b remove reference to non-existing deriveTestSuite function 2018-11-12 11:33:40 +01:00
Max Neunhoeffer 326da7e180
Document greylisted test. 2018-11-09 12:19:05 +01:00
Frank Celler 10ceaf2391 moved to grey 2018-11-08 21:05:16 +01:00
Max Neunhöffer d21a0f8bca
Greylist moving-shards-with-arangosearch-view-cluster. (#7272)
* Greylist moving-shards-with-arangosearch-view-cluster.

* Add documentation for greylisted tests.
2018-11-08 16:25:52 +01:00
Wilfried Goesgens d33ffab6d8 add more information when timeout failing the index creation tests (#7266) 2018-11-08 12:44:28 +01:00
Andrey Abramov 4873ef79d5
Bug fix 3.4/internal issue #6289 (#7250)
* improve troubleshooting

* fix tests

# Conflicts:
#	arangod/IResearch/IResearchViewBlock.h
#	tests/IResearch/ExpressionContextMock.cpp
#	tests/IResearch/ExpressionContextMock.h
2018-11-07 16:43:08 +03:00
Simon 0d955554f2 Use shared_ptr for LogicalCollection (#7220) (#7244) 2018-11-07 10:43:08 +01:00
Simon f4a1f15964 Simplify dropDatabaseCoordinator & fix some bugs (#7211) (#7243) 2018-11-07 10:41:02 +01:00
KVS85 0822677a0c Fix update-view-arangosearch-spec tests (#7246) 2018-11-07 00:30:40 +03:00
KVS85 38d127cc5a Add view profiling tests (#7230) 2018-11-06 17:15:31 +03:00
Tobias Gödderz 8401f0e36c Fix teardown, improved assertion & error message (#7218) 2018-11-06 13:10:08 +01:00
Dan Larkin-York e5243f9254 [3.4] Upgrade old MMFiles collections for compatibility with ArangoSearch (#7133) 2018-11-06 11:12:54 +01:00
Vasiliy d644561f1f issue 496.4.1: backport 3.4: move StorageEngine-specific flag out of the genric API and closer to the storage engine (#7213)
* issue 496.4.1: backport 3.4: move StorageEngine-specific flag out of the genric API and closer to the storage engine

* address merge issue
2018-11-04 16:52:54 +03:00
Simon 9c53d045be Server stream cursor (#7186) (#7210) 2018-11-03 20:17:52 +01:00
Jan eb3deb578f
smaller changes for replication (#7201) 2018-11-02 15:47:49 +01:00
Vasiliy 850919178f issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca (#7167)
* issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca

* address merge issue

* backport: remove code causing nullptr access

* invalidate payload for each field in FieldIterator before setting a value

* address compilation issues
2018-11-01 23:12:39 +03:00
Jan 023ca6dc33
Bug fix 3.4/patch slave collection count (#7156) 2018-10-31 17:20:46 +01:00
Andrey Abramov 8225003861
[3.4] arangosearch speedup removals (#7158)
* Feature/arangosearch speedup removals (#7134)

* speedup document removals and optimize data model

* fix invalid constexpr

* reduce number of heap allocations for removals (#7157)
2018-10-31 15:54:16 +03:00
Jan aa385c2bbc
increase the maximum allowed number of collections in an AQL query (#7155) 2018-10-31 10:08:32 +01:00
Vasiliy 2458705607 issue 496.2: backport 3.4: allow customization of segment size limits on arangosearch view creation, minor code cleanup (#7141)
* issue 496.2: backport 3.4: allow customization of segmentsize lmts on arangosearch view creation, minor code clanup

* backport: fix incorrect condition
2018-10-30 23:41:15 +03:00
Simon 9271a11441 RocksDB replication thread safety (#7088) (#7131) 2018-10-30 11:24:17 +01:00
Vasiliy e6a6025818 backport: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion (#7106)
* backport: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion

* backport: ensure arangosearch links get exported in the dump

* backport: ensure view is created during restore on the coordinator

* Updates for ArangoSearch DDL tests, IResearchView unregistration and known issues

* Add fix for internal issue 483
2018-10-30 12:50:29 +03:00
Jan 889cee0dae
speed up query string parsing (#7116) 2018-10-29 14:42:39 +01:00
Max Neunhöffer 568f5ee8bf
Consider case of resigned leader. (#7038) 2018-10-29 09:19:17 +01:00
Simon 78132bc2e5 Next try at truncate (#7090) (#7096) 2018-10-26 15:06:36 +02:00
Jan b0bff0a7da
potentially fix failing Windows catch test (#7080) 2018-10-26 10:11:02 +02:00
Frank Celler 5db8528beb more debug output 2018-10-25 17:27:48 +02:00
Michael Hackstein 94a793fe61
Removed incorrect skipping of Batches in RocksDB Tailing syncer (#7021)
* Removed incorrect skipping of Batches in RocksDB Tailing syncer. This caused issues, whenever one transaction was spiltted.

* Added a test for Splitting a large transaction in RocksDB

* Reactivated skipping in RocksDB Wal Tailing (reverts initial fix)

* Actually include lastScannedTick in CollectionFinalize. Proper fix, kudos to @jsteemann.

* Fixed healFollower task in split-large-transaction test
2018-10-25 14:13:40 +02:00
Jan b903f1f8ff
Bug fix 3.4/fix catch test issues (#7045) 2018-10-25 12:49:00 +02:00
Simon e87b42a0c3 Silence tsan warnings (#7051) 2018-10-24 23:58:47 +02:00
KVS85 29d5e2d0e1 Execute all ArangoSearch DDL tests on both cluster and single (#7054) 2018-10-24 22:17:46 +03:00
Alan Plum e821ed6923 Fix Foxx API handling of broken services (#6459) (#7013)
* Add tests for service failing on mount

* Don't install broken services

* Restore error page for broken services

* Prefer JSON error pages

* Expose service upsert in API

* Add Foxx fixes to CHANGELOG

* Update CHANGELOG

Typo
2018-10-24 15:29:31 +02:00
Vasiliy 52e2c97693 backport missed changes (#7016) 2018-10-24 15:43:45 +03:00
jsteemann 149e7e9034 fixed jslint 2018-10-23 11:24:31 +02:00
Tobias Gödderz 183f9194f1 [3.4] Fixed optimize-traversals and added a regression test (#6975)
* Fixed optimize-traversals and added a regression test

* Updated CHANGELOG
2018-10-23 09:46:59 +02:00
Jan 3d01c09ea2
Bug fix 3.4/fix array sorting (#6988) 2018-10-22 12:30:47 +02:00
Andrey Abramov 2b46285b3b
Feature/backport arangosearch 3.4 (#6985)
* issue 485.1: reduce scope of lock in FlushFeature (#6943)

* issue 493.1: update iresearch to changeset 15f561dee5865ead83663ef056d7bbcc38636fb2 (#6947)

* issue 493.2: trigger termination of long-running consolidation on shutdown request

* Feature/update iresearch 2 (#6984)

* update iresearch sources

* another update

* update iresearch

* fix segfault in log message

* update iresearch

* update iresearch

* update iresearch

* remove noexcept

* improve logging

* update iresearch
2018-10-20 13:24:29 +03:00
Jan 1002928b5f
fix https://github.com/arangodb/release-3.4/issues/99 (#6951) 2018-10-19 15:26:23 +02:00
Simon c0455e9c60 Add engine specific collection APIs (#6962) 2018-10-19 15:23:55 +02:00
Tobias Gödderz b18fd77137 Removed debug log output, fixed errorNum check (again), added asserts that the views are properly created (#6948) 2018-10-19 14:18:04 +02:00
Michael Hackstein 875185e6c1
Bug fix 3.4/sync repl release thread (#6784)
* First attempt to not block the thread that requires the EXCLUSIVE sync-up lock

* Fixed insertion of query into registry in rest replication handler.

* Removed unnecessary / false asserts as suggested in review. Fixed code comments.

* Replaced auto with a correct type as suggested in review

* Added a helper function to validate if a query is in use in the registry

* Fixed logic bug in usage of query registry

* Fixed compile issue

* Automaticly transfrom int -> bool in initializerlist sucks...

* Inverted boolen logic bug hidden due to int->bool beeing logically inverted.

* Today it seems that bools are too complicated for my brain.

* Removed failure point, didn't write a test for it, and it is hard to write it in the current test environment. Need to find a better solution in future

* Applied chenges required by @goedderz in review
2018-10-19 13:48:22 +02:00
Simon c2b6fb99ba Propper commit Sequence Numbers (#6958) 2018-10-18 18:25:34 +02:00
Jan fa235feeb2
attempt to fix https://github.com/arangodb/release-3.4/issues/96 (#6953) 2018-10-18 12:41:13 +02:00
jsteemann b4a4ed3bc8 attempt to make test more reliable 2018-10-17 20:32:35 +02:00
Heiko b5ff5080ff merge conf. (#6882) 2018-10-17 15:57:39 +02:00
Jan 13a9a0c12b
Bug fix 3.4/use proper log topic for replication test messages (#6920) 2018-10-17 15:40:59 +02:00
Tobias Gödderz 4bcb3b755c Fixed error num comparison (#6941) 2018-10-17 14:14:43 +02:00
Matthew Von-Maszewski a9ce39f85c Bugfix 3.4: Merge scheduler changes by Michael & Frank into recent overlapping code changes (#6928)
* manual recreation of bug-fix-3.4/scheduler-high-low within recent Scheduler changes.

* restore Documentation that was unintentionally deleted
2018-10-16 22:51:00 +02:00
Dan Larkin-York fa6680a252 [3.4] Fix issues with ArangoSearch link permissions in cluster mode (#6726) 2018-10-16 20:43:01 +02:00
Andrey Abramov 6b6e4f6279
issue 485: ensure LogicalDataSource::drop() is called on vocbase drop (#6895) (#6923)
* issue 485: ensure LogicalDataSource::drop() is called on vocbase drop

* add missed change

* backport: address race between make(...) and async job

* add another missed change

* backport: ensure recursive lock reports itself as locked correctly

* backport: address test failure on mmfiles

* backport: remove redundant lock already held by async task

* backport: reset reader before unlinking directory
2018-10-16 21:06:47 +03:00
Tobias Gödderz a5373d6697 Ignore errors caused by an admissible race (#6899) 2018-10-16 14:24:09 +02:00
Wilfried Goesgens 83498d94a0 Feature 3.4/better recovery resulthandling (#6859) 2018-10-16 09:28:49 +02:00
Jan 738c00814a
added waitForSync option to make tests more deterministic (#6886) 2018-10-15 17:37:44 +02:00
Andrey Abramov 4ef4e1119a
backport new arangosearch to 3.4 (#6874)
* backport new arangosearch

* backport tests

* backport another test

* backport changes in cmake
2018-10-13 01:27:31 +03:00
Tobias Gödderz 9717c94a43 Added waitForEstimatorSync() (#6867) 2018-10-12 19:17:41 +02:00
Jan 9b7258a4d1
added several query optimizations (#6781) 2018-10-12 17:41:45 +02:00
Tobias Gödderz 3c1db60d70 [3.4] Remove nondeterministic edge index test (#6862) 2018-10-12 15:18:47 +02:00
Simon 010b54c81e Allow WAL logger to split up transactions (#6800) 2018-10-12 15:15:55 +02:00
Jan 3adaf001c5
velocypack library update (#6850) 2018-10-12 12:46:52 +02:00
Wilfried Goesgens 825dc54332 fix windows path escaping in testcase (#6839) 2018-10-11 18:40:46 +02:00
Tobias Gödderz 351a10a547 [3.4] Added a regression test for arangodb/backlog#486 (#6791)
* Added a regression test for arangodb/backlog#486

* Moved regression test in existing ddl test files
2018-10-11 16:23:37 +03:00
Tobias Gödderz 7ec610a42a [3.4] Rework move shards with view test (#6772)
* Fixed testSetup(). Reduced redundant code.

* Reworked assertions in moving-shards-with-arangosearch-view-cluster.js

* Fixed merge

* Added changes from review

* Removed debug output / fixed jslint error
2018-10-11 10:25:40 +02:00
Dan Larkin-York ff2ce5c846 Fix issue with colleciton/view name conflict checking in cluster. (#6779) 2018-10-10 12:40:28 +02:00
Michael Hackstein 137f243fe2 Bug fix 3.4/views in aql collections (#6714) 2018-10-10 10:11:14 +02:00
Matthew Von-Maszewski 276da923cf Bugfix 3.4: dynamic management of libcurl's open connections (#6711)
* untested connection count management code.
* add digit to identify location of identical error messages.
* unit tests created, code working and integrated
* subtle changes to smoothing algorithm, close ... but still not perfect
* use scheduler queue() instead of post() to avoid occassional extreme latencies. throughput improved!
* temporary hack to hardcode queue size much lower
* force direct calls to post() to instead route through queue()
* correct issue with previous check-in, but performance has dropped with this on
* revert hardcoded value in SchedulerFeature.cpp
* queue to high priority to be consistent with other Aql actions
* backout all edits to Scheduler.cpp and Scheduler.h
* oops, forgot to remove some testing code.
* 3.4 merge/update
* add changelog entry
2018-10-10 09:11:11 +02:00
jsteemann 41c0236c87 fix wrong function name 2018-10-10 01:43:49 +02:00