1
0
Fork 0
Commit Graph

643 Commits

Author SHA1 Message Date
Jan d894986cd9
do not optimize away sort clauses when it is unsafe to do so (#7694) 2018-12-07 16:23:13 +01:00
Jan 2f48d03c19
speed up remove ops for RocksDB engine (#7638)
* speed up remove ops for RocksDB engine

* add more tests and improve queries a bit for single remote AQL operations
2018-12-06 17:48:42 +01:00
Max Neunhöffer 3a7df19189 Fix super user JWT token behaviour with non-ex. db. (#7656) 2018-12-05 16:50:41 +01:00
Frank Celler 6e2cbe2d1e greylisted 2018-12-04 09:28:00 +01:00
Max Neunhöffer ceb1018af4
Wait for 5 dbservers before starting resilience tests. (#7541)
* Wait for 5 dbservers before starting test.
* Fix jslint.
2018-12-03 13:15:56 +01:00
Frank Celler fb3a8b6b39 sleep before check 2018-12-02 21:44:16 +01:00
Jan 92616c1dca
fix path normalization for Windows (#7565) 2018-11-30 16:21:13 +01:00
Jan 2c3542d41e
fixed issue #7522 (#7554) 2018-11-29 19:26:42 +01:00
jsteemann 7e4a93d161 move commit out of assertion 2018-11-29 14:23:55 +01:00
Simon 933ca8a775 Bug fix/restore index refactor (#7470) (#7491)
(cherry picked from commit d0efd95a37)
2018-11-29 14:08:29 +01:00
Jan 2d4b38600f
prevent operations from overtaking each other (#7498) 2018-11-28 14:30:54 +01:00
Vasiliy 3caed3eb9a issue 506.3: backport 3.4: issue 506.3: use camel-case configuration parameter names consistntly, add a configuration version property to iresearch view meta (#7476)
* issue 506.3: backport 3.4: issue 506.3: use camel-case configuration parameter names consistntly, add a configuration version property to iresearch view meta

* backport: ensure meta version is supported

* backport: hide 'version' property from non-persistence json
2018-11-27 18:35:34 +03:00
Vasiliy f701c6d681 issue 506.2: backport 3.4: add optimization to not reexecute a primary-key filter if a match was already found (#7461)
* issue 506.2: backport 3.4: add optimization to not reexecute a primary-key filter if a match was already found

* backport: explicitly check type of instance of the primary-key filter

* backport: return non-null prepared filter and convert check to assert
2018-11-27 18:29:41 +03:00
Dan Larkin-York 00c060c884 [3.4] Fix end condition (hasMore) for EnumerateViewNode. (#7278)
* Fix end condition (hasMore) for EnumerateViewNode.

* Fix crashes.

* Some more fixes.

* eliminate code duplication
2018-11-27 00:41:29 +03:00
Jan ffc823e1c8
Bug fix 3.4/backport optimizations (#7434) 2018-11-26 19:16:05 +01:00
Max Neunhöffer 6bd61760f2
Fix moving of shard leaders. (#7446)
* Ungreylist move shard test.
* Move leader shard: wait until all but the old leader are in sync.
* Increate moveShard timeout to 10000 seconds.
* Add CHANGELOG.
* Fix compilation.
* Fix a misleading comment.
2018-11-26 15:05:56 +01:00
Wilfried Goesgens eb41c6afcc Bug fix 3.4 /resync test (#7435) 2018-11-26 14:05:33 +01:00
Michael Hackstein 75f89ed74b
Bug fix/update foxx services after restore (#6774) (#7455)
* Bug fix/update foxx services after restore (#6774)

* triggers foxx queue update which leads to the internal selfHeal function of a foxx app to make foxx apps publicy visible after a foxx app is restored

* this will also add the recognition of imported foxx services

* Testing JS refactoring

* Added test case for Foxx dump -> restore cases

* Fixed check, sth- i tries to contact to the foxx service. Test is red now.

* Fixed tests for dump / restore using Foxx. Also first draft to fix the fox side. Blocked by sth. fixed in the Main Repositorx already

* Fixed typo in dump/restore testsuite

* Removed old version of the fix

* Fixed JSLint

* Removed debug-log output from foxx manager
2018-11-26 13:22:50 +01:00
Simon 96346a12d0 switch default message for requireFromPresent (#7439) (#7450)
(cherry picked from commit f90b48f792)
2018-11-26 09:16:48 +01:00
Andrey Abramov 822e15e770
issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes (#7370) (#7451)
* issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes

* backport: add test to ensure views are dropped when database is dropped from plan, fix some issues in ClusterInfo

* optimize primary key lookups in ArangoSearch

* fix test

* Add JS tests

* temporary comment optimizations

# Conflicts:
#	arangod/Cluster/ClusterInfo.cpp
2018-11-26 00:33:58 +03:00
Simon ebad3c3c83 Fix restore of views, add --view option (#7425) (#7427)
(cherry picked from commit c584527d79)
2018-11-23 09:11:33 +01:00
Max Neunhöffer 7bf63cdb95
Make error handling in move shard tests more robust. (#7418)
* Make getCleanedOutServers error handling more robust.

* Fix two more instances of getCleanedOutServers.
2018-11-22 22:53:07 +01:00
Frank Celler 085e6706ea updated for failed foxxmaster 2018-11-22 19:01:29 +01:00
Jan a6cb178b86
add some more intermediate commit tests (#7417) 2018-11-22 15:29:08 +01:00
Frank Celler ef5ffbef61 greyed foxxmaster.js because it is not stable 2018-11-22 12:55:26 +01:00
Simon ef239cbe4e Make recovery more reliable (#7297) (#7367) 2018-11-21 16:51:38 +01:00
Simon 5124633e6a Faster index creation (#7348) 2018-11-20 13:41:01 +01:00
Tobias Gödderz 3d1c643e23 [3.4] MMFiles replication: get followers under lock (#7298)
* Fix resign order

* Fixed a typo

* Get followers later, add TODOs

* Added a callback parameter to collection insert methods

* Get followers under the lock if necessary

* Extracted the replication of inserts into a separate method

* Move shortcut into replicate method

* Added callbacks for remove, replace and update

* Added missing overrides

* Extracted replication code from modifyLocal and removeLocal

* Update followers under lock also during replace, update, remove

* Fix changes from the last commit for update/replace

* Update comments, add asserts

* Remove changes for document-level locks that will be done in another PR

* Unify replication

* Adapt log messages to the devel ones

* Move common methods from its descendants to TransactionCollection, fix Mock on the way

* More IResearch test / mock fixes

* Relax asserts for nested transactions

* Reformat

* Fix non-babies remove and modify replication
2018-11-19 13:03:07 +01:00
Max Neunhöffer 256c167155
Another place with a resigned leader. (#7350) 2018-11-19 11:41:43 +01:00
Jan 812c9223fe
fix queries that refer to COLLECT variables from inside COLLECT (#7333) 2018-11-15 15:10:56 +01:00
Andrey Abramov 2a1542fdc2
Feature/arangosearch pk endianness (#7306) (#7312)
* refactor arangosearch pks

* minor refactoring

* store PK as BigEndian since it leads to more compact index representation

* force iresearch to not to use libbfd

* fix tests
2018-11-14 15:56:40 +03:00
Max Neunhöffer 805f7a7621
Fix timeout in cluster operation in create and drop collections. (#7300)
* Fix loophole.
* Fix inquiry case of id not found: 404.
* Also handle correctly in AgencyComm.
* Fix agency tests.
* Fix error handling in dropCollectionOnCoordinator.
2018-11-14 10:02:26 +01:00
Jan 8bcb1a310c
fix failing non-deterministic query-stream test (#7296) 2018-11-13 11:37:09 +01:00
Alan Plum 1ea6374511 Fix Foxx Queues infinite maxFailures (#7224) 2018-11-12 13:21:12 +01:00
jsteemann 7a2314a32b remove reference to non-existing deriveTestSuite function 2018-11-12 11:33:40 +01:00
Max Neunhoeffer 326da7e180
Document greylisted test. 2018-11-09 12:19:05 +01:00
Frank Celler 10ceaf2391 moved to grey 2018-11-08 21:05:16 +01:00
Max Neunhöffer d21a0f8bca
Greylist moving-shards-with-arangosearch-view-cluster. (#7272)
* Greylist moving-shards-with-arangosearch-view-cluster.

* Add documentation for greylisted tests.
2018-11-08 16:25:52 +01:00
Wilfried Goesgens d33ffab6d8 add more information when timeout failing the index creation tests (#7266) 2018-11-08 12:44:28 +01:00
Andrey Abramov 4873ef79d5
Bug fix 3.4/internal issue #6289 (#7250)
* improve troubleshooting

* fix tests

# Conflicts:
#	arangod/IResearch/IResearchViewBlock.h
#	tests/IResearch/ExpressionContextMock.cpp
#	tests/IResearch/ExpressionContextMock.h
2018-11-07 16:43:08 +03:00
Simon 0d955554f2 Use shared_ptr for LogicalCollection (#7220) (#7244) 2018-11-07 10:43:08 +01:00
Simon f4a1f15964 Simplify dropDatabaseCoordinator & fix some bugs (#7211) (#7243) 2018-11-07 10:41:02 +01:00
KVS85 0822677a0c Fix update-view-arangosearch-spec tests (#7246) 2018-11-07 00:30:40 +03:00
KVS85 38d127cc5a Add view profiling tests (#7230) 2018-11-06 17:15:31 +03:00
Tobias Gödderz 8401f0e36c Fix teardown, improved assertion & error message (#7218) 2018-11-06 13:10:08 +01:00
Dan Larkin-York e5243f9254 [3.4] Upgrade old MMFiles collections for compatibility with ArangoSearch (#7133) 2018-11-06 11:12:54 +01:00
Vasiliy d644561f1f issue 496.4.1: backport 3.4: move StorageEngine-specific flag out of the genric API and closer to the storage engine (#7213)
* issue 496.4.1: backport 3.4: move StorageEngine-specific flag out of the genric API and closer to the storage engine

* address merge issue
2018-11-04 16:52:54 +03:00
Simon 9c53d045be Server stream cursor (#7186) (#7210) 2018-11-03 20:17:52 +01:00
Jan eb3deb578f
smaller changes for replication (#7201) 2018-11-02 15:47:49 +01:00
Vasiliy 850919178f issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca (#7167)
* issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca

* address merge issue

* backport: remove code causing nullptr access

* invalidate payload for each field in FieldIterator before setting a value

* address compilation issues
2018-11-01 23:12:39 +03:00
Jan 023ca6dc33
Bug fix 3.4/patch slave collection count (#7156) 2018-10-31 17:20:46 +01:00
Andrey Abramov 8225003861
[3.4] arangosearch speedup removals (#7158)
* Feature/arangosearch speedup removals (#7134)

* speedup document removals and optimize data model

* fix invalid constexpr

* reduce number of heap allocations for removals (#7157)
2018-10-31 15:54:16 +03:00
Jan aa385c2bbc
increase the maximum allowed number of collections in an AQL query (#7155) 2018-10-31 10:08:32 +01:00
Vasiliy 2458705607 issue 496.2: backport 3.4: allow customization of segment size limits on arangosearch view creation, minor code cleanup (#7141)
* issue 496.2: backport 3.4: allow customization of segmentsize lmts on arangosearch view creation, minor code clanup

* backport: fix incorrect condition
2018-10-30 23:41:15 +03:00
Simon 9271a11441 RocksDB replication thread safety (#7088) (#7131) 2018-10-30 11:24:17 +01:00
Vasiliy e6a6025818 backport: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion (#7106)
* backport: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion

* backport: ensure arangosearch links get exported in the dump

* backport: ensure view is created during restore on the coordinator

* Updates for ArangoSearch DDL tests, IResearchView unregistration and known issues

* Add fix for internal issue 483
2018-10-30 12:50:29 +03:00
Jan 889cee0dae
speed up query string parsing (#7116) 2018-10-29 14:42:39 +01:00
Max Neunhöffer 568f5ee8bf
Consider case of resigned leader. (#7038) 2018-10-29 09:19:17 +01:00
Simon 78132bc2e5 Next try at truncate (#7090) (#7096) 2018-10-26 15:06:36 +02:00
Jan b0bff0a7da
potentially fix failing Windows catch test (#7080) 2018-10-26 10:11:02 +02:00
Frank Celler 5db8528beb more debug output 2018-10-25 17:27:48 +02:00
Michael Hackstein 94a793fe61
Removed incorrect skipping of Batches in RocksDB Tailing syncer (#7021)
* Removed incorrect skipping of Batches in RocksDB Tailing syncer. This caused issues, whenever one transaction was spiltted.

* Added a test for Splitting a large transaction in RocksDB

* Reactivated skipping in RocksDB Wal Tailing (reverts initial fix)

* Actually include lastScannedTick in CollectionFinalize. Proper fix, kudos to @jsteemann.

* Fixed healFollower task in split-large-transaction test
2018-10-25 14:13:40 +02:00
Jan b903f1f8ff
Bug fix 3.4/fix catch test issues (#7045) 2018-10-25 12:49:00 +02:00
Simon e87b42a0c3 Silence tsan warnings (#7051) 2018-10-24 23:58:47 +02:00
KVS85 29d5e2d0e1 Execute all ArangoSearch DDL tests on both cluster and single (#7054) 2018-10-24 22:17:46 +03:00
Alan Plum e821ed6923 Fix Foxx API handling of broken services (#6459) (#7013)
* Add tests for service failing on mount

* Don't install broken services

* Restore error page for broken services

* Prefer JSON error pages

* Expose service upsert in API

* Add Foxx fixes to CHANGELOG

* Update CHANGELOG

Typo
2018-10-24 15:29:31 +02:00
Vasiliy 52e2c97693 backport missed changes (#7016) 2018-10-24 15:43:45 +03:00
jsteemann 149e7e9034 fixed jslint 2018-10-23 11:24:31 +02:00
Tobias Gödderz 183f9194f1 [3.4] Fixed optimize-traversals and added a regression test (#6975)
* Fixed optimize-traversals and added a regression test

* Updated CHANGELOG
2018-10-23 09:46:59 +02:00
Jan 3d01c09ea2
Bug fix 3.4/fix array sorting (#6988) 2018-10-22 12:30:47 +02:00
Andrey Abramov 2b46285b3b
Feature/backport arangosearch 3.4 (#6985)
* issue 485.1: reduce scope of lock in FlushFeature (#6943)

* issue 493.1: update iresearch to changeset 15f561dee5865ead83663ef056d7bbcc38636fb2 (#6947)

* issue 493.2: trigger termination of long-running consolidation on shutdown request

* Feature/update iresearch 2 (#6984)

* update iresearch sources

* another update

* update iresearch

* fix segfault in log message

* update iresearch

* update iresearch

* update iresearch

* remove noexcept

* improve logging

* update iresearch
2018-10-20 13:24:29 +03:00
Jan 1002928b5f
fix https://github.com/arangodb/release-3.4/issues/99 (#6951) 2018-10-19 15:26:23 +02:00
Simon c0455e9c60 Add engine specific collection APIs (#6962) 2018-10-19 15:23:55 +02:00
Tobias Gödderz b18fd77137 Removed debug log output, fixed errorNum check (again), added asserts that the views are properly created (#6948) 2018-10-19 14:18:04 +02:00
Michael Hackstein 875185e6c1
Bug fix 3.4/sync repl release thread (#6784)
* First attempt to not block the thread that requires the EXCLUSIVE sync-up lock

* Fixed insertion of query into registry in rest replication handler.

* Removed unnecessary / false asserts as suggested in review. Fixed code comments.

* Replaced auto with a correct type as suggested in review

* Added a helper function to validate if a query is in use in the registry

* Fixed logic bug in usage of query registry

* Fixed compile issue

* Automaticly transfrom int -> bool in initializerlist sucks...

* Inverted boolen logic bug hidden due to int->bool beeing logically inverted.

* Today it seems that bools are too complicated for my brain.

* Removed failure point, didn't write a test for it, and it is hard to write it in the current test environment. Need to find a better solution in future

* Applied chenges required by @goedderz in review
2018-10-19 13:48:22 +02:00
Simon c2b6fb99ba Propper commit Sequence Numbers (#6958) 2018-10-18 18:25:34 +02:00
Jan fa235feeb2
attempt to fix https://github.com/arangodb/release-3.4/issues/96 (#6953) 2018-10-18 12:41:13 +02:00
jsteemann b4a4ed3bc8 attempt to make test more reliable 2018-10-17 20:32:35 +02:00
Heiko b5ff5080ff merge conf. (#6882) 2018-10-17 15:57:39 +02:00
Jan 13a9a0c12b
Bug fix 3.4/use proper log topic for replication test messages (#6920) 2018-10-17 15:40:59 +02:00
Tobias Gödderz 4bcb3b755c Fixed error num comparison (#6941) 2018-10-17 14:14:43 +02:00
Matthew Von-Maszewski a9ce39f85c Bugfix 3.4: Merge scheduler changes by Michael & Frank into recent overlapping code changes (#6928)
* manual recreation of bug-fix-3.4/scheduler-high-low within recent Scheduler changes.

* restore Documentation that was unintentionally deleted
2018-10-16 22:51:00 +02:00
Dan Larkin-York fa6680a252 [3.4] Fix issues with ArangoSearch link permissions in cluster mode (#6726) 2018-10-16 20:43:01 +02:00
Andrey Abramov 6b6e4f6279
issue 485: ensure LogicalDataSource::drop() is called on vocbase drop (#6895) (#6923)
* issue 485: ensure LogicalDataSource::drop() is called on vocbase drop

* add missed change

* backport: address race between make(...) and async job

* add another missed change

* backport: ensure recursive lock reports itself as locked correctly

* backport: address test failure on mmfiles

* backport: remove redundant lock already held by async task

* backport: reset reader before unlinking directory
2018-10-16 21:06:47 +03:00
Tobias Gödderz a5373d6697 Ignore errors caused by an admissible race (#6899) 2018-10-16 14:24:09 +02:00
Wilfried Goesgens 83498d94a0 Feature 3.4/better recovery resulthandling (#6859) 2018-10-16 09:28:49 +02:00
Jan 738c00814a
added waitForSync option to make tests more deterministic (#6886) 2018-10-15 17:37:44 +02:00
Andrey Abramov 4ef4e1119a
backport new arangosearch to 3.4 (#6874)
* backport new arangosearch

* backport tests

* backport another test

* backport changes in cmake
2018-10-13 01:27:31 +03:00
Tobias Gödderz 9717c94a43 Added waitForEstimatorSync() (#6867) 2018-10-12 19:17:41 +02:00
Jan 9b7258a4d1
added several query optimizations (#6781) 2018-10-12 17:41:45 +02:00
Tobias Gödderz 3c1db60d70 [3.4] Remove nondeterministic edge index test (#6862) 2018-10-12 15:18:47 +02:00
Simon 010b54c81e Allow WAL logger to split up transactions (#6800) 2018-10-12 15:15:55 +02:00
Jan 3adaf001c5
velocypack library update (#6850) 2018-10-12 12:46:52 +02:00
Wilfried Goesgens 825dc54332 fix windows path escaping in testcase (#6839) 2018-10-11 18:40:46 +02:00
Tobias Gödderz 351a10a547 [3.4] Added a regression test for arangodb/backlog#486 (#6791)
* Added a regression test for arangodb/backlog#486

* Moved regression test in existing ddl test files
2018-10-11 16:23:37 +03:00
Tobias Gödderz 7ec610a42a [3.4] Rework move shards with view test (#6772)
* Fixed testSetup(). Reduced redundant code.

* Reworked assertions in moving-shards-with-arangosearch-view-cluster.js

* Fixed merge

* Added changes from review

* Removed debug output / fixed jslint error
2018-10-11 10:25:40 +02:00
Dan Larkin-York ff2ce5c846 Fix issue with colleciton/view name conflict checking in cluster. (#6779) 2018-10-10 12:40:28 +02:00
Michael Hackstein 137f243fe2 Bug fix 3.4/views in aql collections (#6714) 2018-10-10 10:11:14 +02:00
Matthew Von-Maszewski 276da923cf Bugfix 3.4: dynamic management of libcurl's open connections (#6711)
* untested connection count management code.
* add digit to identify location of identical error messages.
* unit tests created, code working and integrated
* subtle changes to smoothing algorithm, close ... but still not perfect
* use scheduler queue() instead of post() to avoid occassional extreme latencies. throughput improved!
* temporary hack to hardcode queue size much lower
* force direct calls to post() to instead route through queue()
* correct issue with previous check-in, but performance has dropped with this on
* revert hardcoded value in SchedulerFeature.cpp
* queue to high priority to be consistent with other Aql actions
* backout all edits to Scheduler.cpp and Scheduler.h
* oops, forgot to remove some testing code.
* 3.4 merge/update
* add changelog entry
2018-10-10 09:11:11 +02:00
jsteemann 41c0236c87 fix wrong function name 2018-10-10 01:43:49 +02:00
Max Neunhöffer fa683d3925
Remove a relic from early days in /Target/FailedServers. (#6689)
* Remove a relic from early days in /Target/FailedServers.
* Fix a test.
2018-10-09 13:49:38 +02:00
jsteemann 048d322352 try to fix test 2018-10-09 10:56:28 +02:00
Jan d3392a9050 Bug fix 3.4/fix variable replacement in view search conditions (#6755)
* fix variable replacements in view search conditions

* unify CHANGELOG

* added reference to internal issue

* add catch test

* Added AQL test
2018-10-09 00:31:19 +03:00
Tobias Gödderz ed2c7ad774 Fixed testSetup(). Reduced redundant code. (#6760) 2018-10-08 18:57:07 +02:00
Simon 05446dcac0 Bug fix 3.4/activefail debug (#6717) 2018-10-05 18:36:06 +02:00
Lars Maier c01de053ca Order of transactions depends on implementation. Do only one shard. (#6723) 2018-10-05 14:58:14 +02:00
Simon a8eabf95d4 Fix foxx test failures (#6725) 2018-10-05 12:49:17 +02:00
jsteemann eeed9aa22b try to make test more deterministic 2018-10-03 17:29:01 +02:00
Jan 3c692bb8bd
Bug fix 3.4/display sync progress (#6692) 2018-10-02 20:00:22 +02:00
jsteemann 6b4e7178e2 fixed invalid test setup 2018-10-02 19:52:35 +02:00
Dan Larkin-York a0861eb602 Fix multiple links per collection issue (#6661)
* Fix muliple links per collection issue (arangodb/release-3.4#48).

* Fix comparison.

* Added test

* Fix suite name.

* Address some edge cases.

* Clear views on teadown in tests

* Update aql-view-arangosearch-ddl-cluster.js

* Update aql-view-arangosearch-ddl-noncluster.js

* Fix jslint errors

* Added some comments about the comparison.
2018-10-02 17:33:52 +03:00
KVS85 799083dde6 Change tests setUp/tearDown to be common (#6654) 2018-10-02 13:24:42 +02:00
jsteemann de10c4abba fix wrong numberOfShards values in tests 2018-10-02 10:39:09 +02:00
Dan Larkin-York c794a43ea0 Mark flaky test nondeterministic for now (#6662) 2018-10-01 17:36:47 +02:00
Wilfried Goesgens fbd2ca2e79 Feature 3.4/windows utf16 fileaccess (#6600) 2018-10-01 17:19:01 +02:00
Kaveh Vahedipour 8b9a0f6a25 Feature 3.4/detailed get maintenance feature (#6666)
* backport of test data generation for maintenance from devel
2018-10-01 14:50:25 +02:00
jsteemann 16ff872d14 try to make test more deterministic 2018-09-28 18:08:06 +02:00
Max Neunhöffer b67718d6aa
Fix cleanup of Current entry in case a follower is removed from Plan. (#6623)
* Properly remove unplanned followers in leader and Current.
* Add a catch test.
* Fix tests.
* Fix a bug with a temporary object.
* Protect against exception from getCollection not found.
2018-09-28 17:37:14 +02:00
jsteemann c89c73973e make test more deterministic 2018-09-28 17:06:20 +02:00
Simon c42583dab0 Fix error in dump test, create views before syncing data (#6640) 2018-09-28 17:00:03 +02:00
Kaveh Vahedipour 87e7185dd7 agency updating endpoints properly (#6643)
* agency updating endpoints properly
2018-09-28 15:12:40 +02:00
Tobias Gödderz c54f815134 [3.4] Fix cluster view test (#6621) 2018-09-28 11:34:13 +02:00
Jan 68e81da38e
handle DeleteRange markers on RocksDB recovery (#6565) 2018-09-28 11:10:11 +02:00
Lars Maier 0e9aa10c2a Feature 3.4/cleanup lost collections (#6627)
* Working draft: clean lost collections in supervision.
* Added early exit as in spec.
* Finished test. Fixed logging.
2018-09-27 10:35:39 +02:00
Jan 7c35c98855
Feature 3.4/nested aql (#6612) 2018-09-26 17:17:12 +02:00
Simon f79a7d1a8f Fix crash on Agency / DBserver with user JWT tokens (#6595) 2018-09-26 14:22:27 +02:00
Jan 654b6e601b
fixed issue #6601 (#6607) 2018-09-26 14:18:34 +02:00
jsteemann 1af7873505 split tests 2018-09-26 12:05:36 +02:00
Jan a8cd72f502
Bug fix 3.4/optimizations 210918 (#6574) 2018-09-25 09:50:25 +02:00
Jan 058b5072b3
Feature 3.4/query cache diagnostics (#6581) 2018-09-25 09:49:33 +02:00
jsteemann b17af2ac67 adjust file path 2018-09-24 13:52:00 +02:00
Lars Maier b74222470a Bug fix 3.4/cleanout server dropping wrong follower (#6572)
* Fixing bug: cleanoutServer will no longer add old leader as follower.

* Fixed rollback.
2018-09-21 13:36:37 +02:00
Lars Maier c5b67d217d Feature 3.4/static const strings cleanup (#6504)
* AgentConfiguration cleanup
* static strings in maintenance / agency
* fix windows build
* test bogus
* got rid of old inefficient create method
* completed with NonAction
* this works with osx / windows
* map creation can be outside function
* string init order fiasco
* startup init fiasco
* fix init-order fiasco with static strings (#6475)
* try to work around compile errors
* Removed broken and unused strings.
2018-09-21 13:18:37 +02:00
Dan Larkin-York 95af9a3d56 Backport #6182 and #6549. 2018-09-20 14:35:50 -04:00
Simon 3c965ee48a Resilience test failure points (#6545) 2018-09-20 01:04:38 +02:00
Jan e92d432cf4
Bug fix 3.4/fix stats on skip (#6532) 2018-09-19 22:01:50 +02:00
jsteemann 50c93cb9b0 move tests to the right location 2018-09-17 20:22:37 +02:00
Jan 46b4e7b440
take over selectivity estimates (#6512) 2018-09-17 16:42:24 +02:00
Simon 097d9afaed Fix deduplication in IndexBlock (#6509) 2018-09-17 12:52:55 +02:00
Lars Maier d4d5031287 Bugfix 3.4/early out invalid links in view creation (#6503) 2018-09-17 09:52:10 +02:00
Jan 6e4200d418
make cid values in /_api/replication/logger-follow strings as advertised (#6498) 2018-09-14 14:21:05 +02:00
Lars Maier 78f182ebe8 Completely export views dump restore [3.4] (#6484) 2018-09-13 12:37:37 +02:00
jsteemann 7a664babf6 fix error message (backlog/#479) 2018-09-12 16:34:26 +02:00
Jan b029186edc
Bug fix/aql modify cleanup (#6380) (#6458) 2018-09-12 13:56:59 +02:00
KVS85 500a876fc7 Fix typo in ArangoSearch test name. (#6461) 2018-09-11 12:42:25 +02:00
Simon 2312e46c89 Trace skipSome() calls (#6450) 2018-09-11 08:53:24 +02:00
KVS85 69eefc063b Disable read tests for cluster till issues are not resolved and fix task (#6452)
update test
2018-09-10 23:20:26 +02:00
Heiko 7bc9c5539f added tests, updated docu (#6408) 2018-09-10 16:57:47 +02:00
Jan 1a303dd43d
fix some issues with sorted variant of COLLECT (#6432)
* fix some issues with sorted variant of COLLECT

* honor review comments
2018-09-10 16:20:57 +02:00
Frank Celler ac0a54e0dc fixed missing cleanup 2018-09-07 16:46:13 +02:00
Frank Celler df77347551 release version 3.4.0-rc.1 2018-09-05 21:51:33 +02:00
Jan 1810ec9909
fix profile output for nodes without calls to getSome (#6396) 2018-09-05 20:25:18 +02:00
Heiko 61da33943a Feature 3.4/new versioning scheme (#6395)
* removed old version formatter, ui now showing full version - not a substring anymore

* added verisoning tests for semnativ versioning
2018-09-05 17:20:40 +02:00
Simon dd457b835f Fix pregel during import (#6356) 2018-09-05 16:19:38 +02:00
Kaveh Vahedipour 813a580246 maintenance fast lane backport (#6350) 2018-09-05 14:54:04 +02:00
Jan e87e305793
implement caching for stats values too (#6360) 2018-09-04 16:05:10 +02:00
Simon 3eed525481 Hide links (#6348) 2018-09-03 15:36:37 +02:00
Frank Celler 97117c341b disable temporarily 2018-09-03 15:20:27 +02:00
Frank Celler 5c6dc28266 moved to nondeterministic for now 2018-09-01 15:44:28 +02:00
Dan Larkin-York 18d827688a Fix condition finders moving filters past modifications into index nodes (#6327)
* Fixed issue with condition finder pulling filter past modification node into index.

* Fixed issue with traversal condition finder pulling filter past modification node into index.

* fixed jslint
2018-09-01 13:34:23 +02:00
Max Neunhöffer 071966ce94
Fix maintenance test. (#6326) 2018-08-31 21:54:55 +02:00
Jan 24ca3acf97
rename `tests/js/*/tests/*` to `tests/js/*/*` (#6280) 2018-08-31 19:42:21 +02:00
Jan 191ae2dc43
do not report figures for an index by default (#6296)
the change in behavior crept in unintentionally due to my last
change of the index API. this PR reverts the unintended change
here so figures are only returned when explicitly requested
2018-08-31 17:22:00 +02:00
Lars Maier 63d9cfa081 Maintenance Fixes (#6284)
* Clean up for `FIXMEMAINTENANCE` comments: removed race condition, added errors and `notify()`s.
* Removed dublicated code.
* Added requested changes. Added error reporting for `UpdateCollection`.
* Make it compile. Add missing `notify()`.
* `CreateCollection` generates errors in all code paths.
* Fixed catch test.
2018-08-31 15:24:29 +02:00
Vasiliy 10181433b7 issue 465.1: address V8 memory leak in tests (#6306) 2018-08-31 12:22:43 +02:00
Michael Hackstein 0a343392ac
Forward port of bugfix to issue #5941 from 3.3.15 (#6304) 2018-08-30 21:03:44 +02:00
KVS85 4d972e5900 Enable views usage in designated tests (#6295) 2018-08-30 01:50:39 +03:00
Alan Plum ecfdd8e698 Fix getReadableName (#6272)
* Move getReadableName to new test folder

* More tests

* Fix getReadableName

* Linting
2018-08-29 17:20:52 +02:00
Vasiliy 1586b5128e issue 458.3: syntactic cleanup (#6286)
* issue 458.3: syntactic cleanup

* remove extraneous debug output
2018-08-29 17:20:00 +03:00
Vasiliy a6f3444601 issue 458.2.1: ensure LogicalCollection presence is checked before granting/revoking permissions (#6274)
* issue 458.2.1: ensure LogicalCollection presence is checked before granting/revoking permissions

* try to address test failures

* backport: support wildcard for database too

* create collection before granting

* adjust ruby tests to expect behaviour as defined by issue #458

* adjust expected Ruby test result

* create required collection in Ruby test

* revert back to previous test code since Ruby refuses to create required collection

* missed revert
2018-08-29 14:57:56 +03:00
KVS85 892106e98d Add OPTIONS everywhere in AQL_QUERY and switch FILTER to SEARCH in several queries (#6276) 2018-08-28 22:26:19 +03:00
KVS85 a1c2e49424 Bug fix/fix view check for auth test (#6270)
* Fix view cache clear before switching to root.

* Remove redundant output.

* Fix typo
2018-08-28 20:58:54 +03:00
Jan 494764b95c
Bug fix/fiddle version string into test paths (#6267) 2018-08-28 14:58:35 +02:00
Vasiliy 953027ba63 issue 458.1: move SystemDatabaseFeature from IResearch to RestServer (#6260)
* issue 458.1: move SystemDatabaseFeature from IResearch to RestServer

* Add modified tests.
2018-08-28 09:48:09 +02:00
Jan 5022ccc24d
Bug fix/fixes 2508 (#6254) 2018-08-27 21:36:39 +02:00
Lars Maier 5555bd2fad Schmutz++ Improved (#6259)
* Fixed startup order. Don't start maintenance threads in single-server or agent.
Added range check for `--server.maintenance-threads`.
Fixed invalid array access, when shard exists locally but not in plan.
* Removed unused header imports.
* Added CHANGELOG entry
* Fixed shutdown bug. Startup fixed.
* Fixed catch test.
* Add Maintenance improvements to NewFeature34.md.
2018-08-27 20:25:09 +02:00
Andrey Abramov 615e1cf7de
Feature/add options to view (#6255)
* added OPTIONS for views

* pass options too

* validation for OPTIONS

* fix OPTIONS validation

* removed debug log message

* add forceSync options

* add forceSync view option

* fix comments

* fix some memleaks

* fix typo

* fix integration tests

* fix integration tests

* fix another integration test

* rename 'forceSync' option to 'waitForSync'

* another attempt to fix test

* ensure query caches are properly invalidated

* address integration test failures

* another attempt to fix test
2018-08-26 22:30:23 +03:00
Vasiliy 5d14775de8 issue 459.3: ensure collection permissions are checked before updating/dropping an IResearch view (#6253)
* issue 459.3: ensure collection permissions are checked before updating/dropping an IResearch view

* backport: ensure collection permissions are checked before updating/dropping an IResearch view on cluster

* backport: address test failures

* backport: address more test failures

* reuse existing classes for scoping ExecContext
2018-08-26 18:00:16 +03:00
jsteemann ebba4fd55a fix memory errors and crashes 2018-08-25 20:17:59 +02:00
jsteemann 3c031895c6 fixed compile warning 2018-08-25 11:29:09 +02:00
Simon 568a09f177 Disable JS on DBServer, fix race in UserManager (#6244) 2018-08-24 22:20:49 +02:00
Jan 0d48677619
Bug fix/aql optimizer improvements 2308 (#6241) 2018-08-24 13:42:22 +02:00
Vasiliy 2ecdfefcb8 issue 459.2: ensure view retrieval is denied of detailed definition is denied (#6237)
* issue 459.2: ensure view retrieval is denied of detailed definition is denied

* address test failures
2018-08-24 14:37:35 +03:00
Kaveh Vahedipour 28754cbf15 Feature/schmutz plus plus (#5972)
- Schmutz now called "Maintenance" and completely implemented in C++
 - Fix index locking bug in mmfiles
 - Fix a bug in mmfiles with silent option and repsert
 - Slightly increase supervision okperiod and graceperiod
2018-08-24 12:15:35 +02:00
Vasiliy b55546225f issue 450.6: simplify consolidation policy typing (#6235) 2018-08-24 01:25:23 +03:00
Vasiliy e04b5318b4 issue 450.5: rename consolidation-related configuration properties and remove locale (#6232) 2018-08-23 16:04:25 +03:00
Vasiliy 76548e1161 issue 459.1: modify LogicalView permission validation as per the new requirements (#6226) 2018-08-22 18:56:10 +03:00
Vasiliy 325e61b4ed issue 450.3: use a single configuration policy differentiated by 'type' with arbitrary number of configurable parameters (#6205)
* issue 450.3: use a single configuration policy differentiated by 'type' with arbitrary number of configurable parameters

* ensure test data is persisted to the test directory

* add missed declaration

* fix typo

* add full namespace and includes
2018-08-21 14:46:28 +03:00
Simon 229c09d434 Allow dirty-reads from passive (#6136) 2018-08-20 16:26:14 +02:00
Vasiliy f7d7ce93fe issue 450.2: remove redundant functions from IResearchView API (#6197) 2018-08-20 16:38:17 +03:00
Simon fc204a2b3e fix profiling code (#6190) 2018-08-20 12:59:07 +02:00
Jan 7cb1da12cf
make AQL functions construction easier (#6195) 2018-08-20 11:56:38 +02:00
Vasiliy c08ab01f67 issue 450.1: remove the "commit" configuration layer from ArangoSearch properties (#6185)
* issue 450.1: remove the "commit" configuration layer from ArangoSearch properties

* fix broken tests
2018-08-20 02:18:02 +03:00
Jan 99f176bed5 Feature/add search keyword (#6166)
* added SEARCH keyword

* fixes jslint errors

* add incompatibility notice

* remove VIEW keyword (does not work yet!!)

* add initial support for SEARCH keyword to optimizer rules

* replace FILTER with SEARCH keyword in tests

* removed VIEW keyword, make shell_server_aql tests pass again in single server

* cleanup

* handle SEARCH clause for views

* make SEARCH a non-keyword

* fixed an issue with duplicate variables

* fixed 3 tests

* fix SEARCH statement support for views

* minor refactoring

* fix integration tests

* optimize SEARCH conditions a bit more

* fix jslint error

* fixed wrong comments and typo in class name

* fix documentation

* adjust recovery tests to use SEARCH instead of FILTER

* fix another failing test
2018-08-18 20:22:58 +03:00
Jan a5ef080a8a
attempt to make replication_sync more reliable in tests for MMFiles (#6184) 2018-08-17 14:20:40 +02:00
Vasiliy 364360ae79 issue 435.1: allow a user to specify the number of IResearchFeature threads via command line (#6164) 2018-08-16 13:14:15 +02:00
Simon 392118bd62 Use RangeDelete where possible (#6121) 2018-08-15 18:52:09 +02:00
Vasiliy 6fd541d110 issue 427.5: use ApplicationServer reference instead of pointer (#6145)
* issue 427.5: use ApplicationServer reference instead of pointer

* address MSVC build failure
2018-08-15 12:16:02 +03:00
jsteemann 2fcbb0c02b remove unused AttributeScorer test 2018-08-14 12:10:35 +02:00
Jan 95d1892f18
remove canThrow attribute from AQL functions (#6123)
Its was somehow overlapping with the isDeterministic attribute (but with the opposite meaning)
2018-08-09 16:45:54 +02:00