1
0
Fork 0
Commit Graph

1167 Commits

Author SHA1 Message Date
Michael Hackstein d83e3acfc9 Final modification of ShadowRows in FilterExecutor. All but profiling tests pass. This needs some discussion about overfetching of data, and propagation of hardLimit 2019-12-02 17:02:26 +01:00
Michael Hackstein 8307d15ed6 Added tests for AqlItemBlockInputRange and adjusted implementation accordingly. 2019-11-29 14:03:58 +01:00
Michael Hackstein 2b13d48387 Merge branch 'feature/AqlSubqueryOperationsStack' of ssh://github.com/arangodb/ArangoDB into feature/AqlSubqueryExecutionBlockImplExecuteImplementation 2019-11-28 12:51:27 +01:00
Michael Hackstein d636a10c62 Merge branch 'devel' of ssh://github.com/arangodb/ArangoDB into feature/AqlSubqueryOperationsStack 2019-11-28 12:33:38 +01:00
Jan b610d99d9f Parallelize certain AQL write operations (#10503)
* added highly experimental startup option `--query.parallelize-gather-writes`

Turning this option on will enable the `parallelize-gather` AQL
optimizer rule for certain write queries. This option is `false`
by default.

The feature is highly experimental and should not be used on a
production system. The option is therefore also hidden.

* parallelize certain write operations in AQL

* remove unneeded _vocbase

* remove unneeded _vocbase

* added startup option and tests
2019-11-27 19:05:04 +01:00
Simon 2ae30242c0 Cancel connections to known failed servers (#10546)
* test

* rename shit

* rename shit

* Cancel connections to known failed servers

* do not uncomment code

* Retry on 503 responses

* Make test grey again
2019-11-27 17:34:43 +01:00
Jan 119aa7bfd8 attempt to make shell-query-spec test deterministic (#10551)
* attempt to make shell-query-spec test deterministic

* remove the old test
2019-11-27 17:30:01 +01:00
Jan Christoph Uhde 3c5acf6717 check before foxx-heal (#10512)
* check before foxx-heal

* be more graceful
2019-11-27 17:29:35 +01:00
Jan b0cafb39ae ungreylist the test (#10553) 2019-11-27 16:47:47 +01:00
Jan 4213654624 Allow the optimizer to use indexes (#10541)
when a collection attribute is compared to anexpansion followed by an attribute name, e.g. `doc.value IN something[*].name`.
2019-11-27 16:46:31 +01:00
Wilfried Goesgens 2192b49d4f on exception print which query set fails (#10536)
* on exception print which query set fails

* no need to print this - it does by itself
2019-11-27 16:31:58 +01:00
Michael Hackstein a6281daf9d Removed debug profile execution of a query 2019-11-27 15:37:32 +01:00
Michael Hackstein b5dacbd9cf Improved human readable output of SortLimit test, while validating the result 2019-11-27 15:37:15 +01:00
Jan Christoph Uhde 1cd71a8d11 rename timeout to maxRuntime (#10552)
* rename timeout out maxRuntime

* Update CHANGELOG

Co-Authored-By: Jan <jsteemann@users.noreply.github.com>
2019-11-27 15:08:50 +01:00
Michael Hackstein b91be5f8e2 Fixed SingleRowFetcherTest. Also an AqlItemBlockInputRange can now handle ShadowRows properly 2019-11-27 11:57:31 +01:00
Kaveh Vahedipour d11c0954e8 Missing post failure on readlock in SynchronizeShard (#7860)
* when post cannot be delivered for readlock waiting for put meningless

* devel pull

* we can rely on POST alone

* clean up

* wrong errorCode tested

* fixed nullptr

* correct timeout

* fixed nullptr

* merge devel

* log level

* maintenace default log level raised to INFO, shard synchronisation only logs start/success all WARN/ERR demoted to DEBUG

* message unification

* devel merge

* fixed query registry

* tobias remarks

* mchacki part one

* static string for rebootid

* working tests

* use the reboot tracker from clusterinfo

* use the reboot tracker from clusterinfo

* rebootid be rebootid

* fixed serverid and all working

* static strings

* callguard out of reboottracker

* call callbacks, when query is ditched

* clear priv

* change log

* my oh my

* simon attention

* merge seems fine

* typo

* fix headers
2019-11-26 17:46:26 +01:00
Michael Hackstein 18408c882e Bug fix/gharial return name (#10537)
* Added more return format tests for _api/gharial

* Now return name in api/gharial list api

* Added CHANGELOG entry

* Removed debug print
2019-11-26 10:42:18 +01:00
Wilfried Goesgens b194409654 fix the default case, if we guess that we have structured post data, actually parse it. (#10508) 2019-11-22 15:22:18 +01:00
Michael Hackstein c201dce948
Bug fix/input row serialization (#10502)
* Unified toVelocyPack of InputRow and AqlItemBlock. We can now velocypack any range within an AqlItemBlock as a new block.

* This is the fix required here. We now end exhausted false in initialize cursor. For some reason the other side checks this hard-coded value and if it is not the expected value it does ignore the send body ¯\_(ツ)_/¯

* Added test for range-based serialization
2019-11-22 08:08:53 +01:00
Andrey Abramov da1b549fe9
Feature/arangosearch 3.6 (#10490)
* backport features from iresearch upstream

* some fixes after upgrade

* fix compilation

* backport the recent changes

* small adjustment

* add missing files

* update iresearch from upstream

* added js tests for new analyzers

* update changelog

* make jslint happy

* update changelog

* fix tests
2019-11-21 19:14:15 +03:00
Jan Christoph Uhde 5321bf5c1a dump/restore db properties (#10482) 2019-11-21 15:03:25 +01:00
Tobias Gödderz 168103af88 Splicing gather cleanup (#10479)
Some cleanup and deprecation information
2019-11-21 13:00:31 +01:00
Jan f42dd86b25
add tests for inventory (#10464) 2019-11-21 08:56:27 +01:00
Iurii Popov 9f4926bfec Feature/issue #653 (#10427)
* late document materialization for view draft

* MaterializeType

* asserts and removed std::function

* std::map -> std::array

* Common search ast nodes code to a separate file

* Unit tests for create and clone a node

* js tests

* tmp unfinished

* Replace variables for late materialization

* Move removing

* Removed wrong clears

* Fixed variable replacement

* removed old tests (for separate materialization)

* check if late materialization arangosearch rule is enabled

* js test. added space

* moved a function to anonym namespace

* Subquery assert

* Review improvements

* Review improvements 2

* View node state to a separate var (microoptimization)

* Fixed index assert

* alignment

* C++ unit tests
2019-11-20 22:11:54 +03:00
Markus Pfeiffer 8e13486687 Fix bug in SubqueryEndExecutor (#10485)
* Fix bug in SubqueryEndExecutor

If a subquery was spliced, and did not get any input rows, the SubqueryEnd
executor still expected a relevant ShadowRow to be handed through, and ran into
an assertion (or otherwise crashed the server) if it didn't get one.

* Add regression test for SubqueryEndExecutor fix
2019-11-20 17:03:28 +01:00
Jan 31e75df80f
use batched methods (#10461) 2019-11-20 14:02:13 +01:00
hkernbach 45f7771b66 Merge 2019-11-20 12:33:03 +01:00
hkernbach 79117675fe single row fetcher, execute + tests 2019-11-20 11:17:24 +01:00
Jan 932f8b5874
undistribute a few more queries (#10459) 2019-11-20 08:21:44 +01:00
Dronplane af1a10f913 Made test tolerant to leftover links from previous test-runs (#10480)
* Made test tolerant to leftover links from previous test-runs

* Added semicolon
2019-11-19 21:52:39 +03:00
Andrey Abramov 0b5fc7fba7
allow in-place analyzer creation via link definition (#10466)
* allow in-place analyzer creation via link definition

* add special handling for _analyzers collection

* modify initial syncer

* address review commments

* fix accidentally broken test
2019-11-19 20:55:45 +03:00
Jan f8e6ada19d
make replication timeouts configurable via startup options (#10476)
* make replication timeouts configurable via startup options

The following options are available (for active failover
and master-slave replication):

    --replication.connect-timeout
    --replication.request-timeout

Values can be specified in seconds. If these options are used, they will
be used for replication requests, overriding any hard-coded defaults or
explicitly configured timeouts.
2019-11-19 16:57:48 +01:00
Tobias Gödderz 7a57a72620 Feature/aql subquery splicing with gather (#10341)
Allow Splicing with GATHER nodes
2019-11-18 19:05:44 +01:00
Michael Hackstein 11be23e604 Merge branch 'devel' of ssh://github.com/arangodb/ArangoDB into feature/AqlSubqueryExecutionBlockImplExecuteImplementation 2019-11-18 17:14:00 +01:00
Jan c142e8bc21
fixed issue #10440: Incorrect sorting with sort criteria partially covered by index (#10442) 2019-11-18 15:43:34 +01:00
Dronplane 31a580da7b Feature/internal issue #654 (#10456)
* Implemented PHRASE

* Added more tests

* Implemented array recursion

* Fixed tests

* Fixed tests

* Minor comments added
2019-11-18 13:53:05 +03:00
Michael Hackstein 0300467ab4 Finally merged with latest devel, seems to work 2019-11-18 09:50:42 +01:00
Michael Hackstein 4d030f47c0 Intermediate devel pull, might not compile 2019-11-18 09:17:57 +01:00
Lars Maier ebf3296e9c Backup with view (#10386)
* Commit and store view related data on create backup.
* Fixes to upgrade on env-var.
* Fixed CMakeLists.txt.
* Changes to allow restore from 3.5 to 3.6.
* Remove unnecessary code introduced in merge.
* CHANGELOG:
2019-11-15 17:50:04 +01:00
Iurii Popov caffa6a22e Bug fix/fix late materialization used after sort (#10447)
* Fixed applying late materialization with calc node between sort an limit

* fixed typo

* move micro optimization

* Fixed subqueries error
2019-11-15 17:06:50 +03:00
Andrey Abramov c6fc77858f
Revert "Fixed applying late materialization with calc node between sort an limit (#10439)" (#10446)
This reverts commit e765137c3e.
2019-11-15 12:56:05 +03:00
Dronplane e765137c3e Fixed applying late materialization with calc node between sort an limit (#10439)
* Fixed applying late materialization with calc node between sort an limit

* fixed typo

* move micro optimization
2019-11-15 12:48:55 +03:00
Dronplane a4f2653f4e Feature/internal issue #509 (#10407)
* Added Hint for index creation

* Added tests for proper hint passing

* Added tests

* Added failed link deletion test

* Fixed mmfiles not deleting  failed index

* Fixed cluster run

* Added sync
2019-11-14 18:56:18 +03:00
Andrey Abramov edc8555f17
ArangoSearch index stats (#10421)
* expose ArangoSearch index stats via index figures API

* fix tests

* add tests

* address jslint failures
2019-11-14 18:55:43 +03:00
Jan 2c4f7bb983 Bug fix/dont use indexes in progress (#10432)
* don't return any in-progress indexes

* fix handling of in-progress indexes

* add test

* address review comments
2019-11-14 14:06:42 +03:00
jsteemann a8ec461b58 fix compile warning in AnalyzerFeature test 2019-11-13 23:32:59 +01:00
Jan fd87abc522
allow using `RANDOM_TOKEN` AQL function with an argument value of `0`. (#10414) 2019-11-13 22:20:00 +01:00
Andrey Abramov ff93f45892
Bug fix/internal issue #651 (#10415)
* Bug fix 3.5/internal issue #651 (#10388)

* extract recursive part of IResearchLinkMeta

* avoid saving analyzer definition during link meta initialization

* add tests to check cluster deadlock

* cleanup

* code cleanup

* add moar tests

* mooooaaar checks

* make jslint happy

* backport fix for cluster startup from 3.5.2 branch

* backport changes from 3.5.2

* fix tests

* fix tests

* moar fixes

* refactor analyzer definitions tracking

* add some tests

* extend dump tests

* add tests for replication

* fix tests

* more fixes

* address jslint errors

* address review comments

* address test failures

* reflect changes in changelog

# Conflicts:
#	arangod/IResearch/IResearchAnalyzerFeature.cpp
#	arangod/IResearch/IResearchFilterFactory.cpp
#	arangod/IResearch/IResearchLink.cpp
#	arangod/IResearch/IResearchLinkMeta.cpp
#	tests/IResearch/IResearchAnalyzerFeature-test.cpp
#	tests/IResearch/IResearchDocument-test.cpp
#	tests/IResearch/IResearchFilterBoolean-test.cpp
#	tests/IResearch/IResearchFilterCompare-test.cpp
#	tests/IResearch/IResearchFilterFunction-test.cpp
#	tests/IResearch/IResearchFilterIn-test.cpp
#	tests/IResearch/IResearchLinkHelper-test.cpp
#	tests/IResearch/IResearchLinkMeta-test.cpp
#	tests/IResearch/IResearchView-test.cpp
#	tests/V8Server/v8-analyzers-test.cpp

* fix tests

* fix tests

* Fix tests

* fix replication tests
2019-11-13 19:50:17 +03:00
Simon 5f7803e705 Parallel SortingGatherExecutor (#10410) 2019-11-13 10:39:47 +01:00
Jan Christoph Uhde 2faa44dac4 add optional exclusive writes to rocksdb engine (#10364) 2019-11-12 19:09:13 +01:00