1
0
Fork 0
Commit Graph

17777 Commits

Author SHA1 Message Date
Andrey Abramov 0b5fc7fba7
allow in-place analyzer creation via link definition (#10466)
* allow in-place analyzer creation via link definition

* add special handling for _analyzers collection

* modify initial syncer

* address review commments

* fix accidentally broken test
2019-11-19 20:55:45 +03:00
Lars Maier f5730aa0a5 Fixing vst comm task again. (#10474) 2019-11-19 17:21:45 +01:00
Jan f8e6ada19d
make replication timeouts configurable via startup options (#10476)
* make replication timeouts configurable via startup options

The following options are available (for active failover
and master-slave replication):

    --replication.connect-timeout
    --replication.request-timeout

Values can be specified in seconds. If these options are used, they will
be used for replication requests, overriding any hard-coded defaults or
explicitly configured timeouts.
2019-11-19 16:57:48 +01:00
Tobias Gödderz cac2a279b0 Hopefully satisfy MSVC (#10469) 2019-11-19 16:25:19 +03:00
Max Neunhöffer 315a7ba5f8
Minor fixes for hotbackup before 3.6 release. (#10458)
* TRI_Basename finally with std::string const& parameter overload. I hate .c_str()
* Fix statistics bug.
* Lose saveCurrent in client tool.
* Sort out options of arangobackup.
2019-11-19 12:51:09 +01:00
Wilfried Goesgens b0db98c702 fix windows debug build (#10465) 2019-11-19 11:11:28 +01:00
Tobias Gödderz 7a57a72620 Feature/aql subquery splicing with gather (#10341)
Allow Splicing with GATHER nodes
2019-11-18 19:05:44 +01:00
Dronplane bd1316b300 Add braces (#10460) 2019-11-18 17:58:43 +03:00
Jan c142e8bc21
fixed issue #10440: Incorrect sorting with sort criteria partially covered by index (#10442) 2019-11-18 15:43:34 +01:00
Markus Pfeiffer bd19f67004 Remove as now unused SingleBlockFetcher (#10416) 2019-11-18 12:53:50 +01:00
Dronplane 31a580da7b Feature/internal issue #654 (#10456)
* Implemented PHRASE

* Added more tests

* Implemented array recursion

* Fixed tests

* Fixed tests

* Minor comments added
2019-11-18 13:53:05 +03:00
Lars Maier ebf3296e9c Backup with view (#10386)
* Commit and store view related data on create backup.
* Fixes to upgrade on env-var.
* Fixed CMakeLists.txt.
* Changes to allow restore from 3.5 to 3.6.
* Remove unnecessary code introduced in merge.
* CHANGELOG:
2019-11-15 17:50:04 +01:00
Iurii Popov caffa6a22e Bug fix/fix late materialization used after sort (#10447)
* Fixed applying late materialization with calc node between sort an limit

* fixed typo

* move micro optimization

* Fixed subqueries error
2019-11-15 17:06:50 +03:00
Andrey Abramov c6fc77858f
Revert "Fixed applying late materialization with calc node between sort an limit (#10439)" (#10446)
This reverts commit e765137c3e.
2019-11-15 12:56:05 +03:00
Dronplane e765137c3e Fixed applying late materialization with calc node between sort an limit (#10439)
* Fixed applying late materialization with calc node between sort an limit

* fixed typo

* move micro optimization
2019-11-15 12:48:55 +03:00
Jan 1476ddbd0d
Bug fix/fix cluster upgrade (#10411) 2019-11-15 10:42:04 +01:00
Jan c48747f631
more cppcheck (#10435) 2019-11-14 17:01:27 +01:00
Dronplane a4f2653f4e Feature/internal issue #509 (#10407)
* Added Hint for index creation

* Added tests for proper hint passing

* Added tests

* Added failed link deletion test

* Fixed mmfiles not deleting  failed index

* Fixed cluster run

* Added sync
2019-11-14 18:56:18 +03:00
Andrey Abramov edc8555f17
ArangoSearch index stats (#10421)
* expose ArangoSearch index stats via index figures API

* fix tests

* add tests

* address jslint failures
2019-11-14 18:55:43 +03:00
Jan 5ef3a215ce
added missing option `--server.statistics-history`, which was present in (#10438) 2019-11-14 16:10:44 +01:00
jsteemann 373a7ca0e0 fix description of NetworkFeature options 2019-11-14 13:53:23 +01:00
Jan 2c4f7bb983 Bug fix/dont use indexes in progress (#10432)
* don't return any in-progress indexes

* fix handling of in-progress indexes

* add test

* address review comments
2019-11-14 14:06:42 +03:00
Jan 50be0caabf
fix issues found by cppcheck (#10434) 2019-11-14 12:04:24 +01:00
Simon d4233599f1 Remove IndexHandle (#10424) 2019-11-14 11:34:57 +01:00
Jan e3117c293b fix invalid assertion (#10429) 2019-11-14 12:45:30 +03:00
Jan fd87abc522
allow using `RANDOM_TOKEN` AQL function with an argument value of `0`. (#10414) 2019-11-13 22:20:00 +01:00
Jan 237a3fcf07
centralize cloning functionality for AstNodes (#10430) 2019-11-13 22:18:38 +01:00
Dan Larkin-York 330c4a63b4 Don't modify a finalized node. (#10419) 2019-11-13 22:16:09 +01:00
Andrey Abramov ff93f45892
Bug fix/internal issue #651 (#10415)
* Bug fix 3.5/internal issue #651 (#10388)

* extract recursive part of IResearchLinkMeta

* avoid saving analyzer definition during link meta initialization

* add tests to check cluster deadlock

* cleanup

* code cleanup

* add moar tests

* mooooaaar checks

* make jslint happy

* backport fix for cluster startup from 3.5.2 branch

* backport changes from 3.5.2

* fix tests

* fix tests

* moar fixes

* refactor analyzer definitions tracking

* add some tests

* extend dump tests

* add tests for replication

* fix tests

* more fixes

* address jslint errors

* address review comments

* address test failures

* reflect changes in changelog

# Conflicts:
#	arangod/IResearch/IResearchAnalyzerFeature.cpp
#	arangod/IResearch/IResearchFilterFactory.cpp
#	arangod/IResearch/IResearchLink.cpp
#	arangod/IResearch/IResearchLinkMeta.cpp
#	tests/IResearch/IResearchAnalyzerFeature-test.cpp
#	tests/IResearch/IResearchDocument-test.cpp
#	tests/IResearch/IResearchFilterBoolean-test.cpp
#	tests/IResearch/IResearchFilterCompare-test.cpp
#	tests/IResearch/IResearchFilterFunction-test.cpp
#	tests/IResearch/IResearchFilterIn-test.cpp
#	tests/IResearch/IResearchLinkHelper-test.cpp
#	tests/IResearch/IResearchLinkMeta-test.cpp
#	tests/IResearch/IResearchView-test.cpp
#	tests/V8Server/v8-analyzers-test.cpp

* fix tests

* fix tests

* Fix tests

* fix replication tests
2019-11-13 19:50:17 +03:00
Jan 848b62a219
show index type in not implemented exception (#10426) 2019-11-13 16:46:33 +01:00
Simon 5f7803e705 Parallel SortingGatherExecutor (#10410) 2019-11-13 10:39:47 +01:00
Max Neunhöffer b318ca8084
ARANGODB_UPGRADE_DURING_RESTORE env variable. (#10385)
* ARANGODB_UPGRADE_DURING_RESTORE env variable.

If this is set during startup, a database upgrade is performed
and an automatic restart (with the same process ID) is happening.

* Windows compatibility.

* Deactivate code for Windows. Back to unsetenv.
2019-11-13 10:00:48 +01:00
Jan Christoph Uhde 2faa44dac4 add optional exclusive writes to rocksdb engine (#10364) 2019-11-12 19:09:13 +01:00
Jan d400830814
Feature/parallel aql phase one 2 (#10408) 2019-11-12 15:47:31 +01:00
Simon 0c00feb25b Improve syncer error message (#10403) 2019-11-12 15:30:19 +01:00
Jan Christoph Uhde 7b221e94aa kill AQL query after timeout (#10363) 2019-11-12 14:34:52 +01:00
Jan Christoph Uhde 2365ea419a potential fix for DEVSUP-492 (#10379) 2019-11-12 10:57:00 +01:00
jsteemann b92cbee18c fix error message 2019-11-12 10:46:01 +01:00
Jan 79e145546b
Something about `--agency.supervision-grace-period` (#10395) 2019-11-12 10:43:25 +01:00
Jan 9117a2b14f
fix use-after-free for HTTP 100 Continue case (#10397) 2019-11-11 17:08:13 +01:00
Markus Pfeiffer 3f51d24266 Bug fix for K_SHORTEST_PATHS (#10389)
* Add a test that reproduces k Shortest Paths bug

* Fix a bug in KShortestPathFinder

The finder was too eager to return a "shortest" path when there was actually
potentially a shorter path still to be discovered

* A little bit of cleanup

* Add missing include

* Address review comment

* Add another missed include
2019-11-11 17:37:58 +03:00
jsteemann 037908c4af fixi fix 2019-11-11 09:47:19 +01:00
jsteemann dae935de6e blind commit to fix compile warning 2019-11-11 09:37:00 +01:00
Jan 98880f3937
clean up a bit (#10391) 2019-11-11 09:28:18 +01:00
Jan 6c814223f5
small fixes (#10380) 2019-11-11 09:28:05 +01:00
Jan Christoph Uhde 484e2971d6 C++17 clean up (#10287) 2019-11-11 08:49:54 +01:00
Jan 90a4db9440
do not materialize huge ranges (#10376) 2019-11-08 19:54:02 +01:00
Simon 1dc8a71527 Add sanity check (#10346) 2019-11-08 16:10:59 +01:00
Jan 62e39e80b3
yet another micro-optimization (#10383) 2019-11-08 16:09:52 +01:00
Max Neunhöffer 04cf6b2c41
Repair traffic accounting in statistics. (#10387)
* First stab at porting superuser traffic accounting to devel.
* Remove token forwarding again.
* Fix descriptions of metrics.
* Repair statistics.
* Fix a crash.
* Fix forwarding and permissions.
2019-11-08 15:45:29 +01:00
Iurii Popov 26309c5c96 Feature/issue #642 (#10352)
* Index late materialization draft

* Index late materialization. Refactoring.

* Index late materialization. Expansion draft.

* HashIndexMock

* Refactoring.

* Hash index mock expansion fixes

* Fix compare of attributes.

* Hash index mock. Last expansion support.

* Hash index mock. Take value for array from document, not equal key.

* Optimizations.

* Query tests

* lateMaterialized improvements

* velocypack fixes and tests for index node

* Fix after merge.

* Const expression in a condition test

* Clone tests

* More tests

* Fix for materialized view (nullptr var)

* Fixed index vars registers count planning

* javascript tests

* Fixed cluster tests

* Cluster support

* MaterializeExecutor and MaterializerExecutorInfos refactoring

* More tests

* js tests rocksdb only

* js test. Removed print()

* js testd added skiplist

* C++ unit tests for invalid json

* js test var i

* js tests == -> ===

* iFix js tests ===

* jslint ;

* int unsigned int fix

* double deletion fix

* refactoring

* Added const for collection source

* override final, added materialize namespace, fixed femove in hash index mock

* Removed expansion support. Index can contain null value in case of several object with same fields

* isNumber<>

* Optimization for single collection case

* Renaming

* refactoring

* Unit tests. Added checking documents

* !sliceIt.valid() instead of !(!=)

* Fix primary index (object instead of array)

* Edge collection test

* Windows compilation fix

* IndexExecutor getCallback optimization

* ADB_UNLIKELY

* explainer.js

* removed unsused variable in js test

* fix explainer.js

* do not use several indexes with js test

* Removed several indexes implementation

* space

* fix explainer.js

* fix explainer.js

* code alignment
2019-11-07 19:16:33 +03:00
Wilfried Goesgens b6a400aec1 Bug fix/foxx vst (#10349) 2019-11-07 16:34:02 +01:00
Markus Pfeiffer 972e0b2ce0 Rewrite ModificationExecutor (#10221) 2019-11-07 14:48:26 +01:00
Simon Grätzer 359723add4
return has more 2019-11-06 18:26:02 +01:00
Simon Grätzer cebf0fbb1a
change algorithm a bit 2019-11-06 14:56:37 +01:00
Simon Grätzer ce539002e1
Merge branch 'devel' of github.com:arangodb/arangodb into feature/parallel-aql-phase-one 2019-11-06 12:09:45 +01:00
Jan 3bafcf2556
try to improve query shutdown in case DB server(s) can't be reached (#10359) 2019-11-05 20:41:51 +01:00
Max Neunhöffer b58cd6e91b
Fix immediate shutdown after a startup failure. (#10366)
* Add missing dependencies to IResearchAnalyzerFeature
* First all features beginShutdown, then stop.

   This is for the case of immediate shutdown if the startup did not work.
2019-11-05 16:52:39 +01:00
Simon Grätzer eab9e0c5ab
missing atomic 2019-11-05 16:33:39 +01:00
Simon Grätzer 48169b5af0
next try 2019-11-05 16:26:59 +01:00
Simon Grätzer 36cc2dc6c6
fix shared query state 2019-11-05 15:56:24 +01:00
Simon Grätzer 39f7a34c4a
remove logging 2019-11-05 14:06:02 +01:00
Simon Grätzer 867233b293
remove debug logs 2019-11-05 13:39:36 +01:00
Simon Grätzer c8c17b0e84
fix a bug SharedQueryState 2019-11-05 11:57:11 +01:00
Simon Grätzer d27249634b
some small changes 2019-11-05 00:34:15 +01:00
Jan 1a9ebff60a
always create `_analyzers` collection if missing (#10357) 2019-11-04 22:59:46 +01:00
Jan 6fa2f2abc1
added an assert (#10358) 2019-11-04 22:52:45 +01:00
Lars Maier a7ec369d0b Fix thrown exception when doing auto upgrade. (#10345) 2019-11-04 15:56:10 +01:00
Simon Grätzer a678ee124c
add latch 2019-11-04 15:47:56 +01:00
Jan 7c5c1dd6cc
@neunhoef (#10335) 2019-11-04 11:31:09 +01:00
Simon Grätzer ad7be71095
fix the shit 2019-11-01 15:22:22 +01:00
Simon Grätzer 8b946fc804
forgot to reset in flight flag 2019-10-31 15:45:44 +01:00
Simon Grätzer b0a2e207c1
Merge branch 'devel' of github.com:arangodb/arangodb into feature/parallel-aql-phase-one 2019-10-31 14:40:28 +01:00
Lars Maier a2d6f78330 Devel port of backup fixes 2. (#10246) 2019-10-30 18:18:36 +01:00
Simon 4ed945a04b Improve Connection pool robustness (#10268) 2019-10-30 17:30:50 +01:00
Tobias Gödderz 6a3f50fb88 Enable AQL subquery optimization (only on getSome) (#10267)
Activate the Subquery Optimization rule in getSome only cases
2019-10-30 17:10:01 +01:00
Jan f949b175b2
vale, vamos a ver! (#10337) 2019-10-30 16:04:55 +01:00
Jan Christoph Uhde 6282e16616 smart join views (#10309) 2019-10-30 14:17:58 +01:00
jsteemann 9f9b35d685 added assertions 2019-10-30 13:51:26 +01:00
jsteemann 791c926327 make "parallelize-gather" an optimizer rule, so it can be turned off 2019-10-30 11:54:28 +01:00
jsteemann d48fff70f2 fix some tests, and remove legacy API response 2019-10-29 20:36:06 +01:00
jsteemann 125dcfffa9 Merge branch 'devel' of github.com:arangodb/arangodb into feature/parallel-aql-phase-one 2019-10-29 13:10:12 +01:00
Simon Grätzer 5e0321900e
Merge branch 'feature/parallel-aql-phase-one' of github.com:arangodb/arangodb into feature/parallel-aql-phase-one 2019-10-29 11:47:13 +01:00
Simon Grätzer aef6b87521
Merge branch 'devel' of github.com:arangodb/arangodb into feature/parallel-aql-phase-one 2019-10-29 11:46:52 +01:00
jsteemann d1b4cfc9ef Merge branch 'devel' of github.com:arangodb/arangodb into devel 2019-10-29 10:44:41 +01:00
jsteemann 203333bfe4 more debug infos 2019-10-29 10:43:48 +01:00
Andrey Abramov 7541b4d5e6
Bug fix/internal issue #647 (#10292)
* extend replication tests

* ensure proper replication order

* fix tests

* address review comments

* address test failures

* extend dump tests

* fix analyzers tests

* more fixes

* extend tests

* enhance tests

* adjust tests

* use enum instead of flags (part 1)

* cleanup

* use enum instead of flags (part 2)

* get rid of flags for views

* get rid of flags for collections

* completely get rid of collection flags

* fix replication test

* refactor index flags

* fix tests and move AnalyzerPool out of class scope

* fix tests

* adjust log levels

* add tests

* remove debug logging

* remove noexcept from `equalAanalyzer`

* extend cluster tests

* fix cluster tests

* add tests for views and smart graphs

* address jslint errors
2019-10-29 12:09:04 +03:00
Jan 513151c010
try to make coordinator more resilient when database/collection does not (#10328) 2019-10-28 15:44:13 +01:00
Jan 0e97f322e5
activate early pruning (#10308) 2019-10-28 14:22:33 +01:00
Jan ae818e07d5
Feature/add cluster force one shard option (#10300) 2019-10-28 13:23:33 +01:00
Jan 669bd406e2
micro optimizations (#10316) 2019-10-25 18:40:55 +02:00
Jan df02bcd505
test attempt to increase max collection name length from 64 chars to 256 (#9890) 2019-10-25 18:00:10 +02:00
Lars Maier b53ba3b907 Feature/force backup (#10265)
* abort write transactions
* Code layout for force backup.
* improve killing of queries
* added query killing test
* reactivate all other tests again
* added tests for killing queries
* Lock dbserver async when forced.
* make it even more killable
* added query status "killed"
* Fixed logids.
2019-10-25 16:39:55 +02:00
Jan 359ee03dd8
upgrade vpack library (#10314) 2019-10-25 11:04:16 +02:00
Jan 46e98d7110
avoid string copies in several cases (#10317) 2019-10-25 10:47:04 +02:00
Jan b124113190
abort write transactions (#10248) 2019-10-23 15:49:47 +02:00
jsteemann d6d8f321e7 move static variable from function into TU scope 2019-10-22 16:04:55 +02:00
Michael Hackstein bf2423d024
Feature/explain spliced subqueries (#10298)
* Implemented explain output for Subquery start and End nodes. Unfortunately i had to inject a temporary output variable for the Subquery start.
2019-10-22 15:38:33 +02:00
Simon Grätzer 02760bff67
ffffff 2019-10-22 12:48:18 +02:00
Simon Grätzer 5ce1b8bcc1
ffffff 2019-10-22 12:47:44 +02:00