1
0
Fork 0
Commit Graph

17771 Commits

Author SHA1 Message Date
Iurii Popov 77f08b2ec7 decapitalize json in late materialization (#10610) 2019-12-03 13:35:32 +03:00
Kaveh Vahedipour 211812c6f5 Metrics tests (#10578)
* adding tests

* consolidate

* tests working again

* KAVEH!

* more tests

* jsteemann rev pt 1

* minor rewrite

* remove static pointer in metrics feature

* feature api && tests

* fixed tests

* reflective dep

* invalidated iterators on obi watch

* fix test

* back in

* fix counter fetch

* obi1

* added _admin/metrics documentation

* try_emplace and docu touch up
2019-12-02 16:55:29 +01:00
Heiko a472758986 Bug fix/fix internal issue 4451 (#10540)
* Fix dump_authentication suite

* user the correct attribute name

* properly reload user permissions after _users collection restore

* fixed foxx restore test

* changelog

* changed the order of index creation during restore for _users collection

* changed interface of forwarding target in general server rest handler

* added remove header function to general request class

* implemented forwardingRequest interface changes

* added method to find collection in vocbase through shard id

* added co perm verification

* Revert "added method to find collection in vocbase through shard id"

This reverts commit af28442c01432224cfe4d777b6134d0f685e38ba.

* added shard to name map to cluster info

* return ResultT in forwarding

* fixed test

* fixed compile issue

* changelog

* Improved changelog formatting.

* Revert "fixed test"

This reverts commit 3f63d94ff099a94e56addcb432bd0fe733d1bcc6.

* Added authentication dump to singleserver and handle admin users.

* restore perms
2019-11-30 02:40:28 +01:00
Wilfried Goesgens eda64397b5 add quoting for better readability of the errormessage (#10579) 2019-11-29 17:25:32 +01:00
Simon 6f4ce44716 Rename minReplicationFactor to writeConcern (#10568)
* Rename minReplicationFactor to writeConcern

* fix rest handler

* fix rest handler

* fix some tests

* fix some tests

* modify changelog

* fix suggestions
2019-11-28 20:37:06 +01:00
Wilfried Goesgens 589f321ace only anounce coordinator readiness once the agency is convinced we are (#10562)
* only anounce coordinator readiness once the agency is convinced we are

* wait for DB-Servers too

* move test creating the database to the front

* move test to be run first
2019-11-28 18:56:59 +01:00
Jan 0f66d83738 use isDirect for slightly different cases (#10560)
* use isDirect for slightly different cases

* comments
2019-11-28 18:31:04 +01:00
Jan b610d99d9f Parallelize certain AQL write operations (#10503)
* added highly experimental startup option `--query.parallelize-gather-writes`

Turning this option on will enable the `parallelize-gather` AQL
optimizer rule for certain write queries. This option is `false`
by default.

The feature is highly experimental and should not be used on a
production system. The option is therefore also hidden.

* parallelize certain write operations in AQL

* remove unneeded _vocbase

* remove unneeded _vocbase

* added startup option and tests
2019-11-27 19:05:04 +01:00
Simon 2ae30242c0 Cancel connections to known failed servers (#10546)
* test

* rename shit

* rename shit

* Cancel connections to known failed servers

* do not uncomment code

* Retry on 503 responses

* Make test grey again
2019-11-27 17:34:43 +01:00
Jan Christoph Uhde 3c5acf6717 check before foxx-heal (#10512)
* check before foxx-heal

* be more graceful
2019-11-27 17:29:35 +01:00
Jan 4213654624 Allow the optimizer to use indexes (#10541)
when a collection attribute is compared to anexpansion followed by an attribute name, e.g. `doc.value IN something[*].name`.
2019-11-27 16:46:31 +01:00
Jan Christoph Uhde 1cd71a8d11 rename timeout to maxRuntime (#10552)
* rename timeout out maxRuntime

* Update CHANGELOG

Co-Authored-By: Jan <jsteemann@users.noreply.github.com>
2019-11-27 15:08:50 +01:00
Kaveh Vahedipour d11c0954e8 Missing post failure on readlock in SynchronizeShard (#7860)
* when post cannot be delivered for readlock waiting for put meningless

* devel pull

* we can rely on POST alone

* clean up

* wrong errorCode tested

* fixed nullptr

* correct timeout

* fixed nullptr

* merge devel

* log level

* maintenace default log level raised to INFO, shard synchronisation only logs start/success all WARN/ERR demoted to DEBUG

* message unification

* devel merge

* fixed query registry

* tobias remarks

* mchacki part one

* static string for rebootid

* working tests

* use the reboot tracker from clusterinfo

* use the reboot tracker from clusterinfo

* rebootid be rebootid

* fixed serverid and all working

* static strings

* callguard out of reboottracker

* call callbacks, when query is ditched

* clear priv

* change log

* my oh my

* simon attention

* merge seems fine

* typo

* fix headers
2019-11-26 17:46:26 +01:00
Lars Maier b9b9a0c613 Direct Execution RestHandler (#10510)
* Ask the handler for direct execution instead of just looking at the RequestLane.

* Update arangod/RestHandler/RestDocumentHandler.cpp

* Do not access handler avter it was moved into lambda.

* Lambda should be mutable otherwise members are const and moving has no effect.

* Added more handlers to allowDirectExecution.

* Only allow direct execution for RestClusterHandler if asking for endpoints.
2019-11-26 17:06:21 +01:00
Jan a50f07e928 obsolete option `--vst.maxsize` requires a value if specified (#10547) 2019-11-26 13:23:20 +01:00
Michael Hackstein 18408c882e Bug fix/gharial return name (#10537)
* Added more return format tests for _api/gharial

* Now return name in api/gharial list api

* Added CHANGELOG entry

* Removed debug print
2019-11-26 10:42:18 +01:00
Simon 45cccf8537 Make some changes to Comm Tasks (#10520)
* Make some changes to VST handlers

* clear response body after sending

* less code
2019-11-25 20:01:38 +03:00
Jan Christoph Uhde b94755c61e fix segfault and try to avoid oom (#10518)
* create arena before using it

* try to avoid oom situation
2019-11-25 13:49:50 +03:00
Tobias Gödderz a8ceab9c71 Enabled modification nodes in spliced subqueries again (#10499)
* Enabled modification nodes in spliced subqueries again

* Fixed two bugs where the shadow row depth of rows wasn't copied
2019-11-22 18:30:14 +01:00
Tobias Gödderz 913e464962 Set internal state to DONE when upstream is DONE (#10513) 2019-11-22 18:29:55 +01:00
Lars Maier 68e72eab28 Put the write into the IoContext. (#10511)
* Put the write into the IoContext.
* Forgot to stage: Fix compile by using shared pointer, because std::function can not handle only-move types.
2019-11-22 17:43:29 +01:00
Wilfried Goesgens b194409654 fix the default case, if we guess that we have structured post data, actually parse it. (#10508) 2019-11-22 15:22:18 +01:00
Kaveh Vahedipour 1489afa148 metricsfeature cleanup in unprepare (#10514) 2019-11-22 15:02:36 +01:00
Michael Hackstein c201dce948
Bug fix/input row serialization (#10502)
* Unified toVelocyPack of InputRow and AqlItemBlock. We can now velocypack any range within an AqlItemBlock as a new block.

* This is the fix required here. We now end exhausted false in initialize cursor. For some reason the other side checks this hard-coded value and if it is not the expected value it does ignore the send body ¯\_(ツ)_/¯

* Added test for range-based serialization
2019-11-22 08:08:53 +01:00
Kaveh Vahedipour b94f40d890 feature/metrics (#10423)
- New internal counters and histograms.
- Prometheus compatible endpoint to expose new metrics, old statistics and RocksDB metrics.
2019-11-22 08:02:48 +01:00
Andrey Abramov 6e350d9c9f
fix compilation on mac (#10505)
* fix compilation on mac

* fix another error
2019-11-22 09:36:42 +03:00
jsteemann e5d6b837b9 fix whitespace issues 2019-11-21 17:34:35 +01:00
Andrey Abramov da1b549fe9
Feature/arangosearch 3.6 (#10490)
* backport features from iresearch upstream

* some fixes after upgrade

* fix compilation

* backport the recent changes

* small adjustment

* add missing files

* update iresearch from upstream

* added js tests for new analyzers

* update changelog

* make jslint happy

* update changelog

* fix tests
2019-11-21 19:14:15 +03:00
Jan 75b87689fa
remove cctype (#10501) 2019-11-21 15:59:59 +01:00
Jan Christoph Uhde 5321bf5c1a dump/restore db properties (#10482) 2019-11-21 15:03:25 +01:00
Tobias Gödderz 168103af88 Splicing gather cleanup (#10479)
Some cleanup and deprecation information
2019-11-21 13:00:31 +01:00
Markus Pfeiffer e11e81e0b7 Fix potential segfault (#9308)
* Check whether name is empty in getCollectionId{Local,Cluster} before access
2019-11-21 12:33:05 +01:00
jsteemann 573a1b5362 don't smile away exception 2019-11-21 11:47:35 +01:00
Lars Maier 51af263960 Added precondition to ensure that server is still as seen before. (#10468) 2019-11-21 09:21:36 +01:00
Michael Hackstein 3090e49258
Actually use the given format to execute a query (#10484)
* Actually use the given format to execute a query

* Send the serialization format of AQL from Coordinators.
2019-11-21 09:10:32 +01:00
Markus Pfeiffer 688a680023 Fix SubqueryStartExecutor (#10488)
fetchRow must not be called with `atMost == 0`, which can happen if
output.numRowsLeft() == 1.
2019-11-21 09:04:33 +01:00
Jan d3b00d60cc
fix truncate operation in synchronous replication (#10492) 2019-11-21 08:51:07 +01:00
Iurii Popov 9f4926bfec Feature/issue #653 (#10427)
* late document materialization for view draft

* MaterializeType

* asserts and removed std::function

* std::map -> std::array

* Common search ast nodes code to a separate file

* Unit tests for create and clone a node

* js tests

* tmp unfinished

* Replace variables for late materialization

* Move removing

* Removed wrong clears

* Fixed variable replacement

* removed old tests (for separate materialization)

* check if late materialization arangosearch rule is enabled

* js test. added space

* moved a function to anonym namespace

* Subquery assert

* Review improvements

* Review improvements 2

* View node state to a separate var (microoptimization)

* Fixed index assert

* alignment

* C++ unit tests
2019-11-20 22:11:54 +03:00
Jan Christoph Uhde 62457a2c6b no context fix (#10467) 2019-11-20 20:01:11 +01:00
Max Neunhöffer c2346c15ad
Fix argument handling in hotbackup if body is empty. (#10489) 2019-11-20 17:28:22 +01:00
Tobias Gödderz 618ffec7cb Catch exceptions in noexcept methods (#10483) 2019-11-20 17:05:05 +01:00
Markus Pfeiffer 8e13486687 Fix bug in SubqueryEndExecutor (#10485)
* Fix bug in SubqueryEndExecutor

If a subquery was spliced, and did not get any input rows, the SubqueryEnd
executor still expected a relevant ShadowRow to be handed through, and ran into
an assertion (or otherwise crashed the server) if it didn't get one.

* Add regression test for SubqueryEndExecutor fix
2019-11-20 17:03:28 +01:00
Jan Christoph Uhde 937334d49b remove rest route db properties (#10462) 2019-11-20 16:01:50 +01:00
Jan 932f8b5874
undistribute a few more queries (#10459) 2019-11-20 08:21:44 +01:00
Andrey Abramov 0b5fc7fba7
allow in-place analyzer creation via link definition (#10466)
* allow in-place analyzer creation via link definition

* add special handling for _analyzers collection

* modify initial syncer

* address review commments

* fix accidentally broken test
2019-11-19 20:55:45 +03:00
Lars Maier f5730aa0a5 Fixing vst comm task again. (#10474) 2019-11-19 17:21:45 +01:00
Jan f8e6ada19d
make replication timeouts configurable via startup options (#10476)
* make replication timeouts configurable via startup options

The following options are available (for active failover
and master-slave replication):

    --replication.connect-timeout
    --replication.request-timeout

Values can be specified in seconds. If these options are used, they will
be used for replication requests, overriding any hard-coded defaults or
explicitly configured timeouts.
2019-11-19 16:57:48 +01:00
Tobias Gödderz cac2a279b0 Hopefully satisfy MSVC (#10469) 2019-11-19 16:25:19 +03:00
Max Neunhöffer 315a7ba5f8
Minor fixes for hotbackup before 3.6 release. (#10458)
* TRI_Basename finally with std::string const& parameter overload. I hate .c_str()
* Fix statistics bug.
* Lose saveCurrent in client tool.
* Sort out options of arangobackup.
2019-11-19 12:51:09 +01:00
Wilfried Goesgens b0db98c702 fix windows debug build (#10465) 2019-11-19 11:11:28 +01:00