1
0
Fork 0
Commit Graph

1159 Commits

Author SHA1 Message Date
Iurii Popov 77f08b2ec7 decapitalize json in late materialization (#10610) 2019-12-03 13:35:32 +03:00
Jan Christoph Uhde 56d4610dca de gray - test-shell-foxx-paths (#10555)
* re-enable test

* install only once
2019-12-03 00:33:39 +03:00
Kaveh Vahedipour 211812c6f5 Metrics tests (#10578)
* adding tests

* consolidate

* tests working again

* KAVEH!

* more tests

* jsteemann rev pt 1

* minor rewrite

* remove static pointer in metrics feature

* feature api && tests

* fixed tests

* reflective dep

* invalidated iterators on obi watch

* fix test

* back in

* fix counter fetch

* obi1

* added _admin/metrics documentation

* try_emplace and docu touch up
2019-12-02 16:55:29 +01:00
Heiko a472758986 Bug fix/fix internal issue 4451 (#10540)
* Fix dump_authentication suite

* user the correct attribute name

* properly reload user permissions after _users collection restore

* fixed foxx restore test

* changelog

* changed the order of index creation during restore for _users collection

* changed interface of forwarding target in general server rest handler

* added remove header function to general request class

* implemented forwardingRequest interface changes

* added method to find collection in vocbase through shard id

* added co perm verification

* Revert "added method to find collection in vocbase through shard id"

This reverts commit af28442c01432224cfe4d777b6134d0f685e38ba.

* added shard to name map to cluster info

* return ResultT in forwarding

* fixed test

* fixed compile issue

* changelog

* Improved changelog formatting.

* Revert "fixed test"

This reverts commit 3f63d94ff099a94e56addcb432bd0fe733d1bcc6.

* Added authentication dump to singleserver and handle admin users.

* restore perms
2019-11-30 02:40:28 +01:00
Wilfried Goesgens 2bf269a842 Bug fix/increase test timeout (#10596)
* add quoting for better readability of the errormessage

* increase sleep for stability
2019-11-29 18:46:33 +01:00
Wilfried Goesgens d30e873945 cleanup after test (#10588)
* cleanup after test

* Update upgrade-data-views-msv3.2.1.js
2019-11-29 14:15:49 +01:00
Simon 6f4ce44716 Rename minReplicationFactor to writeConcern (#10568)
* Rename minReplicationFactor to writeConcern

* fix rest handler

* fix rest handler

* fix some tests

* fix some tests

* modify changelog

* fix suggestions
2019-11-28 20:37:06 +01:00
Dan Larkin-York 99d2b1cc93 Fix and un-grey any iterator tests. (#10548)
* Fix and un-grey any iterator tests.

* Remove debugging output.

* Make test more deterministic.

* Address review comments.

* use bulk
2019-11-28 19:01:17 +01:00
Wilfried Goesgens 589f321ace only anounce coordinator readiness once the agency is convinced we are (#10562)
* only anounce coordinator readiness once the agency is convinced we are

* wait for DB-Servers too

* move test creating the database to the front

* move test to be run first
2019-11-28 18:56:59 +01:00
Jan 0f8897f9c6 fix the fix (#10574) 2019-11-28 18:45:23 +01:00
Heiko 9772f35083 Feature/react webpack testing (#10302)
* init commit

* cleanup of not needed css

* todo

* jquery ui 192 cusotm not needed anymore

* leaflet

* test files, remove after complete trasnfer to webpack

* more changes, see react/TODO.md for details

* webpack dev config

* added content of build direcotry, please remmeber TODO.md - this needs a total refactor

* html react

* added needed images, also refactor is here needed

* aardvark question

* temp commented out shard distribution, changed app

* gitignore aardvark + react

* src ace - why? donw know

* renamed ejs files to html

* rm not needed files

* new pure versions

* fix aardvark for react

* more fixes, still sigma js wheel nav svg icons not wokring

* grunt cleanup, more removals to come

* new manifest

* fix ace

* rm not needed files

* working version with first react native component

* Added missing typescript types

* Formatting

* rm unused views

* better check of variable

* pre-compiled ejs templates, fixing tippy tooltips, fixing sigma js

* not needed ,

* hg ignore

* tippy js module

* precompile, do not longer require file per file

* added build env file

* added devel env file

* load env files for devel and build environemnts

* load config js properly

* executable again, needs future fix

* load host via env file

* arnagojs host detection regarding dev or build mode

* task repeater rise to 10s interval instead of 1s

* rm old app js version

* rm old extra css

* rm old templates

* rm libs js

* more cleanup, remove old index html

* rm old style css

* rm old style minified css

* adjust new `make frontend` command to new react build structure

* rm not needed css

* todo

* hljs instead of jquery.snippet.min.js

* updated todo

* updated noty version. changed internal apis to fit new noty version

* rm old node package json, rm old grunt file, those will not be used anymore

* updated todo

* rm not needed files

* updated todo

* updated todo

* do not use crazy global vars

* updated todo

* updated todo

* rm compress img folder, moved compressed to img, adjusted manifest

* add replc scss

* remove old build folder

* not needed anymore

* adjusted gitignore file

* adjusted release.sh script

* adjusted release.sh script

* adjusted readme maintainers

* updated todo

* png instead of svg, cleanup not needed files, proper version login img

* up
dated todo

* updated todo

* remove console log

* cluster task only in cluster

* adjusted readme maintainers

* updated todo

* remove the cool web ui name 😢

* clean up, finalization

* added missing assets

* added package lock

* added build - needs to discussion if we want to check that in or not

* use old shard view for now until react view is finalized

* react build

* updated maintainers

* Update js/apps/system/_admin/aardvark/APP/manifest.json

Co-Authored-By: Michael Hackstein <michael@arangodb.com>

* changed manifest

* rm todo file

* updated react manifest

* rm react logo

* reverted port changes

* Fixed img folder

* Merged with devel, solved hidden merge conflicts. Also added react/build to git ignore.

* updated uploadfile library

* require sort order

* cleanup, correct name + version

* rm hgignore file

* re-added commented out noty functions

* removed duplicate

* removed duplicate

* noty

* added automatic proxy setup

* readme maintainers

* jslint

* manifest

* more requires then imports

* do not use index.html, but instead use an arangodb logo to check for non json output

* updated webpack-dev-server

* updated jest

* fixed removal of logger view

* updated babel jest

* Fix .env.build path

* Update .gitignore to include build

* Add compiled UI

* Fix UI for packages

* Fix cmake

* Update CHANGELOG
2019-11-28 18:26:04 +01:00
Jan Christoph Uhde d9cb0cd6e3 Bug fix/test shell skiplist rm performance (#10557)
* de-graylist shell-skiplist-rm-performance-timecritical-noncluster

* increase delta

* delete test
2019-11-28 14:55:41 +01:00
Jan b610d99d9f Parallelize certain AQL write operations (#10503)
* added highly experimental startup option `--query.parallelize-gather-writes`

Turning this option on will enable the `parallelize-gather` AQL
optimizer rule for certain write queries. This option is `false`
by default.

The feature is highly experimental and should not be used on a
production system. The option is therefore also hidden.

* parallelize certain write operations in AQL

* remove unneeded _vocbase

* remove unneeded _vocbase

* added startup option and tests
2019-11-27 19:05:04 +01:00
Simon 2ae30242c0 Cancel connections to known failed servers (#10546)
* test

* rename shit

* rename shit

* Cancel connections to known failed servers

* do not uncomment code

* Retry on 503 responses

* Make test grey again
2019-11-27 17:34:43 +01:00
Jan 119aa7bfd8 attempt to make shell-query-spec test deterministic (#10551)
* attempt to make shell-query-spec test deterministic

* remove the old test
2019-11-27 17:30:01 +01:00
Jan Christoph Uhde 3c5acf6717 check before foxx-heal (#10512)
* check before foxx-heal

* be more graceful
2019-11-27 17:29:35 +01:00
Jan b0cafb39ae ungreylist the test (#10553) 2019-11-27 16:47:47 +01:00
Jan 4213654624 Allow the optimizer to use indexes (#10541)
when a collection attribute is compared to anexpansion followed by an attribute name, e.g. `doc.value IN something[*].name`.
2019-11-27 16:46:31 +01:00
Wilfried Goesgens 2192b49d4f on exception print which query set fails (#10536)
* on exception print which query set fails

* no need to print this - it does by itself
2019-11-27 16:31:58 +01:00
Jan Christoph Uhde 1cd71a8d11 rename timeout to maxRuntime (#10552)
* rename timeout out maxRuntime

* Update CHANGELOG

Co-Authored-By: Jan <jsteemann@users.noreply.github.com>
2019-11-27 15:08:50 +01:00
Kaveh Vahedipour d11c0954e8 Missing post failure on readlock in SynchronizeShard (#7860)
* when post cannot be delivered for readlock waiting for put meningless

* devel pull

* we can rely on POST alone

* clean up

* wrong errorCode tested

* fixed nullptr

* correct timeout

* fixed nullptr

* merge devel

* log level

* maintenace default log level raised to INFO, shard synchronisation only logs start/success all WARN/ERR demoted to DEBUG

* message unification

* devel merge

* fixed query registry

* tobias remarks

* mchacki part one

* static string for rebootid

* working tests

* use the reboot tracker from clusterinfo

* use the reboot tracker from clusterinfo

* rebootid be rebootid

* fixed serverid and all working

* static strings

* callguard out of reboottracker

* call callbacks, when query is ditched

* clear priv

* change log

* my oh my

* simon attention

* merge seems fine

* typo

* fix headers
2019-11-26 17:46:26 +01:00
Michael Hackstein 18408c882e Bug fix/gharial return name (#10537)
* Added more return format tests for _api/gharial

* Now return name in api/gharial list api

* Added CHANGELOG entry

* Removed debug print
2019-11-26 10:42:18 +01:00
Wilfried Goesgens b194409654 fix the default case, if we guess that we have structured post data, actually parse it. (#10508) 2019-11-22 15:22:18 +01:00
Michael Hackstein c201dce948
Bug fix/input row serialization (#10502)
* Unified toVelocyPack of InputRow and AqlItemBlock. We can now velocypack any range within an AqlItemBlock as a new block.

* This is the fix required here. We now end exhausted false in initialize cursor. For some reason the other side checks this hard-coded value and if it is not the expected value it does ignore the send body ¯\_(ツ)_/¯

* Added test for range-based serialization
2019-11-22 08:08:53 +01:00
Andrey Abramov da1b549fe9
Feature/arangosearch 3.6 (#10490)
* backport features from iresearch upstream

* some fixes after upgrade

* fix compilation

* backport the recent changes

* small adjustment

* add missing files

* update iresearch from upstream

* added js tests for new analyzers

* update changelog

* make jslint happy

* update changelog

* fix tests
2019-11-21 19:14:15 +03:00
Jan Christoph Uhde 5321bf5c1a dump/restore db properties (#10482) 2019-11-21 15:03:25 +01:00
Tobias Gödderz 168103af88 Splicing gather cleanup (#10479)
Some cleanup and deprecation information
2019-11-21 13:00:31 +01:00
Jan f42dd86b25
add tests for inventory (#10464) 2019-11-21 08:56:27 +01:00
Iurii Popov 9f4926bfec Feature/issue #653 (#10427)
* late document materialization for view draft

* MaterializeType

* asserts and removed std::function

* std::map -> std::array

* Common search ast nodes code to a separate file

* Unit tests for create and clone a node

* js tests

* tmp unfinished

* Replace variables for late materialization

* Move removing

* Removed wrong clears

* Fixed variable replacement

* removed old tests (for separate materialization)

* check if late materialization arangosearch rule is enabled

* js test. added space

* moved a function to anonym namespace

* Subquery assert

* Review improvements

* Review improvements 2

* View node state to a separate var (microoptimization)

* Fixed index assert

* alignment

* C++ unit tests
2019-11-20 22:11:54 +03:00
Markus Pfeiffer 8e13486687 Fix bug in SubqueryEndExecutor (#10485)
* Fix bug in SubqueryEndExecutor

If a subquery was spliced, and did not get any input rows, the SubqueryEnd
executor still expected a relevant ShadowRow to be handed through, and ran into
an assertion (or otherwise crashed the server) if it didn't get one.

* Add regression test for SubqueryEndExecutor fix
2019-11-20 17:03:28 +01:00
Jan 31e75df80f
use batched methods (#10461) 2019-11-20 14:02:13 +01:00
Jan 932f8b5874
undistribute a few more queries (#10459) 2019-11-20 08:21:44 +01:00
Dronplane af1a10f913 Made test tolerant to leftover links from previous test-runs (#10480)
* Made test tolerant to leftover links from previous test-runs

* Added semicolon
2019-11-19 21:52:39 +03:00
Andrey Abramov 0b5fc7fba7
allow in-place analyzer creation via link definition (#10466)
* allow in-place analyzer creation via link definition

* add special handling for _analyzers collection

* modify initial syncer

* address review commments

* fix accidentally broken test
2019-11-19 20:55:45 +03:00
Jan f8e6ada19d
make replication timeouts configurable via startup options (#10476)
* make replication timeouts configurable via startup options

The following options are available (for active failover
and master-slave replication):

    --replication.connect-timeout
    --replication.request-timeout

Values can be specified in seconds. If these options are used, they will
be used for replication requests, overriding any hard-coded defaults or
explicitly configured timeouts.
2019-11-19 16:57:48 +01:00
Tobias Gödderz 7a57a72620 Feature/aql subquery splicing with gather (#10341)
Allow Splicing with GATHER nodes
2019-11-18 19:05:44 +01:00
Jan c142e8bc21
fixed issue #10440: Incorrect sorting with sort criteria partially covered by index (#10442) 2019-11-18 15:43:34 +01:00
Dronplane 31a580da7b Feature/internal issue #654 (#10456)
* Implemented PHRASE

* Added more tests

* Implemented array recursion

* Fixed tests

* Fixed tests

* Minor comments added
2019-11-18 13:53:05 +03:00
Lars Maier ebf3296e9c Backup with view (#10386)
* Commit and store view related data on create backup.
* Fixes to upgrade on env-var.
* Fixed CMakeLists.txt.
* Changes to allow restore from 3.5 to 3.6.
* Remove unnecessary code introduced in merge.
* CHANGELOG:
2019-11-15 17:50:04 +01:00
Iurii Popov caffa6a22e Bug fix/fix late materialization used after sort (#10447)
* Fixed applying late materialization with calc node between sort an limit

* fixed typo

* move micro optimization

* Fixed subqueries error
2019-11-15 17:06:50 +03:00
Andrey Abramov c6fc77858f
Revert "Fixed applying late materialization with calc node between sort an limit (#10439)" (#10446)
This reverts commit e765137c3e.
2019-11-15 12:56:05 +03:00
Dronplane e765137c3e Fixed applying late materialization with calc node between sort an limit (#10439)
* Fixed applying late materialization with calc node between sort an limit

* fixed typo

* move micro optimization
2019-11-15 12:48:55 +03:00
Dronplane a4f2653f4e Feature/internal issue #509 (#10407)
* Added Hint for index creation

* Added tests for proper hint passing

* Added tests

* Added failed link deletion test

* Fixed mmfiles not deleting  failed index

* Fixed cluster run

* Added sync
2019-11-14 18:56:18 +03:00
Andrey Abramov edc8555f17
ArangoSearch index stats (#10421)
* expose ArangoSearch index stats via index figures API

* fix tests

* add tests

* address jslint failures
2019-11-14 18:55:43 +03:00
Jan 2c4f7bb983 Bug fix/dont use indexes in progress (#10432)
* don't return any in-progress indexes

* fix handling of in-progress indexes

* add test

* address review comments
2019-11-14 14:06:42 +03:00
jsteemann a8ec461b58 fix compile warning in AnalyzerFeature test 2019-11-13 23:32:59 +01:00
Jan fd87abc522
allow using `RANDOM_TOKEN` AQL function with an argument value of `0`. (#10414) 2019-11-13 22:20:00 +01:00
Andrey Abramov ff93f45892
Bug fix/internal issue #651 (#10415)
* Bug fix 3.5/internal issue #651 (#10388)

* extract recursive part of IResearchLinkMeta

* avoid saving analyzer definition during link meta initialization

* add tests to check cluster deadlock

* cleanup

* code cleanup

* add moar tests

* mooooaaar checks

* make jslint happy

* backport fix for cluster startup from 3.5.2 branch

* backport changes from 3.5.2

* fix tests

* fix tests

* moar fixes

* refactor analyzer definitions tracking

* add some tests

* extend dump tests

* add tests for replication

* fix tests

* more fixes

* address jslint errors

* address review comments

* address test failures

* reflect changes in changelog

# Conflicts:
#	arangod/IResearch/IResearchAnalyzerFeature.cpp
#	arangod/IResearch/IResearchFilterFactory.cpp
#	arangod/IResearch/IResearchLink.cpp
#	arangod/IResearch/IResearchLinkMeta.cpp
#	tests/IResearch/IResearchAnalyzerFeature-test.cpp
#	tests/IResearch/IResearchDocument-test.cpp
#	tests/IResearch/IResearchFilterBoolean-test.cpp
#	tests/IResearch/IResearchFilterCompare-test.cpp
#	tests/IResearch/IResearchFilterFunction-test.cpp
#	tests/IResearch/IResearchFilterIn-test.cpp
#	tests/IResearch/IResearchLinkHelper-test.cpp
#	tests/IResearch/IResearchLinkMeta-test.cpp
#	tests/IResearch/IResearchView-test.cpp
#	tests/V8Server/v8-analyzers-test.cpp

* fix tests

* fix tests

* Fix tests

* fix replication tests
2019-11-13 19:50:17 +03:00
Simon 5f7803e705 Parallel SortingGatherExecutor (#10410) 2019-11-13 10:39:47 +01:00
Jan Christoph Uhde 2faa44dac4 add optional exclusive writes to rocksdb engine (#10364) 2019-11-12 19:09:13 +01:00