1
0
Fork 0
Commit Graph

15169 Commits

Author SHA1 Message Date
Vasiliy b1e30937bb issue 520.1.1: decrease link commit interval to 1 second, add workaround for MMFiles not recovering document insertions via WAL (#8313) 2019-03-05 14:50:54 +03:00
Wilfried Goesgens 4ae0cd42c3 when in activefailover mode detect leader changes, and abort tests since they wouldn't deliver good values anymore (#8306) 2019-03-05 11:10:20 +01:00
Kaveh Vahedipour 68178ba165 [devel] supervision bug fix backports (#8314)
* back ports for supervision fixes from 3.4 part 1

* back ports for supervision fixes from 3.4 part 2
2019-03-04 19:27:24 +01:00
jsteemann 0d2056550c added derived files for web UI 2019-03-04 19:15:34 +01:00
Wilfried Goesgens b1a1edb205 add default values and documentation missing for this parameter (#8303) 2019-03-01 14:11:48 +01:00
Michael Hackstein 6e8d43b2da
Feature/aql traversal prune (#8255)
Allow PRUNE in the AQL Traverser.
2019-02-27 11:43:06 +01:00
Heiko b04cd607f4 fixed the graph editing modal, ordering of edge definitions was false (#8225)
* fixed the graph editing modal, ordering of edge definitions was false

* changelog
2019-02-27 09:52:55 +01:00
Heiko e6ae1e42b1 fixed some escpaing issues, removed dead code, eslint (#8222)
* fixed some escpaing issues, removed dead code, eslint

* wrong function name

* changelog

* applied requested changes
2019-02-27 09:51:14 +01:00
Simon dc24d7fa4e Sync Foxx Queues (#8250) 2019-02-25 17:13:14 +01:00
Frank Celler 2a9b1b127a
upgraded to 4.17.11 because of CVE-2018-16487 (#8238) 2019-02-25 12:20:00 +01:00
Jan d46acbb156
Bug fix/make ttl index work with datestrings too (#8208) 2019-02-22 16:09:51 +01:00
Jan 44c6a2d732
Feature/ttl index (#8169) 2019-02-19 14:12:21 +01:00
Wilfried Goesgens 492d05c1f1 Feature/upgrade v8 7.1.302.28 (#8088) 2019-02-19 11:15:34 +01:00
Luschgy b7b84beebf Feature/aql blocks by line (#6553)
* Fixed hidden merge conflict

* Added BlockFetcher, added a minimal test for SingleRowFetcher

* move RegInfo in types.h

* fix getSomeLogic

* Added the AqlItemMatrix implementation. Not yet tested!

* Fixed nr called => Waiting ratio in AllBlocksFetcherMock

* fix compiling

* add RegInfo to produceRow

* BlockFetcherHelper now returns a matrix

* pass RegInfo as requested into AqlItemRow ctor

I would still keep it out as the ItemRow should be a thin view.

* allow to change the AqlItemRows cheaper / remove _sourceRow member

* implement copyRow for AqlItemRow

* organize cleanup for outputblock used in getsome / shrink if necessary

* Added tests for SingleRowFetcher, cleanup in AqlItemRow

* start mocking

* Added test helpers, began work on a more complex test for SingleRowFetcher

* Re-added RegInfo again to AqlItemRow

* helper, added test case for FilterExecutor

* merge fixed compile

* Removed trx name where it is actually not used

* Made some functions TEST_VIRTUAL for mocking.

* implemented Sort executor

* Fixed the BlockFetcherHelper API, to always return a matrix if it is not waiting

* Implemented a SortExecutor test with data

* disable borken test

* Fixed test on SortExecutor. Green now, needs some more testing

* change a bit how the AqlItemRow is used in a test

* Added another test for the SingleRowFetcher

* Added more tests for SingleRowFetcher

* fix getRegisterInfo

* Moved RegInfo into ExecutorInfos. Also now use the FilterExecutor implementation in production code instead of FilterBlock. Starting integration testing.

* add more asserts

* Fixed undefined behaviour in TestCode.

* Do not shrink an empty output block

* switch to block pointers in AqlItemRow

* return blocks in the row fetcher

* Updated grammar.cpp

* Updated (fixed) tests to verify returnBlock

* Improved const-ness

* Changed BlockFetcher constructor in order to make it mockable

* Implemented BlockFetcherMock and rewrote some tests with it

* Updated a comment

* Updated comments

* init commit - EnumerateListExecutor, including EnumerateListExecutorInfos

* add potential fix for ItemMatrix

* Replaced fakeit with BlockFetcherMock in another GIVEN block

* Replaced the last fakeit mocks with BlockFetcherMock and removed fakeit

* Updated function definition

* included missing arary included

* Renamed AqlItemRow to InputAqlItemRow

* Split AqlItemRow into Input~ and Output~ classes

* EnumerateListExecutor + Tests

* Added tests for AqlItemRows

* Added test file for AqlItemRows...

* Made the ostream operator for AqlItemBlocks available to Logger and Catch info

* build error

* Added a second test for AqlItemRows. Need to make input space invalid now, sth. acidential referencing will show up

* Introduce a block ID in the InputAqlItemRow

* Copy output values correctly, avoid InputAqlItemRow pointers

* Added a test for registerClearout

* Fixed tests

* Added a test for adding new values

* Added a test for an incomplete row write to not count as produced.

* Fixed getSome and a test

* Added a test for larger AQL values in AqlItemRows

* Fixed compile error in hidden merge conflict

* Added tests for Filter counter in FilterExecutor

* OutputAqlItemRow now takes responsibility of the block

* Handed responsibility of blocks in ExecutionBlockImpl to OutputAqlItemRow

* EnumerateListExecutor should be close to its finish. Tests need to be fixed, not ready yet.

* better swap

* OutputAqlItemRow now takes ExecutorInfos

- added several assert
- implemented a more strict and safe produced() logic

* enum list test

* Added a more specific error message

* Removed OutputAqlItemRow.changeRow()

* fix invalid block freeing

* changed order of input/output registers

* Fixed a test

* Fixed matrix width in test

* fix failure tests

* finished enumlist tests

* Implemented AllRowsFetcher and tests for it

* Bugfix in skipSome stub

* insert sort and enumerate list executors

into exectuion nodes' create functions

* fixed singlerowfetcherhelper, added tests

* small fixes

* add missing Infos

* restore accidentally deleted scorer

* make it compile

* fix executor info creation / usage

* make use of output var in EnumarateListNode

* Added Executor::Stats and FilterStats

* Extended FilterExecutor tests with stats, added node tracing to getSome

* Fixed Sort-&EnumerateList- Executor to use the new return type with stats

* Fixed compile error in tests

* Changed *ExecutorInfo constructors and classes to contain the necessary register informations

* Made an ExecutorInfo construction more readable

* Updated comments

* Fixed checks in OutputAqlItemRow::setValue()

* Add comparison method to SortRegister. Forbid construction without one.

* Implemented ExecutionBlockImpl::initializeCursor

* more mocking inside ExecutionBlockImplTest

* Minor changes

* Avoid AqlValueGuard destroying the value copied into the output block

* Disabled failure tests that do not apply to the new Sort implementation

* further mocking of test modules

* Removed constexpr for compatibility with outdated gcc versions

* add some failure tests - getsome works differently

therefor we do not test the old behavior

* fix sort node

* clean up alq item matrix

* Removed the transaction methods from read-only access to AqlValues (get and at) and repliced by CollectionNameResolver where necessary. Still left: some calls extract VPackOptions from the Transaction. Compare needs a BuilderLeaser only.

* textexecutionhelper, execimpl test

* Eliminated FilterBlock

* Eliminated the EnumerateListBlock

* first successful running test of executorblockimpl

* Eliminated SortBlock

* fixed testexecutor helper

* Made the ExecutorInfos private to the executors again.

* Implement and use AqlItemBlockShell (#6562)

* Added AqlItemBlockShell

* Minor changes

* Mostly replaced AqlItemBlock with ~Shell.

Current state:
- arangod compiles
- OutputAqlItemRow has yet to be changed
- catch tests have yet to be fixed

* Use AqlItemBlockShell in OutputAqlItemRow

* Added registersToKeep to AqlItemBlockShell

* Removed ExecutorInfos from OutputAqlItemRow

* Split AqlItemBlockShell into Input~ and Output~

* Changed tests so they compile again - they're still not yet working.

* Fixed tests

* fixed building, modified impl test

* Removed now superfluous BlockFetcherMock functions

* more execimpl testing

* Removed block IDs

* more impl testing

* Reduced dependencies of BlockFetcher construction

* Bugfix, cleared documentation

* Removed debug-output

* Adressed minor code review remarks

* Moved method definitions into .cpp files to avoid includes

* Added assertions

* Added comments

* Addressed several more review comments

* Added missing includes

* more testing, not finalized yet

* added missing header file

* added a test for execution block impl

* removed old comment

* Improved lookup algorithm to identify correct block/row combination in AqlItemMatrix

* added test for ExecutionBlockImpl

* move utility to the right position

* Bugfix and a TODO note

* Bugfix: use a uniform ResourceMonitor in tests

* Made OutputAqlItemRow::setValue clone by default and copy on move

* Replaced the getRow lookup with a binary search

*  enumerate tests

* Disable emplacing of AqlValues in ItemBlock

* Reenabled std::enable_if will warn until oskar is using c++17 as standard.

* Add helper function to create a shared pointer of an unordered_map<RegisterId>

* CalculationExecutor (#6570)

* add CalculationExecutor skeleton

* first shot of CalculationExecutor

* fix minor bugs

* handle references

* use new shared pointers

* commit to share work

* fix failure test

* reformat with clang-format

* add test for CalculationExecutor

* fix CalcualtionExecutor test

* clean up

* Removes unused code

* clean up includes

* fix/remove comments

* add changes requrested by hacki

* ReturnExecutor (#7932)

* add skeleton to CMakeLists.txt

* build most parts of the ReturnExecutor

* This commit removes ReturnBlock and adds some debug messages

removed inheritRegisters functionality

* finish ReturnExecutor

* add test for return executor

* remove unused code

* add stats and clean up includes

* verify result in ReturnExecutorTest and move *Stats to "Aql/Stats.h"

* Fixed algorithm to find correct row in a MultiRow Input

* fix full count and failure tests (#7969)

* fix full count and failure tests

* fix filter test

* WIP: fixes

* fixed

* NoResultsExecutor (#7953)

* add NoResultsExecutor

* clean up

* some review changes

* fix test

* fix

* fix WAIT -> DONE

* remove unused code (#7995)

* create skeleton for SingletonExecutor (#7957)

* create skeleton for SingletonExecutor

* WIP: continue implementation

* WIP: add fetcher skel

* WIP: add inject function to ConstFetcher

* rename SingletonExecutor to IdExecutor

* WIP: replace singleton node

* WIP: More Debugging on IdExecutor

* WIP: IdExecutor

* WIP: add failure tests

* make iresarch test work but not pass

* WIP: add ConstFetcherHelper

* fix test

* fix tests

* fix iresearch tests

* fix wording

* add review changes

* add review change to SingleRowFetcher as well

* fix test

* fix error when increasing index

* temporarily remove fold-expression

* clean up

* Fix gcc compile error

* Feature/aql limit executor (#7982)

* limit executor

* removed not needed tri assert

* rm _invariable in limitnode

* find out if we are in a subquery

* queryDepth in limit infos

* added missing queryDepth

* finalizing limit executor

* added more tests, fixed a condition

* add assert to test

* added missing fullcount check

* typo

* minor changes, fixed test

* test

* wrong check

* fixed tests

* false merge

* remove basic blocks

* remove basic block includes

* include sort order

* removed not needed basic blocks

* removed not needed basic blocks

* fix test

* Feature/remove input output shells (#8090)

* Added template parameters to allow for block pass-through to be chosen at compile time

* Adapted the tests to match the new template parameters

* Adapted ConstFetcher and IdExecutor to match the new templated fetcher

* Implemented pass-through, fixed SingleRowFetcherTest

* Fixed implicit merge conflicts

* Fix assumptions that are violated by block pass-through

* Added 2 regression tests

* Fixed test expected data

* Fix nullptr dereference

* Fix handling of non-invalidated input variables

* Fix nullptr dereference

* Fix handling of non-invalidated input variables

* Fixed compile error

* Fixed a useless and leaking allocation

* Try a less implicit fix

* Allow IdExecutor and ConstFetcher to be used with pass-through

* Performance patches from @mchacki

* Fixed merge conflicts, and bugs in ConstFetcher

* Fixed atMost pass-through, and blocks that call their parents too often

* Removed InputAqlItemBlockShell (except from tests)

* Removed OutputAqlItemBlockShell (except for tests)

* Moved implementations of OutputAqlItemRow methods in the header

* Moved SingleRowFetcher::fetchRow to the header to allow inlining

* Reenabled returnInheritedResults optimization

* Enable passThrough for ReturnExecutor with inherited results

* Specialized CalculationExecutor to avoid unneccessary conditional jumps

* Made tests compile again (but are currently broken)

* Fixed ReturnExecutor test

* Move created InputRows out of AqlItemMatrix

* Limit- and EnumerateList Executors no longer fetch from upstream after DONE

* Added comments

* Added experimental AqlItemBlock optimizations

* Removed _numEntries, added comments

* Allow executors to pass an "atMost"-limit to the SingleRowFetcher (for LIMIT)

* Let the LimitExecutor pass atMost upstream

* Bugfix for FullCount

* Feature/aql enumeratecollection executor (#8028)

* initial commit

* enum coll executor

* buildable version of enumeratecollectionexecutor

* wrong usage of outVariable

* Added template parameters to allow for block pass-through to be chosen at compile time

* Adapted the tests to match the new template parameters

* Adapted ConstFetcher and IdExecutor to match the new templated fetcher

* more fixes, still some tests failing

* Implemented pass-through, fixed SingleRowFetcherTest

* Fixed implicit merge conflicts

* adding missing set value (remember optimize todo), optimized constructor

* removed old enumerate collection blocks

* Fix assumptions that are violated by block pass-through

* Added 2 regression tests

* Fixed test expected data

* Fix nullptr dereference

* Fix handling of non-invalidated input variables

* Fix nullptr dereference

* Fix handling of non-invalidated input variables

* Fixed compile error

* Fixed a useless and leaking allocation

* added broken uncompilable executor test

* Try a less implicit fix

* fix mocking

* enumerate collection executor test

* remove class, use only static function.

* clean up test after merging with main branch

* Allow IdExecutor and ConstFetcher to be used with pass-through

* Performance patches from @mchacki

* Fixed merge conflicts, and bugs in ConstFetcher

* Fixed atMost pass-through, and blocks that call their parents too often

* Removed InputAqlItemBlockShell (except from tests)

* Removed OutputAqlItemBlockShell (except for tests)

* Moved implementations of OutputAqlItemRow methods in the header

* Moved SingleRowFetcher::fetchRow to the header to allow inlining

* Reenabled returnInheritedResults optimization

* Enable passThrough for ReturnExecutor with inherited results

* Specialized CalculationExecutor to avoid unneccessary conditional jumps

* Made tests compile again (but are currently broken)

* Fixed ReturnExecutor test

* Limit- and EnumerateList Executors no longer fetch from upstream after DONE

* Removed an assertion which seems to be incorrect during bootstrap.

* Inlined AQL ItemMatrix and removed unused elements in other Executors

* Now inline + Move in AqlItemMatrix, seems to be overall best performing

* Bugfix: Do not returnInheritedResults on DBServers

* Fixed LIMIT test, and made it more thorough.

* Fixed createion of NoResultBlock creation in IResearch Nodes. Also relaxed an assertion

* Reactivated failure point, now identical with anotherone in OutputRow, need to unified

* Bug fix: do not mutate the offset in the LimitExecutor (#8109)

* Introduced test

* Fixed LimitExecutor to not mutate its infos, so it works correctly in subqueries

* Fixed crashes in CatchTests

* Fixed non-maintainer build

* try to fix subqueries

* Fix isInSubQuery for non-singleton nodes.

* remove useless while true

* Feature/aql blocks by line dan sort (#8143)

* Add SortNode::SorterType to SortExecutorInfoss.

* prepare imple of sort executor

* WIP: add some code for dan sort

* WIP: working at pushRows

* WIP - try to add Dan's heap-sort

* re add missing test

* 2 fixes

* fix

* Dan's tests are working

* remove unused variable

* remove SortBlock.cpp from CMakeLists.txt

* remove hack and provide an extra method to set the _baseIndex

* Simplified ContrainedSortExecutor.

* fix forgotten variable

* update doc

* Assert that we do not use functions that might return wrong results.

Preconditions or invariants the functions rely on are broken. Therefore
the functions can not be used. This is asserted in maintainer mode.

* add function to restore row invariant

* do not emplace and pop_back if not necessary

* Use clear registers in case we can move the rows.

* WIndows opst zirkus

* Actually destroy AqlItemValue

* Feature/traversal executor by line (#8000)

* Added stubs for TraversalExecutor, no implementation, not compiled in yet

* Included production code of TraversalExecutor and made it compile. Now implement

* Implemented production code for trivial tests, if no row is reaching the traverser.

* Fixed TraversalExecutor code to pull all rows from above and added tests. No traversal yet, this is next

* Intermediate blind commit might not work

* Fixed compile issue in test code

* Created a shared place for Mocks in tests and moved the StorageEngineMock there, also started a shared place for mock servers, most test will need the same server in order to work.

* Fixed travesalExecutor tests. Now able to create tests with actual input.

* Added successful test in TraversalExecutor, that Traverser as started with correct start vertices (by inputRegister)

* Further test cases

* Added stubs for TraversalExecutor, no implementation, not compiled in yet

* Included production code of TraversalExecutor and made it compile. Now implement

* Implemented production code for trivial tests, if no row is reaching the traverser.

* Fixed TraversalExecutor code to pull all rows from above and added tests. No traversal yet, this is next

* Intermediate blind commit might not work

* Fixed compile issue in test code

* Created a shared place for Mocks in tests and moved the StorageEngineMock there, also started a shared place for mock servers, most test will need the same server in order to work.

* Fixed travesalExecutor tests. Now able to create tests with actual input.

* Added successful test in TraversalExecutor, that Traverser as started with correct start vertices (by inputRegister)

* Fixed leftovers from rebase

* Refixed mocks in different folder

* Fixed Mock import

* Fixed Calculators Exector Test to use the unified mocked server.

* Implemented logic for the TraversalExecutor. Also added tests for it. Not fully complete though

* Added validation of result values

* Added usage of constant register in traversal executor

* Included filter variables in traersal executor. Added test for const input. And moved MMDR into base traverser class for simplicity

* Added ostream operators on AQLValue and AqlInputRow. Not 100% done yet but good enough

* Added a shutdownable ExecutionBlock. Some blocks need to implement a specific shutdown still. I added this class to make it easier to eliminate them when the time is due.

* Removed ostream operator for INPUT row again, does for some reason not compile on Linux0o

* Fixed initialization order

* Removed classwrapper for shutdown.

* Applied review changes

* Refixed failing tests, API is not subject to change

* Fixed CatchTest (wrong usage of string literal in test case)

* Feature/shortest path executor (#8042)

* Added stubs for TraversalExecutor, no implementation, not compiled in yet

* Included production code of TraversalExecutor and made it compile. Now implement

* Implemented production code for trivial tests, if no row is reaching the traverser.

* Fixed TraversalExecutor code to pull all rows from above and added tests. No traversal yet, this is next

* Intermediate blind commit might not work

* Fixed compile issue in test code

* Created a shared place for Mocks in tests and moved the StorageEngineMock there, also started a shared place for mock servers, most test will need the same server in order to work.

* Fixed travesalExecutor tests. Now able to create tests with actual input.

* Added successful test in TraversalExecutor, that Traverser as started with correct start vertices (by inputRegister)

* Further test cases

* Added stubs for TraversalExecutor, no implementation, not compiled in yet

* Included production code of TraversalExecutor and made it compile. Now implement

* Implemented production code for trivial tests, if no row is reaching the traverser.

* Fixed TraversalExecutor code to pull all rows from above and added tests. No traversal yet, this is next

* Intermediate blind commit might not work

* Fixed compile issue in test code

* Created a shared place for Mocks in tests and moved the StorageEngineMock there, also started a shared place for mock servers, most test will need the same server in order to work.

* Fixed travesalExecutor tests. Now able to create tests with actual input.

* Added successful test in TraversalExecutor, that Traverser as started with correct start vertices (by inputRegister)

* Fixed leftovers from rebase

* Refixed mocks in different folder

* Fixed Mock import

* Fixed Calculators Exector Test to use the unified mocked server.

* Implemented logic for the TraversalExecutor. Also added tests for it. Not fully complete though

* Added validation of result values

* Added usage of constant register in traversal executor

* Included filter variables in traersal executor. Added test for const input. And moved MMDR into base traverser class for simplicity

* Added ostream operators on AQLValue and AqlInputRow. Not 100% done yet but good enough

* Added a shutdownable ExecutionBlock. Some blocks need to implement a specific shutdown still. I added this class to make it easier to eliminate them when the time is due.

* Removed ostream operator for INPUT row again, does for some reason not compile on Linux0o

* Fixed initialization order

* First draft of shortest path executor

* Fixed logic bugs, Local AQL tests succeed

* Added first version of ShortestPathExecutor tests. Edge output tests are missing yet.

* Added EDGE output tests

* Replaced TraversalStats with NoStats, they have never been tracked...

* Removed obsolete ShortestPathBlock.

* Removed classwrapper for shutdown.

* Applied review changes

* Refixed failing tests, API is not subject to change

* windows macro opst circus

* Clear registers per block, not per row (#8164)

* Fixed compilation under linux again...
2019-02-14 19:13:08 +01:00
Alan Plum f6467126a3 Fix isAqlQuery with empty query (#8141) 2019-02-13 08:48:35 +01:00
Simon 1123bc10c0 Check authentication for cluster APIs (#8051) 2019-02-04 14:47:44 +01:00
Dan Larkin-York efb8364d99 Optimize memory usage in AQL by using constrained heap sort when reasonable (#7990) 2019-01-31 22:46:57 +01:00
jsteemann 35311178fd try..catch to avoid useless failures 2019-01-29 18:00:56 +01:00
Jan f7d94daba2
port some changes from 3.4 (#8011) 2019-01-29 09:26:57 +01:00
Jan 65dc15bc61
Bug fix/misc issues (#8013)
* added missing return statements

* only spend up to 10 seconds for initially fetching the list of collections in arangosh

fetching the list of collections is a blocking operation, and the default timeout for this is very high.
If the server is blocked by whatever reason, then the shell is unusable until the collections list request returns.
To avoid this, the initial request is limited to 10 seconds, so the shell can be used afterwards.

* if an index cannot be used for sorting, its sort

cost was previously returned as 0. this will in fact favor
indexes that can be used for filtering but not for sorting
over indexes that can be used for both.

this change is to report the sort cost for indexes that
cannot be used for sorting to n * log(n), where n is the
number of documents that optimizer expects to come out of the
index after filtering
2019-01-28 08:55:22 +01:00
Frank Celler eb09e034dc
upgraded to new lodash and marked (#7993) 2019-01-23 09:54:52 +01:00
Frank Celler 9927b3a281
Feature/maskings (#8006) 2019-01-22 22:23:25 +01:00
Jan 6944115de6
various optimizations (#7994) 2019-01-21 13:40:39 +01:00
Frank Celler b35194d1af
updated marked to 0.3.9 2019-01-17 22:01:33 +01:00
Jan 9635df56eb
added "peakMemoryUsage" query result figure (#7952) 2019-01-17 13:58:18 +01:00
maxkernbach afa0889dbd UI: Add Drivers & Integrations column + fix links for 3.4 (#6695)
* Add Drivers & Integrations column + fix links for 3.4

* dynamic-link-versions
2019-01-16 07:38:25 +01:00
sleto-it 6f23bb5445 New customer login url (#7870) 2019-01-14 16:17:49 +01:00
Tobias Gödderz a1d3bc3e94 Foxx queue jobs hanging after Foxxmaster crash (#7922)
* Fixed bug where the Foxxmaster doesn't reset jobs after a crash when it should, or a non-master coordinator removes jobs in progress during startup

* Added a regression test

* Updated CHANGELOG

* Fixed non-maintainer compile
2019-01-14 16:08:08 +01:00
Wilfried Goesgens 457e14b970 add windows suspend/resume hooks as @char101 sugested for others (#7833)
* add windows suspend/resume hooks

* disable procdump
2019-01-11 12:41:27 +01:00
jsteemann e05e88eebd fix web interface document view 2019-01-11 10:03:05 +01:00
Jan Christoph Uhde f65853e30f make use of sortedness of rocksdb primary index (#7788) 2019-01-11 09:40:22 +01:00
Andrey Abramov d4a010baf9
Bug fix/internal issue #316 (#7911)
* allow using scorers outside ArangoSearch view context

Signed-off-by: Andrey Abramov <andrey@arangodb.com>

* ensure query is properly optimized after replacement of scorer functions

* do not apply `handleViewsRule` to queries without views

* simplify optimization rule for ArangoSearch views

* show ArangoSearch view scorers in query explanation

* fix tests

* fix tests

* add stub for scorer related tests

* reformat

* check variable depth in `ViewExpressionContext::getVariableValue`

* add some tests

* address js test failures

* address jslint errors

* ensure `IResearchViewNode` exposes variables used in scorers

* ensure scorers with expressions are deduplicated

* fix deduplication for indexed access

* more tests

* partially address review comments

* address review comments

* simplify code

* remove irrelevant, commented out code

* ensure array comparisons are properly handled

* update changelog & loki
2019-01-10 21:04:19 +03:00
Jan Christoph Uhde 7e0a79b585 fix #7900 - null bind values do not change to empty string anymore (#7917) 2019-01-09 10:04:49 +01:00
Jan fe81007438
support db._explain with all plans (#7895) 2019-01-08 18:06:46 +01:00
Simon a2a0b03f43 Rdb index background (preliminary) (#7644) 2018-12-21 19:24:10 +01:00
KVS85 bbd8aa4e0b Remove procdump usage while taring archives (#7815) 2018-12-21 11:39:39 +01:00
Wilfried Goesgens 7acb3b3ec4 wait for procdump to exit too. (#7731)
* wait for procdump to exit too.

* move running process check up, propagate status. First check whether processes are still running before attempting to force kill them

* only list processes, don't change their state

* add stopping procdump in all places
2018-12-12 18:06:08 +01:00
Michael Hackstein 170e3520be
Improved stability of dump restore test (#7593)
* Improved stability of dump restore test, the assumption tested was not correct

* Fixed options in recovery test suite
2018-12-10 15:48:34 +01:00
Alan Plum a88c5b42e6 Fix TypeError for invalid manifests (#7602)
* Fix TypeError for invalid manifests

* Removed unnecessary wrap
2018-12-10 15:45:19 +01:00
Alan Plum c74583b089 Fix windows test for Foxx socket request URL (#7536)
* Fix windows test for Foxx socket request URL

* Fix unix abs path test
2018-12-10 15:44:00 +01:00
Dan Larkin-York 68ebf1d934 Update upgrade data tests for compatibility with Oskar. (#7485) 2018-12-10 12:51:51 +01:00
Jan fb04c1c602
Bug fix/forward port missing changes (#7706) 2018-12-10 12:51:20 +01:00
Tobias Gödderz 44b6257df9 Fix error messages, allow usage of rr with the recovery suite (#7539) 2018-12-10 12:43:45 +01:00
Tobias Gödderz ceeae07ffe Reload Foxx routes during startup (#7533) 2018-12-10 12:41:50 +01:00
maxkernbach 969ceaffbe UI: rename danger button (#7041) 2018-12-10 11:25:44 +01:00
Wilfried Goesgens ea44f8394d try checking whether _admin/shutdown is received, print sockstats of arangod processes (#7677) 2018-12-06 15:52:46 +01:00
Heiko 5dc0a969ba fixed query result not being displayed if active view was running or … (#7586) 2018-12-06 15:00:31 +01:00
Wilfried Goesgens e890bdc01a add bucket to test summary, so you can determine which logfile to look at (#7661) 2018-12-06 14:23:42 +01:00
Heiko fd78c7a1e3 spotlight ui router was missing (#7626) 2018-12-04 11:42:25 +01:00
Lars Maier 908df47cd7 [devel] Bug fix/cluster health ui timestamp (#7562) 2018-11-30 16:26:21 +01:00
Wilfried Goesgens 879c7bb479 slash all left over processes (if) and set status to bad. (#7557) 2018-11-30 16:24:07 +01:00
Heiko b1d34ea0a2 fixed ui not updating its view name propertly (#7553) 2018-11-29 16:50:45 +01:00
Wilfried Goesgens 76cf74cc83 add missing rootDir parameter (#7546) 2018-11-29 15:18:58 +01:00
Lars Maier 52cff7ad55 Feature/engine version added to agent configuration (#7481) (#7524)
* agents' is obtained from leader's configuration
* corrections in Supervision for advertised endpoints
* change log
* Updated Documentation for cluster/health.
* Unified naming convention.
* Fixed missing update of volatile fields.
* Set version in right order.
* Removed debug output.
* Fixed jslint - missing ;
2018-11-29 14:25:40 +01:00
Jan 683d45bd68
Feature/micro optimizations 28112018 (#7496) 2018-11-28 15:57:10 +01:00
Wilfried Goesgens 3cf8d2a2e7 make the recovering server output its log (#7467) 2018-11-26 19:16:51 +01:00
Wilfried Goesgens 346a0a15a4 fix test status (#7456) 2018-11-26 14:03:37 +01:00
Michael Hackstein 0c3685d777 Removed debug-log output from foxx manager (#7458) 2018-11-26 11:36:53 +01:00
Frank Celler 7a4cb9346e allow buckets for authentication 2018-11-23 22:13:22 +01:00
Heiko 3322cc5ae2 Bug fix/update foxx services after restore (#6774)
* triggers foxx queue update which leads to the internal selfHeal function of a foxx app to make foxx apps publicy visible after a foxx app is restored

* this will also add the recognition of imported foxx services

* Testing JS refactoring

* Added test case for Foxx dump -> restore cases

* Fixed check, sth- i tries to contact to the foxx service. Test is red now.

* Fixed tests for dump / restore using Foxx. Also first draft to fix the fox side. Blocked by sth. fixed in the Main Repositorx already

* Fixed typo in dump/restore testsuite

* Removed old version of the fix

* Fixed JSLint
2018-11-23 17:06:09 +01:00
Wilfried Goesgens ed4af5acf8 re-connect force terminate mechanism on test timeout (#7424) 2018-11-23 11:16:29 +01:00
Heiko a21a197cad refresh properties after switching back to edit mode (#7422) 2018-11-22 15:09:47 +01:00
Heiko 9a7bd2d360 use of job api for patching and removing views (#7354)
* use of job api for patching and removing views

* fixed check of async call of in progress

* finalizing views ui

* link docu change
2018-11-22 14:53:37 +01:00
Wilfried Goesgens a905b2ca35 Bugfix/fix recovery testsuite (#7396) 2018-11-22 11:18:28 +01:00
Wilfried Goesgens 51e020b0f7 make our tools output their log messages (#7403) 2018-11-21 16:38:03 +01:00
Simon c9e44046a2 add timeout (#7398)
(cherry picked from commit 800acadfcabc508cf9c65a18e7c0032b4bfb0c62)
2018-11-21 14:16:23 +01:00
Alan Plum 787ed85e6a Fix Foxx complaining about valid manifest.json $schema value (#7303)
* Fix manifest $schema schema

* Remove unused argument

* Add to CHANGELOG
2018-11-20 14:21:40 +01:00
Alan Plum c36c8c48ee Teach Foxx req.makeAbsolute about unix sockets (#7327)
* Expose rawReq.server.endpoint in JS

* Make rawReq.portType enumerable

This is not strictly necessary but we don't gain much from hiding its existence.

* Allow using http: protocol in local requests

This helps distinguishing local request URLs from file paths in ambiguous contexts.
The alternative would require the user to specify the local endpoint but this doesn't work with
sockets (and for non-sockets would incur the penalty of a real network roundtrip).

* Teach Foxx req.makeAbsolute about unix sockets

* Add Foxx socket tests
2018-11-20 14:20:56 +01:00
Wilfried Goesgens 270301b312 when checking for test leftovers catch dead server connections and abort tests cleanly (#7283) 2018-11-20 10:42:55 +01:00
Wilfried Goesgens fdb1e85d8d When using `--test` to segment filter, we also need to add it to the database directory. (#6944) 2018-11-20 10:26:55 +01:00
Heiko 963fce33eb Feature/joi ui upgrade (#7324)
* fix a small regex issue, upgrade joi to newer version

* changelog

* prev. commited wrong regex
2018-11-20 09:50:50 +01:00
Jan 0dd1776467
Make recovery more reliable (#7297) 2018-11-19 13:59:18 +01:00
Markus Pfeiffer 39bdebf851 Port bug-fix-3.4/timeout-create-coll to devel (#7307)
* Fix loophole in error handling.
* Fix inquiry case of id not found: 404.
* Also handle correctly in AgencyComm.
* Fix agency tests.
* Fix error handling in dropCollectionOnCoordinator.
2018-11-14 10:03:55 +01:00
Jan 4631cfb5e8
do not create _modules collection for new databases/installations (#7291) 2018-11-13 11:40:15 +01:00
Alan Plum fe7eae33bd Fix Foxx Queues infinite maxFailures (#7223) 2018-11-12 13:20:10 +01:00
Frank Celler a6e4c844ad Feature-3.4/whiteblacklist (#7259)
* add blacklist

* added --skipGrey
2018-11-08 00:01:29 +01:00
Wilfried Goesgens 6fe9b774f8 fix typo (#7254) 2018-11-07 17:37:12 +01:00
Dan Larkin-York b447f98a7a Upgrade old MMFiles collections for compatibility with ArangoSearch. (#7248) 2018-11-07 15:52:37 +01:00
KVS85 4646ff28b2 Add view profiling tests (#7229)
* Add view profiling tests

* Fix jslint errors
2018-11-06 17:15:46 +03:00
Dan Larkin-York 0bc6a4d7a2 Fix query profiling discrepancy in console. (#7241) 2018-11-06 14:50:32 +01:00
Vasiliy 68953ae33a issue 496.4.1: move StorageEngine-specific flag out of the genric API and closer to the storage engine (#7212) 2018-11-04 16:52:28 +03:00
Simon b883026f45 Server stream cursor (#7186) 2018-11-02 16:19:48 +01:00
Wilfried Goesgens ecade47aaf don't spawn additional arangosh processes to run the tests (#7185) 2018-11-02 13:08:04 +01:00
Jan dc03e370f9
stop printing `connection class corrupted` in arangosh (#7180)
when just starting the arangosh without a connection to a server
and running code such as `require("internal")`, the shell always
printed "connection class corrupted", which is somewhat misleading.
just don't print this error here, as it is useless
2018-10-31 18:46:47 +01:00
Jan 4bc646f207
increase the maximum allowed number of collections in an AQL query (#7154) 2018-10-31 17:20:30 +01:00
Simon c8961b2faa Remove unused bindings (#7143) 2018-10-30 19:42:45 +01:00
Jan 9bb460c3d5
do not rely on _modules collection being present at startup (#7118) 2018-10-29 13:54:34 +01:00
Matthew Von-Maszewski 97ba8ca2be Bugfix: More 3.4 scheduler changes backported (#7091) 2018-10-26 17:09:20 +02:00
Heiko 83785de993 fixed a routing bug in the ui (#7067)
* fixed a routing bug in backbone js ui

* use of navigate

* changelog

* fixes same issue in another view, too
2018-10-25 16:11:17 +02:00
Heiko 55b0ad7c96 fixes some graph data parsing issues, if format was not like it was e… (#7057)
* fixes some graph data parsing issues, if format was not like it was expected

* changelog
2018-10-25 16:07:27 +02:00
Wilfried Goesgens a95d117396 if we run in maintainer mode, be more patient (#7050) 2018-10-25 15:39:53 +02:00
Wilfried Goesgens 2cfe9126f2 Bug fix/windows process handling (#7012) 2018-10-23 15:38:24 +02:00
jsteemann 2c6e760ea0 adjusted link 2018-10-23 14:26:41 +02:00
Heiko 4cb57cea04 added readOnly mode, added success notification, added view documentation reference (#6995) 2018-10-23 14:22:52 +02:00
Heiko 0ed9bba054 fixes validation of allowed or not allowed foxx service mount paths (#6968) 2018-10-23 14:21:10 +02:00
Alan Plum 4e25350f6b Fix Foxx API handling of broken services (#6459)
* Add tests for service failing on mount

* Don't install broken services

* Restore error page for broken services

* Prefer JSON error pages

* Expose service upsert in API

* Add Foxx fixes to CHANGELOG

* Update CHANGELOG

Typo
2018-10-23 13:05:03 +02:00
Wilfried Goesgens 15a366b17f Bug fix/fix duplicate testcasenames (#7003) 2018-10-23 11:18:22 +02:00
Wilfried Goesgens 806e7d0f1f Doc - fresh swagger (#7006) 2018-10-22 18:52:47 +02:00
Simon 4c1e8819c2 Add engine specific collection APIs (#6977) 2018-10-19 17:46:33 +02:00
Wilfried Goesgens b0c91cf80c Don't listen to procdumps exit code (#6932) 2018-10-18 11:36:56 +02:00
Heiko 477a90d2f7 fixes the ui dashboard statistics in cluster environment (#6917) 2018-10-17 15:52:57 +02:00
Heiko bd7849538e fixed gathering of coordinator statistics in a cluster environment (#6934) 2018-10-17 15:43:42 +02:00
KVS85 3b6191305c Added timestamps to each test for jsUnity (#6926) 2018-10-17 15:32:16 +02:00
Wilfried Goesgens 55a45f1a84 properly check wether the replication follower instance is still alive (#6938) 2018-10-17 14:14:09 +02:00
Heiko b1d98475ad ui is now checking if statistics are enabled or not before it fires i… (#6907) 2018-10-16 11:05:05 +02:00
Wilfried Goesgens d1b3a1ee98 Don't talk to a server when we know its dead. Print current testsuite on Falure. (#6879) 2018-10-15 14:29:16 +02:00
Wilfried Goesgens 239771b5f3 Better result handling for recovery tests (#6826) 2018-10-15 13:17:45 +02:00
Heiko 6d197a2d99 Bug fix/update ui node dependencies (#6869)
* update some ui build  related node modules, fixed some eslint errors

* do not uglify libs any more, as libs are already uglified in most cases
2018-10-15 12:38:06 +02:00
ArangoDB Release Bot 0f04bc4fa4 nightly frontend build 2018-10-12 23:58:35 +00:00
Kaveh Vahedipour 7f7e4e04fd fuerte move resulted in broken inspector 2018-10-12 19:52:24 +02:00
Jan 6d54518145
forward port changes from 3.4 (#6849) 2018-10-12 17:49:17 +02:00
Jan a0980ed2f2
Bug fix/fixes 111018 (#6843) 2018-10-12 12:51:11 +02:00
ArangoDB Release Bot 9448bb4565 nightly frontend build 2018-10-11 23:58:19 +00:00
Heiko 9d2da2c22c Bug fix/internal issue 2770 (#6822) 2018-10-11 15:39:06 +02:00
jsteemann bccd10d622 handle missing frontend collection 2018-10-11 11:55:42 +02:00
Heiko ef8ac38728 Bug fix/internal issue 2035 (#6805) 2018-10-11 11:29:42 +02:00
Heiko cb5839e057 fixed a caching bug in IE11 (#6808) 2018-10-11 11:27:41 +02:00
Heiko afef5ec73a Bug fix/internal issue 2688 (#6818) 2018-10-11 10:57:01 +02:00
Heiko 16af0901f1 Bug fix/internal issue 2785 (#6802) 2018-10-11 10:43:04 +02:00
Heiko c93b359043 Bug fix/internal issue 2764 (#6812) 2018-10-11 10:34:59 +02:00
Heiko b0cf8be2d4 changelog (#6815) 2018-10-11 10:24:47 +02:00
Wilfried Goesgens 676f61805e Make procdump abort on std::bad_cast; kill SUT if it occurs; Make procdump optional. (#6602) 2018-10-10 17:55:53 +02:00
Wilfried Goesgens ad31b31096 print when we mark a build crashy (#6769)
LGTM
2018-10-09 16:47:16 +02:00
Jan bd344f9f09
remove undocumented view.toArray() function (#6763) 2018-10-09 09:48:00 +02:00
ArangoDB Release Bot 7d34c5ca9b nightly frontend build 2018-10-08 23:58:23 +00:00
Wilfried Goesgens 056ee7064c Feature/log timestamp on test start (#6759) 2018-10-08 16:18:04 +02:00
Jan 66d04a10bc
handle a missing _frontend collection gracefully (#6750) 2018-10-08 10:16:24 +02:00
Heiko 24c6a7037a Bug fix/internal issue 1983 (#6746) 2018-10-08 10:15:40 +02:00
ArangoDB Release Bot 9bf58f1591 nightly frontend build 2018-10-05 23:58:23 +00:00
Lars Maier 26c0c7be67 In readonly mode disable the `New View/Service` Buttons. Fixed a stupid warning about lower case constructors. (#6732) 2018-10-05 15:35:10 +02:00
Simon f299e9f6cf Fix foxx test failures (#6724) 2018-10-05 12:49:24 +02:00
Jan 46efcff7d7
micro improvements (#6674) 2018-10-05 10:25:13 +02:00
ArangoDB Release Bot 1de6a7aff9 nightly frontend build 2018-10-02 23:58:16 +00:00
KVS85 883a2baace Switch view editor 'Save' action to use PUT to get full update (instead partial one) (#6630) 2018-10-02 13:20:01 +02:00
ArangoDB Release Bot 0c024bdd3d nightly frontend build 2018-09-28 23:58:24 +00:00
Jan 4b2588d74f
Bug fix/remove valgrind (#6644) 2018-09-28 17:51:53 +02:00
Simon Oualid 937da9c462 Fixed the web UI to properly display JSON properties of user defined Foxx services configuration (#6611) 2018-09-28 14:46:11 +02:00
ArangoDB Release Bot dc54b0eccf nightly frontend build 2018-09-27 23:58:14 +00:00
Jan 78f86ee134
included arrows to better visualize that the collection names accordion elements (#6642) 2018-09-27 19:33:01 +02:00
ArangoDB Release Bot a473df127e nightly frontend build 2018-09-26 23:58:17 +00:00
Alan Plum 78425e510c Add support for nested aql queries in JS (#6482)
* Add support for nested aql queries in JS

* updated documentation
2018-09-26 14:21:24 +02:00
ArangoDB Release Bot 5c12ca89d5 nightly frontend build 2018-09-25 23:58:15 +00:00
Jan ae85fbc4ea
much better diagnostics for AQL query results cache (#6580) 2018-09-25 09:49:11 +02:00
Kaveh Vahedipour 1eab18be2a Feature/generate test data for maintenance script (#6249)
* test data script being fixed
* test data can be generated with expectations
* starting / stopping is done by script
2018-09-24 11:04:00 +02:00
Simon 0fa7f01c66 Resilience test failure points (#6539) 2018-09-20 01:05:10 +02:00
ArangoDB Release Bot 0dd277d325 nightly frontend build 2018-09-18 23:58:31 +00:00
jsteemann a57640993f fixed JavaScript error 2018-09-18 20:13:46 +02:00
Heiko 78fc6aa758 catch 501 (not implemented) in the query editor (ui) (#6523) 2018-09-18 17:46:15 +02:00
Simon 82aa24ad7e Copy installation files on startup (#6491) 2018-09-14 11:15:21 +02:00
ArangoDB Release Bot 0041d120a4 nightly frontend build 2018-09-13 23:58:21 +00:00
ArangoDB Release Bot 7b9ea7e5de nightly frontend build 2018-09-12 23:58:12 +00:00
Simon 22b9c31c13 Removing ClusterComm ClientTransactionID (#6294) 2018-09-12 22:15:16 +02:00
ArangoDB Release Bot 2d039e39ee nightly frontend build 2018-09-11 23:58:17 +00:00
Heiko 2ec1a5cc26 Feature/new devel versioning scheme (#6312) 2018-09-11 08:57:38 +02:00
ArangoDB Release Bot 3ed501db8f nightly frontend build 2018-09-10 23:58:36 +00:00
Jan dbe4559ed1
fix some issues with sorted variant of COLLECT (#6433) 2018-09-10 17:01:51 +02:00
Jan 7a3c2bf6af
add some debugging for unstable replication_sync test (#6436) 2018-09-10 14:46:50 +02:00
Jan 3752c7deab
fix profile output for nodes without calls to getSome (#6397) 2018-09-10 09:19:01 +02:00
ArangoDB Release Bot 64282625bd nightly frontend build 2018-09-06 23:58:22 +00:00
Heiko c4d878ece8 query result map added tooltips, added recognition of geometry attribute (#6371)
* new features geo aql editor

* added geo geometry attribute detection, added tooltips for geo elements

* max height

* added max height for map tooltip
2018-09-06 11:38:04 +02:00
maxkernbach 87e4f455d6 improve graph error messages in the UI (#6368) 2018-09-05 12:34:09 +02:00
ArangoDB Release Bot 72532ca24a nightly frontend build 2018-09-04 23:58:35 +00:00
Simon 0661a4c1fe Hide Links from getIndexes() (#6325) 2018-09-03 15:17:24 +02:00
Jan 07abfca588
Bug fix/cleanup 020918 (#6338) 2018-09-03 12:56:41 +02:00
Frank Celler f17eac6b96 fixed typo in test setup 2018-09-02 10:21:39 +02:00
Frank Celler f696efe5ea removed auditlog 2018-09-02 08:54:04 +02:00
Jan e03f0daccd skip "dump_encrypted" test in non-enterprise mode (#6334) 2018-09-01 22:55:04 +02:00
Jan 3a3c4f7f8b fix failing readOnly test (#6333) 2018-09-01 22:54:33 +02:00
Frank Celler ca34956f3c fixed wrong result code 2018-09-01 16:16:29 +02:00
ArangoDB Release Bot 7aae2051bf nightly frontend build 2018-08-31 23:58:22 +00:00
Heiko e2f72f7a68 fixed displaying of log output in the ui (#6320) 2018-08-31 20:08:01 +02:00
Heiko 51e411bf20 fixed the checkbox alignment inside a modal element (#6319) 2018-08-31 20:07:35 +02:00
Jan 24ca3acf97
rename `tests/js/*/tests/*` to `tests/js/*/*` (#6280) 2018-08-31 19:42:21 +02:00
ArangoDB Release Bot eec3ec2b06 nightly frontend build 2018-08-30 23:58:16 +00:00
Wilfried Goesgens a30a93aa3f fix example, so geo indices are actually used (#6305) 2018-08-30 19:22:13 +02:00
Heiko fd81e34498 fixed the selection of the wrong line inside the aql query editor when an query backend error appears (#6302) 2018-08-30 14:51:16 +02:00
Heiko 5dccea9789 disabled renaming of views in the cluster, added search, added desc sorting (#6300) 2018-08-30 12:34:27 +02:00
Heiko 668d24cf89 optimized geo json fallback in query editor (#6298)
* optimized geo json fallback in query editor

* requested change
2018-08-30 09:29:02 +02:00
Wilfried Goesgens 72b2909dc9 Doc - use standard geo-json in this example (#6291) 2018-08-30 04:41:57 +02:00
ArangoDB Release Bot 83087da1bc nightly frontend build 2018-08-29 23:58:46 +00:00
Heiko 6ac135e876 semver foxx plain func (#6293) 2018-08-29 20:26:03 +02:00
Alan Plum ecfdd8e698 Fix getReadableName (#6272)
* Move getReadableName to new test folder

* More tests

* Fix getReadableName

* Linting
2018-08-29 17:20:52 +02:00
jsteemann 9650911d53 improve wording here and there 2018-08-29 12:34:29 +02:00
ArangoDB Release Bot ee30ca1cdf nightly frontend build 2018-08-28 23:58:22 +00:00
jsteemann 05cbc5a9ec jslint 2018-08-28 15:12:28 +02:00
Jan 494764b95c
Bug fix/fiddle version string into test paths (#6267) 2018-08-28 14:58:35 +02:00
Alan Plum cfa0e0db55 Better foxx errors (#6264)
* Fix codeFrame formatting

Pushing the codeFrame first results in ugly line breaks or extra spaces.

* Include cause in MODULE_FAILURE message

The error is always a wrapper for an underlying cause so it should be easier to determine what caused it.

* Add a codeFrame for failed _install

We normally only want this in dev mode but service CRUD should always provide detailed info.

* Expose codeFrame in Foxx CRUD

The codeFrame can only come from a failed _install, so let's make it visible to Foxx CLI and friends.

* Add codeFrame to runScript

Scripts can also only be executed with access to the Foxx API so we can provide the same info as during CRUD.

* Trim codeFrame fileName to basePath

If we have a basePath, we don't need to expose the full path to the user for the codeFrame to be meaningful.

* Fix getReadableName

Previously 'catch-fire' would become 'Catch  Ire'.

* Add to changelog
2018-08-28 14:36:33 +02:00
Vasiliy 953027ba63 issue 458.1: move SystemDatabaseFeature from IResearch to RestServer (#6260)
* issue 458.1: move SystemDatabaseFeature from IResearch to RestServer

* Add modified tests.
2018-08-28 09:48:09 +02:00
Jan 0a73e64b0b Bug fix/fiddle version string into test paths (#6266)
* fiddle version string into test paths
2018-08-28 09:27:32 +02:00
jsteemann df53e1ea82 make test not immediately fail 2018-08-28 01:10:04 +02:00
jsteemann 6fc8b43fe2 start the correct test 2018-08-28 01:01:02 +02:00
jsteemann 44eae59dc0 remove functions that are not called anymore 2018-08-28 01:00:40 +02:00
Jan 5022ccc24d
Bug fix/fixes 2508 (#6254) 2018-08-27 21:36:39 +02:00
KVS85 e41a854f59 Move testInTokensFilterSortTFIDF test to nondetermenistic module. (#6246)
* Move testInTokensFilterSortTFIDF test to nondetermenistic module.

* Lost file.

* Rename to conform with other named test modules.

* Resolve conflicts
2018-08-27 15:50:28 +03:00
Jan 791eaba873 Bug fix/planning 2865 (#6252)
* potential bugfix for planning/#2865

* speed up dump tests setup

* enable authentication for backup tests

* make arangodump provide a "serverId" to the server

this allows the server to track arangodump as an active dump client
so any data required for the dumping may be retained while the
dump is ongoing

* don't log binary stuff into the logfile
2018-08-27 10:21:34 +02:00
ArangoDB Release Bot d776c18479 nightly frontend build 2018-08-26 23:58:12 +00:00
Andrey Abramov 615e1cf7de
Feature/add options to view (#6255)
* added OPTIONS for views

* pass options too

* validation for OPTIONS

* fix OPTIONS validation

* removed debug log message

* add forceSync options

* add forceSync view option

* fix comments

* fix some memleaks

* fix typo

* fix integration tests

* fix integration tests

* fix another integration test

* rename 'forceSync' option to 'waitForSync'

* another attempt to fix test

* ensure query caches are properly invalidated

* address integration test failures

* another attempt to fix test
2018-08-26 22:30:23 +03:00
Vasiliy 5d14775de8 issue 459.3: ensure collection permissions are checked before updating/dropping an IResearch view (#6253)
* issue 459.3: ensure collection permissions are checked before updating/dropping an IResearch view

* backport: ensure collection permissions are checked before updating/dropping an IResearch view on cluster

* backport: address test failures

* backport: address more test failures

* reuse existing classes for scoping ExecContext
2018-08-26 18:00:16 +03:00
KVS85 f7d85edef9 Doc - Internal issue 448 + fix build (#6229) 2018-08-26 09:32:57 +02:00
Simon 568a09f177 Disable JS on DBServer, fix race in UserManager (#6244) 2018-08-24 22:20:49 +02:00
Jan 73e44bc605
invalidate query cache after modification of views (#6198) 2018-08-24 19:54:10 +02:00
Jan 0d48677619
Bug fix/aql optimizer improvements 2308 (#6241) 2018-08-24 13:42:22 +02:00
Vasiliy 2ecdfefcb8 issue 459.2: ensure view retrieval is denied of detailed definition is denied (#6237)
* issue 459.2: ensure view retrieval is denied of detailed definition is denied

* address test failures
2018-08-24 14:37:35 +03:00
Kaveh Vahedipour 28754cbf15 Feature/schmutz plus plus (#5972)
- Schmutz now called "Maintenance" and completely implemented in C++
 - Fix index locking bug in mmfiles
 - Fix a bug in mmfiles with silent option and repsert
 - Slightly increase supervision okperiod and graceperiod
2018-08-24 12:15:35 +02:00
Wilfried Goesgens 2b063cada8 properly feed the crash analyzer function, so arangosh crashes will be analyzed too (if) (#6238) 2018-08-24 11:47:44 +02:00
Jan 03ea6b929b
fix "auto" test (#6224) 2018-08-24 10:45:31 +02:00
Simon 18c3069117 Make cluster routes check roles (#6239) 2018-08-24 09:46:27 +02:00
Simon 948820e484 Various small changes (#6234) 2018-08-24 09:39:03 +02:00
ArangoDB Release Bot 7244b833bf nightly frontend build 2018-08-23 23:58:19 +00:00
Heiko b1b68b19b9 Bug fix/gharial deletion of connected edges (#6201)
* added test for recursive edge deletion, still missing c++ implementation

* test

* added deletion of connected edges when removing an edge or a vertex

* Added a helper function to iterate over all graphs.

* applied requested test changes

* edge definition helper function

* moved removeVertex and removeEdge inside a helper function

* more optimizations

* compile error

* typo

* requested changes

* const func
2018-08-23 18:52:06 +02:00
Vasiliy e04b5318b4 issue 450.5: rename consolidation-related configuration properties and remove locale (#6232) 2018-08-23 16:04:25 +03:00
ArangoDB Release Bot e567a5669e nightly frontend build 2018-08-22 23:58:14 +00:00
jsteemann e95a1b5483 added generated files 2018-08-22 20:49:10 +02:00
jsteemann 08c67c61a8 Merge branch 'bug-fix/add-arangosearch-view-to-resilience-tests' of https://github.com/arangodb/arangodb into devel 2018-08-22 15:15:26 +02:00
Vasiliy febd445410 issue 451.1: ensure errors are properly propagated during LogicalView creation (#6218)
* issue 451.1: ensure errors are properly propagated during LogicalView creation

* address Ruby test failures

* ensure invalid view type returns TRI_ERROR_BAD_PARAMETER

* address jslint errors
2018-08-22 16:11:24 +03:00
Simon Grätzer 73640d6b7c Merge branch 'devel' of github.com:arangodb/arangodb into bug-fix/add-arangosearch-view-to-resilience-tests
# Conflicts:
#	3rdParty/fuerte/src/HttpConnection.cpp
2018-08-22 14:54:26 +02:00
Simon Grätzer feaeac12bd some fixes 2018-08-22 14:01:24 +02:00
ArangoDB Release Bot 9d03ab532b nightly frontend build 2018-08-21 23:58:42 +00:00
Vadim Kondratyev a0659c2b99 Comment out #2907 related test 2018-08-22 00:47:59 +02:00
Vadim Kondratyev 0c78848876 Split view and original tests and change approach of test in move shards 2018-08-22 00:36:34 +02:00
Simon Grätzer 2e05ad8f90 Fixing some small issues, adding views to move shards 2018-08-21 23:48:56 +02:00
Simon Grätzer 6b3f8d8c78 Merge branch 'devel' of github.com:arangodb/arangodb into bug-fix/add-arangosearch-view-to-resilience-tests 2018-08-21 20:44:31 +02:00
jsteemann fa0def4d3a added generated files 2018-08-21 18:53:27 +02:00
jsteemann 9959218d1d revert unification of collection name validation 2018-08-21 18:46:13 +02:00
Vasiliy 325e61b4ed issue 450.3: use a single configuration policy differentiated by 'type' with arbitrary number of configurable parameters (#6205)
* issue 450.3: use a single configuration policy differentiated by 'type' with arbitrary number of configurable parameters

* ensure test data is persisted to the test directory

* add missed declaration

* fix typo

* add full namespace and includes
2018-08-21 14:46:28 +03:00
Simran 6f4371bcdd Improve debug package description dialog (#6010) 2018-08-21 13:42:15 +02:00
Vadim Kondratyev 7deb68b941 Comment view usage in resilience-synchronous-repl-cluster.js 2018-08-21 12:55:59 +02:00
Vadim Kondratyev 833f3aa984 Merge branch 'devel' of https://github.com/arangodb/arangodb into bug-fix/add-arangosearch-view-to-resilience-tests 2018-08-21 11:23:07 +02:00
Jan 2aa879a53b
unify validation of collection names in AQL (#6203) 2018-08-21 11:11:15 +02:00
Simon 97b7e15792 Fixing crashes on UPDATE / INSERT queries (#6207) 2018-08-21 11:10:44 +02:00
Simon 229c09d434 Allow dirty-reads from passive (#6136) 2018-08-20 16:26:14 +02:00
Vadim Kondratyev 8ebb4e92db Merge branch 'devel' of https://github.com/arangodb/arangodb into bug-fix/add-arangosearch-view-to-resilience-tests 2018-08-20 16:07:27 +02:00
Heiko 0e03167606 updated npm version of some ui modules (#6000) 2018-08-20 14:29:03 +02:00
Heiko bb3a6002b8 added missing if none match header when reading nodes or edges (#6165) 2018-08-20 14:28:50 +02:00
Vadim Kondratyev 7a3ca8e002 Add ArangoSearch view to resilience-synchronous-repl-cluster tests 2018-08-20 13:03:16 +02:00
Simon fc204a2b3e fix profiling code (#6190) 2018-08-20 12:59:07 +02:00
Jan 102f15bece
removed several unused internal APIs (#6193) 2018-08-20 12:57:58 +02:00
Jan 7cb1da12cf
make AQL functions construction easier (#6195) 2018-08-20 11:56:38 +02:00
ArangoDB Release Bot 0aaf96cbf9 nightly frontend build 2018-08-19 23:57:54 +00:00
Vasiliy c08ab01f67 issue 450.1: remove the "commit" configuration layer from ArangoSearch properties (#6185)
* issue 450.1: remove the "commit" configuration layer from ArangoSearch properties

* fix broken tests
2018-08-20 02:18:02 +03:00
ArangoDB Release Bot 2f65ac3694 nightly frontend build 2018-08-18 23:58:17 +00:00
Jan 99f176bed5 Feature/add search keyword (#6166)
* added SEARCH keyword

* fixes jslint errors

* add incompatibility notice

* remove VIEW keyword (does not work yet!!)

* add initial support for SEARCH keyword to optimizer rules

* replace FILTER with SEARCH keyword in tests

* removed VIEW keyword, make shell_server_aql tests pass again in single server

* cleanup

* handle SEARCH clause for views

* make SEARCH a non-keyword

* fixed an issue with duplicate variables

* fixed 3 tests

* fix SEARCH statement support for views

* minor refactoring

* fix integration tests

* optimize SEARCH conditions a bit more

* fix jslint error

* fixed wrong comments and typo in class name

* fix documentation

* adjust recovery tests to use SEARCH instead of FILTER

* fix another failing test
2018-08-18 20:22:58 +03:00
ArangoDB Release Bot 72f1c13cb4 nightly frontend build 2018-08-17 23:58:15 +00:00
jsteemann 59db24c65e fixed jslint error 2018-08-17 20:24:47 +02:00
Vasiliy 320332c779 issue 433.1: make client JavaScript code for view DDL more similar to collection DDL (#6179)
* issue 433.1: make client JavaScript code for view DDL more similar to collection DDL

* remove invalid statement

* remove cached view
2018-08-17 17:14:57 +03:00
Jan 91577d93f5
remove unused frontend tests (#6114) 2018-08-17 15:20:12 +02:00
jsteemann d019989d7c fixed jslint warning 2018-08-17 15:09:23 +02:00
jsteemann 6cbe24f7c5 added generated file 2018-08-17 13:14:19 +02:00
jsteemann aa68414207 fix jslint warnings 2018-08-17 11:05:58 +02:00
Alan Plum 1698687f4f Add uuidv4 & genRandomBytes methods (#5732) 2018-08-17 11:04:43 +02:00
Alan Plum 1f69cb6d9d Fix Foxx CRUD errors (#5876)
* Fix off-by-2 error for SyntaxError line nums

* Actually log Foxx HTTP API errors

* Fix line wrap when logging error stacks
2018-08-17 10:09:12 +02:00
Simon 2d29232c59 fix restoring iresearch view in cluster (#6159) 2018-08-17 09:28:20 +02:00
Simran c9ec32af0f Disable showPrintMargin for saved query preview too (#5995) 2018-08-17 09:21:26 +02:00
Heiko cd32dded74 Bug fix/issue 5831 (#6091) 2018-08-17 09:03:21 +02:00
Jan d7e631eddf
Bug fix/more sparsung (#6177) 2018-08-17 08:47:45 +02:00
Jan b5eaf1443b
make optimizer rule "patch-update-statements" fire for REPLACE too (#6181) 2018-08-17 08:45:40 +02:00
Jan d78adb7ae1
Bug fix/turn off range deletes in cluster (#6178) 2018-08-17 08:41:00 +02:00
ArangoDB Release Bot 6e270fba91 nightly frontend build 2018-08-16 23:58:11 +00:00
Heiko a4683fa118 added lost gharial tests (#6173) 2018-08-16 18:40:03 +02:00
Jan 63efe2a634
fixed issue #6128 (#6137) 2018-08-16 11:01:44 +02:00
jsteemann c6de98882c jslint 2018-08-16 09:26:44 +02:00
Jan d6a3b66e2a
micro optimizations (#6162) 2018-08-16 08:50:16 +02:00
Heiko 542634ff5e fixed events not properly bound to view (#6143) 2018-08-16 08:48:08 +02:00
Heiko 01cbb4cac4 webui, fixed misalignment of a table (#6134) 2018-08-16 08:47:33 +02:00
ArangoDB Release Bot 55b46e28cb nightly frontend build 2018-08-15 23:58:18 +00:00
Simon 392118bd62 Use RangeDelete where possible (#6121) 2018-08-15 18:52:09 +02:00
Jan 2bc672cebd
centralized more of the sharding strategies code (#6140) 2018-08-15 14:37:01 +02:00
Alan Plum dc2bca23cf Fix #5736 (#5844)
* Fix issue 5736

* Add #5736 to CHANGELOG
2018-08-15 14:11:20 +02:00
KVS85 c5cb2fa10a Bug fix/fix arangosearch authentication tests for cluster (#6161)
* Initial changes in assertions

* Fix typo

* Fix for issues #452, #453

* Fix drop task test

* Deal with fuetre possible bug on connection

* More fixes

* Enable shell_*_aql tests for RF > 1
2018-08-15 12:13:15 +03:00
ArangoDB Release Bot cf6a9ee352 nightly frontend build 2018-08-14 23:58:08 +00:00
jsteemann b09638a883 fixthedocs.com 2018-08-14 12:02:53 +02:00
jsteemann d634e0166b Merge branch 'feature/add-aql-function-regexmatches' of https://github.com/arangodb/arangodb into devel 2018-08-14 10:18:53 +02:00
ArangoDB Release Bot 8b60d9692c nightly frontend build 2018-08-09 23:58:12 +00:00
Shivam Dave 9b926dc2fd Resolved regex matches integration tests 2018-08-09 16:33:19 -07:00
Shivam Dave 1360cfc3c3 Resolved regex matches integration tests and documentation 2018-08-09 15:09:47 -07:00
Jan 8267c61ec2
Merge branch 'devel' into feature/add-aql-function-regexmatches 2018-08-09 20:28:06 +02:00
Shivam Dave 47bea99bbe Regex matches implementation integration tests and documentation 2018-08-09 10:17:32 -07:00
Dan Larkin-York 5f87f57cd0 Improved sharding algorithms (#6089) 2018-08-09 19:03:32 +02:00
Jan 95d1892f18
remove canThrow attribute from AQL functions (#6123)
Its was somehow overlapping with the isDeterministic attribute (but with the opposite meaning)
2018-08-09 16:45:54 +02:00
jsteemann 27b518cccf fix tests 2018-08-09 14:29:03 +02:00
jsteemann bbad6bb682 fix test 2018-08-09 13:00:57 +02:00
jsteemann 1e466f6545 fix jslint warnings 2018-08-09 11:39:21 +02:00
Jan bf3ce0b704
fixed issue #6106: Arithmetic operator type casting documentation inc… (#6113) 2018-08-09 11:30:54 +02:00
Heiko 9e37486c32 fixed api views within the ui (#6022)
* fixed api views within the ui

* added view keyword
2018-08-09 11:29:42 +02:00
Jan 9abf1b1562
make tests non-timecritical (#6129) 2018-08-09 11:28:29 +02:00
Tobias Gödderz de4f5587ae Gharial rewrite in C++ (#5631)
* Built a C++ skeleton REST handler for gharial, with fallback to the JS handler

* Moved aql::Graph to graph::Graph

* Added complete edge definitions to Graph

Also:
- some cleanup
- used forward-declarations in headers
- use Graph in graph rest handler

* Handle graph lookup failures according to the test suite

* Added GET vertex

* Bugfixes in ResultT

- Added missing #include
- Fixed move semantics

* Move central code of readVertex to GraphOperations

* ResultT fixes and complements

* Implemented a graph cache

* Added and used graph cache to the rest handler

* Added GET edge

* Added DELETE edge

* Extracted some code

* Added PATCH and PUT for both edge and vertex

* Moved update/replace transaction code to GraphOperations

* Added stub routes for POST and a TODO note

* Added a test checking that deleting a vertex removes all incident edges as well

* Added a test checking that deleting a vertex does not remove edges in non-graph collections

* fixed compiler warnings and errors

* Began work on DELETE vertex

For this, added a V8Context to allow for AQL queries to use subtransactions

* Continued work on DELETE vertex (still WIP)

* prep for graph post routes

* fixed removeVertex operation (aql)

* added post vertex and post edge gharial routes

* wasSynchronoues flag changed

* gharial post c++ handler, naming conventions

* added gharial tests

* temporary disabled cache (because not completed), added graph property read functions

* added c++ gharial list vertex collections

* added c++ gharial graph config

* added c++ gharial list graphs

* added graph manager class

* first implementation of create graph in c++, WIP

* changed error messages

* added etag to create graph api, still multiple edge definition check missing

* finished POST /_api/gharial/<graph>

* WIP - DELETE /_api/gharial/<graphName>

* added DELETE /_api/gharial/<graphName> validation, still missing correct response

* gharial delete

* fixed delete gharial lock

* finished DELETE /_api/gharial/<graphName>

* added routes for graph based vertices and edge definitions

* improved delete route

* added add new edge definition to existing graph

* patch edge definition in a graph, still <WIP>

* finished edit edge definition route

* code changes due to devel code changes

* added remove edge definition route

* added vertex delete function

* added todo note regarding one drop collection issue

* add oprhan collection to graph route implemented

* Added a test

* Updated a comment

* Several minor changes

* Minor changes during review

* Changes during review

* Changes during review

* Bugfix: orphans may be null or omitted

* Bugfix: resolve externals

* minor code changes

* seperated graph class to independent component classes

* seperated graph class to independent component classes

* removed log output

* fixed create collection behaviour in a cluster environment

* fixed enterprise graphs behaviour in c++ gharial api

* removed log output

* formatting

* improved error handling, fixed a linux compile bug

* more result refactoring

* more result type cleanup

* fixed wrongly defined test

* result handling

* error handling

* more refactoring

* Bugfix: avoid race condition in cluster when creating collections

* updated graph documentation

* added graph related static strings

* static strings, new method to create options for gharial created collections

* Some minor cleanup

* more use of static strings

* minor code changes, review

* added missing parseint

* removed gharial foxx, added js common module, added v8 general graph module

* correct use of virtual method

* more v8, js general graph, broken state

* more v8 graph functions

* fixed editEdgeDefinition, added drop function

* fixed drop behaviour

* added _list, _exists

* added c++ rename graph collections, added v8 + graph module function

* Added a regression test

* added graph._deleteEdgeDefinition, v8, server

* more v8g

* added _removeVertexCollection

* added _extendEditDefinitions

* todo, need to add a helper sort method for a local defined relation

* fixed test

* fixed lots of tests, added more client functions, _addVertexCollection on client module is still broken

* added more client graph functions, all tests green

* more client functions

* add del edge def route

* Fix use after move

* Minor changes in client general-graph.js module

* Make a copy before sorting (don't touch the argument)

* Minor changes and some additional asserts in graph tests

* Consistently set parameter defaults

* Renamed static strings

* Remove superfluous function

* Made comment more verbose

* Minor changes in general-graph-common.js

* Added missing template arguments

* Fixed community build

* Cleanup in editEdgeDefinition

* Regression test & bugfix: comparison of edge definitions didn' order from and to

* Fixed errors introduced by merge

* Minor changes in v8-general-graph.cpp

* Fixed test failure due to wrong error code in CE

* added missing id field

* Added permission checks for graph._create

* Removed assertion that is no longer valid

* Moved removeGraph from GraphOperations to GraphManager

* Allow C++ implementation of graph._drop to handle smart graphs

* Flush js client db cache after creating/dropping collections via the general graph module

* Added _deleteEdgeDefinition to the general graph client module

* WIP: Added permission checks for drop graph

* Fixed permission checks for drop graph

* Added permission checks for other graph operations

* Bugfix: assert edge definitions are returned in order

* Some cleanup

* Removed unused method

* Minor improvements in GraphManager

* Fixed a type in general-graph common module

* Most useful fix of all times ever: Do not auto cast from bool to int and alternate error/noerror by this

* Added the initial keyword to StaticStrings

* Added a new error code, used whenever a user tries to inject a documentcollection as a relation into the graph, which is invalid

* Some GraphManager/Ops/Graph cleanup. Less Slice parsing, more usage of GraphObjects

* Test edgeDefinitions in graphs with a defined ordering

* GraphClass Layout cleanup

* Do not test error messages, use codes instead

* Recreated backwards compatibility of Graph Creation Permission errors

* Changed error-code if edgedefinition is used twice

* Added a StaticString for the GraphName

* Renamed graphToVpack => graphForClient

* Partly fixed graph-api test to work with better error messages. Still red: The edgeDefinitions are now sorted, the test is supposed to sort his own list, but appearently does not do so. Under investigation

* Added a new error code that rejects injection of differently sharded smart collection into smartgraph. Should be more helpful to our users

* graph createCollectionOptions now require an open object to be cross-called from enterprise. Made enterprise switch for creation of graph more elegant.

* Updated graphs.cpp

* Massive refactoring. Made Factories for graphs to make SmartGraph much more transparent. Also reduced amount of multiple implementations of the same stuff. Killed vocbase/graphs use GraphManager instead. Removed usage of GraphCache, was not completely implemented anyway and only partially used, which is bad at the moment. Option for later improvement never the less

* Adapted JS code to now really use c++ variants. ALso included 3 Classes: Graph, SmartGraph and GraphModule.

* Fixed undefined behaviour in Remove Vertex. Fixed smartgraph sharding if one collection already exists.

* Removed DEBUG output

* Removed DEBUG logs

* Removed dead code

* Fixed Graph EdgeDefinition test, they now have a different ordering.

* Added a test when adding a vertexCollection that it is actually valid in the graph

* Client Graph API now correctly sends `orphanCollections` and not `orphans`

* Let GraphOperations modify the graph in-place. It should now properly handle edgeDefinitions.

* Added initial cid StaticString

* Included the vocbase in fromPersistence creation of Graphs. Only required to enhance 3.3 SmartGraphs on the fly.

* Fixed internal error message

* Fixed compiler isses originiated from merging

* Removed unused imports

* Regenerated generated file
2018-08-09 09:30:04 +02:00
ArangoDB Release Bot 4aa174399c nightly frontend build 2018-08-08 23:58:18 +00:00
Jan 93222b15d4
track last used keys in cluster key generators, track key on cluster document insert (#6101) 2018-08-08 14:32:16 +02:00
Vinay Pyati 5709034e3d getBatchSize() instead setBatchSize() in Get query options (#6116) 2018-08-08 14:07:04 +02:00
Simon 606c15ce48 VST support in arangosh (#6047) 2018-08-08 12:18:54 +02:00
Simon 6a97e441a6 Doc - New section for query profiler + fresh examples (#6070) 2018-08-08 10:51:09 +02:00
ArangoDB Release Bot e5ee7f4457 nightly frontend build 2018-08-07 23:58:09 +00:00
Vasiliy 66efaa6022 issue 427.3: uncomment authentication tests, address error propagation issues during view drop (#6103) 2018-08-07 19:52:12 +03:00
Heiko 6e64c8ec9a Bug fix/issue 5943 (#6096) 2018-08-07 15:13:35 +02:00
Heiko b6c87a2342 Bug fix/issue 5354 (#6083) 2018-08-07 15:11:23 +02:00
Heiko 59d97c4649 fixed ui bug when saving invalid document type (#6079) 2018-08-07 15:10:00 +02:00
jsteemann d448b4367b adjusted test 2018-08-07 11:53:29 +02:00
Kaveh Vahedipour fd60b359b6 fixed parallel creation of indexes in cluster (#6088)
* fixed parallel creation of indexes in cluster

* added tests
2018-08-07 10:00:15 +02:00
ArangoDB Release Bot 7324240a31 nightly frontend build 2018-08-06 23:57:56 +00:00
Jan 42fdef45d4
Bug fix/fix profile query (#6073) 2018-08-06 17:02:27 +02:00