1
0
Fork 0
Commit Graph

45768 Commits

Author SHA1 Message Date
Lars Maier f6c163ae1a Added available field to indicate bad backups. (#10129)
* Added available field to indicate bad backups.
* Added nrPiecesPresent.
* Fixed logids...
* Make Windows compiler happy.
* Fix log ids.
2019-10-08 15:35:38 +02:00
Michael Hackstein 1755b2b253
Feature/aql subquery single input tests (#10175)
Added DISABLED_ tests for the new Subquery Optimization Rule
2019-10-08 15:29:09 +02:00
Simran 74fdcf5b5a
ArangoSearch refactor (part 2) (#9822)
* ArangoSearch refactor (3.5) (#9597)

* Correct View Creation object struct (WIP)

* 404 -> 409, remove old note

* Remove unnecessary DocuBlocks, uppercase Views

* field-name has object value

* Add missing View props, unify

* Remove line break

* Remove subtype for consolidationPolicy

* Indent list

* attempt to fix fields / field-name

* remove links @RESTSTRUCTs and point to docs
Note: this uses an absolute link in order to work in Swagger

* Double line-breaks break indention
2019-10-08 14:38:14 +02:00
Jan af5e3d4763
don't taint hash set if insert/emplace fails for whatever reason (#10179) 2019-10-08 14:29:20 +02:00
Wilfried Goesgens 6f289d03ce Bug fix/result evaluation test counting (#10176) 2019-10-08 11:14:08 +02:00
Jan 35786aa517
decrease payload size of some lambdas (#10167) 2019-10-08 10:12:22 +02:00
Markus Pfeiffer e9ab15db03 Add a comment that subquery splicing should run last (#10181) 2019-10-08 09:13:50 +02:00
Michael Hackstein cf99ff1586
Feature/aql subquery all rows fetcher shadow rows (#10079)
Allow handling of ShadowRows in AllRowsFetcher
2019-10-07 16:49:30 +02:00
jsteemann 98614321ee Merge branch 'feature/one-shard-testing' of github.com:arangodb/arangodb into devel 2019-10-07 15:35:51 +02:00
Jan 21b0311d57
rename minReplicationFactor to writeConcern (#10118) 2019-10-07 15:12:15 +02:00
Michael Hackstein 3aa9a2cf72 Attempt to fix compilation 2019-10-07 13:30:31 +02:00
Simran 62a822f64c
Docs: Add which option is used by which ArangoBackup operation (#9934) 2019-10-07 11:49:25 +02:00
Simran b583fb45cf
Docs: Dump program options of arangobackup as well (#9932) 2019-10-07 11:47:26 +02:00
Michael Hackstein 1d4584ffab
Add a way to avoid core-dumps on death tests (#10132)
* Added a way to execute DEATH tests in a core-free way, otherewise the Linux jenkins will produce core-files on those tests

* Update tests/Mocks/Death_Test.h

no new line at end of file

* Renamed the DeathTest macro as suggested.

* Yeah Windows Yeah, disabled death-test because i cannot get it to work.
2019-10-07 10:59:21 +02:00
Jan 6f14048bbe
implement early pruning of documents in EnumerateCollectionExecutor (#10159) 2019-10-05 13:38:23 +02:00
Iurii Popov 2fa1107d7f Fixed repeatable seek to the same document (#10164)
* Fixed repeatable seek to the same document

* Fix. Multiple conjuncts in conjunction.
2019-10-04 22:04:32 +03:00
Jan 3ff223b131
fix generating examples (#10171) 2019-10-04 19:56:51 +02:00
Tobias Gödderz 8603ceb995 Implement copying/moving constructors of InputAqlItemRow (#10165) 2019-10-04 17:46:08 +02:00
Tobias Gödderz 4ec4218213 Replace union by separate members (#10168) 2019-10-04 17:38:29 +02:00
Max Neunhöffer 8cd54e79eb
Fix hotbackup restore example snippet for devel. (#10169) 2019-10-04 17:15:15 +02:00
Tobias Gödderz e2c84acfaf Use explicit default destructors where possible (#10166) 2019-10-04 15:58:30 +02:00
Jan 0da109bf82
fixed issue #10158 (#10162) 2019-10-04 13:53:31 +02:00
Max Neunhöffer c3f863f289
Port latest API docs for hotbackup to devel. (#10161) 2019-10-04 10:49:35 +02:00
Jan ae05fafa4e
Bug fix/fix parsing unterminated strings (#10155) 2019-10-03 13:38:05 +02:00
jsteemann 662293c877 show shards of system collections in web UI too 2019-10-03 00:37:36 +02:00
Jan a1775b7930
cleanup some of the internal APIs a bit (#10152) 2019-10-03 00:02:27 +02:00
Wilfried Goesgens 1bbdea4dd4 Bug fix/one more place to do preceding dir char wrong (#10150)
* make sure we don't build paths that start with two \'s

* fix condition
2019-10-02 22:55:30 +03:00
Wilfried Goesgens 823640e8f7 Feature/testing result evaluation (#10124) 2019-10-02 17:49:32 +02:00
KVS85 c8c1b07d40
Revert "make sure we don't build paths that start with two \'s (#10144)" (#10148)
This reverts commit 1ad3d1a327.
2019-10-02 18:47:05 +03:00
Jan 9c4d424368
ignore files in .bin when copying js files (#10145) 2019-10-02 17:46:29 +02:00
Wilfried Goesgens 1ad3d1a327 make sure we don't build paths that start with two \'s (#10144) 2019-10-02 18:35:14 +03:00
jsteemann 1258cdc2d9 use unique_ptr 2019-10-02 16:03:37 +02:00
Jan d29d3df698
improve test statements, fix memleaks and init-order-fiasco (#10142) 2019-10-02 16:02:56 +02:00
Kaveh Vahedipour dc6dba27a2 add repository address normalisation (#10113)
* add repository address normalisation
2019-10-02 11:38:38 +02:00
Michael Hackstein ccb2a3c62e Fixed invalid log ids 2019-10-02 10:26:38 +02:00
Markus Pfeiffer fc634a2fa0 Replace template <bool blockPassthrough> (#10127)
* Replace template <bool blockPassthrough>

by template <BlockPassthrough blockPassthrough> where BlockPassthrough is an
enum class.

This is mainly for better readability and for some type safety.

* Fixup some implicit conversions to bool
2019-10-02 09:47:09 +02:00
Jan c28f571b65
use malloc/realloc/free (#10119) 2019-10-01 19:47:02 +02:00
Jan c3423c7db0
Bug fix/disallow sharding on rev (#10123) 2019-10-01 19:42:55 +02:00
Jan 9898606223 fix logIds (#10135) 2019-10-01 20:19:38 +03:00
Dan Larkin-York c0f63856c2 Fix Windows compile error from network namespace. (#10133) 2019-10-01 18:47:00 +02:00
Wilfried Goesgens 2b743e0e61 Bug fix/speedup tests (#10109) 2019-10-01 18:23:00 +02:00
Kaveh Vahedipour a0be102d2c unitended multiple unlocks (#10114) 2019-10-01 16:21:44 +02:00
Max Neunhöffer 9b3f911cb5
Use execvp instead of execv and handle error. (#10102)
* Use execvp instead of execv and handle error.
* CHANGELOG.
2019-10-01 16:19:47 +02:00
Max Neunhöffer fb8bc4bc31
Fix a subtle special case of the shutdown hanger. (#10120)
* Another shutdown problem with CollectionKeysRepository.
2019-10-01 16:11:33 +02:00
Max Neunhöffer ca9affc798
Add backup sizes. (#10104)
* Single server backup size in META and create.
* More size info in backup.
* Finish size and nrfiles for create and list.
* Add nrDBServers and potentiallyInconsistent to BackupMeta.
* Fix API documentation.
* Make Windows compiler happier.
* One more fix for Windows.
* Added creation date.
2019-10-01 13:31:17 +02:00
Simon 9040f1d18a Fuerte + Pregel + Agency = 🥑 (#10110) 2019-10-01 11:19:18 +02:00
Michael Hackstein c6af396188 Make SubqueryEndExecutor compile again on all platforms again 2019-09-30 17:11:05 +02:00
Jan 1d84dd861d
use setUpAll and tearDownAll to reduce test durations (#10107) 2019-09-30 17:05:20 +02:00
Markus Pfeiffer 32884568cb Feature/subquery end node executor (#10087)
* Add Start/End subquery node skeleton

* Added a test query that triggers complex interna in the future and needs to proof that our work is side-effect free.

* Added first draft of ShadowRow Interface

* Refactored RegisterPlan and pulled it out of the ExecutionNode

* AqlItemBlock now has an additional hidden register to store subquery depth infromation. Right now no shadow rows are created, however thy could now make use of this situation

* Added API and test to insert new shadow rows into an OutputRow.

* Extrated test helper function

* Add template function to statically assert size of type

* Add Start/End subquery node skeleton

* Add Start/End subquery node creation to ExecutionNode

* Cleanup SubqueryEndNode

* Add test file

* Add isEqualTo to ExecutionNode

* Subquery nodes cleanup

* Update ExecutionNode tests

* Added API and tests to consume ShadowRows. Interface is there and compiles with templates, we might need to implement further underlying functions later on as we make progress on ShadowRows, it is only implemented in the minimal way (intentionally)

* Updates to testing code

* Added a test for nested ShadowRows and adapted OutputRow accordingly.

* More updates

* Add optimizer rule

* Fix optimizer rule

* Added additional memory include, seems to be required under GCC not udner CLANG

* it actually helps to save fies before commiting them...

* Fix optimizer rule (again)

* Fixed serialization/Deserialization of AqlItemBlock to contain the hidden subquery register now

* Added a c++ test for AqlItemBlock. It just covers the basics thus far and needs to be improved.

* Fixed toVPack of AqlInputRow for subqueries. Also added serialization / deserialization tests for AqlItemRow

* Added a c++ test for inputAqlItem row serialization => AqlItemBlock deserialization

* Add a public function to get plan from query

* Fix register planning

* Add test for splicing subquery nodes

* add static asserts for sizes of SubqueryStartNode and SubqueryEndNode

* Add comment about statically asserted size

* Fix isEqualTo virtual and override dance.

* Attempt to fix :windows: compile warning

* Fix isEqualTo, remove static_assert_size

* Remove a TODO; the plan owns the ExecutionNodes

* Only add stealPlan to Query when testing

* Remove another static_assert_size

* Fixed mac compile issues

* Added a serialization format to be backwards compatible to 3.5 whenever AQL item blocks need to be send over to remote nodes.

* Handle ShadowAqlItemRow in SingleRowFetcher

* Move some code from header to cpp

* Added more tests for serialization of shadow rows, and fixed a bug revealed by this

* Apply suggestions from code review

Thank you for review!

Co-Authored-By: Tobias Gödderz <tobias@arangodb.com>

* Review comments. Thanks for spotting

* Fixed hidden merge conflicts

* Removed unused variable

* Added first test on ShadowRows in SingleRowFetcher. Found inconvenience in original code with it.

* Added a test for multi level shadow rows

* Added a test and fixed production for multiple consecutirve shadow rows.

* Added tests for pass through blocks and shadow rows

* Attempt to explain windows on how one can actually cast numbers into other number types...

* Add SubqueryEndExecutor

* Adapted RowFetcherHelper to be able to work on ShadowRows

* Fixed minor error in RowFetcherHelper that causes LIMIT tests to error

* Temporarily disabled test suites (sorry there is only one 'test case' in this suites that does all or nothing tests ...) as it tests a feature we cannot support in this intermediate state, we need to default disable our new rule first.

* IMplemented missing function to copy over SubqueryDepth between blocks

* Seperated assert, to see faster which part is violated

* Update arangod/Aql/AqlItemBlockSerializationFormat.h

Co-Authored-By: Tobias Gödderz <tobias@arangodb.com>

* Disabled subquery splice rule by default

* Forgotten merge marker

* temporarily modified test

* Some Subquery End Executor work

* Fix RowFetcherHelper to work with ShadowRows

* Add tests for SubqueryEndExecutor

* Rewrite SubqueryEndExecutor

* Update test

* Add createBlock code for SubqueryEndExecutionNode

* Some fixups adding ExecutionBlockImpl for SubqueryEndExecutor

* Fix SubqueryEndExecutor

* Update SubqueryEndExecutorTest

* Update endexecutor test

* Fix the endnode executor once more

* Fix some merge fallout

* Update test

* Add missing advanceRow to SubqueryEndExecutor

* SubqueryEndExecutor Tests

* Activate a death test

* Better handling of death test

* RowFetcherTest refactoring Part 1, still ongoing. We use this for AqlItemMatrix and SingleRowFetcher

* Update and cleanup the SubqueryEndExecutor tests

* Check that expected shadow row depths are met

* Remove commented out code in AqlItemBlock.cpp

* Remove a misplaced comment

* Sort out SubqueryEndExecutor includes

* Remove superflous include

* Consistently use NoStats{} in SubqueryEndExecutor

* Make SubqueryEndExecutor properties constexpr

* Reactivate IResearchTests

* Do not copy the accumulator in SubqueryEndNode

* Return a more sensible value for expectedNumberOfRows of SubqueryEndNodeExecutor

* Constify an argument

* Fix ownership problems with the buffer for _accumulator

* Cleanup SubqueryEndExecutor tests

Also add a test that writes to a register other than 0

* Patch RowFetcherHelper to count the number of Items returned instead of number
of calls

* Make MSVC happy
2019-09-30 15:24:13 +02:00
Dan Larkin-York 1d7225b289 Pass connection pool directly to network methods. (#10096) 2019-09-30 12:44:47 +02:00