1
0
Fork 0
Commit Graph

17424 Commits

Author SHA1 Message Date
Tobias Gödderz 6f16c3deef [3.5] Make AQL's constrained heap play nice with fullCount (#10007)
* Make AQL's constrained heap play nice with fullCount (#9981)

* Update CHANGELOG
2019-09-13 12:28:28 +03:00
Jan c9de78c7c5 backport bugfixes from this week (#9985)
* backport bugfixes from this week

* use steady_clock, after 2 votes for it
2019-09-12 17:35:57 +03:00
Jan 8830aad557 Bug fix 3.5/allow not like (#9991)
* allow NOT LIKE, NOT =~ and !~ in grammar

* updated CHANGELOG

* added derive files
2019-09-12 16:59:40 +03:00
Jan c7b0e68026 disable the creation of TTL indexes on sub-attributes (#9995)
* disable the creation of TTL indexes on sub-attributes

* updated CHANGELOG
2019-09-12 16:42:56 +03:00
Frank Celler 393ffba276 fixed wrong defines 2019-09-12 14:46:23 +02:00
Heiko 86a35e93b6 always create statistics collections & indices & fishbowl (#9967)
* Squashed commit of feature-3.5/hotbackup_devel.

This puts hotbackup into 3.5.

* Port atomic-database-creation-2 to 3.5.

* Remove some wrongly ported code.

* Fix compilation.

* Fix a manual merge error.

* Remove a feature from the mocks which does not exist in 3.5.

* Add some code which was forgotten in manual merge.

* Fix a problem introduced in a manual merge.

* reuse function

* Address some whitespace issues that came up in review

* aardvark should not create the frontend collection

* create _frontend collection from c++

* recheckAndUpdate Callback in CollectionWatcher

* Wrong author ;)

* rm outdated todo

* Update lib/Basics/VelocyPackHelper.h

Co-Authored-By: Michael Hackstein <michael@arangodb.com>

* use logger unique id, use startup logger

* not needed

* optimized vector shardid method

* do not create _modules collection lazy anymre

* Formatting.

* Assert instead of if/TRI_ASSERT(false)

* Don't use exceptions as control structure

* Re-add READ_LOCKER that got lost in translation

* Fix audit log in case database creation fails early.

* legacy sharding

* Add CHANGELOG entry.

* Retry database cancellation indefinitely

* Do not use exceptions in UpgradeTask

* DropCollection is a FAST_LANE action and should not need much time or else retry.

* Remove superflous addition of LdapFeature

Proudly brought to you by ASAN tests

* Fixed check for distributShardsLike sharding on _system database

* Fixed compile issue on tests

* Removed assertion that seems to be not correct yet on devel.

* Sort out google cloud storage as remote. (#9918)

* Add successful method to ClusterCommResult.
* Improve error forwarding for cluster internal communication.

* Feature/hotbackup list retries (#9924)

* retry hot backup listing for 2 minutes in cluster before giving up

* Enable api by default.

* always create statistics collections & indices & fishbowl

* fix broken list of non existing id (#9957)

* Fix compilation after manual merge.

* Fix another compilation problem.

* Yet more fixes for compilation.

* More compilation fixes.

* Removed forgotten, illegal if.

* Removed obsolete include
2019-09-11 13:54:59 +03:00
Max Neunhöffer 328f46e3d6 This merges hotbackup and atomic-db-creation into 3.5. (#9968)
* Squashed commit of feature-3.5/hotbackup_devel.

This puts hotbackup into 3.5.

* Port atomic-database-creation-2 to 3.5.

* Remove some wrongly ported code.

* Fix compilation.

* Fix a manual merge error.

* Remove a feature from the mocks which does not exist in 3.5.

* Add some code which was forgotten in manual merge.

* Fix a problem introduced in a manual merge.

* reuse function

* Address some whitespace issues that came up in review

* aardvark should not create the frontend collection

* create _frontend collection from c++

* recheckAndUpdate Callback in CollectionWatcher

* Wrong author ;)

* rm outdated todo

* Update lib/Basics/VelocyPackHelper.h

Co-Authored-By: Michael Hackstein <michael@arangodb.com>

* use logger unique id, use startup logger

* not needed

* optimized vector shardid method

* do not create _modules collection lazy anymre

* Formatting.

* Assert instead of if/TRI_ASSERT(false)

* Don't use exceptions as control structure

* Re-add READ_LOCKER that got lost in translation

* Fix audit log in case database creation fails early.

* legacy sharding

* Add CHANGELOG entry.

* Retry database cancellation indefinitely

* Do not use exceptions in UpgradeTask

* DropCollection is a FAST_LANE action and should not need much time or else retry.

* Remove superflous addition of LdapFeature

Proudly brought to you by ASAN tests

* Fixed check for distributShardsLike sharding on _system database

* Fixed compile issue on tests

* Removed assertion that seems to be not correct yet on devel.

* Sort out google cloud storage as remote. (#9918)

* Add successful method to ClusterCommResult.
* Improve error forwarding for cluster internal communication.

* Feature/hotbackup list retries (#9924)

* retry hot backup listing for 2 minutes in cluster before giving up

* Enable api by default.

* fix broken list of non existing id (#9957)

* Fix compilation after manual merge.

* Fix another compilation problem.

* Yet more fixes for compilation.

* More compilation fixes.
2019-09-11 13:13:54 +03:00
Michael Hackstein 9e76d995d0 Fixed and enabled an accidentially disabled assertion (#9970) 2019-09-11 10:10:48 +03:00
Jan 068d422d59 Bug fix 3.5/fix transaction errors (#9928)
* don't make index selectivity estimate requests fail inside cluster
transactions

* improve logging, and don't make transactions more robust

don't make transaction operations fail immediately if they cannot
acquire the transaction lock instantly. it is somewhat expected that
sometimes the garbage collection comes in-between and acquires locks
for a short amount of time - this should not lead to failures in
other operations on the transaction

* fix a race for transaction leases

* fix test failure

* moved functionality into shutdownExecute
2019-09-09 21:37:46 +03:00
Jan 949f85497c improve handling of FILTERs with constant expressions (#9942) 2019-09-09 21:35:35 +03:00
Jan ecd45a802a Harden database creation against spurious "duplicate name" errors (#9950)
that were caused by other parallel operations lazily creating required
system collections in the same database.
2019-09-09 21:34:17 +03:00
Jan 4feb615de7 handle K_SHORTEST_PATHS where it was forgotten (#9955) 2019-09-09 21:32:58 +03:00
Jan 1d92a22f76 make smart graphs transaction-aware (#9911)
* make smart graphs transaction-aware

* more debugging, fix test failure
2019-09-06 20:31:49 +03:00
Jan 7eb000fe98 avoid lookup plus sequent insert/emplace for the fast path (#9904)
* avoid lookup plus sequent insert/emplace for the fast path

additionally add transaction id and more location information to
error messages which were previously undistinguishable

* Revert "avoid lookup plus sequent insert/emplace for the fast path"

This reverts commit 11b27c338940a9fc203dbdb35713845c407a902d.

* revert most stuff, only leave improved logging there
2019-09-05 20:07:37 +03:00
Dronplane 85814c05f1 Bug fix 3.5/internal issue #633 (#9902)
* Fix for internal issue #633 (#9884)

* Made ANALYZER BOOST and MIN_MATCH non deterministic to prevent premature calls

* Returned Deterministic flag. Added context function implementation for cons arguments calls.

* Fixed filter volatility detection

* Added assertion

* Fixed formatting.  Removed redundant checks.

* Applied review suggestion

Co-Authored-By: Jan <jsteemann@users.noreply.github.com>

* Added CHANGELOG record

* Update CHANGELOG
2019-09-05 12:21:29 +03:00
Jan ac221ae1b8 fix audit test (#9887)
* fix audit test

* fix compile error in community version

* try to harden view test
2019-09-04 19:24:25 +03:00
Kaveh Vahedipour 8e04c84380 [3.5] drop collection action timeout (#9894)
* DropCollection is a FAST_LANE action and should not need much time or else retry.

* DropCollection is a FAST_LANE action and should not need much time or else retry.

* Update CHANGELOG
2019-09-04 18:52:29 +03:00
Jan 2fe0527d25 check for duplicate server endpoints on cluster startup (#9863)
* check for duplicate server endpoints on cluster startup

* Update arangod/Cluster/ServerState.cpp
2019-09-03 11:49:08 +03:00
Jan f8c156a44f make graphs transaction-aware (#9855)
* make graphs transaction-aware

* simranification

* fix tests with mmfiles
2019-09-02 22:06:10 +03:00
Kaveh Vahedipour 10d99b20cb url should be deleted not path (#9882) 2019-09-02 16:41:33 +03:00
Jan 479e2ab5da don't issue a warning when transaction log iterator reports more data (#9869) 2019-09-02 11:29:00 +03:00
Jan 480f0e799a Bug fix 3.5/babies unknown shard (#9871)
* fixing cluster

* added tests for baby operations with custom sharding

* added errorMessage for UX

* updated CHANGELOG

* updated CHANGELOG

* fix error code handling
2019-09-02 10:58:25 +03:00
Jan ad1e5d2e51 fixed issue #9862 (#9865) 2019-08-30 19:31:55 +03:00
Heiko e40d7fadd1 Bug fix 3.5/graph create orphan collection properly (#9842)
* added ensureCollections to orphan create method

* do not move anymore

* rm trx finish. will be handled automatically in error case

* changelog
2019-08-30 13:55:08 +03:00
Jan 2123fceb7a cover more cases of "unique constraint violated" issues during replication (#9829)
* cover more cases of "unique constraint violated" issues during
replication

* add more testing

* fix compile error
2019-08-30 12:42:58 +03:00
Jan d2efc6cea8 fix return value when reboot id cannot be retrieved (#9858) 2019-08-30 12:26:00 +03:00
Max Neunhöffer 0599a1c79c
Fix unneeded return code. (#9853) 2019-08-30 08:44:07 +02:00
Kaveh Vahedipour 139c5d3839 [3.5] agency lockup when removing 404ed callbacks and leadership preparation (#9846)
* queue the write
* finishing 3.5
* commenting
2019-08-29 14:32:48 +02:00
Dronplane 1eef617a07 Fixed issue #9795 Fixed NOT IN clause in ArangoSearch (#9836)
* Fixed issue #9795 Fixed NOT IN clause in ArangoSearch

* Update CHANGELOG
2019-08-28 18:38:02 +03:00
Dan Larkin-York 7aea108197 [3.5] Minimize unnecessary dropping of followers due to poorly set synchronous replication timeouts (#9810)
* Minimize unnecessary dropping of followers due to poorly set synchronous replication timeouts.

* Add changelog entry.

* Add setIntroducedIn versions.
2019-08-28 14:07:33 +03:00
Jan 226373e200 Bug fix 3.5/fix in not in workaround (#9814)
* remove hack for NOT IN

* added parsing test

* added derived files

* added CHANGELOG entry
2019-08-28 14:04:24 +03:00
Jan bc1df0e78d adjust log level for "closing stream" message (#9815) 2019-08-27 16:51:25 +03:00
Frank Celler 35e307934c use LDAP_PATH instead of fixed one (#9812) 2019-08-27 10:20:56 +02:00
Jan Christoph Uhde 44ab3f04b5 3.5 -- intermediate commit stats (#9780)
* count intermediate commits

add transactions statistics struct

add tests

put values in object / split test is multiple smaller tests

* fix broken condition

* fix test

* remove print

* fix windows build

* fix mmfiles

* fix cluster

* add structs in docublocks

* we do not know about intermediate commits on coordinators

* add documentation

* add isCluster function

* add serverStatistics to 3.5 client

* update documentation
2019-08-26 16:56:21 +03:00
Jan 6d53c1e02f Feature 3.5/curl 7.65.3 (#9790)
* upgrade curl to 7.65.3

* re-add modifications to curl

* remove curl 7.63.0

* update LICENSES file

* fix error handling
2019-08-26 15:54:42 +03:00
Jan 4a749a66b3 Bug fix 3.5/multi bugs (#9792)
* add missing whitespace to make error message readable

* try to continue running scheduler threads even when there are exceptions

* give up trying to persist follower info in agency for already dropped collections.

* updated CHANGELOG
2019-08-26 15:51:14 +03:00
Jan 3c5b755d35 remove now-obsolete warning (#9802) 2019-08-26 14:26:56 +03:00
Dan Larkin-York a9dced45ee Add user restrictions for streaming transactions. (#9796) 2019-08-23 19:51:59 +03:00
Kaveh Vahedipour 09d2745625 [3.5] clean up your crap, dbservers. alright, i'll do it. (#9722)
* clean up your crap, dbservers. alright, i'll do it.

* ts ts ts

* body is shared_ptr

* Update CHANGELOG

* revert callback bodies to API specification

* array needs be inside so that multiple unobserves to same key are possible
2019-08-22 14:26:44 +03:00
Dronplane 5bee042b65 Bug fix 3.5/internal issue #622 (#9787)
* Bug fix/internal issue #622 (#9781)

* Added analyzer cache invalidation for dropped database

* Fixed jslint reported errors

* Update CHANGELOG
2019-08-22 14:25:14 +03:00
Jan 3592af0b79 Bug fix 3.5/mark fulltext near etc as cacheable (#9772)
* mark AQL functions FULLTEXT, NEAR, WITHIN, WITHIN_RECTANGLE as cacheable

* updated CHANGELOG
2019-08-21 19:08:15 +03:00
Dronplane 2c72655dd5 Bug fix 3.5/issue #9612 (#9778)
* Bug fix/issue #9612 (#9764)

* Fixed ViewExecutionNode retrieval with deleted documents present in view

* Ported solution from 3.4 branch

* Changed index store in collection from vector to set. To make reversable indexes always last to execute

* Fixed re-enter hung

* Index storage fix

* Made index order deterministic

* Fix Mac build

* Added tests for index reversal

* Fixed Mac build

* Code cleanup

* Some cleanup

* Removed some redundand copy constructor calls

* Applied review comments

* Applied review comments

* Update CHANGELOG

* Update CHANGELOG
2019-08-21 17:59:59 +03:00
Andrey Abramov 35e2ebc729 bug-fix/internal-issue-#591 (#9639) (#9779)
* update iresearch

* update iresearch

* fix compilation errors

* update iresearch
2019-08-21 17:55:24 +03:00
Jan 5a20828210 fix potential spurious wakeups in scheduler code (#9777)
* fix potential spurious wakeups in scheduler code

* added CHANGELOG entry
2019-08-21 13:10:05 +03:00
Jan 70c31da560 port change from devel by @danielhlarkin (#9773) 2019-08-21 13:07:43 +03:00
Simon bd5df4d49e Enforce stricter transaction limits (#9740) (#9775)
* Enforce stricter transaction limits (#9740)

* changelog

* make CHANGELOG entry more verbose
2019-08-21 13:07:17 +03:00
Dan Larkin-York 663212ba19 [3.5] Check scheduler queue return value (#9759)
* Add to cmake.

* Backport changes from devel.

* added CHANGELOG entry, port adjustments from devel
2019-08-20 12:57:51 +03:00
Jan 3dcc293224 make index selection more deterministic (#9736)
* make index selection more deterministic

* updated CHANGELOG

* serialize indexes used by traversal with their estimates

* serialize selectivity estimates for shortest path nodes too

* fix assertion that doesn't hold true in unit tests

* fix test
2019-08-20 12:55:21 +03:00
Jan 0f03655ce3 issue #9654: make `--rocksdb.max-write-buffer-number` work (#9751)
* issue #9654: make `--rocksdb.max-write-buffer-number` work

* fix the logic
2019-08-20 12:54:24 +03:00
Lars Maier 87ae6165d7 [3.5] Move Shard Bug 4567124 (#9747)
* Fixed abort in moveshard in the case new leader is not in Current.

* Fixed special case + updated changelog.

* Update CHANGELOG
2019-08-19 19:23:12 +03:00