1
0
Fork 0
Commit Graph

643 Commits

Author SHA1 Message Date
Jan 9b5d75071d make replication timeouts configurable via startup options (#10472)
* make replication timeouts configurable via startup options

The following options are available (for active failover
and master-slave replication):

    --replication.connect-timeout
    --replication.request-timeout

Values can be specified in seconds. If these options are used, they will
be used for replication requests, overriding any hard-coded defaults or
explicitly configured timeouts.

Additionally, this change increases the default request timeout
for replication from 10 minutes to 20 minutes.

* do *not* change timeouts

* make tests work again
2019-11-19 19:45:40 +03:00
Jan 69747bc86f Bug fix 3.4/disallow subqueries in prune (#10266)
* backport of #10231

* added derived files
2019-10-16 19:19:57 +03:00
Iurii Popov 3e7879600d Bug fix 3.4/issue #10090 (#10211)
* Fixed repeatable seek to the same document (#10164)

* Fixed repeatable seek to the same document

* Fix. Multiple conjuncts in conjunction.

* Add tests for issue #10090 (#10203)

* Add tests for issue #10090

* Remove spaces

* Added CHANGELOG for the issue #10090.

* Fixed doc_limits error

* Fixed approx_ error
2019-10-10 18:27:49 +03:00
Jan 6bbcb1c934 fixed issue #10193 (#10196) 2019-10-09 16:39:57 +03:00
Jan b4e56f4285 Bug fix 3.4/fix parsing unterminated strings (#10157)
* fix parsing of unterminated string literals

* added CHANGELOG entry

* added generated file
2019-10-09 16:35:29 +03:00
Jan 4477bd1ed1 Bug fix 3.4/issue 10078 (#10083)
* fixed issue #10078: FULLTEXT with sort on same field not working

* added test

* simplify the implementation
2019-09-27 16:59:42 +03:00
Jan e502feeea6 fixed issue #10062: AQL: Could not extract custom attribute (#10066) 2019-09-27 16:58:58 +03:00
Tobias Gödderz dc2e27db6c [3.4] Feature/rebootid notice changes, backport of #9523 (#9685)
* Feature/rebootid notice changes, backport of #9523

* Move to 3.4 and C++11-compatible code (except for test code)

* Backported tests/Mocks/Servers.{h,cpp}

* Rebuilt errorfiles

* Ported CallbackGuardTest from gtest to catch

* Ported RebootTrackerTest from gtest to catch

* Make sure the state method is called, so the overridden method is used during tests

* Fixed test to work with the old scheduler

* release version 3.4.8

* [3.4] fix agency lockup when removing 404-ed callbacks (#9839)

* Update arangod/Cluster/ServerState.cpp

Co-Authored-By: Markus Pfeiffer <markuspf@users.noreply.github.com>

* Instantiate the scheduler during ::prepare()

* Fix test crash introduced during backport

* Fix a compile error on Windows (thanks, V8)
2019-09-19 15:03:39 +03:00
Tobias Gödderz 78fad805b5 [3.4] Bug fix 3.4/allow agency ops in active failover (#9960)
* Backported #9881

* Fixed changelog

* Fixed merge
2019-09-19 11:45:49 +03:00
KVS85 227a92dd3a
Fix jslint 2019-09-12 22:27:35 +03:00
KVS85 3b8b727d0e Add more stability to moving-shards-cluster.js 2019-09-12 18:34:08 +02:00
Frank Celler d1de4e9d28 fixed wrong defines 2019-09-12 14:51:33 +02:00
Heiko 4298098f56 Bug fix 3.4/arangosh gharial vertex deletion (#9927)
* typo in route

* unused function removed

* merge

* changelog

* removed fail, removed print
2019-09-11 13:00:42 +03:00
Dronplane ccfa517178 Bug fix 3.4/internal issue #633 (#9916)
* Ported fix for internal issue #633

* fixed indentation

* Another indent fixed

* Update CHANGELOG
2019-09-11 12:58:24 +03:00
Jan 34481860a9 cover more cases of "unique constraint violated" issues during replication (#9828)
* release version 3.4.8

* cover more cases of "unique constraint violated" issues during
replication

* add more testing
2019-09-11 12:48:08 +03:00
Tobias Gödderz 4ada35f20c [3.4] Bug fix 3.4/add shard id to replication client identifier (#9466)
* Bug fix/add shard id to replication client identifier (#9366)

* Fixed compile (but not linker) errors

* Backported ReplicationClientProgressTracker

* Fixed compile errors, fixed hash function

* No longer use SyncerId for real asynchronous replication

* Updated docu

* Try to fix compile error on windows

* Fixed a bug

* Removed old code

* Fixed CHANGELOG entry
2019-09-11 12:45:57 +03:00
Jan ea5106ff60 Bug fix 3.4/babies unknown shard (#9872)
* release version 3.4.8

* [3.4] fix agency lockup when removing 404-ed callbacks (#9839)

* fix non-deterministic occurrences of "document not found" in sharded
collections with custom sharding and multi-document lookup

* updated CHANGELOG

* fix error code handling

* Update CHANGELOG
2019-09-03 23:58:14 +03:00
Dan Larkin-York 4a0383849f [3.4] Minimize unnecessary dropping of followers due to poorly set synchronous replication timeouts (#9811)
* Minimize unnecessary dropping of followers due to poorly set synchronous replication timeouts.

* Add changelog entry.

* Add setIntroducedIn version.
2019-08-27 11:45:37 +03:00
Dronplane 12ec3f63d1 Bug fix 3.4/issue #9795 (#9807) 2019-08-27 10:32:36 +02:00
Lars Maier 6f4eb0e89f [3.4] Move Shard Bug 4567124 (#9741)
* Fixed abort in moveshard in the case new leader is not in Current.
* Updated Changelog.
* Fixed special case if to server is follower.
2019-08-20 11:39:45 +02:00
Lars Maier 562ee69ca4 [3.4] Backported TakeoverLeadership action. (#9732)
* Backported TakeoverLeadership action.
* Fix a LOG_DEVEL.
2019-08-16 17:31:02 +02:00
Max Neunhöffer 6720427b72
Fix an agency bug found in Windows tests. (#9729)
* Fix agency bug found in Windows tests.
* CHANGELOG.
2019-08-16 12:16:11 +02:00
Kaveh Vahedipour 5c8aee1b67 Bug fix 3.4/node corrections (#9417)
* op:set should have new, some operators should not create non existing keys
* this is the proper direction
* observe/unobserve have no business in Node
* normalization of URI
* agency test added for observe / unobserve
* more tests
* Fixed catch tests.
2019-08-13 15:15:45 +02:00
Lars Maier 6b04e3de03 Ported ResignLeadership to 3.4 (#9669)
* Ported ResignLeadership to 3.5

* Added http route.
2019-08-09 16:41:13 +02:00
Dronplane 592063c503 Bug fix 3.4/data loss in view (#9658)
* Added full index iterator utilization in case of some documents was not found in collection

* Added index operations reversal in case of insertion failure in rocksdb

* Removed singleop optimization as rollback possible even for such operations (in case of index operation failure on insert)

* Added tests for insert rollback in views

* Added catch tests for view block

* Added changelog entry

* fixed jslint errors

* fixed linux build

* Added test for update

* Fix CHANGELOG sequence

* Add line

* Added reverts for update and remove failures

* Cleanup in test. Added throwing error in case of failed reversal

* fixed typo

Co-Authored-By: Simran <Simran-B@users.noreply.github.com>

* fixed build

* Applied review comments

* Applied review comments
2019-08-09 17:30:17 +03:00
Lars Maier 508abc311e Fail the FailedLeader Job if the new leader fails. (3.4 port) (#9640) 2019-08-09 14:00:55 +02:00
Jan ab847839df
Bug fix 3.4/reduce arangosearch rwlock waits (#9622) 2019-08-02 14:26:17 +02:00
Jan d64ad7ac0b
attempt to fix load_balancing tests in slow test environments (#9627) 2019-08-02 14:18:50 +02:00
Jan Christoph Uhde 6211a5fc4f nested collect backport 3.4 (#9590)
* stop optimization for nested collects (#9484)

* Update CHANGELOG
2019-07-29 19:42:50 +03:00
Wilfried Goesgens 8169df9a05 do away with fancy exit codes, they don't work reliable (#9580) 2019-07-29 17:11:12 +02:00
Wilfried Goesgens 19887387d1 Feature 3.4/add js isolate mem statistics (#9570) 2019-07-26 17:51:53 +02:00
Jan 51921c4129
fixed a bug in RTRIM implementation, fixed issue #9558 (#9564) 2019-07-25 13:04:21 +02:00
Matthew Von-Maszewski 015f59f0b9
Feature 3.4: Use ManagedDirectory class to add gzip and encryption to import/export (#9472)
* preview code I dropped on jackie today.  only supports document collections.

* saving work in progress

* update arangoexport to fully use ManagedDirectory object (arangoimport still needs work).

* migrate remainder of import to using ManagedDirectory objects

* correct spelling within activateEncryption(): encription to encryption

* forgot to fix up graphExport for managed directory.  luckily unittest noticed.

* add test read of gzip json file

* add readGzip to our fs object

* add TRI_SlurpGzipFile function

* add code to bridge javascript fs.readGzip to TRI_SlurpGzipFile

* correct the return type used by JS_ReadGzip

* add gzip test for jsonl type export

* add remain gzip versions of existing export tests

* add import tests of gzip files

* activate encryption in enterprise to enable fs.readDecrypt()

* bug fix: allow encryption to enable in empty directory if EncryptionFeature active.

* add JS_ReadDecrypt to enterprise build.  Current used for unit tests.

* enterprise build needs EncryptionFeature added to build to support TRI_SlurpDecryptFile()

* add TRI_SlurpDecryptFile() to aid in unit test of encrypted stuff

* missing newline at end of file.

* add fs.readDecrypt when available

* add test of encrypted json array export

* correct progress meter when gzip involved

* move from using ManagedDirectory::File to ManagedDirectory::readableFile calls

* create version of readableFile that uses file descriptor as param
2019-07-23 14:58:34 -04:00
Max Neunhöffer 75f0a63549
Various error reporting fixes plus Maintenance Current fix. (#9398)
* Cleanup new logging.
* Hand on error message from getLocalCollections.
* Better behaviour if a database was announce but has vanished since.
* Fix catch tests.
* Switch on maintenance debugging output.
* Fix maintenance reporting bugs.
* CHANGELOG.
* No error if follower cannot be dropped.
* Improvement to avoid copying.
* Add preconditions to FollowerInfo agency operations.
* Adjust timeouts.
* Use isEqualString instead of compareString.
* Fix Windows compilation.
2019-07-05 13:38:44 +02:00
Jan c655a89db6
make sure all errors are prefixed with ERROR_ @fceller @kvs85 (#9383) 2019-07-02 18:06:52 +02:00
Lars Maier 8bd34fd1e3 [3.4]Precs to check if collection exists (#9283)
* Adding preconditions for jobs to check that the collection still exists.

* Make it compile.

* Fixed tests.
2019-07-01 13:26:01 +02:00
Wilfried Goesgens 1be89f8ce7 Bug fix 3.4/fix snappy dependency chain (#9316)
* fix snappy build dependencies

* fix snowball invocation and dependencies (#9275)
2019-06-25 11:20:18 +02:00
Heiko 5d5eb23e7f Bug fix/gharial 3 4 edge from and tos verification (#9263)
* attempt to apply PR: pull/#9177

* changelog
2019-06-21 14:43:43 +02:00
Jan 0c62f96cee
fix failing agency test (#9238) 2019-06-08 23:24:31 +02:00
Kaveh Vahedipour a46fc0690b fix agency's ttl handling in object assignments (#9180) 2019-06-08 22:23:05 +02:00
Jan 2de2d92054
remove archived RocksDB WAL files on agent servers (#9230) 2019-06-08 19:40:07 +02:00
jsteemann c20a5f5ec2 Revert "add limits test (#9197)"
This reverts commit 9c123a638c.
2019-06-08 15:51:27 +02:00
Max Neunhöffer 68926032d0
Fix yet another agency test with clientid. (#9159) 2019-06-07 10:31:03 +02:00
Jan Christoph Uhde 9c123a638c add limits test (#9197) 2019-06-06 12:07:49 +02:00
Jan Christoph Uhde 19190dc963 add shardKeyAttribute to pregel start parameters (#9157) 2019-06-05 14:27:26 +02:00
Jan 81686eebb9
fix handling of comments in ini files (#9170) 2019-06-04 14:47:02 +02:00
Tobias Gödderz a25c0fa1b0 [3.4] Wait for replication before inserting (#9153)
* Increased timeouts, added a little more helpful error messages for assertions (#9135)

* Wait for replication before inserting documents

Un-greylist repair-distribute-shards-like-spec
2019-05-31 18:41:23 +03:00
Kaveh Vahedipour 75f0a51d67 [3.4] fix clientid register in state (#9065)
* fix flientid register in state

* remove the log erase locations

* iterator check

* also clear considered

* emplaces also handled

* don't add if clientId empty

* move semantics for log_t

* forward log_t into deque. bail out also as follower, when log_t cannot be emplaced

* whitespaces

* change log

* fix agency test for leadership change during long transactions with clientId

* log_t was as good as it gets

* white spaces

* add clientIds the inc/dec test

* client id for inc/dec test

* Fix a typo in a message.

* Add a comment for better readability.

* Fix agency test.

* Take debugging out.

* Activate another old agency test.

* Fix client id.

* Consistent behaviour across branches.
2019-05-29 21:43:45 +02:00
Simon 87977d1228 Pregel segmented buffers (#9109) 2019-05-28 18:21:56 +02:00
jsteemann 82eb569738 fix jslint warning 2019-05-27 17:58:47 +02:00