1
0
Fork 0
Commit Graph

4054 Commits

Author SHA1 Message Date
Jan 00ac1db850
add RocksDB options `--rocksdb.allow-fallocate` and `--rocksdb.limit-open-files-at-startup` (#8493) 2019-03-21 14:21:35 +01:00
Jan 6d107beeda
don't run compact() on a collection after a truncate() was done in th… (#8468)
* don't run compact() on a collection after a truncate() was done in the same transaction

running compact() in the same transaction will only increase the data size on disk due to RocksDB not being able to remove
any documents physically due to the snapshot we take at transaction start.
Decoupling the truncate transaction from the compact operation allows finishing the truncate transaction first, so we can
get rid of the snapshot. Running compact afterwards is then free to physically remove all the data.
As a nice side effect this change will also speed up the truncation of larger collections, because the compact will run
faster.

This change also exposes db.<collection>.compact() in the arangosh, in order to manually run a compaction on the data
range of a collection should it be needed for maintenance.

* fix documentation anchors
2019-03-20 16:27:54 +01:00
Frank Celler ea9be71998 added --log.file-mode and --log.file-group (#8450) 2019-03-20 14:21:18 +01:00
Simran Brucherseifer 4c8cb6704d Doc - Fix cluster health indention 2019-03-20 12:53:40 +01:00
Simran e829d2e491
Add log level description under Monitoring (#8461) 2019-03-20 02:17:09 +01:00
Simran fe67f4f93c
Doc - Make cleanOutServer step mandatory in drain documentation (#8462) 2019-03-20 02:15:27 +01:00
Simran c6e80910e1
Doc - Fix Client Tools section in NewFeatures35.md (#8463) 2019-03-20 00:57:21 +01:00
Jan 2c4accdf34
micro improvements for rocksdb options (#8433) 2019-03-19 12:47:57 +01:00
Dan Larkin-York 2eadab33e7 Index hints (#8431) 2019-03-19 09:14:18 +01:00
Jan 5d527168d0
arangodump & arangorestore all databases (#8394) 2019-03-18 17:05:08 +01:00
Simran b211277870
Doc - Add v3.4 Active Failover known issues (#8400) 2019-03-13 23:18:49 +01:00
Simran f816597e84
Doc - Sync external repos 2019-03-13 (devel) (#8405) 2019-03-13 23:00:43 +01:00
Dan Larkin-York 413e90508f Named indices (#8370) 2019-03-13 18:20:32 +01:00
Jan a841d472be
emit a warning when connecting with the client tools to a DBSERVER (#8397) 2019-03-13 13:08:41 +01:00
Simran 6bf276405b
Doc - Add cross-refs & better AQL function descriptions (#8242) 2019-03-13 08:49:12 +01:00
Simran 80fab81db8
Doc - AQL UDFs: Manage on coordinator, improve warning (#8340) 2019-03-12 09:08:26 +01:00
Simran 3ded78c495
Doc - Fix ReplicationApplier.md hint box (#8372) 2019-03-11 16:36:06 +01:00
Simran 8891f79356
Doc - Fix/improve graph traversal/background indexing pages, console.history and examples/options (#8336) 2019-03-11 14:06:28 +01:00
Jan 12e11a5197
port of replication improvements from 3.4 (#8308) 2019-03-11 13:37:18 +01:00
Jan 4c6c61ca33
document `includeFoxxQueues` attribute and persist it (#8351) 2019-03-08 18:43:35 +01:00
Jan c82e0c2ca0
add option `--console.history` to arangosh (#8327) 2019-03-07 13:05:54 +01:00
Simran 915512647f
Doc - Fix typo in GettingStarted/QueryingTheDatabase.md 2019-03-07 01:50:10 +01:00
Vasiliy b1e30937bb issue 520.1.1: decrease link commit interval to 1 second, add workaround for MMFiles not recovering document insertions via WAL (#8313) 2019-03-05 14:50:54 +03:00
jsteemann 45dd94e60c Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2019-03-04 16:26:56 +01:00
jsteemann 6d751686e3 updated documentation 2019-03-04 16:26:46 +01:00
Simran 0a237fb10c
Doc - Rework AQL Data Types page (#8287) 2019-03-04 16:16:25 +01:00
Frank Celler 2329dd1ee2
Feature/data masking improvments (#8129) 2019-03-04 10:47:26 +01:00
Simran e7cdfaa2cb
Doc - Add missing deprecation note for traversal module (#8293) 2019-03-01 08:30:03 +01:00
sleto-it f7dec4eacb Doc - Azure Deployment: Make statement clearer (#8149) 2019-03-01 08:25:18 +01:00
Simran a41b13894e
Doc - Update Kubernetes (Tutorial/Drain) (#8295) 2019-02-28 22:06:52 +01:00
sleto-it 37c5c1239d
Doc - Fast Cluster Restore Procedure (#7756) 2019-02-27 16:29:51 +01:00
sleto-it ef03234331
Doc - Cluster Architecture Improvements (#7992) 2019-02-27 16:24:42 +01:00
sleto-it a76f21735a
Doc - AF improvements (#8237) 2019-02-27 14:42:14 +01:00
Michael Hackstein 6e8d43b2da
Feature/aql traversal prune (#8255)
Allow PRUNE in the AQL Traverser.
2019-02-27 11:43:06 +01:00
Heiko b6224c65bb Bug fix/geo optimization cleanup (#7637)
* docu geo

* cleanup, reuse of code

* Update Geo.md

Fix indention, improve links, fix description of GEO_MULTIPOLYGON() parameter.

* One array level can be omitted if the Polygon has no holes
2019-02-27 09:01:40 +01:00
Simran 3df86129e8 Doc - Use proper terms for editions (esp. shardingStrategy) (#8014) 2019-02-23 23:11:36 +01:00
Simran 9f5f2d7c92 Doc - Add RocksDB known issue to 3.3, 3.4 (#8247)
3.5.0 and higher will not be affected
2019-02-23 12:51:17 +01:00
Simran 7a75f37857 Doc - Improve hint boxes on page MigratingSingleInstanceCluster.md (#8241) 2019-02-23 11:53:02 +01:00
Jan d46acbb156
Bug fix/make ttl index work with datestrings too (#8208) 2019-02-22 16:09:51 +01:00
Simran c3f082db42 Doc - Windows Installation - Use code tags and env vars (#8232) 2019-02-21 23:43:56 +01:00
Dan Larkin-York cd54271af0 Add TTL to query options to standardize usage across components. (#8203) 2019-02-21 20:29:37 +01:00
sleto-it fcc1700d33
Doc - fix link 2019-02-21 20:05:32 +01:00
sleto-it 7afee85fad
Doc - New k8 drain page (#8228)
* tmp - integration preview only

* images

* Update Drain.md

* updates after merge in external repo
2019-02-21 19:10:45 +01:00
jsteemann 4bc8a6aa0d add V8 upgrade to new features 2019-02-20 13:03:44 +01:00
Jan 44c6a2d732
Feature/ttl index (#8169) 2019-02-19 14:12:21 +01:00
Simran 3a03daa771 Doc - Complete the highlights page (#7972) 2019-02-19 00:17:13 +01:00
sleto-it 43faa28d90
Doc - _rev warning (#8044) 2019-02-19 00:14:39 +01:00
Simran 8690d21522 Doc - Improve description of CHECK_DOCUMENT() AQL function (#8003) 2019-02-17 23:53:20 +01:00
Luigi Servini 7f0cab12d2 Doc - Added .insert part for document insertion (#8033) 2019-02-17 23:49:03 +01:00
Luigi Servini 3f2af07e78 Doc - Added default ttl for cursor (#8148) 2019-02-13 13:20:25 +01:00
sleto-it dce9e661e5
Doc - Cites Kubernetes in the upgrade guide (#8133) 2019-02-13 13:13:01 +01:00
Vasiliy 98b024d787 issue 466.6: remove unused code, remove hardcoded view meta values (#8130) 2019-02-11 16:32:04 +03:00
Tobias Gödderz 542435d43b Doc - Note that ArangoSearch views cannot be used as edge collections in traversals. (#8099) 2019-02-06 10:44:25 +01:00
sleto-it f1ddaeedf2
Doc - Production Checklist Improvements (#8110) 2019-02-06 10:42:04 +01:00
sleto-it 0337458461
Doc - More downgrade options (solving challenging situations) (#7988) 2019-02-05 00:48:33 +01:00
sleto-it 8a5db1c14d
Doc - fixes link (#8043) 2019-02-05 00:23:14 +01:00
Dan Larkin-York 2497173fb3 Adde missing documentation and CHANGELOG entries for sort-limit optimization. (#8087) 2019-02-01 15:31:42 +01:00
Simran 0f889d61bc Doc - Maskings - Forward port improvement from 3.3 (#8066) 2019-01-31 11:41:48 +01:00
sleto-it 7cbb97f5b4
Doc - Sync external repos (#8063) (#8067) 2019-01-30 20:20:56 +01:00
Frank Celler 603612f1d2
Feature/maskings documentation (#8018) 2019-01-30 12:01:49 +01:00
Simon fd70b6fc34 Background Indexing (#8039) 2019-01-29 09:31:32 +01:00
Simran 33220fb589 Doc - Deprecate --server.jwt-secret startup option (#7947) 2019-01-28 09:12:18 +01:00
Frank Celler 9927b3a281
Feature/maskings (#8006) 2019-01-22 22:23:25 +01:00
maxkernbach 7958ac1a68 Doc - peakMemoryUsage , add info on version (#8007) 2019-01-21 17:48:45 +01:00
jsteemann cd26187993 fix typo in docs 2019-01-17 19:48:17 +01:00
Jan 9635df56eb
added "peakMemoryUsage" query result figure (#7952) 2019-01-17 13:58:18 +01:00
sleto-it d245e5c96d
Doc - Upgrade on Windows (#7682) 2019-01-16 14:59:17 +01:00
Simran 50f248faec Doc - Single Instance vs. Cluster (update) (#7960) 2019-01-16 14:56:29 +01:00
KVS85 ac37dbed89 Doc - updates to the compiling under windows section (#7894) 2019-01-15 20:00:35 +01:00
Simran 9fea30b8ee Doc - rel notes page imp (#7613) 2019-01-15 19:56:14 +01:00
sleto-it 9802561ed5
Doc - fixes link 2019-01-15 10:22:10 +01:00
sleto-it d6761ba873
Doc - upgraded starter procedure 2019-01-15 10:17:39 +01:00
Simran c8730b99ef Doc - Cookbook: Remove outdated OpenSSL recipe (#7929) 2019-01-11 22:34:06 +01:00
Jan Christoph Uhde f65853e30f make use of sortedness of rocksdb primary index (#7788) 2019-01-11 09:40:22 +01:00
Simran 6a3fa519a2 Doc - Extend generation of program option tables (#7888) 2019-01-10 19:39:26 +01:00
Andrey Abramov d4a010baf9
Bug fix/internal issue #316 (#7911)
* allow using scorers outside ArangoSearch view context

Signed-off-by: Andrey Abramov <andrey@arangodb.com>

* ensure query is properly optimized after replacement of scorer functions

* do not apply `handleViewsRule` to queries without views

* simplify optimization rule for ArangoSearch views

* show ArangoSearch view scorers in query explanation

* fix tests

* fix tests

* add stub for scorer related tests

* reformat

* check variable depth in `ViewExpressionContext::getVariableValue`

* add some tests

* address js test failures

* address jslint errors

* ensure `IResearchViewNode` exposes variables used in scorers

* ensure scorers with expressions are deduplicated

* fix deduplication for indexed access

* more tests

* partially address review comments

* address review comments

* simplify code

* remove irrelevant, commented out code

* ensure array comparisons are properly handled

* update changelog & loki
2019-01-10 21:04:19 +03:00
Max Neunhöffer cf249ff447 Doc - Add a paragraph that JS JS trxs are excluded from intermediate commits. (#7919) 2019-01-09 15:20:14 +01:00
Simran e7810e1956 Doc - Update remark about per-database replication (#7891) 2019-01-08 19:36:00 +01:00
sleto-it 28b84951cb
Doc - Known Issues - new links (#7908) 2019-01-08 19:11:01 +01:00
sleto-it fbb1de5bcc
Doc - check_function (#7885) 2019-01-04 21:05:31 +01:00
Jan f66bac4f86
added AQL function CHECK_DOCUMENT (#7842) 2019-01-04 15:31:29 +01:00
Jan 28528973e3
added arangorestore option `--cleanup-duplicate-attributes` (#7877) 2019-01-04 15:25:45 +01:00
sleto-it c48756486e
Doc - arangorestore improvements (#7878) 2019-01-03 18:26:07 +01:00
Jan b3a3e35f3d added arangorestore options `--number-of-shards` and `--replication-f… (#7869)
* added arangorestore options `--number-of-shards` and `--replication-factor`

* updated documentation

* added version numbers
2019-01-03 11:07:02 +01:00
sleto-it 20d5e1655e
Documents that arangorestore/arangodump threads option is from v3.4.0 on (#7701) 2018-12-29 13:29:10 +01:00
sleto-it 099fd6d2db
Doc - Forwardports to devel - 2018-12-27 (#7858) 2018-12-27 17:12:50 +01:00
Omar_A 5bf0eb4fea Doc - Sync-external-repo-2018-12-25 (#7854) 2018-12-27 11:17:11 +01:00
maxkernbach 4db6390054 Doc - re-add switching storage engine section (#7781) 2018-12-27 11:03:31 +01:00
Simran f7b9733a84 Doc - Fix build (whitespaces, triple-backticks, comments) (#7857) 2018-12-26 21:41:19 +01:00
maxkernbach 76f98429e6 Doc - Improve MacOS Installation page (#7744) 2018-12-24 17:18:34 +01:00
Simran 06e123de22 Doc - Single Instance vs. Cluster (diff + migration) (#7739) 2018-12-22 23:30:24 +01:00
Simon a2a0b03f43 Rdb index background (preliminary) (#7644) 2018-12-21 19:24:10 +01:00
Andrey Abramov ac3a8a3f0b
update knownissues (#7807) 2018-12-19 16:10:34 +03:00
Jan 529e1a5579
fix issue #7743: properly invalidate variables after COLLECT statemen… (#7780) 2018-12-18 18:13:34 +01:00
maxkernbach 775129ad1a Doc - fix build by adding missing SUMMARY entries (#7741) 2018-12-11 18:42:25 +01:00
jsteemann 66ea1fd494 fix typo 2018-12-08 01:34:31 +01:00
Simran 37eb34ad50 Doc - Placeholder pages for 3.5 Release Notes (#7686) 2018-12-06 14:41:27 +01:00
Simran 801bc38ab9 Doc - cleanups (#7685) 2018-12-06 14:25:31 +01:00
sleto-it 856de1fb36
Doc - Installation improvements (#7681) 2018-12-06 13:41:29 +01:00
sleto-it 0a8369abf7
Doc - Production Checklist (#7582) 2018-12-06 12:44:39 +01:00
sleto-it 59a831eed8
Doc - Rewrite Configuration page, restore old file structure (#7628) 2018-12-06 12:42:20 +01:00
Simran bf5787ec84 Doc - Installation refactor MacOSX (#7672) 2018-12-06 12:38:05 +01:00
Simran 48043c667e Doc - Installation refactor Linux (#7671) 2018-12-06 12:25:33 +01:00
Simran 32bc599a87 Doc - Installation refactor Windows (#7669) 2018-12-06 12:06:13 +01:00
sleto-it 44b424ef71
Doc - Scripts to Optimize OS (#7674) 2018-12-06 11:52:54 +01:00
sleto-it de4591d4bd
Doc - cite the tar.gz in what's new (#7675) 2018-12-06 11:49:41 +01:00
sleto-it ea28b0bf86
Doc - Community to Enterprise Upgrade (#7668) 2018-12-06 11:40:39 +01:00
Simran df5f64f95d Doc - new page for Uninstallation (#7673) 2018-12-06 11:39:52 +01:00
Simran dec65b904c Doc - deprecate simple all keys (#7657) 2018-12-06 11:19:31 +01:00
sleto-it 820147f4d3
Doc - 3.3 to 3.4 starter upgrades: additional info (#7663) 2018-12-05 22:58:14 +01:00
Simran f1c98f279a Doc - Add missing example file for GEO_MULTIPOLYGON() (#7662) 2018-12-05 20:50:09 +01:00
maxkernbach e48030b37c Doc - sync external repositories (#7616) 2018-12-05 18:49:11 +01:00
maxkernbach c245e9e230 Doc - change replica-amount (#7655)
forwardport #7625
2018-12-05 17:03:30 +01:00
Simran f7952ce445 Doc - Mention GEO_MULTIPOLYGON() in 3.4 release notes (#7651) 2018-12-05 15:18:33 +01:00
Jan 7c1f958c50 Doc - additional 3.4 related info (#7646) 2018-12-05 13:06:43 +01:00
Jan a473ab9aa1 Doc - add known issue for parallel collection creation (#7642) 2018-12-04 20:42:24 +01:00
Heiko 442d59a3f8 added MultiPolygon GeoJSON constructor function (#7633) 2018-12-04 14:40:13 +01:00
Simran 746443d511 Doc - Remove _getConnectingEdges() as it's not implemented (#7621) 2018-12-03 20:13:44 +01:00
Simran e917deb84a Doc - 3.4 known issues (#7599) 2018-12-03 16:19:30 +01:00
Andrey Abramov 6ba81d7603
Documentation 3.4/update known issues (arangosearch) (#7600) (#7601)
* update known issues for 3.4

* more known issues
2018-12-03 16:25:06 +03:00
sleto-it a4abb4f9ec
Doc - Known Issues 3.3 - forward port simran's feedback (#7592) 2018-12-03 13:15:41 +01:00
sleto-it 4eb37c348e
Doc - 3.3 known issues (#7576) 2018-12-02 16:30:50 +01:00
Frank Celler 710ca04fb1
Feature/maskings [WIP] (#7347) 2018-11-30 18:21:37 +01:00
Jan Christoph Uhde b59ec27bea update ssl instructions (#7567) 2018-11-30 16:27:48 +01:00
Lars Maier 908df47cd7 [devel] Bug fix/cluster health ui timestamp (#7562) 2018-11-30 16:26:21 +01:00
Simran 9cdc2630dc Documentation/rdb exclusive options (#7548) 2018-11-29 15:18:41 +01:00
Lars Maier 52cff7ad55 Feature/engine version added to agent configuration (#7481) (#7524)
* agents' is obtained from leader's configuration
* corrections in Supervision for advertised endpoints
* change log
* Updated Documentation for cluster/health.
* Unified naming convention.
* Fixed missing update of volatile fields.
* Set version in right order.
* Removed debug output.
* Fixed jslint - missing ;
2018-11-29 14:25:40 +01:00
Simon 6f8829a623 Document RocksDB exclusive option (#7517)
* Document exclusive option, use in more cases

* address review comments
2018-11-29 13:59:07 +01:00
Jan be0f8b59fa
added option `--rocksdb.enforce-block-cache-size-limit` (#7505) 2018-11-28 21:02:45 +01:00
Jan d2d68ee34d Doc - 3.3 to 3.4 notes about upgrading (#7454) 2018-11-28 20:07:10 +01:00
Simran b26804b1ff Doc - Create MonetaryDataWithoutPrecisionLoss.md (#7149) 2018-11-28 20:02:33 +01:00
KVS85 ee97ed3e63 Doc - Add description for new ArangoSearch view properties (#7436) 2018-11-28 17:08:26 +01:00
Simon d0efd95a37 Bug fix/restore index refactor (#7470) 2018-11-27 20:22:36 +01:00
Simran ccc9898c42 Doc - Recommend overcommit_memory 0 or 1 on Linux (planning#3151) (#7258) 2018-11-27 18:16:39 +01:00
Simran 459c689360 Doc - Fix LEVENSHTEIN_DISTANCE function description (#7310)
Removed redundant content, placed paragraph with a remark about LENGTH() back where it belongs
2018-11-27 18:12:10 +01:00
sleto-it 307482515f Doc - Active Failover bug fixes and improvements (#7242) 2018-11-23 13:28:05 +01:00
Simon c584527d79 Fix restore of views, add --view option (#7425) 2018-11-22 19:24:24 +01:00
Simon 2ca8a4fd36 Documentation on Operational Factors and Data Models (#7374) 2018-11-22 16:01:30 +01:00
Simran f5e8d5ead4 Doc - removes deprecated Actions pages and examples (#7391) 2018-11-22 02:03:09 +01:00
jsteemann c8b38e5d06 update known issues 2018-11-21 16:14:28 +01:00
Omar_A f8eab9b7e1 added ":true" to "X-Arango-Allow-Dirty-Read" header (#7277) 2018-11-20 13:08:15 +01:00
jsteemann 58208d32c4 forward-ported #7190 2018-11-20 13:00:46 +01:00
Jan f1760bf01b
fix failing non-deterministic query-stream test (#7295) 2018-11-13 11:36:41 +01:00
jsteemann 70674ccdfa adjusted documentation w.r.t. to toggling statistics 2018-11-12 17:55:32 +01:00
Vasiliy f088733420 issue 496.3: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca (#7166)
* issue 496.3: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca

* address potential deadlock between link creation and FlushThread

* remove code causing nullptr access

* add back lock around reader reopen

* revert: address potential deadlock between link creation and FlushThread

* invalidate payload for each field in FieldIterator before setting a value
2018-11-01 23:10:01 +03:00
Jan 7e78f85f61
add separate option `--query.slow-streaming-threshold` (#7181) 2018-10-31 21:31:52 +01:00
Vasiliy 8f44afb6cf issue 496.1: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion (#7101)
* issue 496.1: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion

* backport: address test failures

* backport: ensure arangosearch links get exported in the dump

* backport: ensure view is created during restore on the coordinator

* Updates for ArangoSearch DDL tests, IResearchView unregistration and known issues

* Add fix for internal issue 483
2018-10-30 12:50:35 +03:00
Jan 28e22d60be
add option `--rocksdb.total-write-buffer-size` (#7025) 2018-10-25 11:36:26 +02:00
Andrey Abramov 86ebc30290 update ArangoSearch known issues (#7055) 2018-10-24 21:59:27 +02:00
Simran eab1488128 Doc - Foxx CLI: Add link to blog post (#6911) 2018-10-24 13:41:01 +02:00