1
0
Fork 0
Commit Graph

350 Commits

Author SHA1 Message Date
Matthew Von-Maszewski bbce4caefa Feature/mv basho smoothing1 (#3384) 2017-11-13 15:43:44 +01:00
Jan 057e87f919 fix shutdown in case no threads can be started (#3648) 2017-11-10 10:21:51 +01:00
Jan 7613bc4314 Bug fix/fixes 0211 (#3568)
* remove some non-unused V8 persistents

* do not throw that many bogus assertions

* do not rely on server role being defined

* slightly better debug output for V8 context debugging

* fix collection ids in inventory response

* simplify bootstrap a bit

* slightly better error handling

* make elapsed time a queryable value

* use less memory for stub collections

* added assertions that will always make sense

* added assertions

* do not garbage-collect while waiting

* less copying of parameters

* do not show "load indexes into memory" buttons for mmfiles engine

  as all indexes are in memory anyway

* when a collection is truncated via the web interface, flush the WAL and rotate all active journals

this will make close all open journals on leader and followers and make them subject to compaction opportunities

* fix invalid server id values being passed from web interface to backend

* introduce afterTruncate method for indexes

* added test case for issue #3447

* updated CHANGELOG

* don't warn about replicationFactor for system collections

* check that the queries actually use the geo index and not some other index

* properly report error in web interface

* fix some internals checks that made truncate fail for bigger collections in maintainer mode

* also run a compact() operation after a serious truncate

in order to make iteration over the truncated range much faster
when the collection is next accessed

* increase default maximum number of V8 contexts to at least 16
2017-11-09 12:48:15 +01:00
Jan f6a90c4879 some cleanup (#3583) 2017-11-07 10:27:21 +01:00
Jan 463ef531f9 more startup environment checks (#3566)
* warn about custom MALLOC_CONF value
* print info if IPv6 is disabled
* print OS info on Linux
2017-11-04 20:52:14 +01:00
Jan Christoph Uhde f0340a0e36 increase message level to ERR for max mappings (#3426) 2017-10-16 17:33:22 +02:00
Jan 0561bf45ce Bug fix/isrestore (#3283)
* Make isRestore work in the cluster.

This covers sharded collections with default sharding and non-default
sharding.

* always use locally generate revision ids for storing and looking up documents
2017-10-03 11:53:49 +02:00
Jan 56fab56ff5 Bug fix/issues 2709 (#3333)
* logging improvements

* fixed copy&paste error

* enable assertions in non-release mode

* updated CHANGELOG

* fix --temp.path (was dysfunctional), fix creation of temporary directories and races
2017-10-01 09:43:03 +02:00
Jan 4ba38bf981 try to work around some assertions (#3296)
* remove obsolete values from relative config

* warn about using obsolete config parameters
2017-09-28 09:21:33 +02:00
Jan 01cdaed684 increase default value for /proc/sys/vm/max_map_count (#3321) 2017-09-26 15:15:22 +02:00
Jan 5165155ed1 Bug fix/fixes 0609 (#3227)
* do not use V8 variant of AQL functions in early optimization stage when a C++ variant is available

* additionally, simplify AQL function definitions and aliases

* warn when more than 90% of max mappings are in use

* added C++ variant of replication catchup

* added `--log.role` option

* updated CHANGELOG

* removed non-existing scheduler.threads option from config

* removed useless __FILE__, __LINE__ invocations

* updated CHANGELOG

* allow a priority V8 context

* remove TRI_CORE_MEM_ZONE

* try to fix Windows errors & warnings

* cleanup

* removed memory zones altogether

* exclude system collections from collection tests
2017-09-13 16:28:21 +02:00
Jan 523d99b236 Bug fix/fixes 0109 (#3191)
* fix double free

* simplfy conditions

* fix cppcheck complaint
2017-09-04 17:32:25 +02:00
Jan 26ede63c84 added option `--server.check-max-memory-mappings` (#3185) 2017-09-01 16:11:22 +02:00
m0ppers ca1aeb4ad4 fight msvc warnings (#3112) 2017-08-24 14:44:29 +02:00
Jan ce2425cade Bug fix/daily fixes (#2958)
* do not rely on non-existing feature "AQL"

using such feature makes the server throw two exceptions (which will be caught) on startup, but its silly for debugging

* use condition variable for signalling shutdown

* do not hard-code the log levels for recovery tests

this has taken so many developers so much of their time that it is about time to fix it

* ensure the 'unittests' script properly finds 'arangosh' and the build directory
2017-08-04 20:46:08 +02:00
Frank Celler fa9246c9f9 fixed locator for icudtl.dat (#2950) 2017-08-04 09:43:49 +02:00
Jan 9ded187324 prevent V8 from causing SIGILL errors (#2932)
* prevent V8 from causing SIGILL errors

* updated CHANGELOG
2017-08-03 22:15:25 +02:00
Simon Grätzer 3f58a44e3b Fix cases where the root user has access to excluded collections (#2856) 2017-08-03 21:16:08 +02:00
Jan 07875791e5 improve shutdown and feature reusability in tests (#2935) 2017-08-03 20:44:04 +02:00
Jan ed9d15156e remove dependency on MMFiles features from non-MMFiles files (#2925) 2017-08-01 22:16:43 +02:00
Jan 871ee6a85f added startsBefore() for ApplicationFeature (#2913) 2017-08-01 17:15:25 +02:00
Simon Grätzer 59dc8d0135 Update rocksdb options (#2880)
* changing some defaults

* Maybe fixing performance

* Modified changelog

* Updated documentation to reflect options
2017-07-27 16:05:31 +02:00
Jan Christoph Uhde c7dd2db2cc log supervisor exit (#2846) 2017-07-26 10:00:45 +02:00
Max Neunhöffer 3387d794a7 Fix configuration file reader in the presence of @include. (#2725)
Vector options in configuration files including others which set
them as well had been ignored. This patch fixes this behaviour.
2017-07-04 22:37:46 +02:00
Jan ccbe1ba792 Bug fix/fix rocksdb options (#2702)
* cleanup rocksdb options
2017-07-02 23:13:42 +02:00
Jan a5afdf9437 Bug fix/small issues (#2696)
* remove unused code

* print values of all options

* don't print "warning(s):" if there are none

* remove remainders of old file deletion functionality

* remove unused function
2017-07-01 00:30:45 +02:00
Dan Larkin d7aedbe562 Changed VM overcommit recommendation for user-friendliness. (#2695) 2017-06-30 11:31:04 +02:00
Dan Larkin c796b5f93d Fixed a typo in overcommit ratio warning logic and some formatting. (#2650) 2017-06-23 08:44:42 +02:00
Jan c873715a18 don't print option value at startup (#2643) 2017-06-22 14:23:20 +02:00
Jan 780de03f5c fix compile error on non-Linux platforms (#2641) 2017-06-22 13:32:44 +02:00
Dan Larkin 690c2d17fd Enabled/added startup checks for VM overcommit values. (#2610) 2017-06-22 12:31:32 +02:00
Frank Celler ce8b1fb885 Feature/rocksdb update 5.6 (#2621) 2017-06-20 18:12:43 +02:00
Jan 08d43dbd78 refactor handling of V8 contexts and care more about exceptions (#2546)
* refactor handling of V8 contexts and care more about exceptions
2017-06-16 09:41:41 +02:00
Frank Celler 07fef71276 Feature/shutdown once (#2588)
only call beginShutdown once
2017-06-15 22:48:34 +02:00
Jan 5ddfc76304 turn off overcommit check temporarily (#2557) 2017-06-12 18:15:52 +02:00
Frank Celler cf89496faa shutdown will close sockets immediately (#2540) 2017-06-09 16:08:54 +02:00
Alan Plum 548f83ceec Reword 'horrible' messages (#2531) 2017-06-09 10:20:57 +02:00
Frank Celler c17d749f01 removed concurrency (#2536) 2017-06-09 00:10:43 +02:00
jsteemann bf209397cd fixed shutdown issues 2017-06-08 12:30:43 +02:00
jsteemann 427fc35f35 fix MSVC compile warnings 2017-06-08 10:48:39 +02:00
Frank Celler a2bf0434a8 Feature/jemalloc 3.6 (#2526)
jemalloc 3.6.0
2017-06-06 20:50:10 +02:00
Dan Larkin c48eb92c1e Added some more pass-through options for RocksDB and optimized a couple defaults. 2017-06-06 10:51:01 -04:00
Frank Celler 0961cdc528 fixed typo 2017-06-05 16:47:17 +02:00
Mark Volmary 89701714ca fixed starting of threads; must not be done before start 2017-06-05 13:51:19 +02:00
jsteemann adc7e49754 added more environment checks 2017-06-02 14:12:23 +02:00
Mop bf829ff665 Add warning about tcp_tw_recycle 2017-06-02 12:51:02 +02:00
jsteemann 6b18cc64fe dont use explicit when unnecessary 2017-06-01 16:47:56 +02:00
jsteemann c590941746 increase default value for block_size to 16 * 1024 2017-06-01 10:06:02 +02:00
jsteemann 8b6e9ec793 adjust warning 2017-06-01 01:24:50 +02:00
jsteemann c4a80b60f8 slightly adjust warning message 2017-06-01 00:49:06 +02:00
Wilfried Goesgens 613ad8bd9c when running as service correctly set the error state on abort / failure cases, so other components can evaluate it. 2017-05-31 13:21:50 +02:00
Frank Celler 4b61f5b8bb added --rocksdb.num-uncompressed-levels 2017-05-29 11:56:48 +02:00
Frank Celler 7040ea72fa added numa check 2017-05-25 16:45:18 +02:00
Frank Celler 4800a8b7f6 Feature/hugepages (#2497)
* enabled checks for memory management

* added MADV_NOHUGEPAGE

* added documentation about NUMA and file systems
2017-05-25 16:04:23 +02:00
jsteemann 9ed93f39ee added one more check 2017-05-24 22:15:23 +02:00
jsteemann b9c4efbaf8 added environmentfeature 2017-05-24 22:00:16 +02:00
jsteemann 631453a1f3 more options 2017-05-24 11:15:36 +02:00
Wilfried Goesgens 5500942f00 enable colors on recent enough windows versions 2017-05-24 10:29:40 +02:00
jsteemann 27a8adf9b8 moved shell colors into their own feature 2017-05-23 16:53:43 +02:00
jsteemann 53fa66e60d move parts from ProgramOptions from headers into cpp files 2017-05-23 10:30:36 +02:00
jsteemann bdac806e49 slightly optimize context destruction 2017-05-22 15:57:08 +02:00
jsteemann efc4ca24eb remove IsolateData again after context gets destroyed 2017-05-22 15:56:23 +02:00
Andreas Streichardt af4da5796f More windows warnings 2017-05-16 17:00:31 +02:00
jsteemann 8de7f6be53 protect vector of isolate data with a mutex 2017-05-12 17:26:56 +02:00
Dan Larkin 024fccf82e Increased default size for RocksDB block cache. 2017-05-12 08:46:16 -04:00
jsteemann fb088d35f2 more unique ptrs 2017-05-12 12:32:47 +02:00
jsteemann b1aae2efdd remove unused options 2017-05-12 12:12:09 +02:00
Simran Brucherseifer c27a8c14a5 Add footer to docs, unify slogan 2017-05-12 10:19:37 +02:00
Wilfried Goesgens c991f52303 forward SIG_HUP from supervisor 2017-05-11 15:20:24 +02:00
jsteemann b64645e83b use some parallelism 2017-05-10 13:08:41 +02:00
Dan Larkin 5702e11bc5 Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-08 12:34:56 -04:00
Dan Larkin 4e70775ec9 Removed some hard-coded default options for RocksDB. 2017-05-08 12:34:51 -04:00
jsteemann 12b46d2086 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-05-08 18:27:07 +02:00
jsteemann 7577fed6fb added logger 2017-05-08 18:24:40 +02:00
Dan Larkin 284bb6fb51 Fixed some issues with RocksDB passthrough options. 2017-05-08 12:08:41 -04:00
Dan Larkin 9924fa1480 Added more RocksDB passthrough options. 2017-05-07 11:08:25 -04:00
jsteemann edeeef8b56 re-enabled signal handlers 2017-05-05 13:09:59 +02:00
jsteemann 400b64ac7c revert commit for deterministic feature orders: breaks signal handlers! 2017-05-05 00:12:44 +02:00
jsteemann 1e72f8ccdc allow configuration of use_fsync from the outside 2017-05-04 01:15:09 +02:00
jsteemann a901b1e8fd make feature-order more deterministic 2017-05-04 00:40:44 +02:00
jsteemann 2e3d704d10 fix MSVC compile warnings 2017-05-03 15:47:45 +02:00
jsteemann 0434d88ab4 rocksdb options 2017-04-25 02:22:00 +02:00
jsteemann 361d513087 re-enable user settings for RocksDB 2017-04-21 15:28:29 +02:00
jsteemann 62d0bb36d1 Merge branch 'devel' of https://github.com/arangodb/arangodb into engine-api 2017-04-21 15:17:43 +02:00
Wilfried Goesgens cb54938582 also try to detect the icu database in its absolute install directory 2017-04-21 14:22:56 +02:00
jsteemann 87d18664f9 Merge branch 'devel' of https://github.com/arangodb/arangodb into engine-api 2017-04-20 12:26:13 +02:00
Frank Celler 6b37aacfa0 remove old files on startup 2017-04-20 11:42:48 +02:00
jsteemann fd333875a2 Merge branch 'devel' of https://github.com/arangodb/arangodb into engine-api 2017-04-20 09:05:23 +02:00
Frank Celler f1d0c5eba1 added jemalloc feature 2017-04-19 19:57:54 +02:00
jsteemann 6786f7257e formatting 2017-04-19 17:26:12 +02:00
Jan Christoph Uhde b66c8526c2 change --rocksdb.enabled to be a obosolete option 2017-04-19 14:54:10 +02:00
Jan Christoph Uhde 507b870ff1 add RocksDBOptionFeature to unify configuration of RocksDB
instances for storage-engine and persistent-index that are used mutual
exclusive.
2017-04-19 12:20:41 +02:00
jsteemann a2705d3e82 fixed issue #2428 2017-04-18 09:30:49 +02:00
Wilfried Goesgens dd2b2b3cce add more state logging to the supervisor 2017-04-10 11:22:07 +02:00
Wilfried Goesgens cfa5daec8f port setenv call for windows 2017-04-07 16:43:26 +02:00
Wilfried Goesgens 331ff7b724 once we found icudtl.dat save its location to the env, so subsequent processes can use that. 2017-04-07 16:06:07 +02:00
jsteemann a0cca4d295 remove usleeps 2017-04-03 15:15:51 +02:00
Simon Grätzer cf4294c9ca Integrated counters with collections 2017-04-03 13:24:22 +02:00
jsteemann a0adeed1c3 Merge branch 'devel' of https://github.com/arangodb/arangodb into engine-api 2017-03-29 18:14:40 +02:00
Frank Celler 3f0915b436 do not require config for --version 2017-03-29 17:52:36 +02:00
Simon Grätzer 913b60c983 Fix usleep 2017-03-28 17:15:05 +02:00
Simon Grätzer 9e1a181393 Edge index tax changes 2017-03-28 14:02:29 +02:00
jsteemann 922a8af392 turn off all MMFiles features in case RocksDB engine is selected 2017-03-27 14:22:00 +02:00
jsteemann 30651604c6 provide more info in supervisor mode 2017-03-10 08:11:09 +01:00
Frank Celler 7eefdf547b simplification: FileResult does only support ok, no additional result
header only, added FileResultString class for Result that return a string
2017-03-08 13:01:20 +01:00
Frank Celler b14dbe6435 added base class Result and an example FileResult 2017-03-06 10:33:32 -05:00
jsteemann 0ac29eb177 don't fail when using optional features as dependencies 2017-03-01 12:52:51 +01:00
jsteemann 43d797132a improved error messages in case config file is not found 2017-02-21 16:19:26 +01:00
Frank Celler 1298c0eaf5 fixed include to include the file at the place where include is issued 2017-02-10 17:17:11 +01:00
jsteemann d024a6d00a remove logging for non-topics 2017-02-10 09:32:50 +01:00
Michael Hackstein 5dfd652d64 Merge branch 'devel' of github.com:arangodb/arangodb into engine-api 2017-02-08 15:57:30 +01:00
Wilfried Goesgens a3ac94d3b2 fix locating of relative ICU files 2017-02-08 15:18:16 +01:00
jsteemann 4fa4259c59 hide some infrequently used config options by default 2017-02-08 14:43:59 +01:00
jsteemann 9d0a210545 prevent memleaks in C++ UnitTests 2017-02-07 17:30:30 +01:00
Wilfried Goesgens 0932d51904 Merge branch 'devel' of github.com:arangodb/ArangoDB into v8_subsubmodule 2017-02-07 13:48:57 +01:00
jsteemann e2a312450f fix out-of-memory handling at startup 2017-02-01 13:00:05 +01:00
Wilfried Goesgens bb80b5cf90 Merge branch 'devel' of github.com:arangodb/ArangoDB into v8_subsubmodule 2017-01-31 16:34:42 +01:00
Wilfried Goesgens f11a545377 fix windows compile 2017-01-31 16:34:29 +01:00
jsteemann e825be35a1 prevent duplicate forward slashes in concatenated filenames
also prevent server start in case included config file cannot be found
2017-01-31 14:56:28 +01:00
Wilfried Goesgens 584f3120dd Upgrade V8
- ICU now doesn't build the icudata library anymore
    - ship the icu database on all platforms and all packages
    - we now load the icu database file ourselves, and hand over the pointer to ICU.
  - follow the V8 changes around Weak pointer handling
2017-01-30 12:30:07 +01:00
jsteemann 19595ad169 fix description 2017-01-18 15:46:53 +01:00
jsteemann 7359ac44b2 more style cleanup 2017-01-05 10:52:03 +01:00
jsteemann 9b42e9cee6 some improvements for memory management
added more memory diagnostics for memory usage:
- collection.figures() now returns a "readCache" attribute which contains the
  number of and memory usage of entries in the document revisions cache for the
  collection, and a "revisions" attribute with the number and memory usage
  of entries in the storage engine's revision lookup table for the collection
- the default value for --database.revision-cache-target-size was changed from
  75% of RAM to 30% of RAM
2016-12-15 15:30:28 +01:00
jsteemann b96897e296 fixed some issues detected by coverity build tool 2016-12-12 15:41:54 +01:00
jsteemann 58da24b1a6 fix engine selection and feature start/stop 2016-11-17 15:58:42 +01:00
jsteemann 5b054a7db7 cosmetics 2016-11-07 21:17:03 +01:00
Frank Celler 192516f4d7 added -D 2016-11-07 17:20:56 +01:00
jsteemann 56b771f0d2 some more debug logging for the supervisor 2016-11-02 21:01:42 +01:00
Frank Celler 7df02164ee fixed supervisor startup 2016-11-02 19:37:49 +00:00
Wilfried Goesgens cbaa2c3b02 More places to pass along the binaryPath for teh windows 2016-10-12 13:21:38 +02:00
Wilfried Goesgens 54ae758c7c We also need to know the binary directory when looking up the config
file; else we may miscalculate file locations.
2016-10-12 12:03:37 +02:00
Frank Celler f559344034 added different path for different editions 2016-09-30 15:24:31 +02:00
Wilfried Goesgens daa5c9f6a5 make relative temporary paths absolute during the system startup. This fixes #1896 2016-09-27 16:19:13 +02:00
jsteemann c4ca7ae2b5 make version details queryable via db._version() 2016-09-09 10:50:21 +02:00
jsteemann fa21e70256 Merge branch 'devel' of https://github.com/arangodb/arangodb into generic-col-types 2016-08-31 17:59:54 +02:00
jsteemann 89ac2dfba5 don't leak on help 2016-08-31 14:28:23 +02:00
jsteemann bc9d0e74d5 unprepare features on abort 2016-08-30 12:59:15 +02:00
jsteemann 85db0a062a removed unused file 2016-08-25 14:03:54 +02:00
jsteemann 07055384b8 Merge branch 'devel' of https://github.com/arangodb/arangodb into readcache 2016-08-24 17:34:59 +02:00
Wilfried Goesgens 1f162ac882 Implement scheme to more clever pass the directories from the build process to the run-time
We will now try to evaluate the toplevel install directory from the configured binary dir.
We will use this toplever directory when searching for other directories.
2016-08-24 14:45:08 +02:00
Frank Celler aed99f6b53 fixed ownership of handler 2016-08-18 23:06:36 +02:00
Michael Hackstein 7b328d39e9 Merge branch 'devel' of github.com:arangodb/arangodb into engine-vs-velocystream 2016-08-11 12:41:08 +02:00
servusoft cfe65305ad Adaptation minimum memory for ARM architecture (over global TRI_V8_MAXHEAP) 2016-08-05 18:54:34 +02:00
jsteemann 5cdbfc423d Merge branch 'devel' of https://github.com/arangodb/arangodb into readcache 2016-08-02 11:57:37 +02:00
Jan Steemann 2870a9f10f visual studio 2016-08-02 11:46:44 +02:00
Frank Celler da85dc2adc added a panic interrupt of memory gets low 2016-08-01 13:43:30 +02:00
jsteemann 71bd7deace Merge branch 'devel' of https://github.com/arangodb/arangodb into readcache 2016-08-01 09:04:17 +02:00
Frank Celler 51683dbda0 added a panic interrupt of memory gets low 2016-07-31 12:58:27 +02:00
jsteemann 5ee344b685 added greetings feature 2016-07-18 18:32:27 +02:00
jsteemann 807f287868 moved server id detection and pagesize detection into their own features 2016-07-18 14:37:12 +02:00