1
0
Fork 0
Commit Graph

175 Commits

Author SHA1 Message Date
jsteemann d6baadf59a fix recovery edge case 2016-07-25 17:57:25 +02:00
jsteemann 2aa2e0dab4 removed server.h 2016-07-25 16:49:52 +02:00
jsteemann 2dab54a751 removed a define 2016-07-18 17:15:41 +02:00
jsteemann f373a2c327 removed TRI_vocbase_defaults_t 2016-07-18 16:55:25 +02:00
jsteemann 807f287868 moved server id detection and pagesize detection into their own features 2016-07-18 14:37:12 +02:00
Jan Steemann 617a833040 handle "isSystem" somewhat smarter 2016-07-06 10:23:37 +02:00
Jan Steemann f3b4a8cee3 properly delete .tmp files 2016-06-15 15:50:53 +02:00
jsteemann 08955341a7 datafile management fixes 2016-05-18 11:29:06 +02:00
jsteemann 7d9e93e61e removed unused includes of JsonHelper.h 2016-05-13 19:00:23 +02:00
Andreas Streichardt 04ba5156e5 Rework planned collection loading 2016-05-06 17:03:13 +02:00
jsteemann 1a942ca589 use fixed-precision floats for logging 2016-05-01 23:31:49 +02:00
jsteemann e3ed9812b4 use value stored in "count" value of collection when re-loading 2016-04-24 14:36:19 +02:00
jsteemann 65a03d2c58 delete duplicate log message 2016-04-24 14:29:49 +02:00
Frank Celler 5335a5b0af moved to Random 2016-04-21 22:53:20 -07:00
Frank Celler cd91d3654e Merge remote-tracking branch 'origin' into FMH 2016-04-15 19:01:38 -07:00
Jan Steemann 1855b74aaa added asserts 2016-04-07 16:44:36 +02:00
Jan Steemann 545b87cb76 test fixes 2016-04-06 17:39:24 +02:00
Frank Celler af00417cf4 skeleton arangod 2016-03-25 15:14:43 +01:00
jsteemann 2ade0ef3d0 fixed log output 2016-03-14 18:05:20 +01:00
jsteemann 358b09260e fixed prologue marker writing 2016-03-14 17:54:46 +01:00
jsteemann e8662b5265 preparation 2016-03-12 12:42:29 +01:00
Jan Steemann b393c3d9bb Merge branch 'devel' of https://github.com/arangodb/arangodb into spdvpk 2016-03-09 09:42:10 +01:00
Frank Celler dfa9047484 switch arangosh to new ApplicationFeatures and ProgramOptions 2016-03-08 23:32:43 +01:00
jsteemann cf1427adff smaller datafile markers 2016-03-04 02:25:03 +01:00
Jan Steemann 78f07c6a31 less json 2016-03-03 14:23:39 +01:00
Jan Steemann 15350cf4b8 renamed and removed 2016-03-01 12:34:03 +01:00
jsteemann adae2e7c67 fixed saving 2016-02-29 23:31:21 +01:00
jsteemann 545b0ed6a2 cleanup 2016-02-27 02:44:51 +01:00
jsteemann f0aeab0d12 cleanup 2016-02-27 01:10:42 +01:00
Jan Steemann bd9293802d marker changes, unfinished 2016-02-26 19:39:17 +01:00
jsteemann 6ff60602de fixed more recovery tests 2016-02-24 00:20:42 +01:00
Frank Celler 963578180a cleanup of TRI_ options 2016-02-23 12:26:10 +01:00
Frank Celler d142a5ddb4 move to strings and away from regexp 2016-02-23 12:26:09 +01:00
Jan Steemann b7abf5a40d attempt to fix Windows build 2016-02-01 12:04:28 +01:00
jsteemann 349a6d9754 more logging 2016-01-31 21:48:59 +01:00
jsteemann b635983d9c removed unused functions and headers 2016-01-31 19:08:39 +01:00
jsteemann 353c9732b7 removed last LOG_xxx macros 2016-01-30 04:03:18 +01:00
jsteemann ff21453255 logger transition: all files in arangod exception transactions.cpp 2016-01-29 23:28:44 +01:00
Jan Steemann 585208afcf changed directory name pattern for collections 2016-01-27 18:53:16 +01:00
Jan Steemann 9046e1831b clang-format 2016-01-27 13:43:46 +01:00
Jan Steemann 3d8a52cdf4 some refactoring 2016-01-27 13:28:19 +01:00
jsteemann 379abd64c3 removed outdated upgrading function 2016-01-21 00:29:56 +01:00
jsteemann 842384016d namespace cleanup 2016-01-21 00:20:22 +01:00
jsteemann ef67a496e6 more checks & asserts, C API cleanup 2016-01-20 22:08:11 +01:00
jsteemann 431900f17a changed namespace from triagens to arangodb 2016-01-17 00:44:53 +01:00
Jan Steemann bb3703cf9e fix recovery 2016-01-12 20:47:02 +01:00
Jan Steemann a119837c3e fixed journalSize handling for collections 2016-01-12 19:41:39 +01:00
jsteemann 9f0576c65f don't rely so much on namespace std being present 2016-01-08 01:05:06 +01:00
Jan Steemann 3ad20c0cae auto-generated headers 2016-01-06 18:41:51 +01:00
Jan Steemann a3b026d9d1 removed useless sections from code, unified include guards 2016-01-06 14:15:22 +01:00
Jan Steemann f422576ee0 clang-format 2016-01-05 17:43:24 +01:00
Frank Celler 6fbe632d08 fixed comparison 2016-01-05 12:36:53 +01:00
Max Neunhoeffer c7f00bfeda Continue work on TODOs. 2015-12-23 14:40:04 +01:00
Max Neunhoeffer 225c8cd843 Work on TODOs. 2015-12-22 16:50:09 +01:00
Jan Steemann 80c7645146 one more try 2015-12-22 13:10:43 +01:00
Jan Steemann e2e483e06a potential fix 2015-12-22 12:34:48 +01:00
Max Neunhoeffer b37c8fb5a2 Fix js/common/tests/shell-collection.js in cluster. 2015-12-21 11:05:02 +01:00
jsteemann a058699312 use std::make_shared 2015-12-18 23:34:18 +01:00
Jan Steemann c701a8e66e Merge branch 'vpack' of https://github.com/arangodb/arangodb into vpack 2015-12-18 12:13:17 +01:00
Jan Steemann ba2ed30093 fix collection creation 2015-12-18 11:35:15 +01:00
Michael Hackstein 506c8f9be2 Constified the keyOptions buffer. No one should ever change it's content once it is stored in the VocbaseCollectionInfo. 2015-12-18 09:34:56 +01:00
Jan Steemann e8084e3ef4 Merge branch 'vpack' of https://github.com/arangodb/arangodb into vpack 2015-12-17 15:45:53 +01:00
Jan Steemann 7dd4cab103 potential fix for server start 2015-12-17 15:40:20 +01:00
Michael Hackstein 3c4643993d Fixed JS constructor for Edge Collections. The collection did not mention that it wants to be an edge collection 2015-12-17 15:06:20 +01:00
Michael Hackstein cd93e959bd Fixed compiler warnings 2015-12-17 14:07:55 +01:00
Michael Hackstein c7b327e7de Fixed access to uninitialized variables 2015-12-17 14:03:43 +01:00
Michael Hackstein 46b9ac5c53 Fixed collection constructor from name 2015-12-17 13:24:45 +01:00
Michael Hackstein b992423d1e Changed default type value for collections if not given in the JSON object on disc 2015-12-17 12:41:40 +01:00
Jan Steemann 2b3f3f997b Merge branch 'devel' of https://github.com/arangodb/arangodb into vpack 2015-12-17 10:59:30 +01:00
Michael Hackstein 73f3ddc753 Finished with first move to VocbaseCollectionInfo class. This commit compiles but it is untested. 2015-12-16 19:03:07 +01:00
Michael Hackstein 41d7fbb803 First draft of class implementation of TRI_col_info_t 2015-12-16 11:46:55 +01:00
jsteemann 1e98af01ba set cloexec for file descriptors 2015-12-15 20:30:28 +01:00
Michael Hackstein ba1a520e8c Fixed a bug in Vocbase collection to VPack. It did not include the collection properties properly 2015-12-11 08:35:44 +01:00
Michael Hackstein c959072733 Adaption to new vocbase-defaults format 2015-12-10 16:42:13 +01:00
Michael Hackstein eb417a2ef3 Removed TRI_json_t from vocbase main file 2015-12-10 15:30:36 +01:00
Michael Hackstein 02784df7f8 Updated file list function to use std::vector<std::string> instead of TRI_string_vector_t. 2015-12-08 15:10:03 +01:00
Michael Hackstein 19343fb0da Added a helper function to init collection info from VelocyPack 2015-12-07 14:23:31 +01:00
Jan Steemann a3e4a2f863 removed some includes 2015-11-11 15:16:37 +01:00
Jan Steemann 496e1cbc0f do not use strdup() 2015-11-03 10:21:35 +01:00
Frank Celler 3500e569a8 reverted 011117edee, 72c8847324, 5da5715fa9, a371aac4af, 7decf1560a, 0331ff7993, 6ec2014052, ae8d686ae6, 7efd0a1ec7, 3449b87e2c, d35a4034ef, 7b3c1ed4dd, e0c88e4a1a, 952d643101, fc9de8ed08, 2f4319b31a, 105662d5ba, 0a08833b0f, 4ac19a99fc, 4c5494c67d, 528bb85b30, 528bb85b30 becuase of missing CLA 2015-11-03 10:19:25 +01:00
CoDEmanX b4593a7e82 Change spelling of 'initialize' to American English (comments and log messages only) 2015-09-01 17:07:21 +02:00
Max Neunhoeffer c0f1b72bab Add "sensible" madvise calls.
Essentially the strategy is: A newly created and a newly opened file
is advised to be "SEQUENTIAL ACCESS", because we will either write to
it or scan it sequentially. As soon as it is sealed, we switch the
advice to "RANDOM ACCESS", because this should be the normal pattern and
aggressive read-aheads tend to be bad. The collector and the compactor
switch a sealed file back to "SEQUENTIAL ACCESS" just before they scan
it and back to "RANDOM ACCESS", when they are done.

Furthermore, all data files in a collection are advised with "WILLNEED"
just before the collection is scanned during loading.

Finally, the actual hash table of AssocMulti is advised to be random
access, although this is an anonymous map given to us by malloc and not
a memory mapped file.
2015-08-26 16:45:26 +02:00
Jan Steemann 907e6368c6 some unused function cleanup 2015-08-17 12:43:09 +02:00
Jan Steemann f89af3f6f4 adjusted tests for indexBuckets 2015-08-04 14:02:04 +02:00
Jan Steemann 6d7ccd7699 move shaper to cxx 2015-07-28 17:38:31 +02:00
Jan Steemann 9d048fd1e0 separate measure for CheckCollection 2015-07-16 12:59:59 +02:00
Max Neunhoeffer 13204298d9 Make number of buckets in edge index configurable. 2015-05-17 19:04:47 -07:00
Jan Steemann a007a867ee "privatized" TRI_vector_t internals.
This allows changing the internals of TRI_vector_t structs in order to make the struct smaller.
On 64 bits, the size of TRI_vector_t is reduced from 48 bytes to 28 bytes.
TRI_json_t does benefit from this, as its biggest component is a TRI_vector_t.
2015-05-05 10:31:02 +02:00
Jan Steemann 7dc3fc3d5c safely create collections and databases 2015-03-19 15:56:12 +01:00
Jan Steemann 6360c798e7 added option `--database.ignore-logfile-errors`
Conflicts:
	arangod/RestServer/ArangoServer.cpp
2015-03-18 17:46:11 +01:00
Jan Steemann 755d728e5a hide warning if not appropriate 2015-03-18 17:44:50 +01:00
Jan Steemann 1461d75ed4 improve collection loading time
This patch reduces collection loading time by preallocating enough space in primary index ahead of time.
When a collection is closed, the number of documents in the collection will be stored in the collection's JSON info file.
This value is used to determine the initial size for the primary index when the collection is loaded next time.

Datafile iteration has also been made slightly faster.

The above changes will have a significant benefit when the collection's datafiles are already in the OS buffer cache, and when there are no secondary indexes.
Loading datafiles from disk or building secondary indexes may be more time-consuming than the improvements reapable by this patch, but the patch shouldn't hurt anyway.
2015-02-26 16:35:51 +01:00
Willi Goesgens a58974d773 Improve error handling
- directory creation
  - zip extraction
2015-02-23 12:26:49 +01:00
Jan Steemann b54dfae96f removed several JSON functions 2015-01-13 01:31:04 +01:00
Jan Steemann 20e7fe7a7a the great rename: array => object, list => array 2014-12-18 21:07:06 +01:00
Jan Steemann 1fff0ecac2 optimization for recovery of collections that are going to be dropped anyway 2014-09-18 18:20:56 +02:00
Jan Steemann e5e2cfe4da Merge branch 'devel' of https://github.com/triAGENS/ArangoDB into aql2
Conflicts:
	arangod/V8Server/v8-vocbase.cpp
2014-09-17 11:50:42 +02:00
Jan Steemann d3f4f05df1 issue #1020 2014-09-17 11:42:01 +02:00
Jan Steemann 506936dcdb rename orgy 2014-09-13 02:35:13 +02:00
Jan Steemann 0dc0bc834f more files renamed 2014-09-13 00:20:30 +02:00