1
0
Fork 0
Commit Graph

99 Commits

Author SHA1 Message Date
Dan Larkin a4aa1eedd2 Updated plain cache to properly count evictions. 2017-05-30 13:04:30 -04:00
Michael Hackstein b9d2faa7cc Added warmup function for indexes.
Squashed commit of the following:

commit bc0472d212b2efef0d7b1b8a36f2b43e8432ba86
Merge: eb47631 5f87674
Author: Michael Hackstein <michael@arangodb.com>
Date:   Mon May 29 09:39:31 2017 +0200

    Merge branch 'devel' of github.com:arangodb/arangodb into feature/rocks-index-warmup

commit eb476310b0ca6165be10b37b960933886c2757f5
Merge: d725f21 32149d2
Author: Michael Hackstein <michael@arangodb.com>
Date:   Mon May 29 09:00:41 2017 +0200

    Merge branch 'devel' of github.com:arangodb/arangodb into feature/rocks-index-warmup

commit d725f21f7d61f7c79ba31fc0338881e35f4d8f48
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 15:53:23 2017 +0200

    Activated collection warmup in Cluster Mode. Added a test for collection warmup (SingleServerOnly)

commit 132bf4f9565b0dcf4ec9f84e93897b482a67ce7f
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 12:46:20 2017 +0200

    Implemented client-side warmup. It can now be triggered via http and arangosh

commit 78ea449dff86118814a2f87bdb59dc16544d92b6
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:25:40 2017 +0200

    Fixed assertion.

commit dae80f6277dde1a52eadda506858cc36e235bd55
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:08:46 2017 +0200

    Improved the CuckooIndexEstimator computeEstimate function. It is now much better on collections with many different values

commit 7abf57876511ba369d7a577e1995d4575e98c7c8
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:06:43 2017 +0200

    Edge index warmup will now first check if a document is stored and if not will insert it. Furthermore it resizes the cache with an estimate of how many documents will be most likely inserted

commit 890d8ad4cdfd155249f060fedd5c798b9531d556
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:04:47 2017 +0200

    Adjusted thresholds in transactional cache. Wastly increased the amount of tries to get the lock. Lowered the fill-grade boundaries

commit 60972ab7151a3acb78e1aae4149de11d0da7aceb
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 10:45:38 2017 +0200

    Added new Logtpopic CACHE that should be used to log important information regarding caches, like debug ouput on evictions / resizing, or memory-pressure resizing going on

commit 2dfacb9aef6e3fde169032514baca386786d059c
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 10:44:21 2017 +0200

    Fixed an assertion in index iterator. It expected _from/_to to be cached but we modified to cache entire document

commit f05beccef65853c30eda1859a39c28ea2295bc71
Merge: 13c6abf 5c46430
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 07:56:58 2017 +0200

    Merge branch 'devel' of github.com:arangodb/arangodb into feature/rocks-index-warmup

commit 13c6abfbc2ddb451a689011110411df68247435e
Author: Michael Hackstein <michael@arangodb.com>
Date:   Wed May 24 09:52:01 2017 +0200

    Added a getExtra feature for the edgeIndex. It now returns the complete edge as extra (temporary). Modified the EdgeCache to cache token and edge document (temporary). Added a warmup Function to collections that is used to warmup the index caches on demand.
2017-05-29 09:40:58 +02:00
Dan Larkin 5ec026b659 Added sizeHint method for caches to improve warmup procedures. 2017-05-24 13:45:53 -04:00
Dan Larkin e935c83762 Exposed isMigrating() method on caches. 2017-05-24 10:44:34 -04:00
Dan Larkin 71846d0ad7 Added hinting so cache table is aware of eviction rate problems. 2017-05-23 19:05:50 -04:00
Dan Larkin 78c80c3a3d Doubled size of cache buckets to increase associativity. 2017-05-23 17:51:47 -04:00
Dan Larkin 8decc3c8b8 Fixed some uninitialized values. 2017-05-17 09:38:31 -04:00
Andreas Streichardt af4da5796f More windows warnings 2017-05-16 17:00:31 +02:00
Dan Larkin 5817de528f Adjusted some cache constants and added eviction rate tracking. 2017-05-15 13:24:30 -04:00
jsteemann 11cf6ed5c6 re-set fillgrades back to original values 2017-05-15 16:47:41 +02:00
jsteemann fc44711531 adjust fillgrades as suggested by @neunhoef 2017-05-15 15:03:29 +02:00
jsteemann f49a32dff9 added missing casts 2017-05-15 14:39:27 +02:00
jsteemann ac6c5a79d7 minor enhancements for the cache 2017-05-15 14:29:14 +02:00
jsteemann a325870e13 fix invalid usage of refcount 2017-05-15 12:06:08 +02:00
Jan Christoph Uhde b7ca835671 release findings sooner if they contain many entries 2017-05-12 16:09:12 +02:00
Dan Larkin 0d89b6d0a4 Changed default cache size to something reasonable. 2017-05-11 16:15:06 -04:00
jsteemann ecff3cbb90 remove unused include 2017-05-10 12:58:09 +02:00
jsteemann a00a24e458 remove unnecessary includes 2017-05-10 12:57:22 +02:00
Dan Larkin f4a8b6911f Fixed data layout of cache buckets for 32-bit systems. 2017-04-27 18:25:42 -04:00
Dan Larkin eaac6c013c Fixed issue with cache transactions. 2017-04-07 16:58:22 -04:00
Simon Grätzer 61791509d6 Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api 2017-04-06 12:41:59 +02:00
Simon Grätzer fce51594ac Fixing hash index semantics 2017-04-06 12:41:47 +02:00
jsteemann 617e23e25a cppcheck 2017-04-06 11:48:07 +02:00
jsteemann 8b57f1996e Merge branch 'devel' of https://github.com/arangodb/arangodb into engine-api 2017-04-06 11:19:41 +02:00
Simon Grätzer a90e62bc02 Conversion errors 2017-04-06 10:50:40 +02:00
Dan Larkin ae84e8ac84 Cache workaround to pass upgrade test. 2017-04-05 12:55:16 -04:00
jsteemann eaba8c5db0 make begin() behave correctly when there is OOM 2017-04-05 14:51:09 +02:00
Dan Larkin dd0a7c8869 Move assertions to maintainer mode conditional blocks. 2017-04-04 19:17:23 -04:00
Dan Larkin c339b641b8 Fixed allocation bug for many-cache situation. 2017-04-03 11:44:37 -04:00
Dan Larkin 9590d911ea Removed some alignas directives. 2017-03-27 17:32:44 -04:00
Dan Larkin c2f370f99b Fixed an alignment bug in cache. 2017-03-24 13:39:05 -04:00
jsteemann 30b4b2b402 prevent unlikely division by zero 2017-03-23 18:17:47 +01:00
Dan Larkin eaca014406 Fixed deadlock in cache shutdown. 2017-03-23 12:11:50 -04:00
Dan Larkin 3ac4495eac Moved Finding class out of Cache for convenience. 2017-03-14 11:51:25 -04:00
Dan Larkin 45ca4bca08 Fixed some compiler warnings. 2017-03-13 13:10:22 -04:00
jsteemann 7634bb5039 fixed some compile warnings 2017-03-13 17:44:46 +01:00
hkernbach ecfe18a6ce fixed clang build error 2017-03-13 12:47:09 +01:00
Dan Larkin 06c3668915 Fixed a compile bug. 2017-03-11 13:22:07 -05:00
Dan Larkin 6a449efb06 Improved cache rebalancing and allocation strategies. 2017-03-11 12:15:08 -05:00
Dan Larkin db2cabf844 Completed implementation of transactional cache. 2017-03-06 10:31:36 -05:00
jsteemann 79f6a39c23 fix cppcheck errors 2017-03-06 14:22:03 +01:00
Mark bf8f0b7be8 fixed windows compile error 2017-03-06 12:24:20 +01:00
Dan Larkin b9b977c889 Added hit-rate reporting to caches. 2017-02-28 14:04:13 -05:00
jsteemann a6421118d4 fix cppcheck complaint 2017-02-28 17:02:24 +01:00
Dan Larkin e538f1e962 Fixed bugs in cache resize tasks and related tests. 2017-02-27 17:28:45 -05:00
jsteemann 779755b605 MSVC 2017-02-27 09:40:14 +01:00
jsteemann f72f53d6ca fix compile warnings and errors 2017-02-27 09:18:56 +01:00
Dan Larkin 84f284543c Fixed two compile errors. 2017-02-24 17:12:32 -05:00
Dan Larkin 09600f0971 Added hash cache system. 2017-02-24 15:31:40 -05:00