1
0
Fork 0
Commit Graph

100 Commits

Author SHA1 Message Date
Dan Larkin a3ae2b7191 Augmented cache API and fixed a potential deadlock scenario. (#2579)
* Augmented cache API and fixed a potential deadlock scenario.

* The RocksDBEdgeIndex now tries to read up to 10 times form the cache on lock_timeout. Instead of rewriting everything after first attempt
2017-06-19 17:28:04 +02:00
Simon Grätzer 634254b80f adding load and unload 2017-06-02 14:44:38 +02:00
Simon Grätzer 6c905c8d26 Missed some markers 2017-05-23 11:37:17 +02:00
Simon Grätzer 88977d204a Merge branch 'devel' of https://github.com/arangodb/arangodb into column-family
# Conflicts:
#	arangod/RocksDBEngine/RocksDBIndex.cpp
#	arangod/RocksDBEngine/RocksDBIndex.h
#	arangod/RocksDBEngine/RocksDBPrimaryIndex.cpp
#	arangod/RocksDBEngine/RocksDBPrimaryIndex.h
2017-05-23 11:17:30 +02:00
Simon Grätzer ddfa15b8cc Adding bound checking back 2017-05-22 19:09:32 +02:00
Simon Grätzer 9679aecf53 Adding bounds back 2017-05-22 17:39:19 +02:00
Simon Grätzer a99611e7c0 Various changes 2017-05-19 16:43:00 +02:00
Simon Grätzer 2bd2a15cb3 Column family support 2017-05-18 22:08:34 +02:00
jsteemann 226920d7fa optimizations 2017-05-17 23:41:16 +02:00
Jan Christoph Uhde 415cbfea60 fix figures and add tests 2017-05-17 12:22:43 +02:00
Simon Grätzer e25f88ef4d Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangod/RocksDBEngine/RocksDBCuckooIndexEstimator.h
#	arangod/RocksDBEngine/RocksDBEdgeIndex.cpp
#	arangod/RocksDBEngine/RocksDBIndex.cpp
2017-05-16 16:59:50 +02:00
jsteemann a75271e1f9 optimizations for key bounds 2017-05-16 12:53:44 +02:00
Simon Grätzer df3eed2289 Various changes 2017-05-16 10:58:15 +02:00
Michael Hackstein d7d650e27d Implemented index estimates for RocksDB. Now the following indexes have
a proper estimate:
* HashIndex
* SkiplistIndex / Persistent
* EdgeIndex
2017-05-15 17:17:58 +02:00
Jan Christoph Uhde d6c06e3672 exose cache hit rate for rocksdb caches 2017-05-12 15:59:26 +02:00
Dan Larkin 787335929c Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-11 14:39:06 -04:00
Dan Larkin 1fc3480a6b Added document cache. 2017-05-11 14:39:00 -04:00
Simon Grätzer 310166d3cf Fixing locking error 2017-05-11 15:55:06 +02:00
Dan Larkin 52711a2b00 Added proper truncation support for RocksDB indexes. 2017-05-10 19:57:22 -04:00
Jan Christoph Uhde e2b78d71b6 Merge branch 'devel' of https://github.com/arangodb/arangodb into feature/edge-index-cache
* 'devel' of https://github.com/arangodb/arangodb:
  Fix abort conditions of FailedLeader
  removing unused and unimplemented methods
  cppcheck
  getting rid of exceptions in supervision
  change to sleep_until so older windows are pleased (and is a better fitting method anyway)
  "searching for culprit breaking ensureIndex in cluster through go driver"
  Fixing fulltext deduplication
2017-05-10 19:00:19 +02:00
Jan Christoph Uhde ce515abbd9 report size of cache for rocksdb indexes 2017-05-10 18:44:01 +02:00
Jan Christoph Uhde 3e25aec2f3 fix enabling of caches 2017-05-10 15:58:28 +02:00
Jan Christoph Uhde e5db579b25 Merge branch 'devel' of https://github.com/arangodb/arangodb into feature/edge-index-cache
* 'devel' of https://github.com/arangodb/arangodb: (54 commits)
  attempt to fix races in replication
  grunt build
  use exclusive transaction in syncer
  change feature order around
  dashboard
  added api cluster api routes
  add selection of storage engine
  use some parallelism
  micro optimizations
  Fix truncate for geo
  added assertions
  remove unused include
  try to fix initial sync problem
  remove unnecessary includes
  Finally fix the error where suddenly an array of dbservers are being called
  Update queryView.js
  initialize bool variable
  remove debug output
  removed unused private field
  Wrong index number
  ...
2017-05-10 15:14:08 +02:00
jsteemann 12093e809f added assertions 2017-05-10 12:58:28 +02:00
Jan Christoph Uhde e6d41cac9a clean up edge-index code - handling of invalidated caches still missing 2017-05-10 09:03:21 +02:00
Jan Christoph Uhde 738989f9a3 add blacklisting for keys in rocksdb-edge-index on insert/remove 2017-05-09 18:33:05 +02:00
Simon Grätzer 1c82d4448c Adding compaction and estimateSize method for rocksdb 2017-05-04 13:08:02 +02:00
Michael Hackstein 33d9e8af9d Added an Assert when persisting an index it's objectId is not allowed to be 0 2017-05-02 13:17:57 +02:00
Dan Larkin 5e0a60406a Fixed recovery bug. 2017-04-28 14:02:49 -04:00
jsteemann fe1268af97 added missing return 2017-04-24 23:30:57 +02:00
jsteemann fcc61115d8 try to fix feature startup order (Scheduler vs. CacheManager vs. DatabaseFeature) 2017-04-24 13:17:21 +02:00
Dan Larkin 841ef8b1a0 Changed index VPack building to include forPersistence flag. 2017-04-17 17:04:50 -04:00
Dan Larkin 2e0fdbf666 Fixed some bugs. 2017-04-13 20:06:25 -04:00
jsteemann 0e98a32455 fix objectId handling 2017-04-06 11:19:27 +02:00
Dan Larkin ae84e8ac84 Cache workaround to pass upgrade test. 2017-04-05 12:55:16 -04:00
Michael Hackstein 3d39766f12 Merge branch 'engine-api' of github.com:arangodb/arangodb into engine-api 2017-04-03 17:10:21 +02:00
Michael Hackstein 069394634c RocksDB Indexes do now destroy their cache as soon as they are dropped, instead of during deletion 2017-04-03 17:10:10 +02:00
Jan Christoph Uhde ae75917640 Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api
* 'engine-api' of https://github.com/arangodb/arangodb:
  added assertion to Comparator
  fix RemoveLargeRange
  fix ub
  fix assertion failure at shutdown
  Remove provisional code
  Fixed counter
  remove usleeps
  Fixed deadlock
  Fixed broken merge
  Fixing some issues
  added p/ to gitignore
  Integrated counters with collections
  properly include the javascript enterprise folders into the test tarballs
  fix parsing for URLs starting with ldap://
  fix filter for replication testcases
  Added counter manager
  updated licenses, added generator
  removed jshint completely
2017-04-03 16:54:09 +02:00
Jan Christoph Uhde 234180c08b wip - drop database 2017-04-03 16:52:21 +02:00
jsteemann f162fb2a0f fix ub 2017-04-03 15:26:38 +02:00
jsteemann 72f1790057 fix assertion failure at shutdown 2017-04-03 15:21:43 +02:00
Michael Hackstein 83e42cf6aa Added a destructor for RocksDB indxes that destroys the cache in the manager. Otherwise we end up with too many caches. 2017-04-03 13:16:38 +02:00
Simon Grätzer 0fd98ed0bb Fixed HashIndex matchesDefinition method 2017-03-31 12:22:58 +02:00
Dan Larkin 079c5764e8 Added cache support to RocksDBPrimaryIndex. 2017-03-30 16:09:40 -04:00
Simon Grätzer e246a8d8cb Moved „removeLargeRange“ method to commons 2017-03-30 14:46:21 +02:00
Simon Grätzer 1c6207fd86 Added drop() to indexes 2017-03-30 14:04:18 +02:00
Simon Grätzer cd9e9a13cf Path based enumerator 2017-03-29 17:33:02 +02:00
jsteemann 38ac3c23c8 fixed serialization bug 2017-03-29 09:17:23 +02:00
Dan Larkin 9b259d91fa Added comparator to engine/index. 2017-03-28 11:58:04 -04:00
jsteemann c986590384 add RocksDBIndex as base class for rocksdb-based indexes 2017-03-28 16:56:29 +02:00