1
0
Fork 0
Commit Graph

73 Commits

Author SHA1 Message Date
Jan dc5f6b89d6
replication improvements (#5958) 2018-07-25 12:49:24 +02:00
Simon 25ceed2c40 keep replication batches alive for longer (#5931)
* keeping replication batches alive for longer

* fix timeouts, fix revisions

* honor force in gc
2018-07-20 11:16:48 +02:00
Jan f83a1a0394
Feature 3.3/add recovery tests for intermediate commits (#4106)
* added several recovery tests that check intermediate commits

* small fixes

* fix tests
2017-12-20 09:46:12 +01:00
Simon Grätzer 90e6c78845 Make sure recalculated counts are actually stored (#4079)
(cherry picked from commit ab9faf56ce81a214a20683f7512db063ef9b063b)
2017-12-18 22:39:04 +01:00
Jan 3b0a8a9cdf make the replication applier auto-start for the RocksDB engine if con… (#3647) 2017-11-15 12:02:37 +01:00
Dan Larkin a775e37c76 Feature/unique vpack index lookup performance improvements with rocksdbkey optimizations (#3123)
* fixed issue #3075

* update the known issues document, as some issues have already been fixed

* speed up equality lookups in unique vpack indexes

* Allow for re-use of RocksDBKey objects through transaction leaser.

* Converted all RocksDBKey variants to non-static constructors.
2017-08-31 20:00:05 +02:00
Jan a212f45a86 Bug fix/issues 2308 (#3117)
* remove API docs for endpoints that were deleted in 3.0

* remove unused variable

* set all scalar values in the ctor, so check tools do not complain

* move Result objects

* prevent potential nullptr access

* remove ambiguous boolean parameter with no clear meaning

* make code check tools happy

* don't allow copying cache Findings, allow moving Results

* the debug functionality for counting RocksDB key ranges was broken

this produced sporadic test failures

* remove superfluous iostream include

* fix range checks

* don't leak if an error happens during database removal

* try to simplify Result a bit

* try to deletion checks a bit more robust
2017-08-24 14:47:22 +02:00
Dan Larkin e373d343c8 Further checks/fixes for RocksDB recovery process (#3110)
* Fixed issue with periodic syncing and WAL file retention.

* Fixed sequence number tracking properly this time.

* Fixed a few small issues.
2017-08-23 11:07:10 +02:00
Dan Larkin 84f11c223d Fixed issue with periodic syncing and WAL file retention. (#3098) 2017-08-22 15:51:12 +02:00
Dan Larkin 2294fbc290 Fixed issue with autoincrement data not being persisted properly in RocksDB (#3059). (#3067) 2017-08-17 21:53:55 +02:00
Jan 4f5d5ff54d slightly move responsibility for recovery (#2922) 2017-08-01 14:25:13 +02:00
Simon Grätzer d8c57f2cc8 Feature/rocksdb hashsearch (#2713)
* Testing hash for documents

* fixing logspam error

* added base support for kHash in the edge index

* Current version of hash enabled edge index

* removed rocksdb key type byte, dynamic prefixes for hash-index

* Fixing issues with key classes

* Fixing merge conflict

* Fixing version with semi-working hash index

* fixing various issues

* Fixing hanger in EdgeIndexIterator nextExta, when _cache is disabled. Reenable cache

* Fixing geo index bounds, and fillIndexes error handling

* Adding back failure point

* Fixing RocksDBKey::vertexId

* Added version check on startup

* Fixing version check

* added one more check

* properly detect column families at startup

* Adding additional sanity checking

* Adding missing column family

* some fixes

* Turned off geoindex sync

* fixed error

* added asserts (untested)

* Adding more asserts
2017-07-05 10:18:52 +02:00
Dan Larkin 05c8d3ae71 Converted Get calls to use PinnableSlice where possible. (#2683) 2017-07-01 00:27:27 +02:00
Dan Larkin ee8cb749bb Added recovery tests for views and fixed a few related bugs. (#2682)
* Added recovery tests for views and fixed a few related bugs.

* Added more view recovery tests.

* Modified view recovery tests to add a waitForSync operation after.

* fixed usage of wrong view type

* fixed recovery of view change markers
2017-06-29 17:09:43 +02:00
Jan dd59eee715 fix a crash in the counter manager (#2665) 2017-06-26 16:28:53 +02:00
Jan cfbd8ed93c Bug fix/rocksdb autoincrement (#2648)
* Added autoincrement keygen support to RocksDB engine with test.

* fixed key generator state keeping for mmfiles engine
2017-06-23 15:27:09 +02:00
Simon Grätzer 21dd147ad6 Fixing issues 2017-05-26 14:03:12 +02:00
Simon Grätzer 92c7bf8dd6 fixing wrong counter manager 2017-05-26 13:35:31 +02:00
Simon Grätzer d5f85d5bbb Adding more colum families 2017-05-26 10:43:17 +02:00
Simon Grätzer 555a7fcecd Merge branch 'devel' of https://github.com/arangodb/arangodb into column-family 2017-05-24 19:04:20 +02:00
Michael Hackstein 91e19071a9 The Cuckoo index estimator now uses 32bit counters instead of 16bit. It should be more relyable now. 2017-05-23 12:56:24 +02:00
Simon Grätzer a99611e7c0 Various changes 2017-05-19 16:43:00 +02:00
Michael Hackstein 5bb55b33e5 Put the release in countermanager into a TRI_DEFER for safety 2017-05-16 11:06:09 +02:00
Michael Hackstein dee84a1edb Added a forgotten release() after using a vocbase 2017-05-16 10:50:09 +02:00
jsteemann baab846d9a remove unused variable 2017-05-15 17:38:33 +02:00
Michael Hackstein d7d650e27d Implemented index estimates for RocksDB. Now the following indexes have
a proper estimate:
* HashIndex
* SkiplistIndex / Persistent
* EdgeIndex
2017-05-15 17:17:58 +02:00
jsteemann 060e875cd4 update tick values from numeric keys 2017-05-03 22:44:58 +02:00
jsteemann c716fcacd3 write settings on shutdown 2017-05-03 15:18:17 +02:00
Jan Christoph Uhde 74e82d15e9 remove exception and add some documentation to function 2017-05-03 11:16:13 +02:00
Jan Christoph Uhde 53004f2a64 recaluclate count by collection scan on request 2017-05-03 10:42:58 +02:00
Dan Larkin 5e0a60406a Fixed recovery bug. 2017-04-28 14:02:49 -04:00
jsteemann 502d3ee354 fix reading of initial tick values from RocksDB 2017-04-28 14:28:13 +02:00
jsteemann 4f226547d9 abort early 2017-04-28 11:34:36 +02:00
Jan Christoph Uhde 8df6e1c289 update ticks after parsing wal 2017-04-28 11:04:06 +02:00
jsteemann d1cad2acc9 cppcheck
fix
2017-04-24 23:06:36 +02:00
jsteemann af9a214c9f Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-04-24 14:23:54 +02:00
jsteemann b7bf8a8983 implement basic operations for settings 2017-04-24 14:19:29 +02:00
Michael Hackstein 6cfa55ac6c Merge branch 'engine-api' of github.com:arangodb/arangodb into devel 2017-04-24 13:54:42 +02:00
jsteemann fcc61115d8 try to fix feature startup order (Scheduler vs. CacheManager vs. DatabaseFeature) 2017-04-24 13:17:21 +02:00
Simon Grätzer 88dc999001 Counter manager fixes 2017-04-24 12:43:44 +02:00
jsteemann 862ec7bae3 remove log garbage 2017-04-21 12:57:20 +02:00
Simon Grätzer b304d35ac2 Added rocksdb background thread 2017-04-20 18:50:52 +02:00
jsteemann e42b500ea7 turn off log spam 2017-04-18 21:58:03 +02:00
Dan Larkin 7ad0c75745 Fixed bug in index info persistence/recovery. 2017-04-18 14:55:58 -04:00
jsteemann 49fbec6ac3 call shutdown in the dtor 2017-04-18 14:49:57 +02:00
Simon Grätzer 3b3ee5f996 Counter fixes 2017-04-12 17:10:35 +02:00
Simon Grätzer d8c191600a Better log messages 2017-04-12 15:24:45 +02:00
Simon Grätzer 5df9867a7c removed unnecessary code 2017-04-12 15:23:35 +02:00
Simon Grätzer d9510eee0b Fixing count 2017-04-12 15:22:18 +02:00
Simon Grätzer 1d90520a9d Updated counter manager 2017-04-12 09:58:01 +02:00