Simon Grätzer
a99611e7c0
Various changes
2017-05-19 16:43:00 +02:00
Simon Grätzer
e73f446c5b
Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
2017-05-18 22:08:39 +02:00
Simon Grätzer
2bd2a15cb3
Column family support
2017-05-18 22:08:34 +02:00
Michael Hackstein
e4050f9804
Temporary Commit, modifying some RocksDB Options and the EdgeIndex Cache size. This commit is used for NoSQL Performance Banchmark validation.
2017-05-18 15:45:49 +02:00
jsteemann
226920d7fa
optimizations
2017-05-17 23:41:16 +02:00
Simon Grätzer
4b6035ff64
Fixed merge
2017-05-16 17:07:15 +02:00
Simon Grätzer
e25f88ef4d
Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
...
# Conflicts:
# arangod/RocksDBEngine/RocksDBCuckooIndexEstimator.h
# arangod/RocksDBEngine/RocksDBEdgeIndex.cpp
# arangod/RocksDBEngine/RocksDBIndex.cpp
2017-05-16 16:59:50 +02:00
Simon Grätzer
5265d2a063
intermediate commits
2017-05-16 16:21:39 +02:00
Jan Christoph Uhde
9aab78a6e9
remove unused code
2017-05-16 13:06:33 +02:00
Simon Grätzer
df3eed2289
Various changes
2017-05-16 10:58:15 +02:00
Michael Hackstein
d7d650e27d
Implemented index estimates for RocksDB. Now the following indexes have
...
a proper estimate:
* HashIndex
* SkiplistIndex / Persistent
* EdgeIndex
2017-05-15 17:17:58 +02:00
jsteemann
c423cf05a7
storage revisions in edge cache
2017-05-15 15:05:46 +02:00
jsteemann
52ba50e281
micro optimizations for edge index
2017-05-15 12:06:27 +02:00
jsteemann
c6d87e0060
ctor, then dtor, then others
2017-05-15 09:31:40 +02:00
jsteemann
51e8ee50c6
fix indentation
2017-05-15 09:31:08 +02:00
jsteemann
7c959cf81f
fix indentation
2017-05-15 09:30:38 +02:00
Jan Christoph Uhde
4a85f93814
avoid search in cache when iterator was resumed
2017-05-12 21:38:29 +02:00
Jan Christoph Uhde
b7ca835671
release findings sooner if they contain many entries
2017-05-12 16:09:12 +02:00
Jan Christoph Uhde
227d6648a2
fix not advancing iterator in rocksdb edge index
2017-05-12 14:47:42 +02:00
Jan Christoph Uhde
07bb07de39
Merge branch 'devel' of https://github.com/arangodb/arangodb into feature/edge-index-cache
...
* 'devel' of https://github.com/arangodb/arangodb :
add debug output
more unique ptrs
fixed comment
moved description into correct section
remove unused options
enable rocksdb logger
2017-05-12 13:56:57 +02:00
Jan Christoph Uhde
db38ef3522
more clean up for edge index
2017-05-12 13:51:05 +02:00
Jan Christoph Uhde
a1454ce87c
clean up RocksDBEdgeIndex code
2017-05-12 13:27:25 +02:00
Jan Christoph Uhde
dd00e03010
fix2
2017-05-12 13:18:13 +02:00
Jan Christoph Uhde
3afdb2a666
fix
2017-05-12 12:35:35 +02:00
Jan Christoph Uhde
7902d0e44e
Merge branch 'devel' of https://github.com/arangodb/arangodb into feature/edge-index-cache
...
* 'devel' of https://github.com/arangodb/arangodb : (25 commits)
Add footer to docs, unify slogan
Docs: make graph traversal images hard copies (fixes Cygwin builds)
Added documentation for RocksDB and hash cache options to manual.
Changed default cache size to something reasonable.
cppcheck
added comments
fix shutdown order
Added document cache.
fix some replication issues
Invalidate current coordinators on every 2nd heartbeatrun
Show timeout when failing
Addding locking, fixing conversion warning
Fixing locking error
resync changelog to 3.1
Fix jslint
CHANGELOG: SIGHUP forwarding
forward SIG_HUP from supervisor
Allow removing dbnodes
Rocksb: index locking issue
Fix serverAlias map...this was ridiculous
...
2017-05-12 10:37:24 +02:00
jsteemann
abeae0a30d
cppcheck
2017-05-11 21:21:58 +02:00
Jan Christoph Uhde
9e9faf7bbd
hopefully fix the cache
2017-05-11 18:07:30 +02:00
Jan Christoph Uhde
dce3250862
add more logging to edge index
2017-05-11 16:42:49 +02:00
Simon Grätzer
310166d3cf
Fixing locking error
2017-05-11 15:55:06 +02:00
Jan Christoph Uhde
ba3c797704
fix bug in edgeIndex
2017-05-11 15:20:39 +02:00
Jan Christoph Uhde
c6fa6bb1ae
add empty array slices in cache if no primary key for fromTo can be found
2017-05-11 13:13:15 +02:00
Jan Christoph Uhde
36d8b31335
decrease log level for edge index cache
2017-05-11 12:56:12 +02:00
Jan Christoph Uhde
ee6e28a33d
first tests pass for rocksdb index with cache
2017-05-11 12:11:00 +02:00
Jan Christoph Uhde
e36d795dad
crashing during lookup
2017-05-11 11:18:44 +02:00
Jan Christoph Uhde
db7fdd2b7f
add postprocessRemove for RocksDBEdgeIndex
2017-05-11 09:50:23 +02:00
Jan Christoph Uhde
847dd3ad5d
Merge branch 'devel' of https://github.com/arangodb/arangodb into feature/edge-index-cache
...
* 'devel' of https://github.com/arangodb/arangodb :
geo index fixes
adding transactions to the geo index
2017-05-10 18:43:20 +02:00
Jan Christoph Uhde
3e25aec2f3
fix enabling of caches
2017-05-10 15:58:28 +02:00
Jan Christoph Uhde
e5db579b25
Merge branch 'devel' of https://github.com/arangodb/arangodb into feature/edge-index-cache
...
* 'devel' of https://github.com/arangodb/arangodb : (54 commits)
attempt to fix races in replication
grunt build
use exclusive transaction in syncer
change feature order around
dashboard
added api cluster api routes
add selection of storage engine
use some parallelism
micro optimizations
Fix truncate for geo
added assertions
remove unused include
try to fix initial sync problem
remove unnecessary includes
Finally fix the error where suddenly an array of dbservers are being called
Update queryView.js
initialize bool variable
remove debug output
removed unused private field
Wrong index number
...
2017-05-10 15:14:08 +02:00
Simon Grätzer
5fa85761a2
adding transactions to the geo index
2017-05-10 14:54:39 +02:00
Jan Christoph Uhde
4cfbe85e4a
honor batch size && length limit for cache values
2017-05-10 14:01:10 +02:00
Jan Christoph Uhde
7ea4eaf774
fix index figures
2017-05-10 14:00:40 +02:00
Jan Christoph Uhde
e6d41cac9a
clean up edge-index code - handling of invalidated caches still missing
2017-05-10 09:03:21 +02:00
Dan Larkin
ca91c0f7c9
Added some optimizations enabled by prefix extraction.
2017-05-09 18:36:12 -04:00
Jan Christoph Uhde
738989f9a3
add blacklisting for keys in rocksdb-edge-index on insert/remove
2017-05-09 18:33:05 +02:00
Jan Christoph Uhde
e29db44af6
begin work on cache for edge index
2017-05-09 17:22:27 +02:00
Simon Grätzer
d9bff18814
Fulltext index
2017-05-05 13:58:11 +02:00
Simon Grätzer
804676ae65
Moving estimatedSize to memory()
2017-05-04 18:57:22 +02:00
Simon Grätzer
94e4437c3a
Added some non transactional truncate logic
2017-05-04 18:07:47 +02:00
Simon Grätzer
1c82d4448c
Adding compaction and estimateSize method for rocksdb
2017-05-04 13:08:02 +02:00
Simon Grätzer
0faa1adac1
fixed unique contraints
2017-05-03 17:45:21 +02:00
Simon Grätzer
a2e2c00d62
fillIndex non transactional + tests
2017-05-03 16:07:29 +02:00
Jan Christoph Uhde
b7f42f638e
add empty impl for recalculating counts in rocksdb engine
2017-05-02 17:54:36 +02:00
jsteemann
fef62ecda6
added more assertions
2017-04-28 14:32:52 +02:00
jsteemann
7344a03623
fix crashes
2017-04-25 15:47:11 +02:00
jsteemann
4300c77d3e
fixes for non-array IN lookups, added tests
2017-04-25 01:47:07 +02:00
jsteemann
d3f32799c6
fixed assertion failure
2017-04-18 14:54:29 +02:00
Dan Larkin
841ef8b1a0
Changed index VPack building to include forPersistence flag.
2017-04-17 17:04:50 -04:00
Simon Grätzer
e0e00b0b6b
Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api
...
# Conflicts:
# arangod/RocksDBEngine/RocksDBEdgeIndex.cpp
2017-04-13 17:48:52 +02:00
Simon Grätzer
866d8b7451
Fixing tests
2017-04-13 17:45:16 +02:00
Michael Hackstein
1087065ea5
Merge branch 'devel' of github.com:arangodb/arangodb into engine-api
2017-04-13 17:34:25 +02:00
Jan Christoph Uhde
e690e7fc80
Merge remote-tracking branch 'origin/feature/engine-api/edgeindex-report-as-single-index' into engine-api
...
* origin/feature/engine-api/edgeindex-report-as-single-index:
change mmfiles indexes to work with slightly changed API
fix rocksdb engine index reporting but break report for mmfiles engine
update error messages
2017-04-13 08:46:54 +02:00
Dan Larkin
d435d274ea
Merge branch 'engine-api' of github.com:arangodb/arangodb into engine-api
2017-04-12 09:35:19 -04:00
Jan Christoph Uhde
2700a6d79d
fix rocksdb engine index reporting but break report for mmfiles engine
2017-04-12 14:50:55 +02:00
Simon Grätzer
fac53e5a06
Fixing edge iterator
2017-04-11 10:01:56 +02:00
Dan Larkin
b030cdb347
Fixed an edge index iterator bug.
2017-04-10 20:12:15 -04:00
jsteemann
0e98a32455
fix objectId handling
2017-04-06 11:19:27 +02:00
jsteemann
e5d733867e
make more tests pass
2017-04-05 14:57:18 +02:00
Michael Hackstein
069394634c
RocksDB Indexes do now destroy their cache as soon as they are dropped, instead of during deletion
2017-04-03 17:10:10 +02:00
Simon Grätzer
7afcac9ed7
Fixing some issues
2017-04-03 14:24:58 +02:00
Jan Christoph Uhde
e49024f16e
add drop collection to rocksdb engine
2017-04-03 10:41:02 +02:00
jsteemann
49551127b9
de-constified lookupKey
2017-03-31 10:16:14 +02:00
Simon Grätzer
9754d38df3
Added hash-, skip list, persistent indexes
2017-03-30 16:00:27 +02:00
Simon Grätzer
1d3149c31b
Edge index compliant with design doc
2017-03-30 15:11:03 +02:00
Simon Grätzer
e246a8d8cb
Moved „removeLargeRange“ method to commons
2017-03-30 14:46:21 +02:00
Simon Grätzer
1c6207fd86
Added drop() to indexes
2017-03-30 14:04:18 +02:00
Simon Grätzer
3eb1723dec
Fixed edge index
2017-03-30 13:22:39 +02:00
Simon Grätzer
cd9e9a13cf
Path based enumerator
2017-03-29 17:33:02 +02:00
Simon Grätzer
d8d7b99a47
Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api
2017-03-29 11:38:24 +02:00
Jan Christoph Uhde
796c32a341
improve error handling in some places
2017-03-29 11:04:04 +02:00
Simon Grätzer
8b832fe746
Moved to KeyBounds for edge prefix
2017-03-29 10:07:12 +02:00
Simon Grätzer
9ba5586f32
Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api
...
# Conflicts:
# arangod/RocksDBEngine/CMakeLists.txt
2017-03-29 09:47:41 +02:00
Simon Grätzer
94e99c28c9
Added PathBasedIndex
2017-03-28 21:50:03 +02:00
jsteemann
f4ce81f2e3
Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api
2017-03-28 17:59:32 +02:00
jsteemann
a221d30b8f
added savepoints
2017-03-28 17:55:25 +02:00
Simon Grätzer
d5d4cae724
Added read options to edge index
2017-03-28 17:41:49 +02:00
Simon Grätzer
b1f010e33c
Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api
...
# Conflicts:
# arangod/RocksDBEngine/RocksDBTransactionState.h
2017-03-28 17:23:38 +02:00
Simon Grätzer
913b60c983
Fix usleep
2017-03-28 17:15:05 +02:00
jsteemann
9e15fb4f35
Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api
2017-03-28 16:59:22 +02:00
jsteemann
c986590384
add RocksDBIndex as base class for rocksdb-based indexes
2017-03-28 16:56:29 +02:00
Jan Christoph Uhde
3c31ec2314
add function for looking up revisions to collection
2017-03-28 14:49:19 +02:00
Simon Grätzer
7a26fb22c1
Pushing commons method
2017-03-28 14:07:01 +02:00
Simon Grätzer
9e1a181393
Edge index tax changes
2017-03-28 14:02:29 +02:00
Simon Grätzer
b2300ca207
Added EdgeIndexValue to RocksDBKey and switched lookup to StringRef
2017-03-28 12:01:40 +02:00
Simon Grätzer
4174183ffa
Fixed exception because of hash index
2017-03-28 11:29:52 +02:00
Simon Grätzer
d6b7df6ba1
Edge index fixes
2017-03-28 10:13:07 +02:00
Simon Grätzer
fc3a950d08
Fixed compiler errors
2017-03-28 01:18:57 +02:00
Simon Grätzer
8543cb77e3
Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api
...
# Conflicts:
# arangod/RocksDBEngine/RocksDBCommon.cpp
# arangod/RocksDBEngine/RocksDBCommon.h
2017-03-28 01:15:50 +02:00
Simon Grätzer
1a50029592
Edge Index work
2017-03-28 00:55:59 +02:00
Simon Grätzer
a2157595e8
RocksDB: starting edge index
2017-03-27 18:22:24 +02:00
jsteemann
2c54a6ac1e
added some basic transaction handling
2017-03-24 17:23:32 +01:00
jsteemann
02c0dcc689
properly report error locations
2017-03-23 20:18:33 +01:00
jsteemann
f17ff29518
added stubs for indexes
2017-03-23 15:24:00 +01:00