1
0
Fork 0
Commit Graph

146 Commits

Author SHA1 Message Date
Jan 5bfcff30cd [WIP] Feature/reduce extraction to projection (#2735)
* reduce extractions to projections

* recycle string buffers in SocketTask

* micro optimizations for mmfiles indexes

* added special lookup function for _key

* moved function into the correct file

* speed up key buffer allocations a bit

* added noexcept specifier

* correctly name variable

* explicitly move bounds

* fix and speedup from/toPersistent functions

* reuse string from ManagedDocumentResult for multiple lookups

* use move-assign

* a bit less work for single server

* speedup AQL function HASH

* single fetch optimization

* performance optimization for the case when no documents need to be returned

* make reduce-extraction-to-projection a RocksDB-only optimizer rule
2017-07-12 11:22:29 +02:00
Simon Grätzer 2d3f1d8245 Added assert(false) to force coredump in jenkins 2017-06-07 17:44:52 +02:00
Simon Grätzer 53ece582a8 optimized all index iterator 2017-05-31 11:34:32 +02:00
jsteemann 53b150b206 added tests for intermediate commits 2017-05-30 12:03:58 +02:00
jsteemann a7b3839e6c renamed "getMore" to "next" 2017-05-23 08:53:13 +02:00
Simon Grätzer ead7ebcd7b Little changes for SLPA support 2017-05-15 10:42:25 +02:00
jsteemann 08cd4ced33 moved class around 2017-04-07 13:13:48 +02:00
jsteemann 81dcfbbe3d pass trx into numberDocuments 2017-03-31 11:33:16 +02:00
Jan Christoph Uhde 95007fe28e Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api-arango-result
* 'engine-api' of https://github.com/arangodb/arangodb: (46 commits)
  Merged RocksDBPathBasedIndex into RocksDBVPackIndex.
  fix handling of externals
  fix toArray()
  fix returning documents
  Added hash-, skip list, persistent indexes
  harmonize filtering - filter on full filename.
  mini modifications
  standardize starting of servers for replication tests
  Edge index compliant with design doc
  another fix for #2404
  Moved „removeLargeRange“ method to commons
  Added length byte to IndexValue keys.
  fixed issue #2404
  Added drop to primary index
  Added drop() to indexes
  Fixes a coordinator crash in Clustered Traversal. In case of failover during query planning.
  Fixed edge index
  Expand on CORS documentation
  Let ArangoDB handle the allow-credentials header
  make the authentication tests run on directories
  ...
2017-03-30 19:46:17 +02:00
Jan Christoph Uhde b83ae2ab82 refactor some code to make use of arangodb::Result 2017-03-30 09:39:21 +02:00
Simon Grätzer 901abc6705 Fixing some windows conversion warnings 2017-03-29 11:35:37 +02:00
Simon Grätzer bac7081983 Pregel: Reduced logspam 2017-03-22 17:55:43 +01:00
Simon Grätzer 7bc01b46e0 Pregel: Changed scheduler post call 2017-03-20 12:22:16 +01:00
Simon Grätzer 79c2e87bac Pregel: code reformatting 2017-03-17 16:21:25 +01:00
Simon Grätzer 162a0476c3 Pregel: Removed ThreadPool, added test for memory mapping 2017-03-17 15:55:01 +01:00
Simon Grätzer 24eaf6a6ef Reverting integer hashing 2017-03-15 12:35:40 +01:00
Simon Grätzer 529cb4ae85 Integer ID for testing 2017-03-15 10:20:48 +01:00
Simon Grätzer ec6eb718f2 Working lazyloading with new memory backend 2017-03-13 23:25:53 +01:00
Simon Grätzer 7e0ed82f0f Memory Mapped files 2017-03-13 15:13:47 +01:00
Simon Grätzer f2d77435c6 Added memory mapped file 2017-03-12 00:46:54 +01:00
Simon Grätzer aa156ac28f Micro-Optimizations 2017-03-09 17:00:24 +01:00
Simon Grätzer 00d77cbb5e Fix compiler warnings 2017-03-09 14:38:39 +01:00
Simon Grätzer a1752da492 Added single server support 2017-03-08 18:20:36 +01:00
Simon Grätzer c049576c59 Added single server support 2017-03-07 15:07:51 +01:00
Simon Grätzer 0d5f8ae5b8 Fixed canceling of storage, changed the docs 2017-03-07 12:14:12 +01:00
Simon Grätzer 0b64bf3bc2 Fixed pregel test, async default off 2017-03-07 10:41:03 +01:00
Simon Grätzer 5b1cb0ec6d Various fixes 2017-03-06 15:41:27 +01:00
Simon Grätzer 77d02669c4 Added LabelPropagation 2017-03-02 19:53:34 +01:00
Simon Grätzer 3533364739 Added support for canceling during loading 2017-03-01 15:06:20 +01:00
Simon Grätzer 27c617fe10 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	3rdParty/V8/v8
#	arangod/Transaction/Methods.h
#	arangod/Utils/UserTransaction.h
#	arangod/V8Server/v8-collection.cpp
2017-03-01 14:52:35 +01:00
Simon Grätzer 92d705ce76 Fix 2017-02-27 02:56:57 +01:00
Simon Grätzer bba94e7ecd Added HITS algorithm 2017-02-20 12:19:01 +01:00
Simon Grätzer ea905816bd Some reshuffling 2017-02-19 13:50:43 +01:00
Simon Grätzer 18fb10e2f7 Added Effective Closeness 2017-02-17 03:41:51 +01:00
Simon Grätzer ddee4c3619 Fixing async mode and LineRank 2017-02-16 16:52:58 +01:00
Simon Grätzer 5f2f6727d3 Fixing log topics 2017-02-10 18:07:02 +01:00
Simon Grätzer 4edba27b41 Fixed log topic 2017-02-10 16:31:38 +01:00
Simon Grätzer 9b9f91a81c Pegel: Adding support for "PREGEL_RESULT" in aql 2017-02-07 18:37:23 +01:00
Simon Grätzer 9d669eadec Pregel: Multi-Threaded vertex updates 2017-02-07 13:27:03 +01:00
Simon Grätzer 00ebdbf61e Reformatting pregel code 2017-02-05 16:06:46 +01:00
Simon Grätzer 473b58c750 Fixed some stuff 2017-02-04 00:58:53 +01:00
Simon Grätzer 877aa43599 Fixing a bug 2017-02-02 16:49:39 +01:00
Simon Grätzer bf25888450 Fixing compiler warnings 2017-02-02 14:58:02 +01:00
Simon Grätzer 5cce352c13 Fixed some stuff 2017-02-02 12:15:24 +01:00
Simon Grätzer 43ad534142 Started README, threshold for page rank 2017-01-31 18:22:50 +01:00
Simon Grätzer 6abfd6c3bd Fixed vertex loading, added back ThreadPool 2017-01-31 00:37:44 +01:00
Simon Grätzer ae07f752d6 Fixing a possible error source 2017-01-30 02:34:59 +01:00
Simon Grätzer 322475a7d5 changing some stuff 2017-01-30 02:28:23 +01:00
Simon Grätzer 5d9aa0cb6b Multi threaded GraphStore, ran clang-format 2017-01-30 01:39:39 +01:00
Simon Grätzer 1e2b4d440a Pre-Allocating memory 2017-01-29 16:11:03 +01:00
Simon Grätzer d1ca2b3411 Fixed a problem with loading edges from multiple collections 2017-01-29 15:16:34 +01:00
Simon Grätzer 324c874e99 Added test, some refactoring 2017-01-27 15:31:54 +01:00
Simon Grätzer b45812e0e1 Seemingly working SCC, optimized graph loading 2017-01-25 02:05:45 +01:00
Simon Grätzer afaab2e8d5 Working on PageRank and SCC 2017-01-24 16:37:21 +01:00
Simon Grätzer 1b65ff07b8 Fixed PageRank 2017-01-24 02:04:53 +01:00
Simon Grätzer 326be844d8 Attempting to fix page rank 2017-01-23 16:22:45 +01:00
Simon Grätzer 79e8a2444c Double page rank, storage optimizations 2017-01-23 16:01:54 +01:00
Simon Grätzer 1cc34c846f Connected components, removing some template parameters 2017-01-23 12:24:00 +01:00
Simon Grätzer 8adf4a3039 Adaptive message buffers, Optimized message format 2017-01-22 15:53:11 +01:00
Simon Grätzer 66ba421dff Pregel Refactoring 2017-01-18 14:06:19 +01:00
Simon Grätzer 2204ba7de0 Some refactoring 2017-01-17 22:27:41 +01:00
Simon Grätzer 7b46af7e67 Better logging 2017-01-13 14:41:54 +01:00
Simon Grätzer d001199450 Better debugging messages 2017-01-10 16:30:15 +01:00
Simon Grätzer b7143906f5 Various changes 2017-01-10 11:15:05 +01:00
Simon Grätzer a4444c3b8a Fixed lazy loading v2 2017-01-10 09:21:26 +01:00
Simon Grätzer 449c182298 Fixed lazy loading 2017-01-09 21:11:39 +01:00
Simon Grätzer 78135ed8b3 Lazy Loading & auto corrections 2017-01-09 12:53:47 +01:00
Simon Grätzer 4ba13abebc Improve lazy loading 2016-12-31 14:46:25 +01:00
Simon Grätzer 21fc5ef91f Refactoring 2016-12-30 13:05:35 +01:00
Simon Grätzer 45ece34ae1 Various Changes 2016-12-29 18:09:39 +01:00
Simon Grätzer 2b18f29de2 Reformatting 2016-12-22 11:47:31 +01:00
Simon Grätzer 97a219da76 Changed document counting 2016-12-21 23:21:23 +01:00
Simon Grätzer f8dfca5e07 Reorganizing code 2016-12-14 10:39:37 +01:00
Simon Grätzer 63f87fbf52 reorganization 2016-12-13 13:54:14 +01:00
Simon Grätzer d293d215c1 Slight restructuring 2016-12-08 12:39:46 +01:00
Simon Grätzer 0f57b6633b Algorithms without combiners supported 2016-12-07 16:00:42 +01:00
Simon Grätzer f3f1e02d76 fixing some bugs 2016-12-05 16:23:06 +01:00
Simon Grätzer 0689ccaabb fixed some stuff, stopping still not working 2016-12-05 01:18:05 +01:00
Simon Grätzer 69322d769e shard indexes 2016-12-02 18:26:29 +01:00
Simon Grätzer 7d7474f6fd Structural changes, Algorithm registry, begin with optimistic recovery 2016-12-01 14:10:52 +01:00
Simon Grätzer 6c6c2a092d Multiple edge collections 2016-11-18 22:02:13 +01:00
Simon Grätzer c3d1118620 Multi-Threaded Pregel 2016-11-17 11:11:20 +01:00
Simon Grätzer 8e16011c67 Adding RangeIterator 2016-11-16 14:47:30 +01:00
Simon Grätzer 497e7b281e PageRank + Result writer 2016-11-13 19:10:37 +01:00
Simon Grätzer b0861672aa Working Aggregators, (seemingly) working PageRank 2016-11-13 03:10:45 +01:00
Simon Grätzer 7e435b2dfa Better GraphStore 2016-11-12 21:55:36 +01:00
Simon Grätzer 524878d242 Fixed aggregators 2016-11-11 12:01:15 +01:00
Simon Grätzer ecc8e29314 Working SSSP 2016-11-09 16:50:31 +01:00
Simon Grätzer 66137e4789 Working multiple collections 2016-11-08 13:45:44 +01:00
Simon Grätzer 034bc41729 Aggregators continued 2016-11-08 11:34:40 +01:00
Simon Grätzer 15224f7819 Using ThreadPool 2016-11-04 11:47:40 +01:00
Simon Grätzer b2819b418a multiple collections 2016-11-03 00:10:36 +01:00
Simon Grätzer 8a33df8314 stuff 2016-11-02 08:18:09 +01:00
Simon Grätzer 8463c41540 Working template version 2016-10-28 20:01:06 +02:00
Simon Grätzer f88612fe97 compiling version 2016-10-27 13:23:52 +02:00
Simon Grätzer a60483dfd8 some changes 2016-10-21 15:08:47 +02:00