History

Max Neunhöffer 20f74ea4cd Improve error output in logs when replication fails. (#6757 ) * Improve error output in logs when replication fails. * Add URL in a lot more replication errors. * More URL output in replication errors for MMFiles. * Fix a typo. * Add CHANGELOG entry.		2018-10-09 11:38:19 +02:00
..
CMakeLists.txt	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesAllocatorThread.cpp	…
MMFilesAllocatorThread.h	…
MMFilesAqlFunctions.cpp	fixed issue #4185 : On execution of FULLTEXT search / AQL query db is … (#4239 )	2018-01-15 22:46:14 +01:00
MMFilesAqlFunctions.h	functionality for plugging REST handlers	2017-03-09 17:12:00 +01:00
MMFilesCleanupThread.cpp	Bug fix/fix compilation with gxx7 (#3637 )	2017-11-10 16:00:57 +01:00
MMFilesCleanupThread.h	fix fulltext index removal performance, simplified code (#3015 )	2017-08-12 09:25:30 +02:00
MMFilesCollection.cpp	[3.3] Backport #6539 . (#6569 )	2018-09-24 13:00:08 +02:00
MMFilesCollection.h	[3.3] Backport #6539 . (#6569 )	2018-09-24 13:00:08 +02:00
MMFilesCollectionExport.cpp	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesCollectionExport.h	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesCollectionKeys.cpp	fix premature unlock (#3802 ) (#4027 )	2017-12-13 18:46:14 +01:00
MMFilesCollectionKeys.h	fix premature unlock (#3802 ) (#4027 )	2017-12-13 18:46:14 +01:00
MMFilesCollectionReadLocker.h	honor exclusive locks	2017-04-25 12:56:56 +02:00
MMFilesCollectionWriteLocker.h	honor exclusive locks	2017-04-25 12:56:56 +02:00
MMFilesCollectorCache.h	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
MMFilesCollectorThread.cpp	improved logging for MMFiles IO operations (#4365 )	2018-01-19 18:36:49 +01:00
MMFilesCollectorThread.h	fix fulltext index removal performance, simplified code (#3015 )	2017-08-12 09:25:30 +02:00
MMFilesCompactionFeature.cpp	Bug fix/issues 2709 (#3333 )	2017-10-01 09:43:03 +02:00
MMFilesCompactionFeature.h	fix dropping of system collections and retrieving list of user databa… (#3304 )	2017-09-21 10:05:46 +02:00
MMFilesCompactionLocker.h	renamed classes	2017-02-28 17:59:48 +01:00
MMFilesCompactorThread.cpp	improve startup resilience in case there are datafile errors (#4974 )	2018-04-13 12:08:41 +02:00
MMFilesCompactorThread.h	Feature/compaction configuration (#3217 )	2017-09-15 14:37:30 +02:00
MMFilesDatafile.cpp	improve startup resilience in case there are datafile errors (#4974 )	2018-04-13 12:08:41 +02:00
MMFilesDatafile.h	improve startup resilience in case there are datafile errors (#4974 )	2018-04-13 12:08:41 +02:00
MMFilesDatafileHelper.h	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
MMFilesDatafileStatistics.cpp	improve startup resilience in case there are datafile errors (#4974 )	2018-04-13 12:08:41 +02:00
MMFilesDatafileStatistics.h	do not complain about missing datafile statistics (#3688 )	2017-11-14 16:42:31 +01:00
MMFilesDatafileStatisticsContainer.cpp	moved files	2017-03-16 16:45:02 +01:00
MMFilesDatafileStatisticsContainer.h	moved files	2017-03-16 16:45:02 +01:00
MMFilesDitch.cpp	…
MMFilesDitch.h	…
MMFilesDocumentOperation.cpp	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
MMFilesDocumentOperation.h	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesDocumentPosition.h	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
MMFilesEdgeIndex.cpp	Feature 3.3/mmfiles index lookup speedup (#5338 )	2018-05-14 10:41:37 +02:00
MMFilesEdgeIndex.h	Feature 3.3/mmfiles index lookup speedup (#5338 )	2018-05-14 10:41:37 +02:00
MMFilesEngine.cpp	Feature/replication ui (#5282 )	2018-06-07 15:54:27 +02:00
MMFilesEngine.h	improved logging for MMFiles IO operations (#4365 )	2018-01-19 18:36:49 +01:00
MMFilesExportCursor.cpp	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesExportCursor.h	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesFulltextIndex.cpp	Feature 3.3/fulltext optimizations (#3925 )	2017-12-19 21:40:12 +01:00
MMFilesFulltextIndex.h	fixed issue #5252 (#5426 )	2018-05-23 08:30:34 +02:00
MMFilesGeoIndex.cpp	fix invalid "out of memory" message when using out-of-range coordinates for the geo index	2018-04-10 11:58:07 +02:00
MMFilesGeoIndex.h	Feature/improved index api for unique constraints and replication (#3715 )	2017-11-16 21:02:01 +01:00
MMFilesHashIndex.cpp	Feature 3.3/mmfiles index lookup speedup (#5338 )	2018-05-14 10:41:37 +02:00
MMFilesHashIndex.h	Feature 3.3/mmfiles index lookup speedup (#5338 )	2018-05-14 10:41:37 +02:00
MMFilesIncrementalSync.h	Improve error output in logs when replication fails. (#6757 )	2018-10-09 11:38:19 +02:00
MMFilesIndex.h	Bug fix/fixes 0211 (#3568 )	2017-11-09 12:48:15 +01:00
MMFilesIndexElement.cpp	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
MMFilesIndexElement.h	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesIndexFactory.cpp	Feature 3.3/forward compatible sync (#6001 )	2018-07-30 08:55:26 +02:00
MMFilesIndexFactory.h	Removed code paths that wrote objectIds into the Agency. This did break replication.	2017-05-02 14:59:19 +02:00
MMFilesLogfileManager.cpp	improve startup resilience in case there are datafile errors (#4974 )	2018-04-13 12:08:41 +02:00
MMFilesLogfileManager.h	make truncate a bit less obstrusive (#3721 )	2017-11-16 20:28:33 +01:00
MMFilesOptimizerRules.cpp	Feature 3.3/aql optimizations (#5140 )	2018-05-15 14:41:07 +02:00
MMFilesOptimizerRules.h	Working geo index + tests	2017-05-09 15:04:51 +02:00
MMFilesPathBasedIndex.cpp	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
MMFilesPathBasedIndex.h	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesPersistentIndex.cpp	Feature 3.3/mmfiles index lookup speedup (#5338 )	2018-05-14 10:41:37 +02:00
MMFilesPersistentIndex.h	Feature 3.3/mmfiles index lookup speedup (#5338 )	2018-05-14 10:41:37 +02:00
MMFilesPersistentIndexFeature.cpp	Bug fix/fixes 0609 (#3227 )	2017-09-13 16:28:21 +02:00
MMFilesPersistentIndexFeature.h	change --rocksdb.enabled to be a obosolete option	2017-04-19 14:54:10 +02:00
MMFilesPersistentIndexKeyComparator.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesPersistentIndexKeyComparator.h	class renaming	2017-03-08 17:54:00 +01:00
MMFilesPrimaryIndex.cpp	fix lookups by _id for smart graph edges (#5122 )	2018-04-18 09:26:45 +02:00
MMFilesPrimaryIndex.h	Feature/improved index api for unique constraints and replication (#3715 )	2017-11-16 21:02:01 +01:00
MMFilesRemoverThread.cpp	…
MMFilesRemoverThread.h	…
MMFilesRestExportHandler.cpp	Active Failover for Foxx Services (3.3) (#4593 )	2018-02-15 09:36:25 +01:00
MMFilesRestExportHandler.h	move common code into its own file	2017-05-22 17:46:12 +02:00
MMFilesRestHandlers.cpp	Moved MMFiles replication handler.	2017-04-18 15:35:45 -04:00
MMFilesRestHandlers.h	make RestWalHandler a handler of the MMFiles engine	2017-03-10 09:00:37 +01:00
MMFilesRestReplicationHandler.cpp	increase the timeouts for replication, in order to increase the chanc… (#6733 )	2018-10-08 17:34:33 +02:00
MMFilesRestReplicationHandler.h	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesRestWalHandler.cpp	remove useless flush from test, bump wal flush default timeouts (#4846 )	2018-03-14 22:00:03 +01:00
MMFilesRestWalHandler.h	make RestWalHandler a handler of the MMFiles engine	2017-03-10 09:00:37 +01:00
MMFilesRevisionsCache.cpp	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
MMFilesRevisionsCache.h	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
MMFilesSkiplist.h	Bug fix/fixes 0609 (#3227 )	2017-09-13 16:28:21 +02:00
MMFilesSkiplistIndex.cpp	Feature 3.3/mmfiles index lookup speedup (#5338 )	2018-05-14 10:41:37 +02:00
MMFilesSkiplistIndex.h	Feature 3.3/mmfiles index lookup speedup (#5338 )	2018-05-14 10:41:37 +02:00
MMFilesSynchronizerThread.cpp	improved logging for MMFiles IO operations (#4365 )	2018-01-19 18:36:49 +01:00
MMFilesSynchronizerThread.h	…
MMFilesTransactionCollection.cpp	fix nullptr access (#4143 )	2017-12-22 10:56:01 +01:00
MMFilesTransactionCollection.h	fix premature unlock (#3802 ) (#4027 )	2017-12-13 18:46:14 +01:00
MMFilesTransactionContextData.cpp	…
MMFilesTransactionContextData.h	…
MMFilesTransactionManager.cpp	optimize away own transaction management for RocksDB engine	2017-05-04 23:16:53 +02:00
MMFilesTransactionManager.h	optimize away own transaction management for RocksDB engine	2017-05-04 23:16:53 +02:00
MMFilesTransactionState.cpp	Missing things for active / passive (#3578 )	2017-11-04 20:30:23 +01:00
MMFilesTransactionState.h	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesV8Functions.cpp	Feature/improved index api for unique constraints and replication (#3715 )	2017-11-16 21:02:01 +01:00
MMFilesV8Functions.h	fix db._engineStats()	2017-05-04 00:33:36 +02:00
MMFilesView.cpp	some fixes for view handling	2017-03-17 11:18:46 +01:00
MMFilesView.h	added stubs for indexes	2017-03-23 15:24:00 +01:00
MMFilesWalAccess.cpp	forward port replication bugfixes from 3.2 (#4575 )	2018-02-13 22:14:23 +01:00
MMFilesWalAccess.h	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
MMFilesWalLogfile.cpp	improve startup resilience in case there are datafile errors (#4974 )	2018-04-13 12:08:41 +02:00
MMFilesWalLogfile.h	improve startup resilience in case there are datafile errors (#4974 )	2018-04-13 12:08:41 +02:00
MMFilesWalMarker.h	added stubs for indexes	2017-03-23 15:24:00 +01:00
MMFilesWalRecoverState.cpp	fix issue #4272 (#4418 )	2018-01-25 15:57:06 +01:00
MMFilesWalRecoverState.h	renaming	2017-03-22 13:01:40 +01:00
MMFilesWalRecoveryFeature.cpp	add a test for replication applier restarts (#3750 ) (#3933 )	2017-12-08 15:48:15 +01:00
MMFilesWalRecoveryFeature.h	…
MMFilesWalSlot.cpp	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
MMFilesWalSlot.h	fix WAL file tick updating (happened too late before) (#2762 )	2017-07-10 17:41:08 +02:00
MMFilesWalSlots.cpp	Bug fix/fix compilation with gxx7 (#3637 )	2017-11-10 16:00:57 +01:00
MMFilesWalSlots.h	fix WAL file tick updating (happened too late before) (#2762 )	2017-07-10 17:41:08 +02:00
MMFilesWalSyncRegion.h	…
README.md	…
mmfiles-fulltext-common.h	move replication-dump into engine	2017-03-21 13:55:57 +01:00
mmfiles-fulltext-index.cpp	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
mmfiles-fulltext-index.h	Bug fix/isrestore (#3283 )	2017-10-03 11:53:49 +02:00
mmfiles-fulltext-list.cpp	Bug fix/fixes 0609 (#3227 )	2017-09-13 16:28:21 +02:00
mmfiles-fulltext-list.h	fix fulltext index removal performance, simplified code (#3015 )	2017-08-12 09:25:30 +02:00
mmfiles-fulltext-query.cpp	Bug fix/fixes 0609 (#3227 )	2017-09-13 16:28:21 +02:00
mmfiles-fulltext-query.h	move replication-dump into engine	2017-03-21 13:55:57 +01:00
mmfiles-geo-index.cpp	Bug fix/fixes 0609 (#3227 )	2017-09-13 16:28:21 +02:00
mmfiles-geo-index.h	move replication-dump into engine	2017-03-21 13:55:57 +01:00
mmfiles-replication-common.cpp	Feature/async failover (#3451 )	2017-10-18 23:59:29 +02:00
mmfiles-replication-common.h	Active Failover for Foxx Services (3.3) (#4593 )	2018-02-15 09:36:25 +01:00
mmfiles-replication-dump.cpp	forward port replication bugfixes from 3.2 (#4575 )	2018-02-13 22:14:23 +01:00
mmfiles-replication-dump.h	Active Failover for Foxx Services (3.3) (#4593 )	2018-02-15 09:36:25 +01:00

README.md

MMFilesEngine

How operations are stored - Overview

All operations like insert or remove are written as markers to a write ahead log (WAL). This WAL consists of files of a certain size and if such a file is full (or is manually flushed), all relevant markers are transferred (transferMarkers()) to the journals of the respective collections. During the transfer any obsolete markers will be thrown away: a sequence of insert, remove, insert on the same document will result in the last insert discarding the previous operations. When a journal file of size (journalSize()) is full, it will be sealed and renamed. By applying these operations it will become a datafile that is read-only. Datafiles will eventually be merged by a compactor thread that does about the same work as the transferMarkers function, reducing the size of the stored data.

Ditches

Ditches are used to pin objects in WAL or journal as long as they are used by other operations.