History

jsteemann 6b882ca8a2 class renaming		2017-03-08 17:54:00 +01:00
..
MMFilesAllocatorThread.cpp	remove logging for non-topics	2017-02-10 09:32:50 +01:00
MMFilesAllocatorThread.h	…
MMFilesAqlFunctions.cpp	renamed methods	2017-02-27 11:22:44 +01:00
MMFilesAqlFunctions.h	move engine-specific optimizer rules into engine	2017-03-07 13:10:58 +01:00
MMFilesCleanupThread.cpp	renamed classes	2017-02-27 11:40:15 +01:00
MMFilesCleanupThread.h	…
MMFilesCollection.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesCollection.h	Moved indexes down into the physical collections	2017-03-08 11:03:45 +01:00
MMFilesCollectionReadLocker.h	Moved CollectionRead/WriteLocker to MMFiles. Also moved cleanupIndexes to MMFilesCollection	2017-02-14 15:12:36 +01:00
MMFilesCollectionWriteLocker.h	Moved CollectionRead/WriteLocker to MMFiles. Also moved cleanupIndexes to MMFilesCollection	2017-02-14 15:12:36 +01:00
MMFilesCollectorCache.h	renamed classes	2017-02-27 11:40:15 +01:00
MMFilesCollectorThread.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesCollectorThread.h	Moved ditches into MMFiles.	2017-02-23 09:02:34 +01:00
MMFilesCompactionLocker.h	renamed classes	2017-02-28 17:59:48 +01:00
MMFilesCompactorThread.cpp	renamed classes	2017-02-28 17:59:48 +01:00
MMFilesCompactorThread.h	renaming	2017-02-13 15:18:40 +01:00
MMFilesDatafile.cpp	move encoding functions into their own file	2017-02-14 12:57:15 +01:00
MMFilesDatafile.h	…
MMFilesDatafileHelper.h	move encoding functions into their own file	2017-02-14 12:57:15 +01:00
MMFilesDatafileStatistics.cpp	remove logging for non-topics	2017-02-10 09:32:50 +01:00
MMFilesDatafileStatistics.h	…
MMFilesDitch.cpp	renamed classes	2017-02-27 11:40:15 +01:00
MMFilesDitch.h	renamed classes	2017-02-27 11:40:15 +01:00
MMFilesDocumentOperation.cpp	Moved primaryIndex knowledge out of Logical Collection. Also moved logic for close into MMFiles	2017-02-21 14:12:07 +01:00
MMFilesDocumentOperation.h	renaming	2017-02-13 15:18:40 +01:00
MMFilesDocumentPosition.h	…
MMFilesEdgeIndex.cpp	Moved indexBuckets from Logical => MMFiles collection.	2017-03-07 14:07:32 +01:00
MMFilesEdgeIndex.h	renaming	2017-02-13 15:18:40 +01:00
MMFilesEngine.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesEngine.h	Moved the decision to write a marker into the databaseFeature, it is not triggered from outside any more. Furthermore renameCollection write marker is now done in MMFiles.	2017-03-08 14:54:25 +01:00
MMFilesFulltextIndex.cpp	renaming	2017-02-13 15:18:40 +01:00
MMFilesFulltextIndex.h	renaming	2017-02-13 15:18:40 +01:00
MMFilesGeoIndex.cpp	renaming	2017-02-13 15:18:40 +01:00
MMFilesGeoIndex.h	renaming	2017-02-13 15:18:40 +01:00
MMFilesHashIndex.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesHashIndex.h	class renaming	2017-03-08 17:54:00 +01:00
MMFilesIndexElement.cpp	…
MMFilesIndexElement.h	…
MMFilesIndexFactory.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesIndexFactory.h	Moved major Index-creation out of LogicalCollection into the StorageEngine Specific IndexFactory.	2017-01-29 15:08:26 +01:00
MMFilesLogfileManager.cpp	don't let read-only transactions block the WAL collector	2017-02-24 17:03:42 +01:00
MMFilesLogfileManager.h	don't let read-only transactions block the WAL collector	2017-02-24 17:03:42 +01:00
MMFilesOptimizerRules.cpp	move engine-specific optimizer rules into engine	2017-03-07 13:10:58 +01:00
MMFilesOptimizerRules.h	move engine-specific optimizer rules into engine	2017-03-07 13:10:58 +01:00
MMFilesPathBasedIndex.cpp	remove logging for non-topics	2017-02-10 09:32:50 +01:00
MMFilesPathBasedIndex.h	…
MMFilesPersistentIndex.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesPersistentIndex.h	class renaming	2017-03-08 17:54:00 +01:00
MMFilesPersistentIndexFeature.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesPersistentIndexFeature.h	class renaming	2017-03-08 17:54:00 +01:00
MMFilesPersistentIndexKeyComparator.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesPersistentIndexKeyComparator.h	class renaming	2017-03-08 17:54:00 +01:00
MMFilesPrimaryIndex.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesPrimaryIndex.h	class renaming	2017-03-08 17:54:00 +01:00
MMFilesRemoverThread.cpp	remove logging for non-topics	2017-02-10 09:32:50 +01:00
MMFilesRemoverThread.h	…
MMFilesRevisionsCache.cpp	…
MMFilesRevisionsCache.h	…
MMFilesSkiplist.h	…
MMFilesSkiplistIndex.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesSkiplistIndex.h	class renaming	2017-03-08 17:54:00 +01:00
MMFilesSynchronizerThread.cpp	remove logging for non-topics	2017-02-10 09:32:50 +01:00
MMFilesSynchronizerThread.h	…
MMFilesToken.h	The Fulltext index now return DocumentIdentifierTokens instead of revisions. Removed one inderection rid <-> Index_doc which were a typedef.	2017-01-25 13:20:15 +01:00
MMFilesTransactionCollection.cpp	Moved isVolatile into MMfiles collection.	2017-02-23 14:56:54 +01:00
MMFilesTransactionCollection.h	renaming	2017-02-13 15:18:40 +01:00
MMFilesTransactionContextData.cpp	removed unused includes	2017-02-27 17:29:28 +01:00
MMFilesTransactionContextData.h	removed unused includes	2017-02-27 17:29:28 +01:00
MMFilesTransactionState.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesTransactionState.h	create engine-specific transaction context data	2017-02-27 17:05:30 +01:00
MMFilesWalLogfile.cpp	move encoding functions into their own file	2017-02-14 12:57:15 +01:00
MMFilesWalLogfile.h	remove logging for non-topics	2017-02-10 09:32:50 +01:00
MMFilesWalMarker.h	move encoding functions into their own file	2017-02-14 12:57:15 +01:00
MMFilesWalRecoverState.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesWalRecoverState.h	…
MMFilesWalRecoveryFeature.cpp	class renaming	2017-03-08 17:54:00 +01:00
MMFilesWalRecoveryFeature.h	…
MMFilesWalSlot.cpp	remove logging for non-topics	2017-02-10 09:32:50 +01:00
MMFilesWalSlot.h	…
MMFilesWalSlots.cpp	move encoding functions into their own file	2017-02-14 12:57:15 +01:00
MMFilesWalSlots.h	…
MMFilesWalSyncRegion.h	…
README.md	remove transferMarkers from StorageEngine.h	2017-02-21 16:00:37 +01:00
fulltext-common.h	The Fulltext index now return DocumentIdentifierTokens instead of revisions. Removed one inderection rid <-> Index_doc which were a typedef.	2017-01-25 13:20:15 +01:00
fulltext-handles.cpp	The Fulltext index now return DocumentIdentifierTokens instead of revisions. Removed one inderection rid <-> Index_doc which were a typedef.	2017-01-25 13:20:15 +01:00
fulltext-handles.h	The Fulltext index now return DocumentIdentifierTokens instead of revisions. Removed one inderection rid <-> Index_doc which were a typedef.	2017-01-25 13:20:15 +01:00
fulltext-index.cpp	remove logging for non-topics	2017-02-10 09:32:50 +01:00
fulltext-index.h	The Fulltext index now return DocumentIdentifierTokens instead of revisions. Removed one inderection rid <-> Index_doc which were a typedef.	2017-01-25 13:20:15 +01:00
fulltext-list.cpp	…
fulltext-list.h	…
fulltext-query.cpp	…
fulltext-query.h	…
fulltext-result.cpp	The Fulltext index now return DocumentIdentifierTokens instead of revisions. Removed one inderection rid <-> Index_doc which were a typedef.	2017-01-25 13:20:15 +01:00
fulltext-result.h	The Fulltext index now return DocumentIdentifierTokens instead of revisions. Removed one inderection rid <-> Index_doc which were a typedef.	2017-01-25 13:20:15 +01:00
geo-index.cpp	…
geo-index.h	…

README.md

MMFilesEngine

How operations are stored - Overview

All operations like insert or remove are written as markers to a write ahead log (WAL). This WAL consists of files of a certain size and if such a file is full (or is manually flushed), all relevant markers are transferred (transferMarkers()) to the journals of the respective collections. During the transfer any obsolete markers will be thrown away: a sequence of insert, remove, insert on the same document will result in the last insert discarding the previous operations. When a journal file of size (journalSize()) is full, it will be sealed and renamed. By applying these operations it will become a datafile that is read-only. Datafiles will eventually be merged by a compactor thread that does about the same work as the transferMarkers function, reducing the size of the stored data.

Ditches

Ditches are used to pin objects in WAL or journal as long as they are used by other operations.