monstache

Changes

• small changes to the settings for the exponential back off on retry. see the docs for details.
• only record timestamps originating from the oplog and not from direct reads
• apply the worker routing filter to direct reads in worker mode

Changes

• add option to configure elasticsearch client http timout. up the default timeout to 60 seconds

Changes

• upgrade gtm to fix an issue where a mongodb query error (such as CappedPositionLost) causes the tail go routine to exit (after which no more events will be processed)

Changes

• new major release
• configuration changes with regards to Elasticsearch. see docs for details
• adds ability to write rolling logs to files
• adds ability to log indexing statistics
• changed go Elasticsearch client from elastigo to elastic which provides more API coverage
• upgrade gtm

Changes

• add support for golang plugins. you can now do in golang what you previously could do in javascript
• add more detail to bulk indexing errors
• upgrade gtm

Changes

• add direct-read-ns option. allows one to sync documents directly from a set of collections in addition to going through the oplog
• add exit-after-direct-reads option. tells monstache to exit after performing direct reads. useful for running monstache as a cron job.
• fix issue around custom routing where db name was being stored as an array
• upgrade gtm

Changes

• Fix order of operations surrounding db or collection drops in the oplog. Required the removal of some gtm-options introduced in 2.11.
• Built with latest version of gtm which includes some performance gains
• Add ssl option under mongo-dial-settings. Previously, in order to enable connections with TLS one had to provide a PEM file. Now, one can enable TLS without a PEM file by setting this new option to true. This was tested with MongoDB Atlas which requires SSL but does not provide a PEM file

Changes

• Built with Go 1.8
• Added option fail-fast
• Added option index-oplog-time

Changes

• Built with Go 1.8
• Performance improvements
• Support for rfc7386 JSON merge patches
• Support for overriding Elasticsearch index and type in JavaScript
• More configuration options surfaced

Changes

• add shard routing capability
• add Makefile

64-bit Linux binary built with go1.7.4

md5

64aba4c4bf6ac2d7e77dca7f50e376db monstache

sha256

9841c386545c9e14947f545fa837b807eaf1454e7cf97525d2668b5b670e9203 monstache

64-bit Windows binary built with go1.7.4

md5

c94d8bfe8e5fd43b52a4ae617df0b87d monstache.exe

sha256

8c96a83ce6b26c51ef28ec915822ecf9ac9ab4ada611dfb139126df7078380c4 monstache.exe

64-bit Mac binary built with go1.7.4

md5

025ff60b2201b53a87309c2acf1ae6c8 monstache

sha256

7d721442453a9d7360591bb75c960fccc91edf7985ecaa1703c4a81c4808c8fc monstache

Changes

• extend ttl for active in cluster to reduce process switching

64-bit Linux binary built with go1.7.4

md5

2923b76e1a847edf1a080764812e9c26 monstache

sha256

49b8e6ec9911d96c2d82aa79cb086af9e92a02e16c11a88b93ca194789c33631 monstache

64-bit Windows binary built with go1.7.4

md5

415ef8d1175d00e1a451e5d8f4d1fb8d monstache.exe

sha256

17365e53d39465eb8f2a1b17297ec12e499f7a35964944ebdaa07652a2f1c05e monstache.exe

Changes

• fix potential collision on floating point _id closes #16

64-bit Linux binary built with go1.7.4

md5

0fda76756339b9a1fc8fe45ec7ddfd8f monstache

sha256

31d91c9ba711b69ea629d7dcfe48e3766686d6386baa83374663d7c88c3e24ef monstache

64-bit Windows binary built with go1.7.4

md5

b15b5165c50876be242e3d0c9e9f8411 monstache.exe

sha256

de25f153b498ec2df9dceb5bc971847cf1357644d676a5dd47d614d9e051bed9 monstache.exe

64-bit Linux binary built with go1.7.4

• fix an edge case #18 where a process resuming for the cluster would remain paused

md5

fd42efdfc5ff859708d69c8f0008fcbc monstache

sha256

afbd171a703113a804f2b499171e32b868673fb5891965b2ca7f1202d0402526 monstache

64-bit Linux binary built with go1.7.4

• fix an issue with formatting of integer ids
• enable option for new clustering feature for high availability
• add TLS skip verify options for mongodb and elasticsearch
• add an option to specify a specific timestamp to start syncing from

md5

c0edac3c86b5e2b39f8876b7b7079d7b monstache

sha256

b6c87bbea0691326a4494cd2574d58f83f52134db13e49c7b4aa80dc190470a3 monstache

64-bit Linux binary built with go1.7.4

• fix an index out of bounds panic during error reporting
• surface gtm options for setting the oplog database and collection name as well as the cursor timeout
• report an error if unable to unzip a response when verbose is true

md5

fd46adb1efa1f596808f13999610f88d monstache

sha256

b3d47a62526e3c42000a62ca3cecff518b8b0dd1b952f7160f12a0050429d737 monstache

64-bit Linux binary built with go1.7.4

• add a version flag -v
• document the elasticsearch-pem-file option
• add the elasticsearch-hosts option to configure pool of available nodes within a cluster

md5

e9b080dd92542a62b292c9f3faaf932d monstache

sha256

ff0d53c47a39b089ca1d2e1a1b7dd617d8052c329c658d97141cfa7865c1ee81 monstache

64-bit Linux binary built with go1.7.4

• add a gzip configuration option to increase performance
• default resume-name to the worker name if defined
• decrease binary size by building with -ldflags "-w"

md5

0bfe608d6bb3de479b7300c6f0cbc72e monstache

sha256

810a43e7f84b42ecf51ae7a002d784dd3edb2c0cf9cad2b48fef0a4fc04856c6 monstache

64-bit Linux binary built with go1.7.4

• reuse allocations made for gridfs files
• add workers feature to distribute synching between multiple processes

md5

1faa4166ac50f8083fde47da8185788b monstache

sha256

77450da993185433630c57fe89346f3aafdc38c5b562bafc075551b3ab1b1545 monstache

64-bit Linux binary built with go1.7.4

• add option to speed up writes when saving resume state
• remove extra buffering when adding file content

md5

b0ac4ce015f274ea04344c640f4f2be7 monstache

sha256

23035be52cfeb8f2f86cb618d514bdcacdbf0c744e85fd48f9fdfb928696ec75 monstache

64-bit Linux binary built with go1.7.3

• Fixed issue #10
• Fixed issue #11

md5

0b7289828b4d244e4aacc2abee371ef2 monstache

sha256

fdf7c990a77bd3a447a1256e4b0365a7658d87415183eae2ff8f3a7d801d54ed monstache