pgsync

Postgres to Elasticsearch/OpenSearch sync

MIT License

Downloads
13.3K
Stars
1.2K
Committers
18

Bot releases are hidden (Show)

pgsync - 2.1.2

Published by toluaina about 3 years ago

  • upgraded package versions and type hints
  • fix syntax error when database name contains hyphen(-) (#152)
  • fix parent NoneType error when inserting into a through table #145
pgsync - 2.1.1

Published by toluaina over 3 years ago

  • Use ELASTICSEARCH_HOST value instead of parsed url in connection (#134)
pgsync - 2.1.0

Published by toluaina over 3 years ago

  • Fix bootstrap triggers creation
pgsync - 2.0.0

Published by toluaina over 3 years ago

Breaking Changes

  • Changed node attribute of schema to be a dict instead of a list
  • Use the schema migration tool to convert existing schema scripts/migrate_schema_v2 -c /path/to/schema.json
  • New trigger methods require a rerun of the bootstrap
    • bootstrap -t -c /path/to/schema.json
    • bootstrap -c /path/to/schema.json

Features

  • Adds support for Elasticsearch routing
  • Check replication slots exists when syncing
  • Move trigger functions into Materialized views for enhanced performance
pgsync - 1.1.33

Published by toluaina over 3 years ago

  • Fixed Children records ignored when a custom foreign_key key #114
  • support aws managed Elasticsearch
  • Addresses #108 (#110)
  • Adds support for all Elasticsearch mapping parameters (#106)
  • Addresses #107 (#109)
  • Adds _doc to the mappings when using ES < 7 (#101)
pgsync - 1.1.32

Published by toluaina over 3 years ago

Republishing previous release

pgsync - 1.1.31

Published by toluaina over 3 years ago

  • Support plugins. See doc here
  • Extend JSON/JSONB support. See doc here
  • Elasticsearch SSL support
  • Support for loose fkey declaration
pgsync - 1.1.30

Published by toluaina over 3 years ago

  • Fixed transform concat bug
pgsync - 1.1.29

Published by toluaina over 3 years ago

Republishing version 1.1.28

  • make regex more robust for handling quoted table names
  • fixed transform bug
  • support Elasticsearch injest pipeline
  • support concat filters
  • use sqlalchemy 2.0 compatible runtime inspection
pgsync - 1.1.28

Published by toluaina over 3 years ago

  • make regex more robust for handling quoted table names
  • fixed transform bug
  • support Elasticsearch injest pipeline
  • support concat filters
  • use sqlalchemy 2.0 compatible runtime inspection
pgsync - 1.1.27

Published by toluaina over 3 years ago

  • Added Redis poll interval environment variable
  • Fetch foreign keys from information_schema
  • Fixed a bug when inserting a child with through table
pgsync - 1.1.26

Published by toluaina over 3 years ago

  • added client system level TCP keepalive configuration
  • ensure slot name contains only alphanumeric and underscore #71
  • encode connection URL #65
  • exit main thread when there is an error in the child
pgsync - 1.1.25

Published by toluaina over 3 years ago

  • encode connection URL #65
  • Fixed trigger error with Postgres 9.6 #64
pgsync - 1.1.24

Published by toluaina almost 4 years ago

  • Fix KeyError when inserting Child with relationship
pgsync - 1.1.23

Published by toluaina almost 4 years ago

  • Support more Elasticsearch bulk index environment variables.
pgsync - 1.1.22

Published by toluaina almost 4 years ago

  • cleanup logical replication slots at periodic intervals #53
pgsync - 1.1.21

Published by toluaina almost 4 years ago

  • insert into child now updates parent relationship
pgsync - 1.1.20

Published by toluaina almost 4 years ago

  • Support uuid field in Elasticsearch query
pgsync - 1.1.19

Published by toluaina almost 4 years ago

  • Fix bug with UUID field
pgsync - 1.1.18

Published by toluaina almost 4 years ago

  • Fix bug with UUID field. #52
Package Rankings
Top 6.93% on Pypi.org
Badges
Extracted from project README
PyPI version Build status Python versions Downloads codecov