pgsync

Postgres to Elasticsearch/OpenSearch sync

MIT License

Downloads
13.3K
Stars
1.2K
Committers
18

Bot releases are hidden (Show)

pgsync - 3.2.0 Latest Release

Published by toluaina 3 months ago

  • fix PG_LOGICAL_SLOT_PEEK_CHANGES query crashe #546
  • support explicit ES mappings
  • Bugfix LOGICAL_SLOT_SUFFIX regex (#532)
  • Fix poll_db crash when notifications payload indeces is None (#537)
  • docker compose: add kibana and add optional EXAMPLE_NAME build arg to select example (#535)
pgsync - 3.1.0

Published by toluaina 10 months ago

  • thread safe QueryBuilder
  • SQLAlchemy 2.x support
pgsync - 3.0.0

Published by toluaina 11 months ago

Update to MIT LICENSE

pgsync - 2.5.0

Published by toluaina over 1 year ago

  • OpenSearch support
  • fix insert on through tables
  • remove 400 from ignore_status as this hides errors by default
pgsync - 2.4.0

Published by toluaina almost 2 years ago

pgsync - 2.3.3

Published by toluaina almost 2 years ago

  • support env var in schema.json
  • fixed bug when inserting into a non-root table
pgsync - 2.3.2

Published by toluaina about 2 years ago

  • Optimise to reduce memory footprint
  • stop sorting list items
pgsync - 2.3.1

Published by toluaina over 2 years ago

  • fix bootstrap teardown drop function error
pgsync - 2.3.0

Published by toluaina over 2 years ago

  • minimize the tmp file disk usage when calling pg_logical_slot_peek_changes and pg_logical_slot_get_changes #267
  • add knn_vector to knownn Elasticsearch types
  • add support for dynamic_template mapping #272
  • support for views #275,#175,#103
  • Async support
  • optimize bootstrap
  • support configurable postgres driver
pgsync - 2.2.1

Published by toluaina over 2 years ago

  • Support multiple threads for Poll db
pgsync - 2.2.0

Published by toluaina over 2 years ago

  • Fixed pickle error in parallel sync
  • search .env file from current folder
  • add a thread exist handler
pgsync - 2.1.11

Published by toluaina over 2 years ago

  • Batching redis writes (#234)
  • Support azure database username format #224
  • Experimental support for parallel sync
  • Support more than 100 column tables #149
pgsync - 2.1.10

Published by toluaina almost 3 years ago

  • remove eold python 3.6 from support matrix
  • fixed rename transform for json fields #212
  • fix materialized view when using non default schema
pgsync - 2.1.9

Published by toluaina almost 3 years ago

  • Clean up Redis cache on teardown.
  • Handle nullable Foreign keys
pgsync - 2.1.8

Published by toluaina almost 3 years ago

  • add support for ELASTICSEARCH_RAISE_ON_EXCEPTION and ELASTICSEARCH_RAISE_ON_ERROR
  • add new Elasticsearch types
  • optimise has_permission query
pgsync - 2.1.7

Published by toluaina about 3 years ago

  • fix UUID column python_type
pgsync - 2.1.6

Published by toluaina about 3 years ago

  • Fixed ModuleNotFoundError when loading plugin
pgsync - 2.1.5

Published by toluaina about 3 years ago

  • Fixed import Error
  • Support auth plugin for secrets
pgsync - 2.1.4

Published by toluaina about 3 years ago

  • Add support for specifying checkpoint file location
pgsync - 2.1.3

Published by toluaina about 3 years ago

  • Pin Elasticsearch client for compatibility with OpenSearch
Package Rankings
Top 6.93% on Pypi.org
Badges
Extracted from project README
PyPI version Build status Python versions Downloads codecov