airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

OTHER License

Downloads
197K
Stars
13.8K
Committers
946

Bot releases are hidden (Show)

airbyte - v0.35.1-alpha

Published by benmoriceau almost 3 years ago

5a2d4b1 force server restart on exception (#9018)
001e8f8 🐛 SAT: fix unit docker tests
467f047 Add cloud e2e tests (#7523)
3f88534 Fix issue when not found docs were failing the app (#9036)
64df1df Improve db check looping (#9013)
2115f7a Use kubectl cp to copy files instead of kube java clients (#8880)

airbyte - v0.35.0-alpha

Published by subodh1810 almost 3 years ago

6dce540 fix config db timeout param (#8988)
a6923b2 handle foreign key violation when expected record doesnt exist (#9016)
6316cb9 Update bigquery.md
0210071 Update Bigquery docs page
5dad5de Destination ClickHouse: Fix destination IllegalStateException (#8982)
67df5b8 🐛 Source Kafka : fixed SASL config read issue (#8865)
287cdb5 🐛 Destination Snowflake SQL compilation error (#9006)
d0f9aa8 Update "Building a connector the hard way" doc (#9008)
ddbce46 update destination_specs.yaml (#9007)
8654c4a implement flyway migration for config database normalization + tests (#8563)
115b0f9 attach kubernetes logs instead of writing to step output (#8979)
ae5b1cf add mini k8s stress test (#8978)
d2d0205 feat(charts): Set new migration values and use bootloader image (#8843)
a3100cb 🐛 Destination S3: avro and parquet formats have issues with JsonToAvroSchemaConverter (#8574)
fd716d7 Adding unit tests to SAT full refresh test (#8589)
de2b4ab Update fields in source-connectors specifications: linkedin-ads (#8984)
4a16965 🐛 SAT: add network host mode (#8998)
fe954c1 Integrate Sentry for performance and errors tracking. (#8248)
f0a9945 Revert "Change copy to add in dockerfiles to reduce container size (#8516)" (#8997)
08dc041 Destination MeiliSearch : failed acceptance tests (#8995)
1029945 🎉 Source Fecebook-Marketing: add asset_feed_spec to ad creatives stream (#8962)
7c0d195 Lever hiring oauth backend (#7677)
1c48122 Publish the bootloader JAR (#8957)
38e61c1 🎉 New Source: My Hours (#8270)
5096074 chore: added to source definitions: (#8983)
105bb58 🎉 New source: Qualaroo (#8623)
9b75a76 📑 Update source database performance test docs (#8980)
a6c2d05 🐞 Destination S3 & GCS: remove excessive logging (#8974)

airbyte - v0.34.4-alpha

Published by pmossman almost 3 years ago

1fe641a use airbyte/temporal-auto-setup which has multi-arch support (#8888)
635fc68 handle destination and source failures equally + fix main process failure handling (#8762)
9dfd0da Add API endpoint and handlers to delete SourceDefinitions and DestinationDefinitions (#8826)

airbyte - v0.34.3-alpha

Published by cgardens almost 3 years ago

b7ec67f Increase test timeout (#8971)
b920dc8 fix auto migration test (#8970)
1c525c0 Fix wrong param typo. Add proper index check for connection (#8968)
63017ea Revert "update to log4j 2.17.0 (#8965)" (#8969)
ae4de9c have discover endpoint that uses configs directly use improved secrets store pattern (#8897)
c5fc568 update to log4j 2.17.0 (#8965)
637fac3 BigQuery/BiqQuery denorm Destinations : Add possibility to use different types of GCS files (#8788)
24fb7d2 🐛 SAT fix containers auto-removing (#8959)
b3b0dce Add logs for errors (#8064)
2c7f239 airbyte-e2e-testing => airbyte-webapp-e2e-tests (#8892)
ffbf8bc Remove jobs and attempts tables from exported archive (#8646)
ff4b83b 🎉 Source Postgres: support all Postgres 14 types (#8726)
6ee29b5 🐞 Destination e2e test: fix documentation url (#8905)
cc70c0f allow serializing to yaml without quoting strings (#8896)

airbyte -

Published by davinchia almost 3 years ago

e92f551 Extend bootloader for Cloud. (#8879)
0de30f5 🎉 Testing destination: multiple logging modes (#8824)
ec305a5 make sure that all the secrets are remove (#8881)
20c4889 add container orchestrator in feature flag (#8015)
9acfc81 🎉 Source Facebook Marketing: Add the option to fetch thumbnail image data. (#8649)
2eace67 🎉 Source Zendesk Support: use cursor-based pagination (#8622)
1f580ed Update changelog 2021-25-11 (#8247)
86e08d0 🎉 Destination Redshift: add option to enable/disable deleting staging data (#8855)
31fcbed Jamakase/add workspaces word to url (#8878)
33e0efc Bumps lxml from 4.6.3 to 4.6.5. (#8845)
da40c4f 🐛 SAT: fix logs slicing (#8848)
0d7101e 🎉 Source Facebook Marketing: fix schema for 'breakdowns' fields (#8742)
212c1ff 🎉 Source Hubspot: Support incremental sync on all possible streams (#8699)
415a208 Destination MariaDbColumnstore: update Docker image for acceptance tests (#8840)
0c99c5d 🎉 Setting CPU and Memory limits for performance tests via github (#8807)
6889a89 🎉 SAT: add assert that spec.json file does not have any $ref in it (#8842)
5e494a9 📝 Update json to avro conversion doc (#8866)
9f9e924 🎉 Source Zendesk Support: Adds Brands, CustomRoles and Schedules (#8616)
8ac2c6f Change copy to add in dockerfiles to reduce container size (#8516)

airbyte - v0.34.1-alpha

Published by benmoriceau almost 3 years ago

7038533 🎉 Destination Redshift (copy): accept bucket path for staging data (#8607)
16f176b Remove nested secret (#8859)
38ae962 Jamkase/workspace slug (#8734)
464c485 Add acceptance tests for source close timeout (#8217)
b018769 ✨ Source Facebook Marketing: Added fields in campaign schema (#8257)
a283a63 Adds Amazon SQS and Lemlist source connectors in connector list (#8796)
5dad18b fix destination-snowflake build for jdk17 (#8854)
a0ec0de Source Linnworks: improve streams ProcessedOrders and ProcessedOrderDetails (#8226)
3a69029 remove validation from source delete (#8724)
2ad4ca1 Update fields in source-connectors specifications: drift, harvest, hubspot, intercom, monday, clickhouse, bing-ads, snapchat-marketing, microsoft-teams (#8429)
fb834c9 🐛 Source Shopify: fix for mismatched number of tables during normalization (#8597)
bc1ff91 🐛 Source Paypal Transaction: report full error message details, updated check method (#8580)
7fbdfc6 Airbyte CDK: Log http status code and content in backoff handlers (#8829)
5ac9049 update prefect-task documentation (#8835)
c84a748 fix secretGenerator (#8839)
2c3e241 Harshith/test pr 8179 (#8836)
21ff8a2 Source Amazon Seller Partner: Add GET_BRAND_ANALYTICS_SEARCH_TERMS_REPORT report (#8179)
91513f5 Destination Snowflake: update check method to verify permissions for staging (#8781)
3740f25 BigQuery locations update (#8816)

airbyte -

Published by davinchia almost 3 years ago

abc5014 Update more scripts. (#8833)
65fb3db Update release script to accommodate new env vars. (#8831)
183a790 increase reliability of frontend and kubernetes tests (#8827)
3a8d262 remove unused secret (#8828)
6b4d9ae fix KubePodProcess port offering race condition (#8804)
a808b4d 🐛 [8783] Fix Broken HelmCharts v0.33.11 (#8784)
530434f Tweak connections doc formatting for clarity (#8822)
369571c 🎉 New Source: OpenWeather (#7434)
e6fac63 🐛Source Google Analytics v4: fix date format (#8656)
b7f55f8 Destination Rockset: format code (#8821)
39b62d6 🐛 Source: Strava: support OAuth 2.0 (#8799)
cde7157 🐛 Source Hubspot: additionalProperties: true (#8658)
bf7d252 🐛 SAT: incorrect package setup (#8813)
b7b7886 🐛 Source Marketo: improve field conversion to conform schema (#8483)
3748c66 🎉 New Destination: Rockset (#8006)
be2ed7d 🎉 SAT: fix of stdout reading (#8743)
d3b0c99 🎉 CI secrets: full migration to GSM (#8561)
0fd129e 🎉 Updated ci performance test sh script (#8780)
60e3237 Switch to use Bootloader. (#8584)" (#8778)" (#8790)
cbcd6e3 update chargify documentation (#8764)
757ba94 Bump lxml in /airbyte-integrations/connectors/source-file (#8758)

airbyte - v0.33.12-alpha

Published by davinchia almost 3 years ago

3c9fe46 Update to Log4J 2.16. (#8779)
216501b Revert "Switch to use Bootloader. (#8584)" (#8778)
5cf3967 Switch to use Bootloader. (#8584)
57c4590 🎉 Updated ci performance test sh script (#8774)
ef7684b 🎉 Updated ci performance test sh script (#8772)
f37f68c 🎉 Updated ci performance test sh script (#8771)
4f2add0 🎉 Updated ci performance test sh script (#8769)
04a377f Source Woocommerce: advanced date checking incremental function (#8417)
678b532 🎉 Source Klaviyo: improve performance and make Global Exclusions stream incremental (#8592)
03e5160 🎉 New CDK: Dotnet/.NET/C# implementation + free exchange rates source connector (#7945)
6f621a7 Update Oracle Deploy Instructions docs (#8164)
bbcd461 🎉 New Destination: ClickHouse (#7620)
cba7285 🎉 New destination: RabbitMQ (#7560)
d50ae47 🐛 CDK: Fix the logging of unhandled exceptions to show stacktrace (#8704)
53c4047 Publish source: new streams are added in google ads (#8521)
e45dc12 format files (#8756)
346b411 add OAuth 2.0 for microsoft_teams source connector (#7807)
94e4364 🎉 Updated ci performance test sh script (#8751)
6854776 Add google cloud storage configuration in helm chart (#8332)
b1c067a 🎉 Updated ci performance test sh script (#8741)
e41b7d2 🎉 Updated ci performance test sh script (#8740)
c07e7d5 🎉 Updated ci performance test sh script (#8739)
02e61ac Source Oracle update docker images for integration tests (#8693)
38ddbd3 Remove multi-node test for Kube Acceptance Test. (#8737)
e791bb2 Created Generic MariaDBTestContainer (#8692)
9e36c38 🐛 Helm chart: Allow writing logs to S3 easily (#8736)
faa4d9a 🎉 Source Mailchimp: updated Mailchimp schemas (#7975)
62c3c4e Update fields in source-connectors specifications: mysql, onesignal, oracle, outreach, paystack, pipedrive, pokeapi (#8582)
4276b2f Bump the minor version for mysql source (#8731)
7591883 Added benchmarks scripts with small instruction (#8529)
70d2f46 Source MySQL\MsSql\Postgres: added RDS base performance tests (#8215)

airbyte - 0.33.11-alpha

Published by davinchia almost 3 years ago

a983f53 🐛 Increase sidecar memory. (#8727)
5adb1d1 Add more tests for json logical type conversion (#8725)
6843bc1 🎉 Source MySQL: support all MySQL 8.0 types (#7970)
2093b19 Upgrade start runner to v2.3.0. (#8703)
0b8c0f5 Bump connector versions for publishing (#8717)
25674fc upgrade to Gradle 7.3.1 / Java 17 (#7964)
e9f414d do not run excluded tags in integration tests (#8715)
fc91f67 move S3Config into destination-s3; update dependencies accordingly (#8562)
fefd575 Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524)
ba09bbf Change CDK "Caching" header to "nested streams & caching"

airbyte - v0.33.10-alpha

Published by jrhizor almost 3 years ago

c18711f bump gcp dependencies to pick up grpc update (#8713)
b6904c2 fail zombie job attempts and add failure reason (#8709)

airbyte - v0.33.9-alpha

Published by jrhizor almost 3 years ago

1529aa1 upgrade jaxb and jackson versions (#8706)

airbyte - v0.33.8-alpha

Published by lmossman almost 3 years ago

23172fc83 bump log4j2 version (#8687)
66fad5462 airbyte-8585 Template for bug-fix PR (#8603)
1cb295930 Docs: add Prefect tutorial (#8664)
d0aacc5a9 fix: added some acceptance tests just to have some basic stuff (#8679)
47e03a3d2 Docs: Update connector list (#8683)
84b3bf55a 🎉 Destination Amazon SQS: New connector (#7503)
678d933e3 🐛 Fix logging test. (#8677)
0bf8f778d 🐛 Source Google Analytics V4: Fix window in days validation issue (#8676)
b0fb656c0 🐛Source Google ads: connector doesn't pull data for today (#8225)
e95718b0d 🐛 Source TikTok Marketing: fix incremental bug + new reports' streams (#8292)

airbyte - v0.33.7-alpha

Published by lmossman almost 3 years ago

036e72fd0 Stricter logging configuration checks. (#8660)
65ef9295d Remove status link from oss version (#8502)

airbyte - v0.33.6-alpha

Published by davinchia almost 3 years ago

5fd44ba Add resource requirements to sidecars. (#8652)
3d7e62d 🎉 Sources Appstore Singer: refactor to use the cdk
fe55cab update Upgrading Airbyte doc to point to patch version of 0.32.0 (#8650)
973c043 Prevent deadlock when importing database (#8648)
07287ca split up insertions into batches of 100 when importing archived table into database (#8609)
38ee7a7 Redirect dbt log files to airbyte log when failing (#8621)
bab9eda Use throwable for tryDeserialise. (#8631)
edefc88 🐛 Source Intercom: Fix conversations order and sorting (#8579)
10f1b58 Source Github: Retry connection using HTTPAdapter (#8518)
58475ce Revert "Update platform containers to use non-root users (#7872)" (#8611)
ebcaf2b Update platform containers to use non-root users (#7872)
d67f427 upgrade temporal sdk to 1.6.0 (#8600)
bdda7e1 Refactor how we configure and build cloud storage clients in CloudLogs (#8573)
cbe01e9 Source Shopify: Add Shop stream (#8297)
c496368 Source BigCommerce: change dates comparison (#8416)
0973b33 Source Typeform: fix check connection authenticator loop (#8466)
aa67604 CDK: Add base pydantic model for connector config and schemas (#8485)
161a1ee format files (#8601)
f00f10e Source Google Analytics: update source spec and documentation (#8571)
ad55ab0 MongoDB limit 10k records during Discovery(#8491)
5ab5cfc fix(mongodb-v2): set logging to debug when field list is out of sync (#8495)
dfdd2c5 🐛 Source Salesforce: filter 'null' byte(s) in HTTP responses (#8405)
ccf8eeb 🎉 New Source: Mailgun (#8056)
34ff075 flake8 fix 3764 obfuscate secrets logging (#8583)
a7061dd Create separate Airbyte Bootloader Application. (#8547)
1d493ec CDK: #3764 obfuscate secrets in logging (#8211)
487f9e7 🎉 Source Google Sheets: migrate to the CDK

airbyte - v0.32.0-alpha-patch-1

Published by lmossman almost 3 years ago

This is a patch for v0.32.0, which adds this change to batch up db insertions in order to fix a bug in which migrations would continuously loop when there was a large volume of data in the jobs database.

This patch also adds this change to prevent deadlocks when importing databases, which could have also manifested during migrations.

airbyte - v0.32.0-alpha-patch-0

Published by lmossman almost 3 years ago

This is a patch for v0.32.0, which adds this change to batch up db insertions in order to fix a bug in which migrations would continuously loop when there was a large volume of data in the jobs database.

airbyte - v0.33.5-alpha

Published by tuliren almost 3 years ago

CHANGELOG

fa999d2 Update specs and fix build (#8560)
f9d8e39 Destination Snowflake: Return Standard Loading (#8528)
17504e9 🎉 Source Iterable: Add email validation to list_users stream method execution (#8380)
1bde075 🎉 Source Retently: add OAuth 2.0 (#8043)
cb120fe 🐛 Source Marketo: Fix timestamp value format issue (#8298)
e549068 Bump versions in spec files for ssh key related connectors (#8549)
79acc2b 🎉 Source Recurly: migrate to the CDK

airbyte - v0.33.4-alpha

Published by Phlair almost 3 years ago

What's Changed

Full Changelog: https://github.com/airbytehq/airbyte/compare/v0.33.3-alpha...v0.33.4-alpha

^ This is missing a few things because the 0.33.3 label is on a later commit than the actual version bump.

airbyte - v0.33.3-alpha

Published by cgardens almost 3 years ago

feb4083 log the job that is cancelled when pruning zombie jobs (#8514)

airbyte - v0.33.2-alpha

Published by davinchia almost 3 years ago

635109a 🐛 Fix forgotten rename. (#8511)