The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
OTHER License
Bot releases are visible (Hide)
Published by subodh1810 almost 3 years ago
0a1dc54a5 remove foreign key from actor_oauth_parameter table (#9112)
e17fa5b04 Update fields in source-connectors specifications: kustomer-singer, lemlist, linnworks, looker, marketo, mixpanel (#8578)
13508dc82 update seed spec (#9113)
88562e7f9 Destination Snowflake added integration test for NameTransformer (#9065)
6f4c3d1e7 🐛 Source CockroachDB: handled case when user can see only tables with select grants (#9004)
cd30cf4fc bump version for affected sources from #8749 (#8958)
92cf7a270 Simplify PostHog source connector (#9082)
eea41b4fc 🎉 Destination Snowflake and RedShift: Implement the Byte-buffered logic (#8869)
0bce8c867 Fix workflow retrieval (#9096)
a7b906ba0 🐛Source Google search console: add 'order' to spec.json props (#9047)
844dd9312 Use multi-stage builds in dockerfiles to reduce java images (#9077)
14c3536d2 🐛 Destination Snowflake | BigQuery: add part_size config to UI (#9039)
389efbd23 Feature/new temporal scheduler (#8352)
c51fb7afe Improve JOB_POD variable naming + improve doc about memory management (#9048)
fe21cf69f Add bootloader dependancy to generate-docker gradle task (#9078)
1c207f360 Update chargify logo (#9083)
7f147315b 🐛 Source Jira: Fix fetching and update schema for filters
stream (#9079)
fd8e5bc46 Source Google Ads: correct keyword schema (#9071)
39e24937d Update fields in source-connectors specifications: paypal-transaction (#9034)
93d2c78dd Update fields in source-connectors specifications: mailchimp (#9000)
cbe8da49f Update fields in source-connectors specifications: amplitude, apify-dataset, appstore-singer, aws-cloudtrail, azure-table, bigcommerce, bigquery, braintree, cart, chargebee (#8434)
586f22d3f Update fields in source-connectors specifications: jira (#8999)
ea578e8f1 🎉 Source Salesforce: Add the ability to filter streams (#8871)
4501ad04a Source Facebook Pages: removed deprecated field live_encoders
from Page stream (#9032)
c12e7bbca Update fields in source-connectors specifications: zendesk-support (#8987)
5ed94a8cd 🎉 Source Zendesk-Chat: add oauth flow support (#7313)
be303bdba Update fields in source-connectors specifications: gitlab (#8991)
41d65f088 Add arch overview page (#9064)
a4be49211 🐛 Source Salesforce: 400 error for non-queryable streams (#9005)
ff5648aa9 Remove comma from source spec (#9067)
6d3a80aaf 🎉 New Source: SearchMetrics (#6992)
20a569e4a 🎉 Source Stripe: extend schema for events.request field (#8992)
13ac480a8 fix formatting in worker documentation
2a1dbe7ca 🎉 Source Kustomer: Clarify setup fields (#8738)
8958bc7b4 chore: added to source definitions: (#9055)
91a368b95 Source Amazon Seller Partner: extract REPORTS_MAX_WAIT_SECONDS to configurable parameter (#9002)
c142dc1f4 🐛Source Braintree: resolve '$ref' in schema and spec (#9042)
Published by benmoriceau almost 3 years ago
5a2d4b1 force server restart on exception (#9018)
001e8f8 🐛 SAT: fix unit docker tests
467f047 Add cloud e2e tests (#7523)
3f88534 Fix issue when not found docs were failing the app (#9036)
64df1df Improve db check looping (#9013)
2115f7a Use kubectl cp to copy files instead of kube java clients (#8880)
Published by subodh1810 almost 3 years ago
6dce540 fix config db timeout param (#8988)
a6923b2 handle foreign key violation when expected record doesnt exist (#9016)
6316cb9 Update bigquery.md
0210071 Update Bigquery docs page
5dad5de Destination ClickHouse: Fix destination IllegalStateException (#8982)
67df5b8 🐛 Source Kafka : fixed SASL config read issue (#8865)
287cdb5 🐛 Destination Snowflake SQL compilation error (#9006)
d0f9aa8 Update "Building a connector the hard way" doc (#9008)
ddbce46 update destination_specs.yaml (#9007)
8654c4a implement flyway migration for config database normalization + tests (#8563)
115b0f9 attach kubernetes logs instead of writing to step output (#8979)
ae5b1cf add mini k8s stress test (#8978)
d2d0205 feat(charts): Set new migration values and use bootloader image (#8843)
a3100cb 🐛 Destination S3: avro and parquet formats have issues with JsonToAvroSchemaConverter (#8574)
fd716d7 Adding unit tests to SAT full refresh test (#8589)
de2b4ab Update fields in source-connectors specifications: linkedin-ads (#8984)
4a16965 🐛 SAT: add network host mode (#8998)
fe954c1 Integrate Sentry for performance and errors tracking. (#8248)
f0a9945 Revert "Change copy to add in dockerfiles to reduce container size (#8516)" (#8997)
08dc041 Destination MeiliSearch : failed acceptance tests (#8995)
1029945 🎉 Source Fecebook-Marketing: add asset_feed_spec to ad creatives stream (#8962)
7c0d195 Lever hiring oauth backend (#7677)
1c48122 Publish the bootloader JAR (#8957)
38e61c1 🎉 New Source: My Hours (#8270)
5096074 chore: added to source definitions: (#8983)
105bb58 🎉 New source: Qualaroo (#8623)
9b75a76 📑 Update source database performance test docs (#8980)
a6c2d05 🐞 Destination S3 & GCS: remove excessive logging (#8974)
Published by pmossman almost 3 years ago
1fe641a use airbyte/temporal-auto-setup which has multi-arch support (#8888)
635fc68 handle destination and source failures equally + fix main process failure handling (#8762)
9dfd0da Add API endpoint and handlers to delete SourceDefinitions and DestinationDefinitions (#8826)
Published by cgardens almost 3 years ago
b7ec67f Increase test timeout (#8971)
b920dc8 fix auto migration test (#8970)
1c525c0 Fix wrong param typo. Add proper index check for connection (#8968)
63017ea Revert "update to log4j 2.17.0 (#8965)" (#8969)
ae4de9c have discover endpoint that uses configs directly use improved secrets store pattern (#8897)
c5fc568 update to log4j 2.17.0 (#8965)
637fac3 BigQuery/BiqQuery denorm Destinations : Add possibility to use different types of GCS files (#8788)
24fb7d2 🐛 SAT fix containers auto-removing (#8959)
b3b0dce Add logs for errors (#8064)
2c7f239 airbyte-e2e-testing => airbyte-webapp-e2e-tests (#8892)
ffbf8bc Remove jobs and attempts tables from exported archive (#8646)
ff4b83b 🎉 Source Postgres: support all Postgres 14 types (#8726)
6ee29b5 🐞 Destination e2e test: fix documentation url (#8905)
cc70c0f allow serializing to yaml without quoting strings (#8896)
e92f551 Extend bootloader for Cloud. (#8879)
0de30f5 🎉 Testing destination: multiple logging modes (#8824)
ec305a5 make sure that all the secrets are remove (#8881)
20c4889 add container orchestrator in feature flag (#8015)
9acfc81 🎉 Source Facebook Marketing: Add the option to fetch thumbnail image data. (#8649)
2eace67 🎉 Source Zendesk Support: use cursor-based pagination (#8622)
1f580ed Update changelog 2021-25-11 (#8247)
86e08d0 🎉 Destination Redshift: add option to enable/disable deleting staging data (#8855)
31fcbed Jamakase/add workspaces word to url (#8878)
33e0efc Bumps lxml from 4.6.3 to 4.6.5. (#8845)
da40c4f 🐛 SAT: fix logs slicing (#8848)
0d7101e 🎉 Source Facebook Marketing: fix schema for 'breakdowns' fields (#8742)
212c1ff 🎉 Source Hubspot: Support incremental sync on all possible streams (#8699)
415a208 Destination MariaDbColumnstore: update Docker image for acceptance tests (#8840)
0c99c5d 🎉 Setting CPU and Memory limits for performance tests via github (#8807)
6889a89 🎉 SAT: add assert that spec.json file does not have any $ref in it (#8842)
5e494a9 📝 Update json to avro conversion doc (#8866)
9f9e924 🎉 Source Zendesk Support: Adds Brands, CustomRoles and Schedules (#8616)
8ac2c6f Change copy to add in dockerfiles to reduce container size (#8516)
Published by benmoriceau almost 3 years ago
7038533 🎉 Destination Redshift (copy): accept bucket path for staging data (#8607)
16f176b Remove nested secret (#8859)
38ae962 Jamkase/workspace slug (#8734)
464c485 Add acceptance tests for source close timeout (#8217)
b018769 ✨ Source Facebook Marketing: Added fields in campaign schema (#8257)
a283a63 Adds Amazon SQS and Lemlist source connectors in connector list (#8796)
5dad18b fix destination-snowflake build for jdk17 (#8854)
a0ec0de Source Linnworks: improve streams ProcessedOrders and ProcessedOrderDetails (#8226)
3a69029 remove validation from source delete (#8724)
2ad4ca1 Update fields in source-connectors specifications: drift, harvest, hubspot, intercom, monday, clickhouse, bing-ads, snapchat-marketing, microsoft-teams (#8429)
fb834c9 🐛 Source Shopify: fix for mismatched number of tables during normalization (#8597)
bc1ff91 🐛 Source Paypal Transaction: report full error message details, updated check method (#8580)
7fbdfc6 Airbyte CDK: Log http status code and content in backoff handlers (#8829)
5ac9049 update prefect-task documentation (#8835)
c84a748 fix secretGenerator (#8839)
2c3e241 Harshith/test pr 8179 (#8836)
21ff8a2 Source Amazon Seller Partner: Add GET_BRAND_ANALYTICS_SEARCH_TERMS_REPORT report (#8179)
91513f5 Destination Snowflake: update check method to verify permissions for staging (#8781)
3740f25 BigQuery locations update (#8816)
abc5014 Update more scripts. (#8833)
65fb3db Update release script to accommodate new env vars. (#8831)
183a790 increase reliability of frontend and kubernetes tests (#8827)
3a8d262 remove unused secret (#8828)
6b4d9ae fix KubePodProcess port offering race condition (#8804)
a808b4d 🐛 [8783] Fix Broken HelmCharts v0.33.11 (#8784)
530434f Tweak connections doc formatting for clarity (#8822)
369571c 🎉 New Source: OpenWeather (#7434)
e6fac63 🐛Source Google Analytics v4: fix date format (#8656)
b7f55f8 Destination Rockset: format code (#8821)
39b62d6 🐛 Source: Strava: support OAuth 2.0 (#8799)
cde7157 🐛 Source Hubspot: additionalProperties: true (#8658)
bf7d252 🐛 SAT: incorrect package setup (#8813)
b7b7886 🐛 Source Marketo: improve field conversion to conform schema (#8483)
3748c66 🎉 New Destination: Rockset (#8006)
be2ed7d 🎉 SAT: fix of stdout reading (#8743)
d3b0c99 🎉 CI secrets: full migration to GSM (#8561)
0fd129e 🎉 Updated ci performance test sh script (#8780)
60e3237 Switch to use Bootloader. (#8584)" (#8778)" (#8790)
cbcd6e3 update chargify documentation (#8764)
757ba94 Bump lxml in /airbyte-integrations/connectors/source-file (#8758)
Published by davinchia almost 3 years ago
3c9fe46 Update to Log4J 2.16. (#8779)
216501b Revert "Switch to use Bootloader. (#8584)" (#8778)
5cf3967 Switch to use Bootloader. (#8584)
57c4590 🎉 Updated ci performance test sh script (#8774)
ef7684b 🎉 Updated ci performance test sh script (#8772)
f37f68c 🎉 Updated ci performance test sh script (#8771)
4f2add0 🎉 Updated ci performance test sh script (#8769)
04a377f Source Woocommerce: advanced date checking incremental function (#8417)
678b532 🎉 Source Klaviyo: improve performance and make Global Exclusions stream incremental (#8592)
03e5160 🎉 New CDK: Dotnet/.NET/C# implementation + free exchange rates source connector (#7945)
6f621a7 Update Oracle Deploy Instructions docs (#8164)
bbcd461 🎉 New Destination: ClickHouse (#7620)
cba7285 🎉 New destination: RabbitMQ (#7560)
d50ae47 🐛 CDK: Fix the logging of unhandled exceptions to show stacktrace (#8704)
53c4047 Publish source: new streams are added in google ads (#8521)
e45dc12 format files (#8756)
346b411 add OAuth 2.0 for microsoft_teams source connector (#7807)
94e4364 🎉 Updated ci performance test sh script (#8751)
6854776 Add google cloud storage configuration in helm chart (#8332)
b1c067a 🎉 Updated ci performance test sh script (#8741)
e41b7d2 🎉 Updated ci performance test sh script (#8740)
c07e7d5 🎉 Updated ci performance test sh script (#8739)
02e61ac Source Oracle update docker images for integration tests (#8693)
38ddbd3 Remove multi-node test for Kube Acceptance Test. (#8737)
e791bb2 Created Generic MariaDBTestContainer (#8692)
9e36c38 🐛 Helm chart: Allow writing logs to S3 easily (#8736)
faa4d9a 🎉 Source Mailchimp: updated Mailchimp schemas (#7975)
62c3c4e Update fields in source-connectors specifications: mysql, onesignal, oracle, outreach, paystack, pipedrive, pokeapi (#8582)
4276b2f Bump the minor version for mysql source (#8731)
7591883 Added benchmarks scripts with small instruction (#8529)
70d2f46 Source MySQL\MsSql\Postgres: added RDS base performance tests (#8215)
Published by davinchia almost 3 years ago
a983f53 🐛 Increase sidecar memory. (#8727)
5adb1d1 Add more tests for json logical type conversion (#8725)
6843bc1 🎉 Source MySQL: support all MySQL 8.0 types (#7970)
2093b19 Upgrade start runner to v2.3.0. (#8703)
0b8c0f5 Bump connector versions for publishing (#8717)
25674fc upgrade to Gradle 7.3.1 / Java 17 (#7964)
e9f414d do not run excluded tags in integration tests (#8715)
fc91f67 move S3Config into destination-s3; update dependencies accordingly (#8562)
fefd575 Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524)
ba09bbf Change CDK "Caching" header to "nested streams & caching"
Published by jrhizor almost 3 years ago
c18711f bump gcp dependencies to pick up grpc update (#8713)
b6904c2 fail zombie job attempts and add failure reason (#8709)
Published by jrhizor almost 3 years ago
1529aa1 upgrade jaxb and jackson versions (#8706)
Published by lmossman almost 3 years ago
23172fc83 bump log4j2 version (#8687)
66fad5462 airbyte-8585 Template for bug-fix PR (#8603)
1cb295930 Docs: add Prefect tutorial (#8664)
d0aacc5a9 fix: added some acceptance tests just to have some basic stuff (#8679)
47e03a3d2 Docs: Update connector list (#8683)
84b3bf55a 🎉 Destination Amazon SQS: New connector (#7503)
678d933e3 🐛 Fix logging test. (#8677)
0bf8f778d 🐛 Source Google Analytics V4: Fix window in days validation issue (#8676)
b0fb656c0 🐛Source Google ads: connector doesn't pull data for today (#8225)
e95718b0d 🐛 Source TikTok Marketing: fix incremental bug + new reports' streams (#8292)
Published by lmossman almost 3 years ago
036e72fd0 Stricter logging configuration checks. (#8660)
65ef9295d Remove status link from oss version (#8502)
Published by davinchia almost 3 years ago
5fd44ba Add resource requirements to sidecars. (#8652)
3d7e62d 🎉 Sources Appstore Singer: refactor to use the cdk
fe55cab update Upgrading Airbyte doc to point to patch version of 0.32.0 (#8650)
973c043 Prevent deadlock when importing database (#8648)
07287ca split up insertions into batches of 100 when importing archived table into database (#8609)
38ee7a7 Redirect dbt log files to airbyte log when failing (#8621)
bab9eda Use throwable for tryDeserialise. (#8631)
edefc88 🐛 Source Intercom: Fix conversations order and sorting (#8579)
10f1b58 Source Github: Retry connection using HTTPAdapter (#8518)
58475ce Revert "Update platform containers to use non-root users (#7872)" (#8611)
ebcaf2b Update platform containers to use non-root users (#7872)
d67f427 upgrade temporal sdk to 1.6.0 (#8600)
bdda7e1 Refactor how we configure and build cloud storage clients in CloudLogs (#8573)
cbe01e9 Source Shopify: Add Shop stream (#8297)
c496368 Source BigCommerce: change dates comparison (#8416)
0973b33 Source Typeform: fix check connection authenticator loop (#8466)
aa67604 CDK: Add base pydantic model for connector config and schemas (#8485)
161a1ee format files (#8601)
f00f10e Source Google Analytics: update source spec and documentation (#8571)
ad55ab0 MongoDB limit 10k records during Discovery(#8491)
5ab5cfc fix(mongodb-v2): set logging to debug when field list is out of sync (#8495)
dfdd2c5 🐛 Source Salesforce: filter 'null' byte(s) in HTTP responses (#8405)
ccf8eeb 🎉 New Source: Mailgun (#8056)
34ff075 flake8 fix 3764 obfuscate secrets logging (#8583)
a7061dd Create separate Airbyte Bootloader Application. (#8547)
1d493ec CDK: #3764 obfuscate secrets in logging (#8211)
487f9e7 🎉 Source Google Sheets: migrate to the CDK
Published by lmossman almost 3 years ago
This is a patch for v0.32.0, which adds this change to batch up db insertions in order to fix a bug in which migrations would continuously loop when there was a large volume of data in the jobs database.
This patch also adds this change to prevent deadlocks when importing databases, which could have also manifested during migrations.
Published by lmossman almost 3 years ago
This is a patch for v0.32.0, which adds this change to batch up db insertions in order to fix a bug in which migrations would continuously loop when there was a large volume of data in the jobs database.
Published by tuliren almost 3 years ago
fa999d2 Update specs and fix build (#8560)
f9d8e39 Destination Snowflake: Return Standard Loading (#8528)
17504e9 🎉 Source Iterable: Add email validation to list_users stream method execution (#8380)
1bde075 🎉 Source Retently: add OAuth 2.0 (#8043)
cb120fe 🐛 Source Marketo: Fix timestamp value format issue (#8298)
e549068 Bump versions in spec files for ssh key related connectors (#8549)
79acc2b 🎉 Source Recurly: migrate to the CDK
Published by Phlair almost 3 years ago
Full Changelog: https://github.com/airbytehq/airbyte/compare/v0.33.3-alpha...v0.33.4-alpha
^ This is missing a few things because the 0.33.3 label is on a later commit than the actual version bump.
Published by cgardens almost 3 years ago
feb4083 log the job that is cancelled when pruning zombie jobs (#8514)