airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

OTHER License

Downloads
197K
Stars
13.8K
Committers
946

Bot releases are hidden (Show)

airbyte - v0.30.31-alpha

Published by jrhizor almost 3 years ago

8ca1870 format (#7661)
8cf5ecf fix container specific logging (#7657)
b863698 log oauth flow failures (#7648)

airbyte - v0.30.25-alpha

Published by cgardens almost 3 years ago

Changelog:

f35ec50 handle npe in test cases for tracking (#7546)

airbyte - v0.30.23-alpha

Published by cgardens almost 3 years ago

15afaf0 revert incorrectly enabled oauth feature (#7319)
6deae28 remove core label, replace with platform (#7305)
84b69d9 remove python from platform build (#7302)
e95a805 Bmoric/fix test bad catch (#7290)
a616c29 [5889] Bmoric/mdc manipulation tools [1/2] (#7266)
077b90e add optional spec field to source and destination definitions (#7254)
1ae5cf4 πŸ› Source Snowflake: Fixed parsing of extreme values for FLOAT and NUMBER data types (#7257)
a9e01db Fix incorrect code for Snowflake GCS (#7287)
5eb2af6 CDK: Autogenerate reference docs (#4759)
0c7f060 πŸ› Airbyte CDK: transforming Python log levels to Airbyte protocol log levels
9a435ec πŸŽ‰ Source Zuora: support of Unlimited option for Data Query (#7093)
cb6408a πŸŽ‰ Source Facebook Pages: bump FB API version (#7128)
0c93274 πŸŽ‰ Redshift Source and Destination set SSL as default option (#7234)
ad6223d Publish PR 6962: New Source Salesloft (#7274)
115af27 πŸŽ‰ New Source: Salesloft (#6962)
c83cafc add salesloft credentials github wf and ci script (#7275)
27568f1 Publish PR 6998: New Source Onesignal (#7271)
fac6840 πŸŽ‰ New Source: OneSignal (#6998)
4efadb2 add onesignal credentials + gradlew format (#7270)
17961fc Source Jira: Make recently added configs optional for backwards compatibility (#7222)

airbyte - v0.30.24-alpha

Published by cgardens almost 3 years ago

Changelog:

fce6056 πŸŽ‰ Created destination-oracle-strict-encrypt (#7460)
ebf35eb Fix SAT failing on similar nested strucutres with different order. (#7491)
a80d388 πŸ› Source Zendesk chat: fix chats stream is only pulling for first page (#7210)
f3fa71b Fix Google Analytics docs link on source definition (#7463)
ff2882d πŸŽ‰ Source Google Workspace Admin: use SAT (#6878)
74c78b9 πŸŽ‰ Source SurveyMonkey: add OAuth support (#7433)
8d95cb8 move file migration logic in ServerApp to its own method and mark as … (#7307)
58902f3 add cli commons to factor out common parsing code (#7301)
fdcbfd9 Source MongoDB: bump connector version (#7381)
238fc1a Regenerate Normalization Integration Tests' output SQL files (#7490)
5fc50df πŸŽ‰ Incremental Normalization (#7162)
9c78351 πŸ› Source Jira: Fix normalization step error (#7408)
269298c πŸŽ‰ Source File: Migrate File source to CDK structure (#7387)
cdb80f4 Instagram and Facebook Pages oAuth backend (#7412)
ab95855 Publish PR 6967: new source freshservices (#7470)
facdf85 πŸŽ‰ New Source: Freshservices (#6967)
d525f1f Save specs to source/dest definitions on create and update (#7367)
10889d8 Add user creation instructions to Postgres destination
d9261c6 Remove outdated block saying postgres doesn't support GCP CDC
ed78937 Add instructions to chmod private key in Azure Setup (#7467)
4bc5005 Add note about host name issue with Azure Cloud (#7462)
97e9b13 πŸ› Source Google-Analytics-v4: add additional permission check while setting up the connector (#7410)
a020618 remove secrets migration code (#7437)
437db3e remove deprecated adwords docs (#7449)
03732df Add version (#7402)
9d30bb0 [5889] Bmoric/log application name for all workers [2/2] (#7268)
aa2caf1 Using helper to get postgres credentials (#7235)
2e128cf Harshith/test pr 7324 (#7432)
bfa91fa Add TikTok Marketing to SUMMARY.md (#7429)
733e785 remove "V4" suffix from GA connector name
7592bca πŸŽ‰ Source Drift: migrate to the CDK
62832cd πŸŽ‰ Source Looker: Migrate Looker source to CDK structure, add SAT testing (#7284)
2048012 Credits Page. Add labels to asix (#7101)
906aa75 πŸ› Source Hubspot: hotfix import urllib package (#7405)
e479388 Harshith/test pr 7063 (#7382)
1a2eaeb Note to airbyte-notification to use username/pass for external database (#7297)
6ff2fc7 Expose version as AirbyteVersion instead of String in Configs iface (#7369)
85851b7 πŸ› Hotfix Hubspot: add the length of separator symbol to check (#7393)
1b1b52d πŸŽ‰ New Source: Strava (#7151)
46a249e πŸŽ‰Source Clickhouse: added option to connect via SSH tunnel (aka Bastion server) (#7327)
1233e33 Fix star link on GitHub. (#7396)
498f325 Add star count to front page of docs. (#7395)
ac754ce Enable fullstory only for cloud (#7298)
6fc9418 Jamakase/fix password invalid text (#6939)
22f8c39 Clarified wording on Save Actions. (#7358)
c2adf9b Set a timeout on kube pod process integration tests to prevent a hang (#7087)
3327bf8 Publish PR 7062: new source lemlist (#7392)
19f2541 πŸŽ‰ New Source: Lemlist (#7062)
91b5abc Fix page style. Remove bottom beige rectangle (#7364)
9157b3d Publish PR 6937: new source amazon sqs (#7389)
002b62d Fix arrow in setup connection flow (#7363)
ed4afd9 Add tooltip (#7365)
58b569d πŸŽ‰ Source Amazon SQS: New connector (#6937)
e92fbd9 prettify connector definition seeds (#7375)
2c8151f Add creds for strava, lemlist, amazon sqs and freshservice (#7388)
928aa62 πŸ› Source Hubspot: Fix issue with getting 414 HTTP error for streams (#6954)
722f82d Creating license-faq (#7153)
35e9050 prefer AirbyteVersion over String (#7310)
06c3fcb Fix the check connection activity (#7366)
5c20ab3 remove py from fe e2e test build (#7361)
779c39c Copy job attempt state to configs database (#7219)
5d2b5dc fetch specs from definitions directly (#7293)
6ead334 Fix codestyle for workspace (#7304)
98d87b1 refactor spec workflow (#7354)
c689e17 refactor the catalog discovery workflow (#7350)
209a4ae Split the check connection workflow into multiple files. (#7292)
5a52d20 Source Recharge: change schema for discount and order (#7295)
dbfd6ca Source MongoDB v2: Fixed nested document parsing (#7160)
27df558 πŸŽ‰ BigQuery destinations with partitionned/clustered keys (#7240)
9a0b8da πŸŽ‰Source Clickhouse: added ssl support and "strict-encrypt" connector (#7127)

airbyte - v0.30.22-alpha

Published by Phlair almost 3 years ago

c6d3387 take out args (#7261)
a82d04f Docs: correct youtube video link for CDK Speedrun(#7256)
0585a5d Publish PR 6930: google dir fix members (#7218)
8a54f1b Google Directory: Fix crash if there's a group don't have members (#6930)
d660661 add google sheets oauth flow to server + fix auth rootObject type in protocol (#7131)
bd5d4ee Fix more typos in the docs (#7225)
561fabe πŸ› BUG-4307: Fix incorrect handling of LONG RAW data type (#7125)
b230bc5 Github oauth backend. (#7237)
a35f93f Java OAuth refactors (#7239)
dfdbda8 Source Klaviyo: update schema validation in SAT (#6952)
d5e80d0 OAuth backend Refactor (#7209)
e87604e Update doc about m1 (#7233)
6c3555b Salesforce oAuth backend. (#7212)
7ae250d Fix WooCommerce source page. (#7228)
58d81b2 Publish PR 5840: hubspot connector add stream (#7220)
78d6d6a Update scaling documentation (#7177)
fae4d00 Source Hubspot: Add new marketing emails (with statistics) stream (#5840)
a7ddd16 Fix typo (#7193)
d38ba5d Use monads capabilities and more explicit variable name (#7195)
1affb14 even more link fixes (#7148)
67b01e7 Update Mockito for running tests on Mac M1 (#7208)
e821919 run gradlew format (#7223)
bc78e1c add secret name for publish config (#7221)
265986b Create a secure-only MongoDb destination (#6945)
059645f πŸŽ‰ Source File: separate secure fork (#6768)
e3be3d2 Update M1 doc and fix doc links (#7205)
6c0a173 Bump Source Jira Connector (#7202)
1fcd6c4 Source Jira: Add Board, Epic, and Sprint-related streams and improve request caching (#6621)
c2eabc1 m1 pr cleanups (#7197)
afde653 Restore platform option in m1-specific docker compose file (#7188)
d9e7bdc Remove platform option temporarily to fix master build (#7184)
3530429 Change Airbyte Spec doc links to permalinks. (#7019)
3e7f95c πŸŽ‰ Support build on MacOS M1 (Apple Silicon) (#7104)
b79984a Fixed broken link in Source Bigquery spec (#7165)
dc575f6 fix kube build again (#7174)
1d3a17a πŸŽ‰ Source S3 - memory & performance optimisations + advanced CSV options (#6615)
25110c1 πŸŽ‰ Google Directory: Add organizations and phones to users schema (#7167)
abf0159 πŸŽ‰ Add configurable dbt parameter to destination-bigquery (#7118)
b18acd6 πŸŽ‰ Connector Facebook-Marketing: update insights streams with custom entries for fields, breakdowns and action_breakdowns (#7158)
214b158 Add labels to EC2 build machines. Refactor actions to reduce duplicate start ec2 runner actions. (#7119)
1441bf9 πŸŽ‰ New Source: Appsflyer (#6497)
2d32df1 fix more doc links (#7146)

airbyte - v0.30.16-alpha

Published by sherifnada about 3 years ago

8d599c8 correct dead links and exclude docs (#6857)
e5abaec πŸŽ‰ Base-normalization: Implement normalization for MSSQL-destination (#6079)
ab6cc49 πŸŽ‰ Source Google Ads: add new stream 'click_view' (#6684)
00d56e7 πŸŽ‰ Source Slack: Implement OAuth support with OAuth authenticator (#6570)
873fc06 πŸ› Fixed mysql source secure only (#6868)
83fabfe Github source: fix config backward compatability (#6833)
ae63696 Asana source: Add oauth init flow parameters support (#6832)
276d914 Direct to Discourse tagged list instead of specific issues on Troubleshooting. (#6848)
31af81e remove marketo singer credentials
b470489 🧹delete marketo singer source (#6800)
ae01fc1 remove woocommerce from list and run format (#6854)
fa871f7 Add Troubleshooting for Shopify (#6853)
3e2a0e6 πŸŽ‰ New Source: WooCommerce (#5955)
3165a74 add toString for MaxWorkersConfig (#6818)
746da21 fix normalization run length logging (#6803)
81e2662 feat: UpgradeButtonsHidden for cloudVersion (#6708)
acff636 Fix list formatting in SSH tunnel sections (#6847)
f4ba6c0 Marcos/test pr 6054 (#6581)
a319642 Forward destination location to dbt profiles (#6709)
1b1ff87 Source Facebook Marketing: added optional end_date configuration (#6054)
1184920 Destination BigQuery: add support to dataset starting with numbers (#6733)
5a5b3c2 πŸŽ‰ Source Hubspot: Bump docker version (#6840)
55dae7f πŸŽ‰ Source Zuora: Add OAuth support for Airbyte Cloud, Migrated to new CI Sandbox (#6575)
933a1e4 fix: NamespaceFormatLabel (#6838)
370805e 249/user cannot change email (#6439)
64d7cf1 πŸ› Source LinkedIn-Ads: Fix for Campaigns/targetingCriteria transformation, coerced Creatives/variables/values to string (#6610)
6e53a57 πŸ› Destination Oracle: maxStringLength should be 128 (#6611)
00b43df Add few new BOOTSTRAP.md files + update existing ones (#6550)
86ee2ad fix(docs): remove #4232 since it is fixed (#6789)
1bf339e Update oracle.md
d5ed24b Update oracle.md
febeb52 πŸŽ‰ Configurable job pull image policy in k8s (#6827)
75aee68 Add waitlist to cloud deploy doc (#6826)
74d1d65 Update quickstart. (#6825)
2603ff9 Update builds.md
9006d16 Update on-cloud.md
c66fc38 Update set-up-a-connection.md (#6757)
ee8528d Fix lists + add headers for cloud deploy (#6823)
cbdb11a Add Deploy guide ☁️ (#6805)

airbyte - v0.30.2-alpha

Published by tuliren about 3 years ago

Summary

Fixed a bug that would fail Airbyte upgrade for any deployment that has setup notifications on sync success or failure.

CHANGELOG

d7ad616 πŸ› Fix migration failure by making notification forward compatible (#6559)

airbyte - v0.30.0-alpha

Published by subodh1810 about 3 years ago

Warning

Please skip this version and upgrade to v0.30.2-alpha.

This version includes a migration bug. When notifications are set up to be sent on sync success or failure, this bug will prevent the Airbyte server from being upgraded to the latest version.

CHANGELOG

e10a198 Inject oauth params when using "sync now" button too (#6545)
6e77a8c πŸ—οΈ SAT: add oauthFlowInitParameters verification for spec (#6534)
b95f366 Fix publish script for non-connector images (#6537)
eb04c1a Secrets Migration utility (#6489)
5af9429 Republish connectors to include new specs fields (#6543)
baea5b4 add Azure DevOps PAT link (#6526)
960214a Change Airbyte Protocol for OAuth and Make protocol more permissive (#6542)
3a825e8 correct linkedin ads readme link (#6540)
6f4b550 πŸ› Source Pipedrive: Normalization Error Person Table: Invalid timestamp (#6441)
13d13b2 implement NoOpMigration for 0.30.0-alpha (#6535)
8b021a8 πŸ—οΈ SAT: check record object fields overlaps with schema
bbf098a πŸŽ‰ Destination MySQl - Added support for MySQL destination via TLS/SSL (#6506)
a595c75 πŸŽ‰ Destination MSSQL: Added support for connection via SSH tunnels (#5… (#6503)
7d1a67f introduce method to query jobs database by end timestamp of attempts (#6505)
6b4c6a1 Fix "android_last_seen_at" data type (#6082)
1043437 Change license in connector generator base files (#6522)
c5e74cf Make spec storybook more prominent in docs
501d07f Facebook marketing source: fix field value type conversion
0105ca9 πŸŽ‰ BigQuery Denormalized Destination: Support for more bigquery types through the format annotation (#6145)
805fabb Fix list in quickstart guide. (#6520)
845f84b Marcos/test pr 5747 (#6516)
4631d8c Move long filename troubleshooting out of deploy guide (#6518)
6b19bf4 Add high level overview to normalization doc. (#6445)
911998b Fix typo in CREATE PUBLICATION statement. (#6476)
d885d77 mysql test int types (#2908)
a28b3f5 Bump Airbyte CDK version to 0.1.25 (#6511)
3c40e98 improvement: modifying the cli tool so that it can accept API_URL (#6507)
eb8be95 Update Google Search Console oauth specs (#6460)
c256114 πŸŽ‰ Destination Oracle - Added support for connection via ssh tunnel (#6370)
8fa1571 πŸŽ‰ Destination MySQl - Added support for connection via ssh (aka bastion server) (#6317)
96aedd3 Stress Test Improvements (#6440)
3369237 πŸŽ‰ Add labels to Kube jobs. Allow injection of Kube Image Pull Secrets. (#6368)
802a818 πŸ› Python Alpine tempales: add build-base packages (#6457)
cbf268a add docker-compose debug extension (#6451)
f308690 Exposing SSL-only version of Postgres Source (#6362)
d9adbd3 πŸŽ‰ Source Stripe: use start_date parameter in incremental streams (#6466)
a9b1c6c Fix doc badges and structure (#6482)
3faaffd Update Google Analytics Oauth Specs (#6459)
4ce6a03 Update Google Ads oauth specs (#6458)
b563b1a Fix exception in yaml persistence test (#6481)
2fe6166 Light cleanup to Quickstart deploy guide. (#6446)
f25542a πŸŽ‰ Update license for Core (#6479)
1773e41 Shorten our headers + adds contributors file (#6478)
89dccf3 Modify oauthSpecification to allow working with oneOfs (#6456)
6767424 πŸŽ‰ S3 source: add support for non-AWS S3 Storage (#6398)
f803481 πŸ› Source Chargebee: fix examples in spec file (#6454)
1c5ac5b πŸ—οΈ Python CDK: add schema transformer class (#6139)
d386ed7 Update roadmap.md (#6452)
c85becc make the seed for YamlSeedConfigPersistence configurable (#6409)

airbyte - v0.29.22-alpha

Published by davinchia about 3 years ago

2f835e4 πŸŽ‰ New Source: LinkedIn Ads (#5285)
fd46ee6 Remove broken link to image in comparison page. (#6449)
6658ecd πŸŽ‰ Source Oracle: Added support for connection via SSH tunnels (#6356)
ec3951b πŸŽ‰ Integration Testing for SSH using a docker container | Postgres Source and Destination update integration tests using ssh bastion in docker container (#6312)
ff479de πŸ› Source Iterable: Fixed normalization issue (#6242)
fe3026d πŸ› Source Asana: fix schemas and invalid_config.json (#6402)
5551698 Source MongoDb: added support via TLS/SSL (#6364)
3378ba4 πŸ› Destination snowflake: split the snowflake insert query into multiple queries with a specific batch size (#5783)
41157f7 Expose more configuration through values.yaml files (#6320)
6f1bd71 Marcos/publish pr 6394 (#6424)
eb41cdd Fix documentation URL (#6394)
b050f65 fix redshift docs formatting
c687d40 Connector Generator: add additional pip install for tests in docs (#6411)
a8261f4 secret coordinate helpers (#6114)
ef6fefc πŸŽ‰ Source Google Search Console: accept admin email as input when using service account key (#6405)
42bb171 🧹 remove google analytics singer from source list (#6358)
26c9546 πŸŽ‰ New Source: Marketo (#5863)
992bdb1 Skip updating spec cache when publishing normalization docker image (#6399)
3d8625e Fix ssh tunneling for normalization (#6396)
0b1f1e2 fix: overflow-y for SyncCatalogField (#6369)
6342592 Remove deprecated connectors: source-google-adwords-singer, source-google-search-console-singer, source-googleanalytics-singer (#6378)
aac98b9 πŸ› Source Hubspot: Use correct schema for 'owners' stream (#6374)
a6ecfda πŸ› Fix Snowflake destination normalization to accept any date-time format. (#6052)
c183410 Google ads: Fix inconsistent segments date type (#6373)
9c5572b Source BigQuery: Fix NPE when dataset_id isn't provided (#6051)
b4cca60 Source Google Search Console: correct spec.json file (#6222)
5861b6f correct CI applying gradlew format (#6390)
98b1900 πŸŽ‰ New API endpoint to search connections (#4813)
9a6cf1e πŸ›Source Google Search Console: Verify access to all sites when performing connection check (#6315)
9aa5a5a πŸŽ‰ CDK: Added support for efficient parent/child streams using cache (#6057)
548a3a3 Format code (#6381)
c86403f πŸŽ‰ New source: Kafka (#5906)
0b82f7f add details for testing ssh normalization (#6376)
7591324 introduce jvm flag MaxRAMPercentage for java connectors (#6001)
6d9ba02 feat: FetchingSourceConnectorError.tsx (#6053)
e8906ea Bump amazon ads version (#6367)
a225b06 Google Search Console Oauth flow implementation (#6088)
7316206 πŸŽ‰ New Source: Lever Hiring (#6141)
1644f90 πŸŽ‰ Source GitHub: Add option to pull commits from user-specified branches (#6223)
8de72d5 6240/Add profile type filter = seller,vendor (#6241)
4dca327 πŸŽ‰ CDK: Add support for custom headers passing to the request in OAuth2Authenticator. refresh_access_token (#6219)
a6c48dc Update README.md (#6350)
bf665cb Fix language consistency in Databricks page (#6360)
4f0839d Add Glossary of Terms to Understanding Airbyte (#6235)
909dfa5 Reorganize BQ docs
c5450d7 Fix typo in bigquery destination readme
d1b37da Fix google analytics auth flow parameters. (#6357)
54016e3 Update bigquery destination README
6ae1901 πŸ› Source Amplitude: Correct output schemas on cohorts, events, active_users, and average_session_lengths streams (#6353)
35c5bcd add displaySetupWizard as an api option (#6331)
59cd5ca πŸŽ‰ Source MSSQL: Added support for connection via SSH tunnels (#5966) (#6318)
023a9ba πŸ“ πŸŽ‰ Source Shopify: added the pre_tax_price to orders/line_items schema, update stream_slices logic (#6056)
0475823 Update Google Analytics Oauth flow (#6321)
12cb3e3 πŸŽ‰ Source greenhouse: added identification of accessible streams for API keys with limited permissions (#6238)
c114ec8 πŸ› Source Salesforce: fix bug with pagination for BULK API (#6209)
45f6598 Fix exception on API calls (#6346)
11f6488 πŸŽ‰Source MySQl - Added support for connection via ssh (aka bastion server) (#6146)
52c4eaa Google analytics v4: Oauth2.0 config (#6306)
478e408 Add High-Level overview to Namespaces doc. (#6234)
7e37883 πŸ› Source Stripe: Remove incorrect timestamp formats from coupons and subscriptions stream schemas (#6328)
fef66e7 Add source type to source definitions (#6304)
4f1da3e Update instance wide oauth parameters (#6309)
31820f9 5595/UI workspace user errors (#6136)
9dfd2b8 added externalDB password secret values (#6311)
82cb353 inject tolerations and add node selectors for worker pods (#6123)
65b42c8 πŸ› Source Intercom: Fix "updated_at" data type (#6087)
e14b03d FB Marketing Oauth flow implementation (#6018)
f5c8ce2 publish PR 5693 (#6299)
f560ae1 πŸŽ‰Source Hubspot: Add contacts associations to Deals stream. (#5693)
1b55742 publish 5898 & 6227 (#6300)
3695170 πŸ› Source GitHub: Add error handling for streams that are not applicable to some repos (#6227)
775bb03 πŸŽ‰ GitHub Source: Don't minimize output fields (#5898)
833dce1 πŸ“ Add link to java 14 in documentation (#6252)

airbyte - v0.29.21-alpha

Published by tuliren about 3 years ago

Summary

  • Fixed a bug that rolled back connector definitions after Airbyte upgrade.
  • Fixed a bug that prevented Airbyte upgrade from an old version (a second one).

Changelog

2473eb7 🐞 Update connector definitions after migrations (#6247)
33a1981 πŸ› Source MixPanel: allow pulling data from different regions (#6075)
5e4dddd πŸ“ Fix links to getting-started (#6237)
111d90f 🐞 Fix db config persistence initialization (#6220)
51fadf2 πŸ› Airbyte Kube will now error on start up if incorrect logs configuration is passed in. Fix scheduler counting bug. (#6188)
fa0bd55 Switch out old Speedrun Tutorial. (#6236)
64ce6fd πŸ›Destination S3 and GCS - Fixed connector's bug that prevent writing streams with more than 50GB (#5890)
69b2453 Gut the FAQ and link to our Discourse (#6159)
efae047 Add kubernetes labels to PRs (#6224)
a9aba9c Create secrets manager API against Google Secrets store, feature flag (#6113)
e04623f πŸŽ‰ Source Shopify: convert prices into numbers
4625d90 πŸ› BigQuery source: Fix nested structs (#6135)
8094a1d Format. (#6214)
76140b5 πŸ› Source Recharge: change cursor_field from created_at on updated_at (#6149)
58b6a1b πŸŽ‰ Amazon SP extra endpoint support (#5248)
0a027a1 πŸ› Fixed test for gcs, csv, json-local, mongodb and meilisearch destination (#6134)
13e8be5 Fix OAuth Summary strings (#6143)
fe460ce πŸŽ‰ Create a Helm Chart For Airbyte (#5891)
108d9e0 Add back the migration acceptance test (#6163)
1bac19c Update new integration request
4940c1a Update Airbyte Spec acknowledgements. (#6155)
d732eaf Add information on which destinations support Incremental - Deduped History in their docs (#6031)

airbyte - v0.29.19-alpha

Published by tuliren about 3 years ago

Summary

Fixed a bug that prevented Airbyte upgrade from an old version.

Changelog

fc64d88 Fix migration validation issue (#6154)
06128ab Doc explains normalization full-refresh implications (#6097)
8b40e13 Jamakase/update onboarding flow (#5656)
39e77f3 Fix request middleware for ConnectionService (#6148)
cba0e33 feat: path for nested fields (#6130)
474b8f1 CDK: support nested refs resolving (#6044)
29cb35c Ignore python test coverage files (#6144)
8dcaf25 return auth spec in the API when getting definition specification (#6121)

airbyte - v0.29.18-alpha

Published by davinchia about 3 years ago

Warning: this version contains a bug. Please use v0.29.21-alpha instead.

CHANGELOG

078c660 Update log message for empty env variable (#6115)
d0f2181 Interface changes to support separating secrets from the config (#6065)
4a0d364 πŸŽ‰ CDK: Add requests native authenticator support (#5731)
278cb7d Disable automatic migration acceptance test (#5988)
8c127d8 πŸŽ‰ Source Github: add caching for all streams (#5949)
e915448 update salesforce docs (#6081)
3ed42fc Fix the format of the data returned by Google Ads oauth to match the config accepted by the connector (#6032)
7a6da86 add coverage report (#6045)
0691e77 Fix dependabot security alert. (#6073)
84b3fbd πŸŽ‰ Added optional platform flag for build image script (#6000)
2390b54 Fix more doc issues (#6072)
aca8c50 Fix or delete broken links (#6069)
9dafec6 Destination Kafka: correct spec json and data types in config (#6040)
b596194 publish #6058 (#6059)
0552b17 Source PostHog: add support for self-hosted instances (#6058)
e837048 πŸŽ‰ New Destination: Databricks (#5998)
679ddf4 Revert "Add skeleton for databricks destination (#5629)" (#6066)
79256c4 Add skeleton for databricks destination (#5629)
49d0f7e πŸŽ‰ Source Stripe: Add PaymentIntents stream (#6004)
14ac554 use spec when persisting source configs (#6036)
a31b9a9 add oauth to connector_base dependencies (#6064)
6d39afc πŸ› Source Facebook Marketing: Convert values' types according to schema types (#4978)
7eb5577 Bump connectors version + update docs (#6060)
20ee2d3 Update ads_insights.json (#5946)
75c17b4 Format google-search-console schemas (#6047)
1314a6a #5796 silence printing full config when config validation fails (#5879)
12b2dc9 Regenerate and check in integration tests files for normalization (#6050)
dc71bf6 🍾 Remove automatic filtering of system schemas from Oracle source. (#6038)
fa0028d remove extra get spec call (#6041)
b16e99b publish PR #5826 (#5958)
efdb2e4 πŸ› Source Facebook Marketing: fix url parsing and add report that exposes conversions. (#5826)
35b38a2 Sherif/publish #5973 (#6033)
c3bdaa8 πŸ› Keen destination: fix for timestamp inference for complex types (#5973)
74c9986 publish spec to cache as part of connector publish script (#5994)
129a8fb Fix oauth test failures causing build to fail (#6030)
2ee79f2 Add Platform CHANGELOG notes up to 0.29.17 (#6029)
5c02ec6 Add CHANGELOG summaries (#6028)
ebd772e Past two connector changelogs (#6025)
6ffb682 Source google sheets: fix full_refresh test by adding supported_sync_modes to Stream inistialization (#5951)
0fe7a53 Google Ads Source: Annotate oauth flow init parameters (#6022)
da34bef Implement Google Analytics & Google Ads OAuth Flow (#5911)
51e2718 πŸ› Source Shopify: fix the connector's performance for incremental refresh (#5945)
03e1e08 πŸŽ‰ New Source: Close.com (#5366)
4ffca60 πŸ› Destination S3: fixed s3 destination field naming for Parquet and Avro formats (#5729)
71f51e0 πŸ› Snowflake destination: snowflake s3 destination COPY is writing records from different table in the same raw table fix (#5924)
6ec45b3 πŸ› Surveymonkey source: fix gzip compressed http response caching (#5983)
7970e63 Add scheduler client that pulls from bucket cache (#5605)
efacd5d use new ami with larger disk for kube builds (#5987)
c633d60 Remove v0.30.0 file-based migration (#5984)
4fa05b7 πŸŽ‰ Pipedrive source: add organizations stream (#5943)
b53d826 Separate connector upgrade from import (#5965)
332687a add secrets to kubernetes yamls (#5962)
75e4998 Fix used connector query and add logging (#5964)
c0d4652 πŸŽ‰ New Source: Google Search Console (#5350)
aa9786d πŸŽ‰ Google Ads improvement: Support user-specified queries (#5302)
5f697ac πŸ› Fix okta incremental stream (#5905)
fc159d8 add instancewide variables setter endpoints (#5940)
2ecc7a6 πŸŽ‰ Sendgrind add single send stats (#5910)
6041f3d πŸ› CDK: fix bug with limit parameter for incremental stream (#5833)
70513bc πŸŽ‰Source Bing Ads: Add Report streams (#5750)
8179992 move GH testing script from top level into connector directory (#5938)
a288641 Source Lever Hiring: initial template blank (#5947)
37943d2 Add missing transitive dependencies causing connector build to fail. (#5944)
ffecc1c πŸŽ‰ New source: MongoDb ported to java (#5530)
984cebe πŸ› Source Zendesk Support: fix incremental logic for ticket_comments stream (#5787)
9b71c28 πŸŽ‰ Source Github: add reaction streams (#5860)
bb043b7 πŸ› Destination BigQuery Denormalized: Fixed compilation error (#5917)
edcd83d Add a config for instance wide oauth parameters (#5761)

airbyte - v0.29.17-alpha

Published by davinchia about 3 years ago

7aa4c71 πŸ› Fix cancel not working on Kube deployment since 0.29.13-alpha. (#5850)
dec2c9e Switch logging logs to DEBUG. Add Kube labels to workers. (#5909)
a1dd956 Source Freshdesk: Fix incorrect type for unique_external_id in contacts schema #5800 (#5871)
e7413de Add a variant of the CDK speedrun that uses the PokeAPI (#5780)
8fcaba4 Fix CDK speedrun stream stub (#5778)
c97798a add acceptance_tests_logs to the common gitignore file (#5914)
ba2203b fix link checker (#5928)

airbyte - v0.29.16-alpha

Published by jrhizor about 3 years ago

c7d8055 πŸŽ‰ split scheduler and worker (#5737)
bbe44bf remove unused check/discover job persistence helpers (#5896)
769fedb make generics less confusing (#5824)
d7f23f1 πŸ› Source Intercom: Fix schema ts and array issue (#5908)
9dcced9 Java sources: Rework JdbcUtils (#5786)
895430e BigQuery Denormalized NPE fix (#5881)
f32b14e πŸŽ‰ Destination Bigquery: added gcs upload option (#5614)
fdb4c85 πŸŽ‰ Salesforce Native Connector: init version (#5619)
5ff0d23 make source-bigquery compile (#5877)
74d6c07 πŸ“š Link to how to preview connector specifications in the UI (#5894)
8ad43af SSH for Postgres Destination (#5743)
589d535 πŸŽ‰ Oracle normalization (#5562)
5e3b24f πŸ› Source Hubspot: fix array fields in schema with missed items property (#5834)
91a9a68 Commit updated lock file (#5892)
1ff177d πŸŽ‰ add ability to send success notifications on webhook (#5517)
3962007 Add sentry (#5861)
17fd9c7 Source Facebook Pages: update documentation (#5876)
ed462a4 updated mongodb data hash from integer to UUID string (#5875)
fe38f69 πŸ›Source Typeform: add support for multiple choices in responses (#5799)
33c2576 docs (faq): fix typos and grammar (#5856)
e2c593e πŸ› Destination BigQueryDenormalized : fixed stackoverflow and array type parsing when source forget to send "items" details for it (#5813)
e1ccf2d πŸŽ‰ New Destination: MongoDB (#5549)
1861fb0 πŸ› Source Shopify: fix for incorrect amount type in order_refunds schema (#5853)
9643f3d Start airbyte-oauth module (#5812)
60fd9d5 πŸ› Fix hubspot datetime empty string (#5798)
483d68c Update .gitbook.yaml
da44243 Jamakase/account settings page (#5597)
8b62fb2 Add db identifier to fix migration file directory (#5851)
71a96f5 πŸ› Migrations are in the wrong directory. (#5844)
e5c44e6 πŸŽ‰ Source S3: support of Parquet format (#5305)

airbyte - v0.29.15-alpha

Published by tuliren about 3 years ago

Changelog:

6e35dc5c7 🐞 Fix db config persistence unique constraint conflict (#5846)
d03ec5024 Add facebook pages to summary (#5848)
a1de8f236 Format code and add missing doc links (#5847)
dc2fa65b3 πŸ› Destination snowflake: updated snowflake query timeout (#5784)
0b658224f added bootstrap to connector checklist (#5817)
898e2c890 πŸ› Source Slack: Fix sync operations hang forever issue (#5830)
7f18cec0b πŸ› SAT: Update DictWithHash class in test_sequential_reads (#5738)

airbyte - v0.29.14-alpha

Published by davinchia about 3 years ago

f3f1c21 Make sure Java and Node is present. (#5829)
9f2394d πŸ› Release bash script use proper eval. (#5827)
30b3eb9 docker login should be part of release script (#5819)
f3f12b2 publish pr 5745 (#5825)
e732906 πŸŽ‰ Redshift Destination: Disable STATUPDATE flag when using S3 staging to speed up performance (#5745)
273fe86 πŸŽ‰ New Destination: DynamoDB (#5561)
7bf531a SSH for Postgres Source (#5742)
175d379 SAT: Bump version to 0.1.16 and publish (#5815)
65efaa5 πŸŽ‰ Oracle specify schema(s) to discover. (#5779)
7216de8 Jira structure: back to swagger schemas, but fix incorrect (#5523)
441d7cd πŸ› Source Github: handling empty repos, check method using RepositoryStats stream (#5788)
d3b2e8a πŸ› Source Jira: changed cursor field from created to updated
8353eea πŸ”ͺ : Get rid of Kube Workspace Volume. (#5663)
9c05308 πŸ› Source Shopify: Fixed line_items/discount allocations & duties parts of orders schema (#5801)
19c8efd πŸ› Slack source connector: do not give up retry attempts if there is 429 error (#5708)
58c9b84 πŸ› CDK: fix number of records mismatch (#5767)
95171b8 update release readme file (#5768)
8d2cd1e πŸŽ‰ Tool for generation catalog schema from OpenAPI definition file (#5734)
75a6a75 [protocol] add oauth params to connector specification (#5776)
7361263 πŸŽ‰ New Source: Facebook Pages (#5158)
caa4dc8 fixed the invalid seq for flake8 (#5785)
d74c47a πŸŽ‰Source GitHub: Add more streams (#5757)
4717257 SAT: check records to comply jsonschema format field (#5661)
1f7edaa Update connector definitions upon server start (#5723)
0d7cdcb Add API endpoint to get oauth request/consent (#5699)
3260a48 introduce a github action for open source release (#5732)
bba0afe Add Faros CDK to summary (#5764)
5a0d7af Destination Oracle: use airbyte default column name + correct ci tests (#5746)
ff70fd3 πŸ› Source Slack: Fix max retries issue (#5697)
7584440 CDK: private configuration option _limit and _page_size (#5617)
3aabd92 Fix facebook marketing source SAT fail on invalid config file (#5621)
90ca4fd Source Harvest: upd version and doc (#5749)
eed2e10 Python CDK: fix retry attempts in case of user defined backoff time (#5707)
90e909f Harvest normalization failure: fixing the schemas (#5701)
3b8f6e8 Source GitHub: use new repo for SAT tests (#5726)
b18bd43 πŸ› Destination Postgres: fix \u0000(NULL) value processing (#5336)
8c1ff00 Fix doc link (#5740)
36ebf95 Revert "add data volume again (#5715)" (#5719)
a53dd7e remove sleep logic when the queue is full from CDC (#5600)
314a747 Lightweight export/import of configurations scoped by workspace Id (#5598)
61842ed πŸŽ‰ Destination Azure blob storage: introduced new connector with jsonl and csv formats (#5332)
073a1d5 Publish source bigcommerce (#5722)
4e8f7af πŸŽ‰ New Source: BigCommerce (#5521)
01b905a Add note to source-file about changing the parsed data type(s) (#5690)
516d276 Add Faros CDK information to CDK docs (#5686)
d63f884 Add Bing Ads to connector grading table (#5680)

airbyte - v0.29.13-alpha

Published by tuliren about 3 years ago

CHANGELOG

e5c64ec6c Bump version: 0.29.12-alpha β†’ 0.29.13-alpha
9564f09c3 🐞 Make the scheduler wait for the server early on (#5716)
32c2a6b1a add data volume again (#5715)
6633eb4f6 add dynamo credentials (#5604)
f76ca9f21 πŸ› Python tempales: add default timezone for Alpine images (#5702)
61f3963f5 πŸ› Source GitHub: handle negative backoff values (#5696)
82f969f03 Fix doc link for source bamboo hr (#5710)
61a18af5a Publish source bamboo hr (#5698)
82f16382a πŸŽ‰ New Source: Bamboo HR (#5054)
de4400185 Add mypy to precommit hooks (#5662)
468a926ed SAT: bump version to 0.1.15 (#5677)
57d948b6a Update MySQL destination docs to indicate required versions with/without normalization
8de9f5c7b move terraform/readme.md to airbyte-integrations/infrastructure/readme.md (#5631)
e873129fe remove all date-time schemas (#5685)
b3c8214b7 Bump version for File connector (#5689)
ad22ee601 source-file: adding support to XLSB format (#5613)
86bdb7e16 rename comprehensive test to typetest and add javadocs (#5675)
cd5d6c47e 0.29.12 Platform Patch Notes (#5681)
32ab2d562 8/26/2021 Connector Patch Notes (#5679)
2a80ecec1 Add clear explanations for Full Refresh sync modes (#5630)
a38226946 Add FAQ for Tech Stack doc (#5175)
164d13866 allow scheduler and server to run on separate nodes (#5506)
0f1cc09c5 hotfix: formatting
487cda501 Fix documentation links (#5672)
4f8843b1c Script: GitHub filler (#5358)
ceb916d87 Source Pipedrive: correct schema removing timestamp from fields (#5642)
b9e1997d2 Split airbyte-db and move db dev commands to gradle (#5616)
b0be38fc0 πŸ› Source Cart: fixing of testing for a lot of data (#5465)
3630cdede πŸŽ‰ New Source: Amazon Ads (initial version) (#5023)
46a4e89ff Add run-migration variable to kube env files (#5654)
cfb4f422c πŸ› Source Google Analytics v4: Fix validation of empty custom reports issue (#5655)
6a3b59457 Clarified wording that confused a new connector developer (#5558)
6106dc3a5 made ordering requirement more clear for stream_slices (#5627)
13349dba7 Add kube resource limit to minio and pod-sweeper (#5620)
f059a278f Update doc about external database setup (#5611)
2ee462a9a πŸŽ‰ New Source-connector for Google Analytics v4 (#5290)
37c53db4b Integrate database with Flyway and jOOQ (#5543)
ce5d8d675 πŸŽ‰ New Source: Trello (#5501)
8ddce6f35 πŸŽ‰ Python CDK: Allow to ignore http status errors and override retry parameters (#5363)
3b9d7026f Fix dates on platform changelog versions (#5610)
397ab9e2b Format + Buff up log regex to handle dashes as well. (#5608)
6a3dc50bc 🍾 Update scaling doc. Add question on long running discover schema. (#5607)
f4ffe47ae 🍾 Add env based toleration to scheduled pods. (#5585)
72ba343a1 🍾 Scaling Airbyte document. (#4630)
cf96e3b76 Jamakase/update styles (#5596)
282f8702a :bug Add regex to log4j to mask any apikey= strings. (#5593)
09928ba5e use ram disk for configs (#5538)
bea0d2a09 remove 5s wait (#5535)
f76a13593 πŸ› Source Shopify: Fixed rate limits throttling (#5470)

airbyte - v0.29.12-alpha

Published by davinchia about 3 years ago

d977927ed Bump version: 0.29.11-alpha β†’ 0.29.12-alpha
3202bf3d0 Add missing import statement. (#5588)
29d65e946 Destination Oracle: change table limit and format record data (#5542)
93032a8dc πŸŽ‰ Source Cart.com: add order_items stream (#5582)
9dd05d479 πŸ”ͺ Get rid of retries within an attempt. (#5570)
fe8f7faf8 πŸŽ‰ Set max_sync_timeout in days by env vars (#5297)
088a138c0 Add oracle dest creds to get from secrets (#5578)
2eb9b67db Fix Keen doc yaml meta tags (#5580)
b943a221d Add 8/20 Patch Notes Summary (#5579)
1954284f6 Update spree-commerce.md (#5572)
16e8683f2 πŸ› Fix bad Kube deploys. (#5567)
61140e4a2 πŸ› Source Intercom: Fixed pagination issue (#5531)
4ca0e2baf Fix airbyte version comparison (#5559)

airbyte - v0.29.9-alpha

Published by davinchia about 3 years ago

45c8e3e47 Update beginners-guide-to-catalog.md (#5492)
03e1ff96b πŸ› Source Github: Fix set up validation (#5456)
5f4d263fe Bump version: 0.29.8-alpha β†’ 0.29.9-alpha (#5490)
bc89f85bd πŸ› πŸ“š Source Hubspot: Fix fail on reading stream using API Key without required permissions (#5463)
6b711aa8e Fixed build (SUB_BUILD=PLATFORM ./gradlew clean build) on master branch - fixed typo in destination_definitions.yaml (#5489)
048b8900c Source Zendesk: correct field unread to boolean (#5476)
179d4b366 publish PR #5339 (#5450)
bbd24fee7 πŸŽ‰ New Destination: Keen (#5339)
a78efe090 πŸŽ‰ JAVA-Based connectors: Bumped version for some javabased connector to start using Config Validator from core module (#5398)
79b8fd5c1 Remove seed generation task and seed from YAML files (#5335)
3e8996192 SAT: Update catalog_fixture to use the discover output (#5278)
d55af64b0 fix DATETIME data type handling in mysql cdc (#5389)
237e44093 Refactor dbt transformation entrypoint script (#5076)
f9705bf73 BigQuery normalization: make credentials json optional (#5433)
ddd7a04b6 Add detailed logging for acceptance tests (#5392)
70167aa30 πŸŽ‰ Source Chargebee: expand endpoint support (#5421)

airbyte - v0.29.11-alpha

Published by tuliren about 3 years ago

9d5c68dca Bump version: 0.29.10-alpha β†’ 0.29.11-alpha (#5560)
7469858e9 Added HOME to fix npm install bug. Improved error reporting to avoid silent failures. (#5554)
74755b277 Add Keen to changelogs for new destinations (#5556)
10da72d17 πŸ› CI templates: update scaffold examples (#5551)
7225187fa run gradlew format (#5552)
a9b2c0893 Add condition for unnest_column_name for pg/redshift/mysql (#5467)
02b360877 SAT: Fix test_read fail (#5550)
d1c3a7bd4 Deprecate server uuid (#5484)
fcf8ba469 Hide config database password in logs (#5540)
968ef3711 Revert placeholder PR (#5545)
05a5503f7 Merge in original GCS destination PR (#4329)
825c35843 Fix documentation links (#5544)
7b7ff3310 πŸ› Connector templates: failure of CI