A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
MIT License
Published by leo-schick over 1 year ago
required changes
You might need to investigate your custom CSS styling, see boostram upgrade above.
Published by leo-schick about 2 years ago
Published by leo-schick about 2 years ago
Published by jankatins about 4 years ago
mara_pipelines.config.password_masks()
Published by jankatins over 4 years ago
Published by jankatins over 4 years ago
Published by jankatins over 4 years ago
Published by jankatins over 4 years ago
Published by jieyinybl about 5 years ago
Including the file_dependencies as variable for the copy command could handle cases in ETL pipeline, where the copy command shall be skipped if the sql_files stay the same.
Published by apisarenco almost 6 years ago
commands.sql.CopyIncrementally
class constructor takes an additional argument, use_explicit_upsert
, that, when set to True
, will use 2 explicit queries (UPDATE + INSERT) instead of using just INSERT ... ON CONFLICT DO UPDATE
. Useful when upserting into partitioned tables.