ddlparse

DDL parase and Convert to BigQuery JSON schema and DDL statements

BSD-3-CLAUSE License

Downloads
36.4K
Stars
86

Bot releases are visible (Hide)

ddlparse - 1.10.0 Latest Release

Published by shinichi-takii over 3 years ago

Added

  • Added supports for Python 3.9

Fixed

  • Fixed parsing of columns with NULL/NOT NULL constraint.
ddlparse - 1.9.0

Published by shinichi-takii almost 4 years ago

Added

  • Add supports Cloud Spanner data-type.
    • STRING
    • BYTES
  • Add supports MySQL data-type.
    • BINARY
    • VARBINARY
  • Add supports PostgreSQL data-type.
    • BYTEA
ddlparse - 1.8.0

Published by shinichi-takii about 4 years ago

Added

  • Add DdlParseColumn.character_set property.
  • Add supports for parsing MySQL FOREIGN KEY options MATCH, ON DELETE and ON UPDATE
ddlparse - 1.7.0

Published by shinichi-takii about 4 years ago

Added

  • Add DdlParseColumn.default property.
  • Add DdlParseColumn.auto_increment property.
  • Add DdlParseColumn.encode property.
  • Add DdlParseColumn.distkey property.
  • Add DdlParseColumn.sortkey property.

Changed

  • Enhancement parse of Redshift DDL.

Fixed

  • Fix parse of column name with space character.
  • Change Email Address.
ddlparse - 1.6.1

Published by shinichi-takii about 4 years ago

Fixed

  • Fix parse Redshift ENCODE attribute.
ddlparse - 1.6.0

Published by shinichi-takii over 4 years ago

Added

  • Add property.
    • DdlParseColumn.is_unsigned
    • DdlParseColumn.is_zerofill
  • Add supports for numeric type attributes of MySQL.
    • UNSIGNED
    • ZEROFILL
  • Add supports MySQL data-type.
    • TINYINT
    • SMALLINT
    • MEDIUMINT
    • DEC
    • FIXED

Fixed

  • Miner fix.
ddlparse - 1.5.0

Published by shinichi-takii over 4 years ago

Added

  • Add supports for Python 3.8

Removed

  • End of support for Python 3.4

Fixed

  • Fix parse for column-constraint.
  • Miner fix.
ddlparse - 1.4.0

Published by shinichi-takii almost 5 years ago

Added

  • Add supports to BigQuery NUMERIC data type.

Data-type Conditions

BigQuery Data Type Source Data Type Precision Scale Database Exapmle Source Data Type
INT64 (NUMERIC|NUMBER|DECIMAL) < 19 = 0 - NUMERIC(18)
FLOAT64 (NUMERIC|NUMBER|DECIMAL) < 19 > 0 - NUMERIC(18, 1)
NUMERIC (NUMERIC|NUMBER|DECIMAL) >= 19 - - NUMERIC(19)
NUMERIC (NUMERIC|NUMBER|DECIMAL) * - - NUMBER(*, 0)
INT64 (NUMERIC|NUMBER|DECIMAL) None - default DECIMAL
NUMERIC (NUMERIC|NUMBER|DECIMAL) None - DdlParse.DATABASE.oracleDdlParse.DATABASE.postgresql NUMBERNUMERIC

Fixed

  • Fix parsing failure for include (*) format of Oracle NUMBER data type.
ddlparse - 1.3.1

Published by shinichi-takii almost 5 years ago

Fixed

  • Fixed parsing failure for columns include dot at default values.
ddlparse - 1.3.0

Published by shinichi-takii over 5 years ago

Added

  • Add supports the parse of COMMENT statements.
  • Add DdlParseColumn.comment property.
  • Add DdlParseColumn.description property for the DdlParseColumn.comment property alias.
  • Add supports column comments in BigQuery DDL.
ddlparse - 1.2.3

Published by shinichi-takii over 5 years ago

Changes

  • Fix parse error for MySQL DDL with FOREIGN KEY.
  • Fix not completely parsed with block comments.
ddlparse - 1.2.2

Published by shinichi-takii over 5 years ago

Changes

  • Fix FutureWarning of Python 3.7.
  • Add supports PostgreSQL data type.
    • UUID
  • Fix parse DEFAULT value.
    • Add parse regex of DEFAULT value.
ddlparse - 1.2.1

Published by shinichi-takii over 5 years ago

Changes

  • Add supports for Python 3.7.
    • Pass Python 3.7 test.
  • Add supports PostgreSQL data type.
    • CHARACTER VARYING
    • JSON
    • Array type
  • Fix parse DEFAULT value.
    • Add decimal point to DEFAULT parse character.
ddlparse - 1.2.0

Published by shinichi-takii almost 6 years ago

Changes

  • Add DdlParseTable.to_bigquery_ddl function. (#20)
    • BigQuery DDL (CREATE TABLE) statement generate function.
  • Add DdlParseColumn.bigquery_legacy_data_type property. (#21)
    • Get BigQuery Legacy SQL data property.
    • Alias of DdlParseColumn.bigquery_data_type property.
  • Add DdlParseColumn.bigquery_standard_data_type property. (#22)
    • Get BigQuery Standard SQL data property.
ddlparse - 1.1.3

Published by shinichi-takii over 6 years ago

Changes

  • Added support inline comment (#17)
  • Added support constraint name with quotes (#15)
  • Added support Oracle Length Semantics for Character Datatypes (#16)
ddlparse - 1.1.2

Published by shinichi-takii over 6 years ago

Changes

  • Add support Oracle data type.
    • CLOB, NCLOB (#9)
    • NUMBER with no length & scale specification (#10)
  • Miner fix. (#13)
ddlparse - 1.1.1

Published by shinichi-takii over 6 years ago

Changes

  • Fix Postgres/Redshift parse of "::" syntax in field attribute. (#11)
ddlparse - 1.1.0

Published by shinichi-takii over 6 years ago

Changes

  • Add source_database option. (#7)
  • Add to_bigquery_fields method to Columns dicttionary(DdlParseColumnDict class). (#5)
  • Fix BigQuery convert of Oracle data type.
    • Oracle 'DATE' -> BigQuery 'DATETIME' (#7)
    • Oracle 'NUMBER' -> BigQuery 'INTEGER' or 'FLOAT' (#4)
ddlparse - 1.0.0

Published by shinichi-takii over 6 years ago

Initial release

ddlparse - 1.0.2

Published by shinichi-takii almost 7 years ago

Changes

  • enhancement
    • ddlparse.py : Exclude unused module.
    • example.py : Modified comment.
    • README.md : Miner fix.