big-data-types
A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets methods to convert it into the rest of the types and vice versa. E.g: a Spark Schema can be transformed into a BigQuery table.
APACHE-2.0 License
Bot releases are hidden (Show)
Published by JavierMonton almost 4 years ago
Big Data Types v0.2.1
- Project split into multiple projects
- core
- bigquery
- spark
Published by JavierMonton almost 4 years ago
Big Data Types v0.1.1
- Spark: Added SparkSchemas as a public interface for conversions.
- Spark: SparkSchemas accepts multiple case classes when generating schemas
- Core: Formats refactored, variables and class names have changed
Published by JavierMonton almost 4 years ago
- Spark: Added support for Spark Schemas (only Spark 2.12)
Published by JavierMonton almost 4 years ago
- BigQuery: TypeClass syntax for case classes instances.
Published by JavierMonton almost 4 years ago
- BigQuery: JavaConverters for cross-version builds
- BigQuery: Formats object that allows different keys transformation like CamelCase -> snake_case for fields
Published by JavierMonton almost 4 years ago
- Cross versions configuration
- Support for Scala 2.12
Published by JavierMonton almost 4 years ago
- Cross versions configuration
- Support for Scala 2.12 added
Published by JavierMonton almost 4 years ago
Sonatype plugin for releases
Published by JavierMonton almost 4 years ago
First stable release.
Support for:
- Basic types conversions into Sql Generic types
- BigQuery Schema creations and types to field conversions
- BigQuery Create tables
- BigQuery time partitioned tables
