sparklyr

R interface for Apache Spark

APACHE-2.0 License

Stars
929
Committers
96

Bot releases are visible (Hide)

sparklyr - CRAN v1.2.0

Published by yitao-li over 4 years ago

sparklyr - CRAN v1.0.5

Published by javierluraschi almost 5 years ago

CRAN 1.0.5 - Support for Delta Lake and minor fixes, see sparklyr NEWS.

sparklyr - CRAN v1.0.4

Published by javierluraschi about 5 years ago

CRAN 1.0.4 - Support for Apache Arrow 0.15 and minor fixes, see sparklyr NEWS.

sparklyr - CRAN v1.0.3

Published by javierluraschi about 5 years ago

CRAN 1.0.3 - Support for multiple files in spark_read methods and minor fixes, see sparklyr NEWS.

sparklyr - CRAN v1.0.2

Published by javierluraschi over 5 years ago

CRAN 1.0.2 - Support for Qubole and minor fixes, see sparklyr NEWS.

sparklyr - CRAN v1.0.1

Published by javierluraschi over 5 years ago

CRAN 1.0.1 - Support for Apache Arrow, see sparklyr NEWS.

sparklyr - CRAN v1.0.0

Published by javierluraschi over 5 years ago

CRAN 1.0.0 - Support for Apache Arrow, see sparklyr NEWS.

sparklyr - CRAN v0.9.4

Published by javierluraschi almost 6 years ago

CRAN 0.9.4 - Patch release over 0.9.3 with fix for tibble 2.0.0 and streaming improvements, see sparklyr NEWS.

sparklyr - CRAN v0.9.3

Published by javierluraschi almost 6 years ago

CRAN 0.9.3 - Patch release over 0.9.2 with support for Spark 2.4.0 and various minor fixes, see sparklyr NEWS.

sparklyr - CRAN v0.9.2

Published by javierluraschi about 6 years ago

CRAN 0.9.2 - Patch release over 0.9.1 with various minor fixes, see sparklyr NEWS.

sparklyr - CRAN v0.9.1

Published by javierluraschi about 6 years ago

CRAN 0.9.1 - Patch release over 0.9.0 with minor streaming related fixes, see sparklyr NEWS.

sparklyr - CRAN v0.9.0

Published by javierluraschi about 6 years ago

  • Create Spark structured streams to process real time data from many data sources using dplyr, SQL, pipelines, and arbitrary R code.
  • Monitor connection progress with upcoming RStudio Preview 1.2 features and support to properly interrupt Spark jobs from R.
  • Use Kubernetes clusters with sparklyr to simplify deployment and maintenance.

Additional changes and improvements can be found in the sparklyr NEWS file and the sparklyr 0.9 release blog post.

sparklyr - CRAN v0.8.4

Published by javierluraschi over 6 years ago

CRAN 0.8.4 - Patch release over 0.8.3 with minor fixes and a request from CRAN to change DESCRIPTION file, see sparklyr NEWS.

sparklyr - CRAN v0.8.3

Published by javierluraschi over 6 years ago

CRAN 0.8.3 - Patch release over 0.8.2 with support to use Spark 2.3 in Windows (#1473).

sparklyr - CRAN v0.8.2

Published by javierluraschi over 6 years ago

CRAN 0.8.2 - Patch release over 0.8.1 with a fix for Livy under Spark 1.6 and support for yarn resource managers using https in cluster mode (#1459).

sparklyr - CRAN v0.8.1

Published by javierluraschi over 6 years ago

CRAN 0.8.1 - Fix for connections using method set to databricks.

sparklyr - CRAN v0.8.0

Published by javierluraschi over 6 years ago

  • MLeap extension to take Spark pipelines to production.
  • GraphFrames extension to perform graph algorithms like: PageRank, ShortestPaths and many others.
  • Support for Spark 2.3 and Livy 0.5.
  • Various other improvements and fixes as listed in the NEWS file.

Additional changes and improvements can be found in the sparklyr NEWS file and the sparklyr 0.8 release blog post.

sparklyr - CRAN v0.7.0

Published by javierluraschi over 6 years ago

CRAN 0.7.0 - Major release with support for:

  • ML Pipelines which provide a uniform set of high level APIs to help create, tune, and deploy machine learning pipelines at scale.
  • Improved Machine Learning capabilities by supporting the full range of ML algorithms and feature transformers.
  • Improved Data Serialization, specifically by adding support for date columns.
  • Improved support for YARN cluster mode connections.
  • Various other improvements as listed in the NEWS file.

Additional changes and improvements can be found in the sparklyr NEWS file and the sparklyr 0.7 release blog post.

sparklyr - CRAN v0.6.4

Published by javierluraschi almost 7 years ago

CRAN 0.6.4 - Patch release over 0.6.3 with multiple fixes for yarn-cluster and spark_apply(), see sparklyr NEWS for details.

sparklyr - CRAN v0.6.3

Published by javierluraschi about 7 years ago

CRAN 0.6.3 - Patch release over 0.6.2 with multiple fixes for spark_apply() and yarn-cluster, see sparklyr NEWS for details.