Bot releases are hidden (Show)
Published by javierluraschi about 7 years ago
CRAN 0.6.2 - Patch to address the following issues:
connection_spark_shinyapp()
under RStudio 1.1 to avoid error while listing Spark installation options for the first time when: https://github.com/rstudio/sparklyr/pull/914
Published by javierluraschi about 7 years ago
CRAN 0.6.1 - Patch to address the following issues:
spark_connect()
failing for concurrent connections: https://github.com/rstudio/sparklyr/issues/880.spark_apply()
under empty partitions with https://github.com/rstudio/sparklyr/issues/878, race conditions using more than on CPU per executor, support for explicit column types and avoid persisting any data: https://github.com/rstudio/sparklyr/pull/899.Published by javierluraschi about 7 years ago
CRAN 0.6 - Major release with support to:
spark_apply()
to execute arbitrary R code across your cluster over rows and groups.spark_read_source()
, spark_write_source
, spark_read_jdbc()
and spark_write_jdbc()
.mode="databricks"
, add support for Yarn Cluster through master="yarn-cluster"
and connection speed was also improved.sdf_pivot()
, sdf_broadcast()
, cbind()
, rbind()
, sdf_separate_column()
, sdf_bind_cols()
, sdf_bind_rows()
, sdf_repartition()
and sdf_num_partitions()
.ml_logistic_regression()
, weights.column
for GLM, ml_model_data()
and a new ft_count_vectorizer()
function for ml_lda()
.ml_linear_regression()
and ml_generalized_linear_regression()
, dplyr support for %like%
, %rlike%
and%regexp%
, extensions now support download_scalac()
to help you install the required Scala compilers while developing extensions, database management got simplified with tbl_change_db()
and src_databases()
to query and switch between HIVE databases and started a joint effort with Microsoft to improve Spark installations under github.com/rstudio/spark-install.Additional changes and improvements can be found in the sparklyr NEWS file and the sparklyr 0.6 release blog post.
Published by javierluraschi over 7 years ago
CRAN 0.5.6 - Patch to address the following issues:
dplyr
joins
with same variable names, see https://github.com/tidyverse/dplyr/issues/2825
dplyr 0.7
to avoid manual install of dbplyr
sample_n
performance https://github.com/rstudio/sparklyr/issues/271
LIMIT
statement, see: https://github.com/rstudio/sparklyr/commit/72b2b97000c1c5676467b8f42e5ea5e0de4c8a12
Published by javierluraschi over 7 years ago
CRAN 0.5.5 - Patch release over 0.5.4 with compatibility fixes for RStudio 1.1 and mode="databricks"
connections.
Published by javierluraschi over 7 years ago
CRAN 0.5.4 - Patch release over 0.5.3 with compatibility fixes for dplyr 0.6
and Spark 2.1
.
Published by javierluraschi over 7 years ago
CRAN 0.5.3 - Patch release over 0.5.2 with fix for new DBI:: sqlInterpolate
#351 and mutate
under dplyr 0.6
#523.
Published by javierluraschi over 7 years ago
CRAN 0.5.2 - Patch release over 0.5.1
with fixes for connections under Windows that require path normalization https://github.com/rstudio/sparklyr/pull/492 and Livy connections to handle states properly while connecting https://github.com/rstudio/sparklyr/pull/421.
Published by javierluraschi almost 8 years ago
Additional changes and improvements can be found in the sparklyr NEWS file and the sparklyr 0.5 release blog post.
Published by javierluraschi about 8 years ago
Additional changes and improvements can be found in the sparklyr NEWS file and the sparklyr 0.4 release blog post.