spiceai

A unified SQL query interface and portable runtime to locally materialize, accelerate, and query datasets from any database, data warehouse, or data lake.

APACHE-2.0 License

Stars
1.5K
Committers
24

Bot releases are visible (Hide)

spiceai - v0.1.1-alpha

Published by github-actions[bot] about 3 years ago

alpha

spiceai - Spice Runtime v0.1.1-alpha

Published by github-actions[bot] about 3 years ago

Spice.ai v0.1.1-alpha

Announcing the release of Spice.ai v0.1.1-alpha! 🙌

This is the first point release following the public launch of v0.1-alpha and is focused on fixes and improvements to v0.1-alpha before the bigger v0.2-alpha release.

Highlights include initial support for interpretations and the addition of a new Json Data Processor which enables observations to be posted in JSON to a new Dataspaces API. The ability to post observations directly to the Dataspace also now makes Data Connectors optional.

Interpretations will enable end-users and external systems to participate in training by providing expert interpretation of the data, ultimately creating smarter pods. v0.1.1-alpha includes the ability to add and get interpretations by API and through import/export of Spicepods. Reward function authors will be able to use interpretations in reward functions from the v0.2-alpha release.

Previously observations could only be added in CSV format. JSON is now supported by calling the new dataspace observations API that leverages the also new JSON processor located in the data-components-contrib repository. The JSON processor defaults to parsing the Spice.ai observation format and is extensible to other schemas.

The dashboard has also been improved to show action counts during a training run, making it easier to visualize the learning process.

New in this release

  • Adds visualization of actions counts during a training run in the dashboard.
  • Adds a new interpretations API, along with support for importing and exporting interpretations to pods. Learn more.
  • Adds a new API for ingesting dataspace observations. Learn more.
  • Adds an official DockerHub repository for spiceai/spiceai.
  • Fixes bug where the dashboard would not load on browser refresh.
spiceai - Spice CLI v0.1.1-alpha-rc

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.1.1-alpha-rc

spiceai - Spice Runtime v0.1.1-alpha-rc

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.1.1-alpha-rc

spiceai - Spice Runtime v0.2.0-alpha-rc

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.2.0-alpha-rc

spiceai - Spice CLI v0.2.0-alpha-rc

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.2.0-alpha-rc

spiceai - Spice Runtime v0.1.0-alpha

Published by github-actions[bot] about 3 years ago

Spice.ai v0.1.0-alpha

Announcing the public release of Spice.ai v0.1.0-alpha! 🎉

See the blog post at blog.spiceai.org.

New in this release

spiceai - Spice CLI v0.1.0-alpha

Published by github-actions[bot] about 3 years ago

Spice.ai v0.1.0-alpha

Announcing the public release of Spice.ai v0.1.0-alpha! 🎉

See the blog post at blog.spiceai.org.

New in this release

spiceai - Spice Runtime v0.1.0-alpha-rc

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.1.0-alpha-rc

spiceai - Spice CLI v0.1.0-alpha-rc

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.1.0-alpha-rc

spiceai - Spice Runtime v0.1.0-alpha.5

Published by github-actions[bot] about 3 years ago

Spice.ai v0.1.0-alpha.5

Announcing the release of Spice.ai v0.1.0-alpha.5! 🎉

This release focused on preparation for the public launch of the project, including more comprehensive and easier-to-understand documentation, quickstarts and samples.

Data Connectors and Data Processors have now been moved to their own repository spiceai/data-components-contrib

To better improve the developer experience, the following breaking changes have been made:

  • The pods directory .spice/pods (and thus manifests) and the config file .spice/config.yaml have been moved from the ./spice directory to the app root ./. This allows for the .spice directory to be added to the .gitignore and for the manifest changes to be easily tracked in the project.
  • Flights have been renamed to more understandable Training Runs in user interfaces.

New in this release

  • Adds Open source acknowledgements to the dashboard
  • Adds improved error messages for several scenarios
  • Updates all Quickstarts and Samples to be clearer, easier to understand and better show the value of Spice.ai. The LogPruner sample has also been renamed ServerOps
  • Updates the dashboard to show a message when no pods have been trained
  • Updates all documentation links to docs.spiceai.org
  • Updates to use Python 3.8.12
  • Fixes bug where the dashboards showed undefined episode number
  • Fixes issue where the manifest.json was not being served to the React app
  • Fixes the config.yaml being written when not required
  • Removes the ability to load a custom dashboard - this may come back in a future release

Breaking changes

  • Changes .spice/pods is now located at ./spicepods
  • Changes .spice/config.yaml is now located at .spice.config.yaml
spiceai - Spice CLI v0.1.0-alpha.5

Published by github-actions[bot] about 3 years ago

Spice.ai v0.1.0-alpha.5

Announcing the release of Spice.ai v0.1.0-alpha.5! 🎉

This release focused on preparation for the public launch of the project, including more comprehensive and easier-to-understand documentation, quickstarts and samples.

Data Connectors and Data Processors have now been moved to their own repository spiceai/data-components-contrib

To better improve the developer experience, the following breaking changes have been made:

  • The pods directory .spice/pods (and thus manifests) and the config file .spice/config.yaml have been moved from the ./spice directory to the app root ./. This allows for the .spice directory to be added to the .gitignore and for the manifest changes to be easily tracked in the project.
  • Flights have been renamed to more understandable Training Runs in user interfaces.

New in this release

  • Adds Open source acknowledgements to the dashboard
  • Adds improved error messages for several scenarios
  • Updates all Quickstarts and Samples to be clearer, easier to understand and better show the value of Spice.ai. The LogPruner sample has also been renamed ServerOps
  • Updates the dashboard to show a message when no pods have been trained
  • Updates all documentation links to docs.spiceai.org
  • Updates to use Python 3.8.12
  • Fixes bug where the dashboards showed undefined episode number
  • Fixes issue where the manifest.json was not being served to the React app
  • Fixes the config.yaml being written when not required
  • Removes the ability to load a custom dashboard - this may come back in a future release

Breaking changes

  • Changes .spice/pods is now located at ./spicepods
  • Changes .spice/config.yaml is now located at .spice.config.yaml
spiceai - Spice Runtime v0.1.0-alpha.5-rc

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.1.0-alpha.5-rc

spiceai - Spice CLI v0.1.0-alpha.5-rc

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.1.0-alpha.5-rc

spiceai - Spice Runtime v0.1.0-alpha.4

Published by github-actions[bot] about 3 years ago

Spice.ai v0.1.0-alpha.4

Announcing the release of Spice.ai v0.1.0-alpha.4! 🎉

We have a project name update. The project will now be referred to as "Spice.ai" instead of "Spice AI" and the project website will be located at spiceai.org.

This release now uses the new spicerack.org AI package registry instead of fetching packages directly from GitHub.

Added support for importing and exporting Spice.ai pods with spice import and spice export commands.

The CLI been streamlined removing the pod command:

  • pod add changes from spice pod add <pod path> to just spice add <pod path>
  • pod train changes from spice pod train <pod name> to just spice train <pod name>

We've also updated the names of some concepts:

  • "DataSources" are now "Dataspaces"
  • "Inference" is now "Recommendation"

New in this release

  • Adds a new Gardener to intelligently decide on the best time to water a simulated garden
  • Adds support for importing and exporting Spice.ai pods with spice import and spice export commands
  • Adds a complete end-to-end test suite
  • Adds installing by friendly URL curl https://install.spiceai.org | /bin/bash
  • Adds the spice binary to PATH automatically by shell config (E.g. .bashrc .zshrc)
  • Adds support for targeting hosting contexts (docker or metal) specifically with a --context command line flag
  • Removes the model downloader. This will return with better supported in a later version
  • Updates Trader quickstart with demo Node.js application to better demonstrate its use
  • Updates LogPruner quickstart with demo PowerShell Core script to better demonstrate its use
  • Updates Tensorflow from 2.5.0 to 2.5.1
  • Fixes potential mismatch of CLI and runtime by only automatically upgrading to the same version
  • Fixes issue with .spice/config.yml creation in Docker due to incorrect permissions
  • Fixes dashboard title from React App to Spice.ai

Breaking changes

  • Changes datasources section in the pod manifest to dataspaces
  • Changes /api/v0.1/pods/<pod>/inference API to /api/v0.1/pods/<pod>/recommendation
spiceai - Spice CLI v0.1.0-alpha.4

Published by github-actions[bot] about 3 years ago

Spice.ai v0.1.0-alpha.4

Announcing the release of Spice.ai v0.1.0-alpha.4! 🎉

We have a project name update. The project will now be referred to as "Spice.ai" instead of "Spice AI" and the project website will be located at spiceai.org.

This release now uses the new spicerack.org AI package registry instead of fetching packages directly from GitHub.

The CLI been streamlined removing the pod command:

  • pod add changes from spice pod add <pod path> to just spice add <pod path>
  • pod train changes from spice pod train <pod name> to just spice train <pod name>

We've also updated the names of some concepts:

  • "DataSources" are now "Dataspaces"
  • "Inference" is now "Recommendation"

New in this release

  • Adds a new Gardener to intelligently decide on the best time to water a simulated garden
  • Adds a complete end-to-end test suite
  • Adds installing by friendly URL curl https://install.spiceai.org | /bin/bash
  • Adds the spice binary to PATH automatically by shell config (E.g. .bashrc .zshrc)
  • Adds support for targeting hosting contexts (docker or metal) specifically with a --context command line flag
  • Removes the model downloader. This will return with better supported in a later version
  • Updates [Trader]](https://github.com/spiceai/quickstarts/tree/trunk/trader) quickstart with demo Node.js application to better demonstrate its use
  • Updates [LogPruner]](https://github.com/spiceai/quickstarts/tree/trunk/logpruner) quickstart with demo PowerShell Core script to better demonstrate its use
  • Updates Tensorflow from 2.5.0 to 2.5.1
  • Fixes potential mismatch of CLI and runtime by only automatically upgrading to the same version
  • Fixes issue with .spice/config.yml creation in Docker due to incorrect permissions
  • Fixes dashboard title from React App to Spice.ai

Breaking changes

  • Changes datasources section in the pod manifest to dataspaces
  • Changes /api/v0.1/pods/<pod>/inference API to /api/v0.1/pods/<pod>/recommendation
spiceai - Spice Runtime v0.1.0-alpha.3

Published by github-actions[bot] about 3 years ago

Spice.ai v0.1.0-alpha.3

Announcing the release of Spice.ai v0.1.0-alpha.3! 🎉

New in this release

  • Adds a new Log Pruner sample and quickstart to intelligently decide on the best time to prune logs or run maintenance on a server
  • Adds a new Kubernetes sample that shows how to get Spice.ai running in your Kubernetes cluster
  • Adds significant improvements to data handling, including the ability to compose data "connectors" and "processors". This changes the way data is specified the pod manifest and is a breaking change (see below)
  • Adds a completely rewritten dashboard based on React, with improved styling and useability, which will serve as a foundation for future improvements
  • Adds a rewrite to the communication backend using gRPC insead of HTTP for improved performance and as a foundation for future improvements
  • Adds the ability to fallback to $GITHUB_TOKEN where $SPICE_GH_TOKEN was not specified during Private Preview
  • Fixes an issue where deleting a manifest file was not handled gracefully by the Spice.ai runtime
  • Fixes an issue where debug logs were printed to the console
  • Fixes an issue when running in Docker where the http_port config value was ignored
  • Fixes an issue where the backend engine process would not terminate if the main spiced process crashes

Notes

New in this release is the ability to compose data "connectors" and data "processors" decoupling the fetching and processing of data inputs. This enables the ability to create a single data processor, for example a CSV processor, with different input data connectors, for example using the "csv" processor with "file", "blob" or "database" connectors.

This introduces a breaking change to the way data connectors are specified in the pod manifest by splitting it into a connector and processor. Previously defined like:

- datasource:
  from: coinbase
  name: btcusd
  # Old format
  connector:
    type: csv
    params:
      path: data/btcusd.csv

Has been changed to:

- datasource:
  from: coinbase
  name: btcusd
  # New format
  data:
    connector:
      name: file
      params:
        path: ../../test/assets/data/csv/COINBASE_BTCUSD, 30.csv
    processor:
      name: csv
spiceai - Spice CLI v0.1.0-alpha.3

Published by github-actions[bot] about 3 years ago

Spice.ai v0.1.0-alpha.3

Announcing the release of Spice.ai v0.1.0-alpha.3! 🎉

New in this release

  • Adds a new Log Pruner sample and quickstart to intelligently decide on the best time to prune logs or run maintenance on a server
  • Adds a new Kubernetes sample that shows how to get Spice.ai running in your Kubernetes cluster
  • Adds significant improvements to data handling, including the ability to compose data "connectors" and "processors". This changes the way data is specified the pod manifest and is a breaking change (see below)
  • Adds a completely rewritten dashboard based on React, with improved styling and useability, which will serve as a foundation for future improvements
  • Adds a rewrite to the communication backend using gRPC insead of HTTP for improved performance and as a foundation for future improvements
  • Adds the ability to fallback to $GITHUB_TOKEN where $SPICE_GH_TOKEN was not specified during Private Preview
  • Fixes an issue where deleting a manifest file was not handled gracefully by the Spice.ai runtime
  • Fixes an issue where debug logs were printed to the console
  • Fixes an issue when running in Docker where the http_port config value was ignored
  • Fixes an issue where the backend engine process would not terminate if the main spiced process crashes

Notes

New in this release is the ability to compose data "connectors" and data "processors" decoupling the fetching and processing of data inputs. This enables the ability to create a single data processor, for example a CSV processor, with different input data connectors, for example using the "csv" processor with "file", "blob" or "database" connectors.

This introduces a breaking change to the way data connectors are specified in the pod manifest by splitting it into a connector and processor. Previously defined like:

- datasource:
  from: coinbase
  name: btcusd
  # Old format
  connector:
    type: csv
    params:
      path: data/btcusd.csv

Has been changed to:

- datasource:
  from: coinbase
  name: btcusd
  # New format
  data:
    connector:
      name: file
      params:
        path: ../../test/assets/data/csv/COINBASE_BTCUSD, 30.csv
    processor:
      name: csv
spiceai - Spice Runtime v0.1.0-alpha.2

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.1.0-alpha.2

spiceai - Spice CLI v0.1.0-alpha.2

Published by github-actions[bot] about 3 years ago

This is the release candidate 0.1.0-alpha.2