Shuffle

Shuffle: A general purpose security automation platform. Our focus is on collaboration and resource sharing.

AGPL-3.0 License

Stars
1.3K
Committers
43

Bot releases are visible (Hide)

Shuffle - v1.3.3 Latest Release

Published by 0x0elliot 8 months ago

What's Changed

  • Added a KMS (Key Management System) built into shuffle with secrets encrypted in the database with support for third party secret providers.
  • Better workflow execution stats and enhanced workflow debugger
  • Code editor quality of life updates (more coming soon)
  • Third party data pipeline trigger (Tenzir)
  • Made user inviting possible when user already exists.
  • Minor UI and backend fixes

Full Changelog: https://github.com/Shuffle/Shuffle/compare/1.3.2...v1.3.3

Shuffle - v1.3.2

Published by 0x0elliot 8 months ago

What's Changed

  • Added management tools for stat management
  • Proxy related bug fixes
  • Fixed queue, variables and loop bugs
  • Fixed input worker bugs
  • Other bug fixes for onprem users

Full Changelog: https://github.com/Shuffle/Shuffle/compare/v1.3.1...v1.3.2

Shuffle - 1.3.1 - Runtime Debugger, Single Action Runs and Subflow Wait Fixes

Published by frikky 11 months ago

This is an update to help fix some of the new issues 1.3.0 introduced.

  • Made Notifications Org-Wide (per tenant) and happen and show up on more events
  • Introduced Single Action executions (e.g. for Code Editor testing)
  • Python can now be ran directly in the Code Editor if the Execute Python action is chosen (otherwise it's liquid)
  • Added the Rerun execution API.
  • Subflows with lists now do what they should again
  • Added additional Proxy config to make it possible to split Proxy between External API's and Shuffle resources
  • Conditions like Smaller Than and Larger Than now take type into account, meaning you don't need {{ ["list"] | size }} anymore.

What's Changed

Full Changelog: https://github.com/Shuffle/Shuffle/compare/v1.3.0...1.3.1

Shuffle - 1.3.0 - Stability, Statistics K8s & AI

Published by 0x0elliot 11 months ago

πŸš€ Features πŸš€

  • Documentation -> OpenAPI Generator with Generative AI. This is an option on the /apps page for everyone.
  • ShuffleGPT: We spent a lot of time testing out different usecases for generative AI throughout the year. The goal with Shuffle has always been to make programming more accessible in cybersecurity, and this is another step on our way there. As it's built on OpenAI (for now..), the goal is to release it on the open source side as well (with your own API key), and tightly building it into the features of Shuffle. First priority: Solve simple problems like "Get my last 10 last tickets and tell me about the most important one", and grow that into Workflow generation over time. More info in Q1 2024.
  • Realtime Workflow Collaboration - Like Google Docs or Figma, Shuffle now has support for realtime workflow collaboration. This is still in Beta, and is disabled by default for now. We may use this feature to do realtime workflow update streaming to self-hosted versions to enhance support as well (your instance -> your browser -> shuffler.io -> our support in realtime).
  • Health API! Adding a Status UI to Shuffle requires historic statistics for workflow performance to check for downtime. This runs checks regularly, both on cloud and onprem! /api/v1/health/stats + a feature that auto runs the health check on a regularly :)
  • Statistics & Usage tracking: This temporarily lives under /admin?tab=billing until we find a nice home for it
  • Orborus Utilization Monitoring: Orborus now checks properly whether the server has CPU and Memory left to run more workflows, and throttles if it doesn't.
  • Added Workflow Run Explorer to make it easier to find workflow bugs over time. URL: /workflows/debug
  • Added Workflow Versioning! Now you can see workflow revisions that you have made in the past.
  • Oauth2 Application Permissions are now supported in the App Creator
  • Added kubernetes support as a scaling option.
  • Added automatic Docker image propagation between Shuffle workers if they are hosted on different machines
  • We support ARM docker images from this version and forward for: 1.3.0+, latest and nightly (We have been supporting nightly for a while now)
  • We fixed a liquid sanitisation related security vulnerability which led to network access to into the host machine through a poorly set up user workflow. Here is the PR for it for more details.
  • And others!

What's Changed

New Contributors

Full Changelog: https://github.com/Shuffle/Shuffle/compare/1.1.0...v1.3.0

Shuffle - 1.1.0 - Creators & Workflow Templates

Published by frikky almost 2 years ago

πŸ“– Resources πŸ“–

πŸš€ Features πŸš€

  • Added new welcome pages that helps you get set up by automatically downloading relevant apps and workflows (WAY less manual building)
  • Added statistics for Workflows, Apps and total for Creators
  • Added a Workflow templating system for generating workflows
  • Added File Editing and Categories to handle new Detection methods
  • Added and fixed Liquid filters
  • New/Edited Apps now become version 1.1 and will return more about the request, including cookies
  • Made Workflow sharing and discovery easier
  • Added new Usecases that Workflows can now be mapped to
  • Added distributed caching mechanism with Memcached
  • Added statistics API that runs automatically in the background available on /api/v1/orgs/{orgid}/stats
  • Added Documentation parser for Apps that loads from Github
  • Added multiple redundancies for making sure Workflows execute in the right order
  • Started development and Shuffle support for K8s to easily work in clusters and on AWS
  • Added automatic app activation onprem for all released apps (search within a workflow)
  • Added subflow export/import as part of parent workflow exports/imports
  • And many more small changes :)

Additional changelog can be found in our Shuffle Shared Repository

What's Changed

New Contributors

Shuffle - 1.0.0 - Launch!

Published by frikky over 2 years ago

πŸ“– Resources πŸ“–
See the release blogpost for Shuffle v1.0
See our support team in action
Join the Discord and talk to other creators πŸ’―

πŸš€ Features πŸš€
Added initial chat system to make it easier to reach support
Added the possibility of becoming a Creator, and search
Added new β€œGetting Started” section
Added App Framework to discover apps easily
Added Usecases to discover relevant workflows easier
Added Liquid Formatting to apps
Added SSO with SAML and OpenID PKCE
Added Swarm configuration possibility for Orborus
Added text/code/json/liquid editor to help making workflow easier
Added Ubuntu and GRPC images for app creation
Added OAuth2 possibility for Apps, whether from app creator or python
Added a lot more multi-tenancy usability features
Added new UI as documentation frontend
Added priority for when workflows execute to not clog up queues, and a button to clean the queue
Added multi-node copy-pasting of workflows

πŸ› Bugs πŸ›
Fixed a lot of bugs related to executions, UI bugs, missing buttons, API’s causing weird effects, bad JSON magic parsing, and much, much more.

What's Changed

New Contributors

Full Changelog: https://github.com/Shuffle/Shuffle/compare/0.9.25...1.0.0

Shuffle - 0.9.25 - MSSP introduction

Published by frikky about 3 years ago

Join the Discord to see our updates in real time!

πŸš€ Features πŸš€

Added initial CI/CD handlers
Fixed workflow view issues, and added workflow listing
Updated Opensearch to 1.1.0
Removed necessity for max_memory setting with Opensearch
Updated App SDK to handle LiquidPy with latest version
Added Oauth2 auth, both with and without App Creator
Added Gmail and Outlook triggers
Merged cgroup v2 compatibility issues
Added documentation popup for apps
Added file namespaces and download option for them (e.g. for Yara, Snort, other rule systems)
Added Webhook parser for Params to JSON to be used in workflows
Added start of a text editor within Workflows
Added resizer for right-side view in Workflow
Added startnode button for nodes in UI
Added suborgs and swapping (MSSP)
Added App Auth encryption possibility with environment variable (MSSP)
Added Single Signon possibility (MSSP)
Added basic Helm chart for K8s usage
Added notifications for failure of workflows (in UI, start workflow & email)
A new documentation UI

πŸ•·οΈ Bugfixes πŸ•·οΈ
LOOOADS - Too many to count, hidden inbetween new features 100

πŸ“– Resources πŸ“–
Loads of updated info in our documentation https://shuffler.io/docs/configuration

Shuffle - 0.9.0

Published by frikky over 3 years ago

Features & Bugs TBD

Shuffle - 0.8.71 release

Published by frikky over 3 years ago

TBD (looong list)

Shuffle - 0.8.56 release

Published by frikky over 3 years ago

Windows users downloads repo - this is not PROD

Shuffle - 0.8.0 - Organizations and Hybrid access!

Published by frikky almost 4 years ago

πŸš€ Features

  • Everything is now versioned at 0.8.0, not "latest", which enables rollback if issues arise! Packages can be found here
  • We've released a pricing model for Shuffle Support us to help development move faster.
  • Documentation for Organizations and the new triggers are ready
  • Everyone are now a part of an organization
  • All parts of Shuffle are now organization based rather than per-instance
  • Organization admins can separate access rights per user.
  • You can set the username, description and image of the organization.
  • Hybrid functionality:
  • It's now possible to synchronize with the shuffle.io. This does not share any information about you with us.
  • Webhooks (public URL)
  • Schedules (runs in our cloud with a cronjob)
  • User Input (ability to PAUSE a workflow until someone clicks a button)
  • Global Email and SMS sending (makes User Input work, and makes it trivial to alert someone directly on their phone

πŸͺ² Bug fixes

  • Issue where other users are removed when you add a new one
  • Issue where authentication for apps sometimes don't show up
  • Issue with app creator where some actions don't work
  • Alerts (popups) are not as stupidly positioned as they used to be. Slight redesign as well.

πŸ“– Resources:

Shuffle - 0.7.6

Published by frikky almost 4 years ago

πŸš€ Features

  • Added OpenAPI drag and drop (thanks!!)
  • Added migration tools for creating Organizations
  • Added basic cloud sync features
  • Changed favicon fire
  • Added App SDK for blackarch and Kali (thanks @aoighost)

πŸͺ² Bugs

  • Multiple app creator bugs fixed
  • Multiple issues with App SDK fixed (thanks @garanews
  • Added feedback multiple places when errors occur
Shuffle - 0.7.5

Published by frikky about 4 years ago

Features
Made autocompleter usefule from previous executions
Started tracking executions to share with other users
All users will now be migrated to organizations (one by default). This will hugely benefit MSSP's in the future.
Added accessibility names (e.g. trigger names) to make it easier to understand workflow executions

Bugs
SSL toggle re-enabled from the App Creator
Multiple OAS specification parsing issues
Fixed a bug where some workflows can't be imported properly
Fixed multiple for-loop issue in App SDK
Fixed JSON parsing issues in workflow frontend
Fixed an issue where you sometimes get a white screen when checking workflow nodes

Shuffle - 0.7.1

Published by frikky about 4 years ago

Loads of fixes and features added to the app creator

Shuffle - 0.7.0

Published by frikky about 4 years ago

Shuffle - 0.6.5

Published by frikky about 4 years ago

A new update with new features for workflow creation, app creation and more.

Shuffle - 0.6.0

Published by frikky over 4 years ago

Includes basic autocomplete and authenticated fields, which removes the need to re-write authentication layers

Shuffle - 0.5.5

Published by frikky over 4 years ago

Release 0.5.5 of Shuffle

Shuffle - Shuffle beta

Published by frikky over 4 years ago

This is the first beta build for Shuffle which the master branch will be under.

Package Rankings
Top 4.7% on Proxy.golang.org
Badges
Extracted from project README
Shuffle Logo
Related Projects