Benchmark-Experiment-Host-Manager

This python tool helps managing DBMS benchmarking experiments in a Kubernetes-based HPC cluster environment. It enables users to configure hardware / software setups for easily repeating tests over varying configurations.

AGPL-3.0 License

Downloads
1.3K
Stars
6
Committers
1
View Code on GitHub
Ecosystems: Kubernetes, Python, Amazon Web Services

Bot releases are visible (Hide)

Benchmark-Experiment-Host-Manager - TPC-H and YCSB Latest Release

Published by perdelt 8 months ago

What's Changed

Full Changelog: https://github.com/Beuth-Erdelt/Benchmark-Experiment-Host-Manager/compare/v0.6.7...v0.7.0

Benchmark-Experiment-Host-Manager - Fixed vulnerabilities and minor improvements

Published by perdelt 11 months ago

Benchmark-Experiment-Host-Manager - Include more images and latest versions

Published by perdelt about 1 year ago

Benchmark-Experiment-Host-Manager - Improved support for YCSB, TPC-C (HammerDB and Benchbase) and TPC-H

Published by perdelt about 1 year ago

  • also includes results as presented at TPCTC23
  • removed some vulnerabilities
  • improved evaluation support
Benchmark-Experiment-Host-Manager - Improved Resilience and Flexibility

Published by perdelt over 1 year ago

  • DBMS that are not single host / Docker images
  • Metrics for more components
  • HammerDB / YCSB support
Benchmark-Experiment-Host-Manager - Unified benchmarking / evaluation components, refined loading and indexing components

Published by perdelt over 1 year ago

  • same benchmarking component for HammerDB, DBMSBenchmarker, YCSB and Benchbase
  • same evaluation component for HammerDB, DBMSBenchmarker, YCSB and Benchbase
  • log timing data and span for schema, ingest, index, constraints and analyze (statistics)
Benchmark-Experiment-Host-Manager - Prepare benchmarking components: HammerDB, YCSB, Benchbase

Published by perdelt almost 2 years ago

  • Improved support for sharded dbms
  • Preparation for deployment and evaluation of further loading and benchmarking components
Benchmark-Experiment-Host-Manager - Refactoring, Naming and Docs, Prepare for more flexible Components

Published by perdelt almost 2 years ago

Draft YCSB and HammerDB

Benchmark-Experiment-Host-Manager - Introduced Cloud-Orchestration and Scalable Loading and Maintaining Components

Published by perdelt about 2 years ago

Benchmark-Experiment-Host-Manager - Draft for Maintaining Service

Published by perdelt about 2 years ago

  • Scaling factor is per experiment only
  • draft for maintaining service
  • don't do port-forwarding for checking DBMS
  • improved docs
Benchmark-Experiment-Host-Manager - storageConfiguration added and configuration and docs improved

Published by perdelt over 2 years ago

Benchmark-Experiment-Host-Manager - Improve debug messages and minor bugfixes

Published by perdelt over 2 years ago

Benchmark-Experiment-Host-Manager - Improve Documentation

Published by perdelt over 2 years ago

Benchmark-Experiment-Host-Manager - Improve Documentation

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - Improve Documentation and TPC-H Example

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - TPC-H Minimum Example Improved

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - TPC-H Minimum Example

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - Improve CI

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - Improve CI

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - TPC-H: Example for Minikube

Published by perdelt about 3 years ago

Package Rankings
Top 19.49% on Pypi.org
Badges
Extracted from project README
Maintenance GitHub release PyPI version .github/workflows/draft-pdf.yml bexhoma Documentation Status
Related Projects
income

INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retr...

23 May 2022 22
bcpandas

High-level wrapper around BCP for high performance data transfers between pandas and SQL Server. ...

04 Aug 2019 112
dfgo

Differentiable Factor Graph Optimization for Learning Smoothers @ IROS 2021

16 Aug 2021 78
cbtool

Cloud Rapid Experimentation and Analysis Toolkit

08 Nov 2012 77
benchm-ml

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementati...

28 Mar 2015 1,870