Benchmark-Experiment-Host-Manager

This python tool helps managing DBMS benchmarking experiments in a Kubernetes-based HPC cluster environment. It enables users to configure hardware / software setups for easily repeating tests over varying configurations.

AGPL-3.0 License

Downloads
1.3K
Stars
6
Committers
1
View Code on GitHub
Ecosystems: Kubernetes, Python, Amazon Web Services

Bot releases are visible (Hide)

Benchmark-Experiment-Host-Manager - Improved Documentation and TPC-H Example

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - Setting up CI to Test PyPi

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - Improve Documentation and Demos

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - Improve Monitoring of Worker Nodes, Restart QE in case of Session Timeout

Published by perdelt about 3 years ago

Benchmark-Experiment-Host-Manager - Relogin when Access Fails and Improved Exception Handling

Published by perdelt over 3 years ago

Benchmark-Experiment-Host-Manager - Support for multiple Contexts

Published by perdelt over 3 years ago

Benchmark-Experiment-Host-Manager - Scaling Factor and Minor Bug Fixes

Published by perdelt over 3 years ago

Benchmark-Experiment-Host-Manager - More Parameter, lightweight No Monitoring Setup, Alias and Zip

Published by perdelt over 3 years ago

  • more parameter
  • lightweight no monitoring setup
  • alias for job pool
  • zip result folder
Benchmark-Experiment-Host-Manager - Persistent Volumes and Recurring Experiments

Published by perdelt over 3 years ago

Benchmark-Experiment-Host-Manager - Prototype - New Experiment Structure and Detached Mode for Parallel Execution

Published by perdelt over 3 years ago

Benchmark-Experiment-Host-Manager - Sketch of detached mode for K8s

Published by perdelt over 3 years ago

Benchmark-Experiment-Host-Manager - Improve inspection, TPC-H example and K8s management

Published by perdelt almost 4 years ago

Benchmark-Experiment-Host-Manager - Improve Documentation

Published by perdelt about 4 years ago

Benchmark-Experiment-Host-Manager - Improve Documentation and TPC-H Example

Published by perdelt about 4 years ago

Benchmark-Experiment-Host-Manager - TPC-H like examples

Published by perdelt about 4 years ago

Benchmark-Experiment-Host-Manager - Improved API and workflow

Published by perdelt about 4 years ago

Benchmark-Experiment-Host-Manager - Improved workflow

Published by perdelt almost 5 years ago

  • Masterscript: AWS - store log of last stop and clean
  • Masterscript: AWS - log volume key
  • Masterscript: Querymanagement
  • Masterscript: Read experiments log
  • Masterscript: Test if experiments path exists
  • Masterscript: setCode for continuing experiments
  • Masterscript: K8s more infos about host - monitoring metrics of multiple gpus
  • Masterscript: K8s - getTimediff
  • Masterscript: K8s more infos about host - debugging
  • Masterscript: K8s more infos about host - monitoring metrics
  • Masterscript: K8s more infos about host - gpu ids and node
  • Masterscript: K8s catch missing portforwarding in stop
  • Masterscript: K8s escape $ in some kubectl commands
  • Masterscript: K8s getMemory() for python 03. Jul
  • Masterscript: K8s kubectl as list, Popen, Shell
  • Masterscript: AWS - set alias
  • Masterscript: AWS - add / to config path
  • Masterscript: K8s - delay in runExperiment()
  • Docs: Alternative workflows, (un)park, experiments.config
  • Masterscript: K8s - add / to config path
  • Masterscript: Load experiment workflow
  • Masterscript: K8s - remove C: from download
  • Masterscript: AWS - log workflow
  • Masterscript: Load experiment workflow
  • Masterscript: K8s - log workflow
  • Masterscript: K8s - delay in prepare and start, log experimental steps
  • Docs: Monitoring, reporting, experiments.config
  • Masterscript: AWS - monitoring exporters in config
  • Masterscript: K8s - allow different query files for same workload
  • Masterscript: runReporting() for AWS
  • Masterscript: More details for k8s
  • Masterscript: Prevent crash at missing data
  • Masterscript: Init paths for K8s corrected
  • Docs: Minor extensions
  • Masterscript: SSH bug in k8s init
  • Masterscript: Wait 30s after unpark
  • Masterscript: Wait after unpark
  • Masterscript: UnparkExperiment removes old docker
  • Masterscript: ParkExperiment removes old parked
  • Masterscript: Default connectionname for unpark
  • Masterscript: Write connection prettily
  • Masterscript: Sketch park/unpark experiment
  • Hardware: RAM in bytes from /proc/meminfo
  • Prepare new version
  • Hardware: RAM in bytes, disk space in Kb
Benchmark-Experiment-Host-Manager - Public

Published by perdelt about 5 years ago

Package Rankings
Top 19.49% on Pypi.org
Badges
Extracted from project README
Maintenance GitHub release PyPI version .github/workflows/draft-pdf.yml bexhoma Documentation Status
Related Projects
dfgo

Differentiable Factor Graph Optimization for Learning Smoothers @ IROS 2021

16 Aug 2021 78
bcpandas

High-level wrapper around BCP for high performance data transfers between pandas and SQL Server. ...

04 Aug 2019 112
cbtool

Cloud Rapid Experimentation and Analysis Toolkit

08 Nov 2012 77
benchm-ml

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementati...

28 Mar 2015 1,870
income

INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retr...

23 May 2022 22