testeth via RPC. Test run, generation by t8ntool protocol
GPL-3.0 License
Bot releases are hidden (Show)
Docker file big update, support pyt8n, besu, evmone, geth, pyspecs, ethereumjs, nimbus
Compatible test release: https://github.com/ethereum/tests/releases/tag/v13
New options:
--singlenet >=forkname select multiple forks when running/generating the tests
--singlenet "fork1,fork2"
--verbosity PYSPEC print pyspec script log
--statediff Frontier--Berlin print state diff between poststates on forkA and forkB of the test
Removed option:
Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: https://tinyurl.com/y525ezs7
Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/
t8n eof
tool to run/generate EOFTests:yul evmversion optimisationflag {}
in test fillersubuntu 20.04.6:
http://retesteth.ethdevops.io/release/0.3.1-cancun/ubuntu-20.04.6/retesteth-0.3.1-cancun-ubuntu-20.04.6
Might need the dependecies install (but better to be run on Ubuntu20):
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode14:
http://retesteth.ethdevops.io/release/0.3.1-cancun/macOS-XCode14/retesteth-0.3.1-cancun-macOS-XCode14
Docker:
Clients updated as of 01.11.2023 (6 GB image)
https://ethereum-tests.readthedocs.io/en/latest/retesteth-tutorial.html#retesteth-in-a-docker-container
geth evm version: evm version 1.13.5-unstable-a3be3812-20231102
lllc version: 0.5.14-develop.2023.7.11+commit.c58ab2c6.mod.Linux.g++
solidity version: 0.8.21+commit.d9974bed.Linux.g++
http://retesteth.ethdevops.io/release/0.3.1-cancun/dretesteth-0.3.1-cancun.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/
Published by winsvega over 1 year ago
Many changes: proto support for pyspec, new clients, Shanghai logic
Introducing more debug options (--statediff, --poststate, --vmtrace) for intermediate states/transactions in blockchain tests
Net tests suites: -t EIPTEsts
, -t EOFTests
Compatible test release: https://github.com/ethereum/tests/releases/tag/v12
New options:
retesteth file.json Run/Fill the test directly (--singletest detected if in tests path, --testfile if outside)
retesteth <Folder> Run/Fill the test directory (if inside testpath detect -t suite, not all suites supported)
--exportcall <Folder> Option to export t8ntool interactions
--vmtrace <Folder> Option to export transaction traces into files
--vmtrace x:y Trace block x, transaction y
--vmtraceraw <Folder> Option to export transaction traces into files
--vmtraceraw x:y Trace block x, transaction y
(intermidiate state for individual transaction in bc tests requires --filltests command)
--poststate <Folder> Option to export transaction states into files (when running state tests)
--poststate x:y Show poststate block x, transaction y
--statediff Print statediff post vs pre in StateTests
--statediff x:ytox2:y2 Show statediff from block x, transaction y to block x2, transaction y2
--statediff xtoy Show statediff from block x to block y
--chainid id To override transaction chain id when generating or running the test
--verbosity <channel> Set logs channels. 'STATS|RPC|TESTLOG|LOWLOG|SOCKET|STATE'
--getvectors Output all subunits of the given test (disables execution)
--filloutdated Run only unfilled test fillers
Removed option:
--testfolder No longer required as new test folders automatically registrate within boost
Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: http://tinyurl.com/2ctak8yn
Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/
checkDifficulty
to verify ETH difficulty calculation of the t8ntool clientcheckBasefee
to verify ETH baseFee calculation of the t8ntool clientcheckBasefee
to verify ETH baseFee calculation of the t8ntool clientfillerSkipForks
to skip filling tests on forks (forks + eips) that are not supportedcalculateBasefee
to calculate basefee for the t8ntool client that does not support itcalculateDifficulty
to force retesteth calculated difficulty (in case client does not support it)support1559
to disable blockheader auto convertion to Merge/1559 rules (for etc clients)transactionAsJson
to send t8ntool tx files in json form not RLP (for evmone type clients)fs=boost::filesystem
in headers compiler errorubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.3.0-shanghai/ubuntu-18.04.3/retesteth-0.3.0-shanghai-ubuntu-18.04.3
Might need the dependecies install (but better to be run on Ubuntu20):
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode12:
http://retesteth.ethdevops.io/release/0.3.0-shanghai/macOS-XCode12/retesteth-0.3.0-shanghai-macOS-XCode12
macOS-XCode14:
http://retesteth.ethdevops.io/release/0.3.0-shanghai/macOS-XCode14/retesteth-0.3.0-shanghai-macOS-XCode14
Docker:
(!Better version of docker is comming with other clients support!)
geth version: geth version 1.11.5-unstable-5d23d21f-20230320 Git Commit (around): 5d23d21f
geth evm version: geth version 1.11.5-unstable-5d23d21f
lllc version: Version: 0.5.14-develop.2022.7.30+commit.a096d7a9.Linux.g++
solidity version: Version: 0.8.17+commit.8df45f5f.Linux.g++
http://retesteth.ethdevops.io/release/0.3.0-shanghai/dretesteth-0.3.0-shanghai.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/
Published by winsvega about 2 years ago
Merge PoS structures support in tests, little refactoring, new option --testfolder, --nologcolor, custom chainID in transactions
Geth + custom eip example configuration, MacOS support, update ReadME
Compatible test release: https://github.com/ethereum/tests/releases/tag/v11
New options:
--testfolder <SubFolder> Run tests from a custom test folder located in a given suite. Requires -t <TestSuite>
--nologcolor Disable color codes in log output
Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: http://tinyurl.com/2ctak8yn
Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/
-d <label>
selector does not require :label
prefix to select transaction by label nameverify
in json tests to check how retesteth generate .json of the test. See::label
prefix for label names is not exported to generated state tests to save spacetest_setChainParams
fail, the tests continue exectutionubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.2.2-merge/ubuntu-18.04.3/retesteth-0.2.2-merge-ubuntu-18.04.3
Might need the dependecies install:
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode12:
http://retesteth.ethdevops.io/release/0.2.2-merge/macOS-XCode12/retesteth-0.2.2-merge-macOS-XCode12
Docker:
geth version: Version: 1.10.22-unstable Git Commit: fea569f90aa608abeb13cea6c9fd55f1d0a77f40
geth evm version: evm version 1.10.22-unstable-fea569f9-20220729
lllc version: Version: 0.5.14-develop.2022.7.30+commit.a096d7a9.Linux.g++
solidity version: Version: 0.8.6+commit.11564f7e.Linux.g++
http://retesteth.ethdevops.io/release/0.2.2-merge/dretesteth-0.2.2-merge.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/
Published by winsvega almost 3 years ago
Coming up with DifficultyTests for ArrowGlacier, new DifficultyTests test suite to point check the difficulty formula depening on fork
New test exceptions for transaction tests invalid RLP handling. T8N, T9N support.
New test suite: -t DifficultyTests
New test method: VALUE test_calculateDifficulty(FORK, VALUE _blockNumber, _parentTimestamp, VALUE _parentDifficulty, VALUE _currentTimestamp, VALUE _uncleNumber)
New options:
--vmtrace.nomemory "Disable memory in vmtrace/vmtraceraw"
--vmtrace.nostack "Disable stack in vmtrace/vmtraceraw"
--vmtrace.noreturndata "Disable returndata in vmtrace/vmtraceraw"
Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: http://tinyurl.com/2ctak8yn
Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/
0x:bigint
feature, fix bugsubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.2.1-difficulty/ubuntu-18.04.3/retesteth-0.2.1-difficulty-ubuntu-18.04.3
Might need the dependecies install:
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode11:
http://retesteth.ethdevops.io/release/0.2.1-difficulty/macOS-XCode11/retesteth-0.2.1-difficulty-macOS-XCode11
Docker:
geth version: Version: 1.10.14-unstable Git Commit: 4ebeca19d739a243dc0549bcaf014946cde95c4f
geth evm version: evm version 1.10.14-unstable-4ebeca19-20211125
lllc version: 0.5.14-develop.2021.11.27+commit.401d5358.mod.Linux.g++
solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++
http://retesteth.ethdevops.io/release/0.2.1-difficulty/dretesteth-0.2.1-difficulty.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/
Published by winsvega about 3 years ago
Breaking change:
Test-parse logic optimization. Do not sort source test json structure before calculating the hash, to save time. This changes the way filler hash is calculated leading to older versions of retesteth tests would not pass the hash verification check. (except legacy tests)
Continue refactoring and optimizations. Near 50% execution time saved on remote VPS so far.
New test suite: -t TransactionTests
New test method: test_rawTransaction(BYTES, FORK)
https://github.com/ethereum/go-ethereum/pull/23494
Check on the generated tests when filling the tests. If no changes after test regeneration, do not update _info
section by default.
New option --forceupdate
to update the regenerated test even if no changes (_info section header always change)
Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: http://tinyurl.com/2ctak8yn
Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/
-t TransactionTests
Net test method: test_rawTransaction(BYTES, FORK)
! - potential bug behavior, stay aware
ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.2.0-memory/ubuntu-18.04.3/retesteth-0.2.0-memory-ubuntu-18.04.3
Might need the dependecies install:
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode11:
http://retesteth.ethdevops.io/release/0.2.0-memory/macOS-XCode11/retesteth-0.2.0-memory-macOS-XCode11
Docker:
geth version: Version: 1.10.9-unstable Git Commit: 84ff152de56b9d65f6888daef9dc00c97a6aafd3
geth evm version: evm version 1.10.9-unstable-84ff152d-20210915
lllc version: Version: 0.5.14-develop.2021.6.12+commit.401d5358.Linux.g++
solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++
http://retesteth.ethdevops.io/release/0.2.0-memory/dretesteth-0.2.0-memory.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/
Published by winsvega about 3 years ago
A big update on memory managment with more optimizations to come.
Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.1.2-london/ubuntu-18.04.3/retesteth-0.1.2-london-ubuntu-18.04.3
Might need the dependecies install:
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode11:
http://retesteth.ethdevops.io/release/0.1.2-london/macOS-XCode11/retesteth-0.1.2-london-macOS-XCode11
Docker:
geth version: Version: 1.10.7-unstable Git Commit: d3e3a460ec947c9e1e963d1a35f887d95f23f99d
geth evm version: evm version 1.10.7-unstable-d3e3a460-20210804
lllc version: Version: 0.5.14-develop.2021.6.12+commit.401d5358.Linux.g++
solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++
http://retesteth.ethdevops.io/release/0.1.2-london/dretesteth-0.1.2-london.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/
Published by winsvega over 3 years ago
Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation.
01 + tx.bytes
)ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.1.1-eip1559/ubuntu-18.04.3/retesteth-0.1.1-eip1559-ubuntu-18.04.3
Might need the dependecies install:
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode11:
http://retesteth.ethdevops.io/release/0.1.1-eip1559/macOS-XCode11/retesteth-0.1.1-eip1559-macOS-XCode11
Docker:
geth version: Version: 1.10.4-unstable Git Commit: eff998effbf466d4acbe599583dd8ec75f2af6a1
geth evm version: evm version 1.10.4-unstable-eff998ef-20210611
lllc version: Version: 0.5.14-develop.2021.6.12+commit.401d5358.Linux.g++
solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++
http://retesteth.ethdevops.io/release/0.1.1-eip1559/dretesteth-0.1.1-eip1559.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/
Published by winsvega over 3 years ago
Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation.
!!!FIX the testfile option!!!
ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.1.0-accesslist/ubuntu-18.04.3/retesteth-0.1.0-accesslist-ubuntu-18.04.3
Might need the dependecies install:
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode10:
http://retesteth.ethdevops.io/release/0.1.0-accesslist/macOS-XCode10/retesteth-0.1.0-accesslist-macOS-XCode10
Docker:
geth version: Version: 1.10.2-unstable Git Commit: faacc8e0faa89f5b3a7055e86924a95b6a9be944
geth evm version: evm version 1.10.2-unstable-faacc8e0-20210315
lllc version: Version: 0.5.14-develop.2021.3.9+commit.14c9d5de.Linux.g++
solidity version: Version: 0.7.0+commit.9e61f92b.Linux.g++
http://retesteth.ethdevops.io/release/0.1.0-accesslist/dretesteth-0.1.0-accesslist.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/
Published by winsvega over 3 years ago
Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation.
ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.1.0-accesslist/ubuntu-18.04.3/retesteth-0.1.0-accesslist-ubuntu-18.04.3
Might need the dependecies install:
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode10:
http://retesteth.ethdevops.io/release/0.1.0-accesslist/macOS-XCode10/retesteth-0.1.0-accesslist-macOS-XCode10
Docker:
geth version: Version: 1.10.2-unstable Git Commit: 22082f9e565665f7da045b9ff708e4698f383c77
geth evm version: evm version 1.10.2-unstable-22082f9e-20210309
lllc version: Version: 0.5.14-develop.2021.3.9+commit.14c9d5de.Linux.g++
solidity version: Version: 0.7.0+commit.9e61f92b.Linux.g++
http://retesteth.ethdevops.io/release/0.1.0-accesslist/dretesteth-0.1.0-accesslist.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/
Published by winsvega almost 4 years ago
Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation.
ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.0.9-berlin/ubuntu-18.04.3/retesteth-0.0.9-berlin-ubuntu-18.04.3
Might need the dependecies install:
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode10:
http://retesteth.ethdevops.io/release/0.0.9-berlin/macOS-XCode10/retesteth-0.0.9-berlin-macOS-XCode10
Docker:
geth evm version 1.9.24-unstable-b63bffe8-20201030
lllc version: 0.5.14-develop.2020.10.30+commit.9189ad7a.Linux.g++
http://retesteth.ethdevops.io/release/0.0.9-berlin/dretesteth-0.0.9-berlin.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/