flowpipeline
Process network flows using fully configurable pipelines.
GPL-3.0 License
Bot releases are visible (Hide)
What's Changed
- output/json: Added zstandard compression. by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/75
- lumberjack: added support for transport compression by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/76
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v1.2.0...v1.3.0
Published by georg-e over 1 year ago
What's Changed
- Fixed modify/dropfields flow duplication bug. Added more tests. by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/72
- Added output/lumberjack segment. by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/73
- New segment modify/addrstrings by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/74
New Contributors
- @hreese made their first contribution in https://github.com/bwNetFlow/flowpipeline/pull/72
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v1.1.0...v1.2.0
Published by georg-e over 1 year ago
What's Changed
- new segment: modify/aslookup by @sebinbash in https://github.com/bwNetFlow/flowpipeline/pull/70
New Contributors
- @sebinbash made their first contribution in https://github.com/bwNetFlow/flowpipeline/pull/70
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v1.0.1...v1.1.0
Published by github-actions[bot] over 1 year ago
What's Changed
- bugfix: impossible to set kafka/sarama dial timeout by @9er in https://github.com/bwNetFlow/flowpipeline/pull/67
- segment toptalkers_metrics: fix info message for default bucket sizes by @9er in https://github.com/bwNetFlow/flowpipeline/pull/68
- segment toptalkers_metrics: fixed logic to evaluate thresholds by @9er in https://github.com/bwNetFlow/flowpipeline/pull/69
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v1.0.0...v1.0.1
Published by github-actions[bot] over 1 year ago
What's Changed
- new segment: analysis/toptalkers-metrics by @9er in https://github.com/bwNetFlow/flowpipeline/pull/66
New Contributors
- @9er made their first contribution in https://github.com/bwNetFlow/flowpipeline/pull/66
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.11.1-beta...v1.0.0
Published by georg-e over 1 year ago
Published by georg-e over 1 year ago
What's Changed
- make kafka connection timeout configurable by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/53
- Add initial clickhouse segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/52
- implement packet segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/60
- implement graceful shutdown for parent pipelines to use in segments by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/64
- implement reversedns segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/54
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.10.3-beta...v0.11.0-beta
Published by georg-e almost 2 years ago
What's Changed
- snmp: optimize memory usage on startup until cache is full by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/62
- Kafkaconsumer: handle multiple rebalances correctly by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/63
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.10.2-beta...v0.10.3-beta
Published by georg-e almost 2 years ago
What's Changed
- enable anonymize for nexthop address by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/59
- trim specified fields on segments using dynamic labels to prevent yaml errors by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/58
- kafkaproducer: hotfix for reflection error occuring on split produce by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/61
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.10.1-beta...v0.10.2-beta
Published by github-actions[bot] almost 2 years ago
What's Changed
- implement support for multiple prometheus segments by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/57
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.10.0-beta...v0.10.1-beta
Published by georg-e almost 2 years ago
What's Changed
- Handle export segment labels/tags dynamically by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/55
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.9.3-beta...v0.10.0-beta
Published by georg-e about 2 years ago
What's Changed
- kafkaconsumer: fix bug where startat would have no effect by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/50
- Fix docker run with args by @Gabscap in https://github.com/bwNetFlow/flowpipeline/pull/51
New Contributors
- @Gabscap made their first contribution in https://github.com/bwNetFlow/flowpipeline/pull/51
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.9.2-beta...v0.9.3-beta
Published by github-actions[bot] over 2 years ago
What's Changed
- update deps by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/49
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.9.1-beta...v0.9.2-beta
Published by github-actions[bot] over 2 years ago
What's Changed
- update flowfilter dep to add new syntax by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/46
- incorporate new bpf module by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/47
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.9.0-beta...v0.9.1-beta
Published by github-actions[bot] over 2 years ago
What's Changed
- New Protobuf and new BGP segment for using some of the new fields by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/40
- update our own deps by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/43
- experimental toptalker segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/42
- Anon: clarify docs, make handling more robust by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/44
- add bgp rpki validation into flow messages by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/45
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.8.0-beta...v0.9.0-beta
Published by github-actions[bot] over 2 years ago
What's Changed
- include release info with binaries by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/38
- prevent release pipeline from running on master too by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/39
- implement plugin support by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/35
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.7.1-beta...v0.8.0-beta
Published by github-actions[bot] over 2 years ago
What's Changed
- improve actions, ease macos compile and test by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/36
- fix action to release by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/37
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.7.0-beta...v0.7.1-beta
Published by georg-e over 2 years ago
What's Changed
- minor fixes and dep updates by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/32
- flowdump: show ASNs in verbose mode, add various bits of docs and fixes by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/33
- controlflow/branch segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/34
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.6.0-beta...v0.7.0-beta
Published by georg-e over 2 years ago
What's Changed
- conditional branch support including an example by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/31
- new elephant flow detection segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/27
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.5.0-beta...v0.6.0-beta
Published by georg-e almost 3 years ago
What's Changed
- snmpinterface: correction for configuration.md by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/30
- printflowdump: add drop reason to printflowdump format by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/29
- kafkaconsumer: make starting point (oldest/newest) configurable by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/28
- make sqlite segment efficient and able to work with user-defined fields by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/26
Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.4.0-beta...v0.5.0-beta