flowpipeline

What's Changed

• output/json: Added zstandard compression. by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/75
• lumberjack: added support for transport compression by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/76

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v1.2.0...v1.3.0

What's Changed

• Fixed modify/dropfields flow duplication bug. Added more tests. by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/72
• Added output/lumberjack segment. by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/73
• New segment modify/addrstrings by @hreese in https://github.com/bwNetFlow/flowpipeline/pull/74

New Contributors

• @hreese made their first contribution in https://github.com/bwNetFlow/flowpipeline/pull/72

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v1.1.0...v1.2.0

What's Changed

• new segment: modify/aslookup by @sebinbash in https://github.com/bwNetFlow/flowpipeline/pull/70

New Contributors

• @sebinbash made their first contribution in https://github.com/bwNetFlow/flowpipeline/pull/70

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v1.0.1...v1.1.0

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.11.0-beta...v0.11.1-beta

What's Changed

• make kafka connection timeout configurable by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/53
• Add initial clickhouse segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/52
• implement packet segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/60
• implement graceful shutdown for parent pipelines to use in segments by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/64
• implement reversedns segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/54

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.10.3-beta...v0.11.0-beta

What's Changed

• snmp: optimize memory usage on startup until cache is full by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/62
• Kafkaconsumer: handle multiple rebalances correctly by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/63

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.10.2-beta...v0.10.3-beta

What's Changed

• enable anonymize for nexthop address by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/59
• trim specified fields on segments using dynamic labels to prevent yaml errors by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/58
• kafkaproducer: hotfix for reflection error occuring on split produce by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/61

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.10.1-beta...v0.10.2-beta

What's Changed

• Handle export segment labels/tags dynamically by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/55

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.9.3-beta...v0.10.0-beta

What's Changed

• kafkaconsumer: fix bug where startat would have no effect by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/50
• Fix docker run with args by @Gabscap in https://github.com/bwNetFlow/flowpipeline/pull/51

New Contributors

• @Gabscap made their first contribution in https://github.com/bwNetFlow/flowpipeline/pull/51

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.9.2-beta...v0.9.3-beta

What's Changed

• minor fixes and dep updates by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/32
• flowdump: show ASNs in verbose mode, add various bits of docs and fixes by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/33
• controlflow/branch segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/34

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.6.0-beta...v0.7.0-beta

What's Changed

• conditional branch support including an example by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/31
• new elephant flow detection segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/27

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.5.0-beta...v0.6.0-beta

What's Changed

• snmpinterface: correction for configuration.md by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/30
• printflowdump: add drop reason to printflowdump format by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/29
• kafkaconsumer: make starting point (oldest/newest) configurable by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/28
• make sqlite segment efficient and able to work with user-defined fields by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/26

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.4.0-beta...v0.5.0-beta

What's Changed

• update readme to reflect addition of configuration guide by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/23
• add benchmarks for testing by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/24
• json i/o utils by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/25

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.3.0-beta...v0.4.0-beta

What's Changed

• handle errors, set bpf default buffer to 64kB by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/20
• Add User Guide and Configuration Docs by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/22
• New Segment: io/csv export by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/18
• init cryptopan anonymization segment by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/21

Full Changelog: https://github.com/bwNetFlow/flowpipeline/compare/v0.2.0-beta...v0.3.0-beta

What's Changed

• Prom exporter by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/1
• add sflow and netflow legacy collector by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/7
• geolocation: add matchboth flag to geolocation, fixes #4 by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/11
• add initial version of controlflow segments by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/12
• add initial bpf flow segment by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/14
• Fix goflow segment, prevent other unnecessary terminations, document Run method termination better by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/15
• io/bpf fixes regarding more generous buffer sizing to avoid dropped packets/records on the way to userland by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/19
• Add some Benchmarks by @debugloop in https://github.com/bwNetFlow/flowpipeline/pull/13
• Influx prom exporter by @georg-e in https://github.com/bwNetFlow/flowpipeline/pull/17

Full Changelog: https://github.com/bwNetFlow/flowpipeline/commits/v0.2.0-beta

Make influxdb connector more configurable

• testing release
• no guarantee to be stable

• testing release
• no guarantee to be stable