adder-codec-rs

A unified framework for event-based video. Encoder/transcoder/decoder for ADΔER (Address, Decimation, Δt Event Representation) video streams.

Downloads
59.7K
Stars
13
Committers
1

Bot releases are visible (Hide)

adder-codec-rs - v0.4.3: Prophesee support Latest Release

Published by ac-freeman 9 months ago

Support Prophesee data files (.dat extension)
Much-improved transcoding of pure DVS-style data. Will be replicated for .aedat files at some point (so they won't have rely on the davis-edi-rs dependency
For best results with Prophesee files in adder-viz:
-- Set Δt_ref slider to 1
-- Use Auto quality, with slider at CRF 9 (lowest sensitivity to temporal intensity change)
Using the source-modeled ADDER compression, the Prophesee file I've tested gets compressed by about 2:1 over the raw input. For comparison, Gzip makes the file 5x larger. The video had a stationary camera, though, which greatly benefits the current ADDER compression model since it doesn't have motion compensation. Your mileage may vary.

Also note that the compression/decompression speeds here are pretty slow, due to the very high event rate. Compressing 1 second of data may take several seconds in actuality. Putting the codec on a separate thread group will help, but further optimization is necessary to make it real time for DVS-based sources.

The feature detection application works as it does with other source video types. Just check the Detect features box in adder-viz, and you can visualize them best with the Show instant option. Feature detection increases the sensitivity of nearby pixels, making the output file size larger. I'll eventually add an option to disable feature-driven sensitivity adjustment.

Special thanks to @arghasen10 for his help and for providing a Prophesee test file.

adder-codec-rs - v0.4.1: Compression and feature detection

Published by ac-freeman 10 months ago

  • Numerous optimizations and bug fixes
  • Favor AbsoluteT time mode
  • Event-based feature detection
  • Feature-driven rate adaptation
  • CRF quality parameter
  • Source-modeled compression
  • Remove OpenCV dependency, unless transcoding from DVS/DAVIS (for now, anyway)
  • Evaluation scripts
  • Visualize detected features and input frames
  • Frame-based quality metrics
  • Plot bitrate and quality metrics
adder-codec-rs - v0.4.0: Compression and feature detection

Published by ac-freeman 11 months ago

  • Numerous optimizations and bug fixes
  • Favor AbsoluteT time mode
  • Event-based feature detection
  • Feature-driven rate adaptation
  • CRF quality parameter
  • Source-modeled compression
  • Remove OpenCV dependency, unless transcoding from DVS/DAVIS (for now, anyway)
  • Evaluation scripts
  • Visualize detected features and input frames
  • Frame-based quality metrics
  • Plot bitrate and quality metrics
adder-codec-rs - v0.3.4: Tiered rate controller

Published by ac-freeman about 1 year ago

  • Set all the ADDER parameters with a single, simple number
  • An adjustable velocity parameter for the rate that the pixel sensitivity decreases
  • Adjust the pixel sensitivities based on the proximity to detected features
  • Add feature detection on the player side of adder-viz
  • Fix the "fast" player mode
  • Fix the file output in adder-viz
  • Update dependencies
  • UI fixes
adder-codec-rs - v0.3.3: Feature detection and compression setup

Published by ac-freeman about 1 year ago

  • Adds asynchronous feature detection on ADDER events
  • Makes stream handling more generic/abstracted, to support future development
  • Includes early experimental work with lossy compression (must be on Rust Nightly to enable the "compression" feature)
  • Numerous bug fixes
adder-codec-rs - v0.3.1: Live DAVIS transcoding

Published by ac-freeman over 1 year ago

Transcode from a live DAVIS camera feed

adder-codec-rs - v0.2.0: MMSys '23 submission

Published by ac-freeman almost 2 years ago

Add support for transcoding DAVIS 346 camera data to ADΔER

adder-codec-rs - v0.1.14: Event pixel restructuring

Published by ac-freeman about 2 years ago

Use a new graph structure for event pixels which is more amenable to various input types

adder-codec-rs - v0.1.9: Bugfixes and metadata CLI

Published by ac-freeman about 2 years ago

adder-codec-rs - v0.1.8: Framing examples

Published by ac-freeman about 2 years ago

Added several example programs

adder-codec-rs - v0.1.7: Parallel framer hooks

Published by ac-freeman about 2 years ago

adder-codec-rs -

Published by ac-freeman about 2 years ago

adder-codec-rs -

Published by ac-freeman about 2 years ago