First major release in way too long! Includes critical bug fixes for Orange Pi object detection crashing/showing no stream/heartbeat freezing, and a new base Orange Pi image. The new base image boots faster without networking and includes other improvements.

[!IMPORTANT]
Teams with Orange Pis will need to reflash using the v2024.3.1 image. Make sure to export your settings (and keep a backup somewhere safe) prior to doing this. If you've got a spare SD card, try to flash it instead so you've got a known-good hot-spare.

[!IMPORTANT]
The Orange Pi NetworkManager interface name changed to "netplan-zz-all-eth" -- make sure to have this selected in the dropdown

[!NOTE]
Teams not using Orange Pi's probably don't need to update, and base images have not changed so a reflash is not required.

Major changes

• Run resize in CPU to avoid RGA-crash/lockup by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1287
• Bump orange pi images to v1.33 by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1276

Other changes

• Bump WPILib to 2024.3.2 by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1283
• Opencv cal: CALIB_USE_LU and use camera focal length guess by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1268
• Disable camera orientation option when camera is calibrated by @philltran in https://github.com/PhotonVision/photonvision/pull/1277
• Add proper exposure range for OV2311 by @gautvm in https://github.com/PhotonVision/photonvision/pull/1282
• Set default pipeline idx in PipelineManager constructor by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1286
• Free native resources in apriltag pipelines by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1272
• Release letterboxed frame in rknn pipe by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1289
• Recreate user pipeline on type change by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1290
• Fix wpiformat by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1291

New Contributors

• @philltran made their first contribution in https://github.com/PhotonVision/photonvision/pull/1277

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.2.9...v2024.3.1

First major release in way too long! Includes critical bug fixes for Orange Pi object detection crashing/showing no stream/heartbeat freezing, and a new base Orange Pi image. The new base image boots faster without networking and includes other improvements.

[!IMPORTANT]
Teams with Orange Pis will need to reflash using the v2024.3.0 image. Make sure to export your settings (and keep a backup somewhere safe) prior to doing this. If you've got a spare SD card, try to flash it instead so you've got a known-good hot-spare.

[!IMPORTANT]
The Orange Pi NetworkManager interface name changed to "netplan-zz-all-eth" -- make sure to have this selected in the dropdown

[!NOTE]
Teams not using Orange Pi's probably don't need to update, and base images have not changed so a reflash is not required.

Known issues

• RKNN pipeline doesn't release the letterboxed frame
• On first boot, camera will not switch pipelines without toggling drivermode on and then off

Major changes

• Run resize in CPU to avoid RGA-crash/lockup by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1287
• Bump orange pi images to v1.33 by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1276

Other changes

• Bump WPILib to 2024.3.2 by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1283
• Opencv cal: CALIB_USE_LU and use camera focal length guess by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1268
• Disable camera orientation option when camera is calibrated by @philltran in https://github.com/PhotonVision/photonvision/pull/1277
• Add proper exposure range for OV2311 by @gautvm in https://github.com/PhotonVision/photonvision/pull/1282
• Set default pipeline idx in PipelineManager constructor by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1286
• Free native resources in apriltag pipelines by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1272

New Contributors

• @philltran made their first contribution in https://github.com/PhotonVision/photonvision/pull/1277

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.2.9...v2024.3.0

Fixes mrcal calibration bug with non-square calibration targets, and implements a incrementally expanding optimization approach to match the behavior of mrcal-calibrate-cameras.

What's Changed

• Create smoketest mode by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1264
• Pipe cscore logs through photonvision by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1260
• Bump mrcal to include solver fixes by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1265

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.2.8...v2024.2.9

Addresses a bug in 2024.2.7 that prevented configs for CSI cameras being saved.

What's Changed

• Fix CSI camera matching by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1258

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.2.7...v2024.2.8

[!CAUTION]
These is a known bug with this release that causes CSI cameras (this includes limelight and raspberry pi cameras) to not be matched to saved configs. A patch is currently in the works.

v2024.2.7

This release contains camera matching updates and other misc changes. The major addition is of the Strictly match ONLY known cameras switch in the device control card, which will ONLY match cameras by the USB port they're plugged into + (basename or USB VID/PID), and never only by the device product string. This also disables automatic detection of new cameras.

Major Changes

• Fix multi-cam matching logic/settings loss bugs by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1245 and https://github.com/PhotonVision/photonvision/pull/1238
• [photonlib] Invert simulated target yaw by @amquake in https://github.com/PhotonVision/photonvision/pull/1243
• Install sqlite3 in install script by @TheTripleV in https://github.com/PhotonVision/photonvision/pull/1247
• update wpilib to 2024.3.1 by @TheTripleV in https://github.com/PhotonVision/photonvision/pull/1246
• Bump orange pi image version to include sqlite3, v4l utils by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1249

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.2.6...v2024.2.7

v2024.2.6

Contains a pretty fundamental rewrite of camera matching logic to improve robustness. As such treat this release with a decent dose of paranoia and reach out with current run/journalctl logs if things are being weird.

We now match cameras in this priority order, with all cameras being matched by each strategy before trying the next:

• By physical usb port path and base name and USB VID/PID
• by physical usb port path and USB VID/PID
• By base name only (with a toggle switch in the networking card to disable this, and create a new VisionModule instead)

We also now glive cscore the /dev/video/by-path camera path on Linux systems, pinning Photon USBCameras to a particular usb port once created instead of the video index (/dev/videoN).

What's Changed

• Load libwinpthread-1.dll before libgcc_s_seh-1 by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1228
• Actually properly match cameras by name fr this time by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1237

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.2.5...v2024.2.6

What's Changed

Includes a fix for Spinel OV9281s that report duplicate video modes/calibration happening at the wrong resolution. Please create issues/drop by Discord if you still have issues!

• Fix for Spinel camera video mode selection bug (Fixes #1219) by @crschardt in https://github.com/PhotonVision/photonvision/pull/1221
• fix chessboard gen by @gerth2 in https://github.com/PhotonVision/photonvision/pull/1217
• Store the last pose on update by @ArchdukeTim in https://github.com/PhotonVision/photonvision/pull/1207

New Contributors

• @ArchdukeTim made their first contribution in https://github.com/PhotonVision/photonvision/pull/1207

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.2.3...v2024.2.4

More small bugfixes, including reduced bandwidth on initial connection and during calibration to address instability in bandwidth limited setups.

What's Changed

• Add v4l utils to installation script by @gautvm in https://github.com/PhotonVision/photonvision/pull/1201
• Dont send targets or cal images to UI by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1200
• Add support for different RKNN YOLO models in the backend by @james20902 in https://github.com/PhotonVision/photonvision/pull/1205
• Python tweaks by @gerth2 in https://github.com/PhotonVision/photonvision/pull/1211
• Fix inverted condition in camera calibration table by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1214
• Add NPU usage to metrics on supported platforms by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1215

New Contributors

• @gautvm made their first contribution in https://github.com/PhotonVision/photonvision/pull/1201
• @james20902 made their first contribution in https://github.com/PhotonVision/photonvision/pull/1205

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.2.2...v2024.2.3

What's Changed

First big feature update of 2024! Brings (still incubating!) object detection using RKNN with a hard-coded YOLOv5 model trained on notes, and an (also new) LimeLight 3 image. Now that features work we'll be changing gears to focus on documenting new things. As always please reach out on Discord with journalctl logs if you encounter any issues!

• Add RKNN / Object Detection Pipeline by @mdurrani808 in https://github.com/PhotonVision/photonvision/pull/1144
• LL3 by @BytingBulldogs3539 in https://github.com/PhotonVision/photonvision/pull/1166

The nitty gritty

RKNN is the neural network accelerator hardware built into rockchip CPUs using on SBCs like the Orange Pi 5. We're able to use this hardware to massively accelerate certain math operations like those needed for running ML-based object detection. The code for that lives here, and publishes to Maven. Our pre-trained note model lives here, and NeuralNetworkModelManager deals with extracting that to disk. If a file named "note-640-640-yolov5s.rknn" and labels.txt does not exist at photonvision_config/models/, it'll be extracted from the JAR -- otherwise, the one already on disk will be used. This technically allows power users to replace the model and label files with new ones without rebuilding photon, though this feature is still largely untested, too.

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.1.5...v2024.2.0

What's Changed

• [photon-lib java] Make targeting classes extend ProtobufSerializable by @ArchB1W in https://github.com/PhotonVision/photonvision/pull/1156
• Bind-mount repo in image builder by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1157 (reduces total image size again)
• Update spotless by @rzblue in https://github.com/PhotonVision/photonvision/pull/1162
• Load libquadmath on Windows by @mcm001 in https://github.com/PhotonVision/photonvision/pull/1163 (Mrcal calibration fixes for Windows)

New Contributors

• @ArchB1W made their first contribution in https://github.com/PhotonVision/photonvision/pull/1156

Full Changelog: https://github.com/PhotonVision/photonvision/compare/v2024.1.4...v2024.1.5

CD thread

IMPORTANT
Releases 2024.1.1 through 2024.1.3 have been removed. There was a bug which caused the photonlib .jar file to be 10x its normal size.

The PhotonVision team is excited to announce the first full release for the 2024 FRC competition season! This beta cycle has been insane, with over 150 commits, 600+ files edited, and over 40,000 LOC modified in the main PhotonVision repo itself. Some of the major changes since 2023 include:

Reworked simulation support for Java and C++ featuring live camera view rendering and updated example projects
SQL-based settings database
Additional networking configurability, including arbitrary NT server location
Multi-tag pose estimation on-coprocessor
Improved camera calibration diagnostics
mrcal-enabled camera-calibration backend
Re-Enabled 36h11 tag support
Multi-camera support for identical USB cameras and CSI cameras
Raspberry Pi 5 supportPre-configured Orange Pi 5 image
Automatic Javadoc, Doxygen, and UI demo publishing
Usage reporting
Protobuf support for targeting results
Status LED support for Pi devices
Basic Python Support

Thank you!

We would like to thank all those who contributed to making this release possible and the continued development of this project. Open source projects like PhotonVision are only made possible through the effort and support from the community which we appreciate.

A big shout out to the following people for helping make this year’s release possible:

• crschardt (🎉first time contributor 🎉)
• rzblue (🎉first time contributor 🎉)
• person4268 (🎉first time contributor 🎉)
• megalinee (🎉first time contributor 🎉)
• StephenDay1 (🎉first time contributor 🎉)
• fovea1959 (🎉first time contributor 🎉)
• superpenguin612 (🎉first time contributor 🎉)
• mvog2501 (🎉first time contributor 🎉)
• calcmogul
• srimanachanta
• mcm001
• bankst
• amquake
• gerth2
• BytingBulldogs3539
• r4stered
• Technologyman00
• MrRedness
• mdurrani808
• prensing
• chiraqLa
• auscompgeek
• ThadHouse

CD thread

The PhotonVision team is excited to announce the first full release for the 2024 FRC competition season! This beta cycle has been insane, with over 150 commits, 600+ files edited, and over 40,000 LOC modified in the main PhotonVision repo itself. Some of the major changes since 2023 include:

Reworked simulation support for Java and C++ featuring live camera view rendering and updated example projects
SQL-based settings database
Additional networking configurability, including arbitrary NT server location
Multi-tag pose estimation on-coprocessor
Improved camera calibration diagnostics
mrcal-enabled camera-calibration backend
Re-Enabled 36h11 tag support
Multi-camera support for identical USB cameras and CSI cameras
Raspberry Pi 5 supportPre-configured Orange Pi 5 image
Automatic Javadoc, Doxygen, and UI demo publishing
Usage reporting
Protobuf support for targeting results
Status LED support for Pi devices
Basic Python Support

Thank you!

We would like to thank all those who contributed to making this release possible and the continued development of this project. Open source projects like PhotonVision are only made possible through the effort and support from the community which we appreciate.

A big shout out to the following people for helping make this year’s release possible:

• crschardt (🎉first time contributor 🎉)
• rzblue (🎉first time contributor 🎉)
• person4268 (🎉first time contributor 🎉)
• megalinee (🎉first time contributor 🎉)
• StephenDay1 (🎉first time contributor 🎉)
• fovea1959 (🎉first time contributor 🎉)
• superpenguin612 (🎉first time contributor 🎉)
• mvog2501 (🎉first time contributor 🎉)
• calcmogul
• srimanachanta
• mcm001
• bankst
• amquake
• gerth2
• BytingBulldogs3539
• r4stered
• Technologyman00
• MrRedness
• mdurrani808
• prensing
• chiraqLa
• auscompgeek

PhotonVision v2024.1.1

Issue after setting static IP noted -- release yanked in favor of one with https://github.com/PhotonVision/photonvision/issues/1137

Dummy release for testing CI :)

Dummy release for testing CI :)

Dummy release for testing CI :)