April-Tag-VR-FullBody-Tracker

Full-body tracking in VR using AprilTag markers.

MIT License

Stars
1.1K
Committers
12

Bot releases are hidden (Show)

April-Tag-VR-FullBody-Tracker - Apriltag Trackers Latest Release

Published by ju1ce about 2 years ago

An update to version 0.7 with a few bug fixes and a new marker library.

  • Fix to bug that caused playspace calibration to reset instead of save when reaching the 60 second timeout
  • Fixed folder structure on linux build to prevent too many intermetidate folders
  • Added marker library to use with dodecahedron trackers

Note that dodecahedron trackers are still failry experimental, so you should only attempt making them if you are already familiar with ATT. With imperfect calibration, they will perform worse than regular trackers.

If you still wish to experiment with them, the necessary files are pinned in the #dev-talk channel on the discord, where most of information about them is. Note that you will also have to change the "markers per tracker" parameter directly in config.yaml from 45 to 11.

Details:

Full Changelog: https://github.com/ju1ce/April-Tag-VR-FullBody-Tracker/compare/v0.7.0...v0.7.1

April-Tag-VR-FullBody-Tracker - Apriltag Trackers

Published by ju1ce about 2 years ago

After a few weeks of delays due to bug fixes, the full version is finaly released! This version features a bunch of QOL improvements, bug fixes, improved GUI and a linux build!

  • The release now includes a Linux build
  • Added support for PS Eyes directly (using Camera API of 9100)
  • Added window naming for easier management of multiple camera setups
  • Changes to driver installation to make it easier to install
  • Smoothing can now be disabled completely by setting Smoothing window to 0
  • Fixed distance from camera resetting when calibrating playspace
  • Added option to mirror camera

The format of the config files has changed, so recalibration of everything is necessary when upgrading. The driver is also new, upgrade it as well!

Known Issues:

  • On linux, the driver installer does not enable multiple drivers in steamvr config, so it must be done manualy.
  • The file structure of the linux download contains too many unecessary folders
  • When calibration mode times out after 60 seconds, the calibration gets reset instead of saved
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce about 2 years ago

This beta includes some more fixes based on feedback from the previous one.

  • The set_exposure.bat script has been added back to the utilities folder, which should help those using IP Webcam set exposure easier
  • Fixed the driver installer not enabling multiple drivers, causing the driver to not work
  • Some more fixes to the build system

Known issues:

  • The fix to the driver installer has not been done for linux yet, meaning it has to be done manualy.
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce over 2 years ago

This beta focuses on some more build changes, a fix to IP Webcam not working, and some fixes to Gstreamer backend on linux.

  • The build system was changed to vcpkg
  • Using IP webcam for the camera now works
  • Using Gstreamer backend on linux should now work better

Known issues:

  • The current driver installer does not enable activating multiple drivers in the SteamVR config. If this is your first time installing ATT, this may cause trackers to not appear inside SteamVR. This has been fixed on the latest nightly build, available on the discord server.
  • You can also fix the above issue by manualy enabling the setting, instructions can be found in the "Installing the driver" wiki page.
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce over 2 years ago

This version focuses on project reformatting for easier build and development, Linux support and changes to ease of use:

  • The release now includes a Linux build
  • Added support for PS Eyes directly (using Camera API of 9100)
  • Added window naming for easier management of multiple camera setups
  • Changes to driver installation to make it easier to install
  • Smoothing can now be disabled by setting Smoothing window to 0
  • Fixed distance from camera resetting when calibrating playspace
  • Added option to mirror camera

The format of the config files has changed, so recalibration of everything is necessary when upgrading.

Full Changelog: https://github.com/ju1ce/April-Tag-VR-FullBody-Tracker/compare/v0.6...v0.7-beta

KNOWN ISSUES:

  • Connecting to IP Webcam seems to be broken
April-Tag-VR-FullBody-Tracker - Apriltag Trackers

Published by ju1ce almost 3 years ago

After a few months of beta releases, ATT seems to be stable enough for a full release! This is the exact same version as the v0.5.5, but released as a full release instead of pre-release.

New additions, compared to the old v0.4 release:

  • New smoothing algorithm, which reduces shaking and delay
  • Support for multiple cameras
  • Easier camera calibration
  • Easier playspace calibration with controllers

For more information on the changes, check the changelogs for the beta releases.

The tutorial has been moved to the wiki with far more information, and a new setup video has been posted to reddit, dont forget to check them out!

April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce almost 3 years ago

This beta focuses mostly on a chinese translation and adding licenses to the program.

  • Thanks to @apriltagtrackers-cn, the program has been translated into chinese! The language can be selected in the params.
  • A tab has been added for all the licenses that must legaly ship with the program.
  • Added an option to disable the out window in order to save resources and make high fps cameras work better.
  • During playspace calibration, distance now also saves rather than resetting every time.
  • Fixed bug that caused crash if preview window was opened during camera calibration
  • Fixed bug where trackers would sometimes dissapear and fail to reapear, even through the axis are seen in the out window
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce about 3 years ago

This beta adds some new features, bugfixes, and a slight UI update.

  • Added an option to use Aruco 4x4 markers
  • Added a depth smoothing option
  • Added additional smoothing to the driver
  • Parameters were grouped better and some were renamed to better represent what they are
  • Fixed a bug where calibration with controllers didnt work correctly on lighthouse systems
  • Fixed a bug where the camera would fly off during multiple camera calibration refinement
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce about 3 years ago

New beta release, containing some more features to make tracking smoother! This should finalize the multiple cameras update and allow you to calibrate their playspaces perfectly.

  • Added option to automaticaly refine one playspace calibration to another. A rough calibration should still be done manualy!
  • Added option to lock camera height during calibration. Should help to recalibrate quicker if your playspace changes on quest.
  • Added an option to spawn trackers in the middle of markers, rather than at the main marker.
  • Added some warnings to parameters that may break detection
  • Calibration mode will exit automaticaly if no button is pressed for 60 seconds
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce about 3 years ago

  • Fixed a crash on certain tracker configurations
  • Fixed a crash when pressing connect to steamvr without a HMD connected
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce about 3 years ago

New beta release, consisting of some more calibration QOL fixes and the full multiple camera implementation!

  • Closing steamvr will now no longer close ATT (if camera is opened)
  • ATT instances will now help each other through the driver, making multiple cameras run smoother
  • Camera calibration will now throw away any frames with big reprojection error
  • During playspace calibration, you can now calibrate distance from camera along with rotation
  • Aditional smoothing parameter no longer represents maximum number of saved values, but rather their maximum time.
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce over 3 years ago

New beta release, mostly consisting of some calibration QOL changes and a fix to a driver bug.

  • Camera FPS and resolution is now shown on camera preview
  • Warnings if camera calibration seems to be bad
  • Can now move and rotate camera with your left controller during playspace calibration (trigger to move, grip to rotate)
  • Trackers should no longer cause controllers to stop working
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Beta

Published by ju1ce over 3 years ago

This is a beta release of the new linear interpolation smoothing, which also allows the use of multiple cameras. It also needs a driver reinstall, which is provided.

  • "Additional smoothing" parameter now defines number of values to use for linear interpolation. 10 is a good starting point.
  • "Camera latency" should now work as expected and noticably reduces delay.
  • Added some options for a virtual hip

For additional information, check the discord!

April-Tag-VR-FullBody-Tracker - Apriltag Trackers

Published by ju1ce over 3 years ago

  • Camera calibration has been reworked for easier calibration
  • Install script has been added for easier driver install
  • More parameters for options to allow more control over webcams
  • Set exposure script for IP-Webcam
April-Tag-VR-FullBody-Tracker - Apriltag Trackers Hotfix

Published by ju1ce over 3 years ago

Some bug fixes

  • Fixed the camera having huge exposure and low fps bug
  • Moved some not needed parameters out of the gui (they are still accessable through the params.yaml file)
  • Added some test hidden parameters only accessable from the params.yaml file:
    • trackerCalibDistance: increase the maximum distance at which trackers will calibrate
    • cameraCalibSamples: increase the number of pictures you take when calibrating camera
    • circularMarkers: use the TagCircle21h7 family of tags instead of the default Standard ones
April-Tag-VR-FullBody-Tracker - Apriltag Trackers

Published by ju1ce over 3 years ago

  • Driver has been reworked and will require a reinstall
  • New playspace calibration system that should be simpler to use and more accurate
  • New camera calibration system that should be more accurate
  • Trackers must now be closer than 30cm to the camera to calibrate
  • Added more help windows and tooltips for parameters
  • Using SteamVR interpolation, which should improve smoothness and latency
  • Make some error messages more helpful
April-Tag-VR-FullBody-Tracker - Apriltag Trackers

Published by ju1ce almost 4 years ago

  • Added option for manual calibration
  • Added option to exclude tracker 0 (hip tracker)
  • Bug fixes (trust me)
April-Tag-VR-FullBody-Tracker - Apriltag Trackers

Published by ju1ce almost 4 years ago

First release of Apriltag Trackers! Follow the readme for instructions.

Related Projects