Cannot perform Aruco marker tracking

MasatoshiOBA · July 13, 2023, 11:30am

I would like to try optical marker tracking which presented in this slides https://github.com/PerkLab/PerkLabBootcamp/blob/master/Doc/day2_Plus.pptx.

Using USB webcam, and Aruco marker, I would like to perform optical marker tracking demo like youtube video.

I basically follow the instructions written in the pptx. When I launched Plus server using configulation file attatched below (which was editted as same as the pptx said.), and connect the Plus server via OpenIGTLinkIF, nothing is shown in Scene. The slide #55 and #56 said that I should find those transform nodes "Scene > IGTLConnector > IN > Marker0ToTracker, Marker1ToTracker, Marker0ToMarker1 " .

I seemed to stack around slide #56.

Do you have any solution for this problem?

Sunderlandkyl · July 13, 2023, 1:50pm

The transforms won’t appear in OpenIGTLinkIF until you show them to the camera.

Make sure to try a couple of different PortUsImageOrientation, MF/UF/UN/UF, depending on your camera, this may need to be adjusted.

Could you attach the Plus log and config file?

MasatoshiOBA · July 14, 2023, 10:37am

Thank you for your reply!

I’m using Windows 10 (64bit) PC with USB webcam.
Slicer 5.2.2
PlusApp-2.9.0.20230704-Win64

My config file is below

And the log file which was obtained immediately after launching Plus server using the config file above.

The message window of Plus server saying

Connection successful!

Tracking of printed ArUco markers using a simple camera. Marker positions and image data are broadcasted through OpenIGTLink (on port 18944 and 18945, respectively). To use a different camera, change CaptureDeviceId attribute (to 0, 1, 2, …).

Plus OpenIGTLink server listening on IPs: 192.168.17.88, 169.254.14.106, 169.254.63.16, 127.0.0.1, 172.23.112.1, 172.18.224.1 – port 18944
Plus OpenIGTLink server listening on IPs: 192.168.17.88, 169.254.14.106, 169.254.63.16, 127.0.0.1, 172.23.112.1, 172.18.224.1 – port 18945

Then I switched to OpenIGTLinkIF module, and change the port number from 18944 to 18945.
After that, I turned the “Active” checkbox on. I showed Aruco marker printed from the slide to my webcam, however, I couldn’t find translation node ("marker0totracker or "marker1totracker) in"I/O configulation window.

the Plus log file in this situation is

071423_193351.080|ERROR|009.708000| Pose estimation failed. Tool Marker0ToTracker with marker 0.| in E:\D\PTNP64b\PlusLib\src\PlusDataCollection\OpticalMarkerTracking\vtkPlusOpticalMarkerTracker.cxx(416)
071423_193351.082|ERROR|009.709000| Pose estimation failed. Tool Marker1ToTracker with marker 1.| in E:\D\PTNP64b\PlusLib\src\PlusDataCollection\OpticalMarkerTracking\vtkPlusOpticalMarkerTracker.cxx(416)
071423_193351.115|ERROR|009.742000| Pose estimation failed. Tool Marker0ToTracker with marker 0.| in E:\D\PTNP64b\PlusLib\src\PlusDataCollection\OpticalMarkerTracking\vtkPlusOpticalMarkerTracker.cxx(416)
071423_193351.115|ERROR|009.742000| Pose estimation failed. Tool Marker1ToTracker with marker 1.| in E:\D\PTNP64b\PlusLib\src\PlusDataCollection\OpticalMarkerTracking\vtkPlusOpticalMarkerTracker.cxx(416)
071423_193351.151|ERROR|009.778000| Pose estimation failed. Tool Marker0ToTracker with marker 0.| in E:\D\PTNP64b\PlusLib\src\PlusDataCollection\OpticalMarkerTracking\vtkPlusOpticalMarkerTracker.cxx(416)
071423_193351.151|ERROR|009.778000| Pose estimation failed. Tool Marker1ToTracker with marker 1.| in E:\D\PTNP64b\PlusLib\src\PlusDataCollection\OpticalMarkerTracking\vtkPlusOpticalMarkerTracker.cxx(416)
071423_193351.184|ERROR|009.812000| Pose estimation failed. Tool Marker1ToTracker with marker 1.| in E:\D\PTNP64b\PlusLib\src\PlusDataCollection\OpticalMarkerTracking\vtkPlusOpticalMarkerTracker.cxx(416)
071423_193351.215|ERROR|009.843000| Pose estimation failed. Tool Marker1ToTracker with marker 1.| in E:\D\PTNP64b\PlusLib\src\PlusDataCollection\OpticalMarkerTracking\vtkPlusOpticalMarkerTracker.cxx(416)
071423_193351.253|ERROR|009.880000| Pose estimation failed. Tool Marker1ToTracker with marker 1.| in E:\D\PTNP64b\PlusLib\src\PlusDataCollection\OpticalMarkerTracking\vtkPlusOpticalMarkerTracker.cxx(416)

I appriciate your support.

MasatoshiOBA · July 14, 2023, 11:24am

I think I could solved this by my self after the latest reply…

When I created two scene, one is listening port 18944, another is listening 18945,
pointer model apperead and which seemed to move with the marker moving in front of the Webcam.

It is little bit lagged, even with low pass filter provided by transform processor module. But it’s fine.

I am still wondering I solved this or not. But your kind reply encourage me to face this.

Sunderlandkyl · July 14, 2023, 4:14pm

Yeah I think you’ve solved it. The config file has 2 OpenIGTLink connections. The one on 18944 is transmitting the marker transforms, and the one on 18945 is transmitting the webcam image.

ngansir · February 17, 2024, 6:44am

Hi, I am new to 3D Slicer, can show the step how to make the Aruco Marker tracking work as the Video exactly? I have followed the tutorial and made webcam function, created the needle model, however the tracking position and direction is not I expected.

https://www.youtube.com/watch?v=MOqh6wgOOYs

Topic		Replies	Views
Overlaying a dot on the camera stream using plus server and slicer module Support	5	718	January 11, 2019
Programmatically setting a TransformProcessorNode Development python	3	327	August 23, 2021
Sending fiducial points via OpenIGTLinkIF Development openigtlink	9	759	April 18, 2021
A few issues with the new Markups Development markups	3	461	March 7, 2019
Reading a Linear Transform using scripting while openigtl server keeps sending transform messages Support	3	275	February 11, 2022

Cannot perform Aruco marker tracking

Related Topics