Some optimizations are possible specially related to image saving etc… before sending it to AIAA server.
But otherwise, the next step is to add Polygon Editing feature (similar to what exists in MITK Nvidia Plugin)
Curve nodes are added in recent Slicer Preview Releases that should be used for this. These new curve nodes provide interactive editing, various interpolation schemes, out-of-plane display, etc. You can also look at other segment editor effects, such as Surface cut and Draw tube to see how you can preserve editable curve points in segment tags. If you need any further help then we can continue the discussion in the extension’s repository (you can add issues for each item to discuss/develop).
This process is very involved and most potentially interested users cannot complete all the steps. Would it be possible to set up a test server that would allow people to try the extension?
We (NVIDIA) would like to… even if it is slow… but still helps user to understand about the feature.
We (as part of NVIDIA) need to clear few security checks to make it public… hence it’s delayed
3 Likes
@lassoan I spoke with one if my colleagues here and standing up an annotation server for development is something we can help with. May take a couple of days but will keep you posted. Will post both here and on repository with details.
Exciting turn around on this work!
2 Likes
Thank you… I have been referring the same extensions to start with.
One thing I couldn’t find: when user clicks label (selects label like Spleen) I would like to send a request to AIAA server and keep the list of models ready… instead of additional click to “Fetch Models”
Is there a way I can get an event that label is selected from the labelmap?
If you mean that you would like to know when the user changes the segment name (or double-clicks the color swatch and selects a terminology item) then you can add an observer to the SegmentModified event in the segmentation node. Whenever this event is invoked your observer can retrieve the segment’s name or terminology and request the appropriate model.
@lassoan I think the question is how to get the event when the segment is selected in the segment list.
@SachidanandAlle in the QuantitativeReporting module we had a similar situation where we wanted to configure actions based on segment selection. I might not remember it correctly, but I think Christian (@che85) who implemented that module didn’t find a way to get that event, and because of that had to customize Segment Editor in this class. I would’t be able to list all the reasons why that customization was needed, beyond this event handler.
To get a notification immediately when the user selects a different segment, you can use the currentSegmentIDChanged signal of the segment editor widget. If you want to check anytime what is the currently selected segment, you can get it from the segment using currentSegmentID method (or from the segment editor MRML node).
1 Like
Just in case somebody comes across this topic now: NVidia Clara AIAA extension is now available in extension manager.
Hello,
Does anyone knows why this message appears ? Is there any server configuration to be made?
Thanks
Sorry, it seems that the latest updates to the extension broke the network communication. It should be fixed by tomorrow but until then you can use this release: https://download.slicer.org/?date=2020-02-20
1 Like
Has anyone tried using DeepGrow? @lassoan I recall we talked that it was 2D only, but their documentation implies it’s 3D (@erikziegler pointed this out).
https://docs.nvidia.com/clara/tlt-mi/clara-train-sdk-v3.0/aiaa/key_features.html#deepgrow
Yes, at the time it was released it was 2D, maybe it is 3D now. However, it does not use any underlying organ model, so it seems to be just another variant of Grow from seeds/Watershed/etc.
Nevertheless, it would be still interesting to try. That would require setting up the latest version of the AIAA server. @pieper if you have time to set it up then I can give you access to the server.
Hi There I am also getting the error.
“Failed to fetch models from remote server. Make sure server address is correct and <server_uri>/v1/models is accessible in browser”
Using a Windows machine and the url field is blank as advised.
Just downloaded the extension yesterday. How can I resolve?
Thanks a lot
The server is up and running and works well from Slicer, from a Windows machine (I’ve just tried it now). If you are behind a company or hospital firewall that prevents web requests to go through then you may need to specify the web access proxy as described here.
Are there any models for segmenting the Bronchi from the lungs?
Thanks a lot
I’ve updated the demo Slicer AI server to use latest NVidia Clara 3.0 version and uploaded the latest models (NVidia provides over 20 image segmentation models as technology demonstration - you can see the list here: https://ngc.nvidia.com/catalog/collections/nvidia:claratrainframework). You may find the fully automatic lung segmentation model useful.
In addition to this, you may find models at other places that can be loaded into the AIAA server directly, or brought into AIAA compatible format (see instructions for bringing your own model).
Hi Andras,
Do you know if there are any open-source COVID lung lesion models currently available in Clara, or elsewhere? And are you still providing a server to host models for the general public via AIAA Slicer plug-in?
Hope you are well.
-Brett
Yes, we still provide the server. We are in the process of switching to Clara 3.0, which has a few COVID related models, for example a fully automatic lung segmentation model. See complete list by clicking on “Download COVID-19 models” button on this page.
This is great, thank you!