# NVIDIA Clara AI-Assisted Annotation Extension

**URL:** <https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570>\
**Category:** Development\
**Tags:** annotations, deep-learning\
**Created:** [July 14, 2019, 6:01pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570 "2019-07-14T18:01:36Z")\
**Posts on this page:** 17\
**Page:** 2

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [December 19, 2019, 9:08pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/21 "2019-12-19T21:08:34Z")

</div>

Just in case somebody comes across this topic now: NVidia Clara AIAA extension is now available in extension manager.

> [@AI-assisted segmentation extension](https://discourse.slicer.org/t/ai-assisted-segmentation-extension/9536):
>
> We are excited to announce that [Nvidia AI-assisted segmentation extension](https://github.com/NVIDIA/ai-assisted-annotation-client/blob/master/slicer-plugin/README.md) is ready to use in latest Slicer Preview Release (rev28686 or later). The extension has been developed by Nvidia, with contributions from Slicer core developers. While there have been other AI-assisted segmentation modules in Slicer (such as [DeepInfer](http://www.deepinfer.org/), [TOMAAT](https://github.com/faustomilletari/TOMAAT-Slicer), [SlicerCIP](https://chestimagingplatform.org/workstation-slicer-cip)), this newest addition uses [Nvidia Clara](https://developer.nvidia.com/clara), a toolkit with significant industrial support and sufficient openness for researchers. Few-minute overview video…

---

<div class="post-metadata">

**Author:** ![Bruno\_Aragao](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/bruno_aragao/32/4433_2.png) [@Bruno\_Aragao](https://discourse.slicer.org/u/Bruno_Aragao)\
**Post date:** [February 28, 2020, 1:31am UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/22 "2020-02-28T01:31:44Z")

</div>

![nvidia server error](https://us1.discourse-cdn.com/flex002/uploads/slicer/original/3X/8/9/895b1f61277da679dd7df9a1a8b8c0cfb3ce3b39.jpeg)

Hello,

Does anyone knows why this message appears ? Is there any server configuration to be made?

Thanks

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [February 28, 2020, 3:15am UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/23 "2020-02-28T03:15:12Z")

</div>

Sorry, it seems that the latest updates to the extension broke the network communication. It should be fixed by tomorrow but until then you can use this release: [https://download.slicer.org/?date=2020-02-20](https://download.slicer.org/?date=2020-02-20)

---

<div class="post-metadata">

**Author:** ![pieper](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/pieper/32/8_2.png) [@pieper](https://discourse.slicer.org/u/pieper)\
**Post date:** [April 27, 2020, 4:28pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/24 "2020-04-27T16:28:28Z")

</div>

Has anyone tried using DeepGrow? @lassoan I recall we talked that it was 2D only, but their documentation implies it’s 3D (@erikziegler pointed this out).

[https://docs.nvidia.com/clara/tlt-mi/clara-train-sdk-v3.0/aiaa/key\_features.html#deepgrow](https://docs.nvidia.com/clara/tlt-mi/clara-train-sdk-v3.0/aiaa/key_features.html#deepgrow)

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [April 27, 2020, 4:39pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/25 "2020-04-27T16:39:08Z")

</div>

Yes, at the time it was released it was 2D, maybe it is 3D now. However, it does not use any underlying organ model, so it seems to be just another variant of Grow from seeds/Watershed/etc.

Nevertheless, it would be still interesting to try. That would require setting up the latest version of the AIAA server. @pieper if you have time to set it up then I can give you access to the server.

---

<div class="post-metadata">

**Author:** ![nanderson](https://avatars.discourse-cdn.com/v4/letter/n/7bcc69/32.png) [@nanderson](https://discourse.slicer.org/u/nanderson)\
**Post date:** [November 9, 2020, 4:19am UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/26 "2020-11-09T04:19:16Z")

</div>

Hi There I am also getting the error.  
“Failed to fetch models from remote server. Make sure server address is correct and \<server\_uri\>/v1/models is accessible in browser”  
Using a Windows machine and the url field is blank as advised.  
Just downloaded the extension yesterday. How can I resolve?  
Thanks a lot

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [November 9, 2020, 5:21am UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/27 "2020-11-09T05:21:19Z")

</div>

The server is up and running and works well from Slicer, from a Windows machine (I’ve just tried it now). If you are behind a company or hospital firewall that prevents web requests to go through then you may need to specify the web access proxy as described [here](https://www.slicer.org/wiki/Documentation/Nightly/Developers/FAQ/Python_Scripting#How_to_configure_network_proxy_.3F).

---

<div class="post-metadata">

**Author:** ![nanderson](https://avatars.discourse-cdn.com/v4/letter/n/7bcc69/32.png) [@nanderson](https://discourse.slicer.org/u/nanderson)\
**Post date:** [November 9, 2020, 6:53am UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/28 "2020-11-09T06:53:19Z")

</div>

Are there any models for segmenting the Bronchi from the lungs?  
Thanks a lot

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [November 9, 2020, 10:12pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/29 "2020-11-09T22:12:20Z")

</div>

I’ve updated the demo Slicer AI server to use latest NVidia Clara 3.0 version and uploaded the latest models (NVidia provides over 20 image segmentation models as technology demonstration - you can see the list here: [https://ngc.nvidia.com/catalog/collections/nvidia:claratrainframework](https://ngc.nvidia.com/catalog/collections/nvidia:claratrainframework)). You may find the fully automatic lung segmentation model useful.

In addition to this, you may find models at other places that can be loaded into the AIAA server directly, or brought into AIAA compatible format (see [instructions for bringing your own model](https://docs.nvidia.com/clara/tlt-mi/clara-train-sdk-v3.0/aiaa/byom.html)).

---

<div class="post-metadata">

**Author:** ![bsmarine](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/bsmarine/32/3898_2.png) [@bsmarine](https://discourse.slicer.org/u/bsmarine)\
**Post date:** [November 13, 2020, 7:16pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/30 "2020-11-13T19:16:49Z")

</div>

Hi Andras,

Do you know if there are any open-source COVID lung lesion models currently available in Clara, or elsewhere? And are you still providing a server to host models for the general public via AIAA Slicer plug-in?

Hope you are well.

-Brett

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [November 13, 2020, 7:49pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/31 "2020-11-13T19:49:19Z")

</div>

Yes, we still provide the server. We are in the process of switching to Clara 3.0, which has a few COVID related models, for example a fully automatic lung segmentation model. See complete list by clicking on “Download COVID-19 models” button on [this](https://developer.nvidia.com/clara-medical-imaging) page.

---

<div class="post-metadata">

**Author:** ![bsmarine](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/bsmarine/32/3898_2.png) [@bsmarine](https://discourse.slicer.org/u/bsmarine)\
**Post date:** [November 14, 2020, 8:14pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/32 "2020-11-14T20:14:52Z")

</div>

This is great, thank you!

---

<div class="post-metadata">

**Author:** ![strakpe](https://avatars.discourse-cdn.com/v4/letter/s/c68b51/32.png) [@strakpe](https://discourse.slicer.org/u/strakpe)\
**Post date:** [April 14, 2021, 5:30am UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/33 "2021-04-14T05:30:29Z")

</div>

Hello Andras,

I have just started to explore the possibilities of Clara and its extension to 3DSlicer. I am quite impressed with the concept and how it works together. My main focus of interest is liver segmentation. There are two liver segmentation models provided by Nvidia and also a general 2D Deepgrow method. Unfortunately, I could not find any annotation model for liver which would make the liver segmentation much faster compared to 2D Deepgrow. I saw the annotation models in some older Clara videos by Nvidia but actual NGC catalog does not offer them anymore. Is there any place where I could download them? Or maybe, do you have any recommendations how to create them from the existing segmentation models?

Thank you,

Petr

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [April 16, 2021, 3:39am UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/34 "2021-04-16T03:39:56Z")

</div>

> [@strakpe](#):
>
> r segmentation models provided by Nvidia and also a general 2D Deepgrow method. Unfortunately, I could not find any annotation model for liver which would make the liver segmentation much faster compared to 2D Deepgrow. I saw the annotation models in some older Clara videos by Nvidia but actual NGC catalog

NVidia developed these models as technology demos, but has no intention of maintaining them. Instead, they provide funding to the [monai](https://monai.io/) community to create and maintain models that can be used in Clara. I would recommend to check out monai, see what models they have, and maybe ask on their [discussion forum](https://github.com/Project-MONAI/MONAI/discussions) about what they recommend for liver segmentation.

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [June 7, 2021, 4:12am UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/35 "2021-06-07T04:12:50Z")

</div>

Split this topic on June 7, 2021, 4:12am UTC

A post was split to a new topic: [NVIDIA AIAA server internal error](https://discourse.slicer.org/t/nvidia-aiaa-server-internal-error/17988)

---

<div class="post-metadata">

**Author:** ![namnh](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/namnh/32/67114_2.png) [@namnh](https://discourse.slicer.org/u/namnh)\
**Post date:** [August 8, 2023, 2:43pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/36 "2023-08-08T14:43:45Z")

</div>

![image](https://us1.discourse-cdn.com/flex002/uploads/slicer/original/3X/b/f/bf68f82cbf1d73633315b453a2145ff68c8cde20.jpeg)  
Is Nvidia clara aaa support anymore

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [August 8, 2023, 2:58pm UTC](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570/37 "2023-08-08T14:58:26Z")

</div>

We don’t provide a publicly usable NVIDIA-AIAA server anymore. You can set up and use your own server (or can run on any Linux computer that supports docker and has an NVIDIA GPU with at least about 8GB GPU RAM).

However, since its developers do not support NVIDIA-AIAA anymore, I would recommend to use MONAILabel instead.

[Previous page](https://discourse.slicer.org/t/nvidia-clara-ai-assisted-annotation-extension/7570.md?page=1)