AI Agent Skills for 3D Slicer?

I noticed in the most recent release notes for VS Code support for “Agent Skills”, which are an open-standard platform-agnostic method of specifying helpful standards and domain-specific reference materials for AI Agents to reference. This seems like potentially a great way of improving Slicer-specific coding abilities for AI agents. This could also be connected with improving the effectiveness of the prototype tool described in this thread Developer Agent for Slicer - Support - 3D Slicer Community. While I think this is still in the realm of rapid development (and so may not be stable), it does intend to be an open standard and currently looks like it has fairly wide support. Has anyone tried to use this framework in the context of Slicer extension development? I think there is an opportunity here to develop some shared community resources like a “skill repository” (skills are intended to be shareable). Personally, I am just starting to try to dip a toe into using an agent to explore developing a segment editor effect, so I don’t yet have enough experience to try to set up anything useful, it just seems like an intriguing and intuitively sensible approach to improving Slicer-related coding via agents. Any experience or thoughts?

Actually this was a topic I was planning to do as a project week project, alas other things intervened and I am not headed to Las Palmas.

I tried a few things on my end (as you linked above). The latest iteration of it uses DeepSeek inference engine on the JS2, which mitigates the need of API keys or subscriptions (though you have to either run inside the JS2 -which is not an issue if you are using MorphoCloud- or need to tunnel the request).

I am more interested in educational aspect of this, bringing people who are not used to coding and wouldn’t invest the time on their own but with a little bit of help would maybe be able to hack together something…

1 Like

A related project will be going on at Project Week:

https://projectweek.na-mic.org/PW44_2026_GranCanaria/Projects/ClaudeScientificSkillForImagingDataCommons/

Informally I know there will be a lot of discussion about how these tools are changing out coding habits and how they are working out for developers and users with more or less experience. We’ll try to capture those experiences and publish any experiments that come up during the week.

2 Likes