All this sounds interesting;
I’ll take a close look at it soon.
Meanwhile you may like to see the app made in Unity by Lluis Vinent,
it’s already pretty cool:
This videos shows the blend part of the project:
2 Likes