All this sounds interesting; I’ll take a close look at it soon. Meanwhile you may like to see the app made in Unity by Lluis Vinent, it’s already pretty cool:
This videos shows the blend part of the project: