Greetings from the Dynamo team!
It has been a while since I wrote here to share some new progress made by our team. If you have been following our blog posts, you may know we have released Dynamo 3.0 – our latest release, loaded with some awesome features and UX improvements. What is even more exciting is that our team has been looking closely at the possibility of integrating a Generative AI (Gen-AI) assistant experience based on Chat-GPT into Dynamo. An AI-powered assistant could offer efficiency, interactive troubleshooting or optimization when integrated into a visual programming tool with a somewhat steep learning curve.
We are exploring the following possibilities of a Chat-GPT like experience in Dynamo! Given this is early days, we cannot guarantee if and when they will be available in Dynamo, or if they will look anything like this, but we are committed to exploring this space and seeing how it can empower Dynamo and shift existing paradigms forward. As with all AI/ML projects, the trick is with data and model fine tuning. So whipping up a concept is super easy and fast, but getting it ready for general use will take a long time. You can think of this as a ratio of days to months. Your opinions would help us greatly as we continue to evaluate the value of such a tool.
Ever felt like the warning messages on certain nodes are not so helpful? You can ask the Gen-AI assistant to explain the graph to you and troubleshoot for you based on its own analysis. In the example above, the Gen-AI assistant explains that the value output from the Code Block node should be a number instead of a string.
In the other example above, the Gen-AI assistant explains that there is an error in the range expression in Code Block node and how to fix it.
Ever wonder if the graph could be simplified or optimized? You can ask the Gen-AI assistant to identify unnecessary nodes or optimize node connections. The above is an example of graph optimization suggested by the Gen-AI assistant to remove the extra node in the workflow, achieving the same result with fewer nodes.
To the same goal, let’s see if we make this problem harder, how would the Gen-AI assistant respond? In this trial, it seems the Gen-AI assistant is aware of the optimization principles, but it is not well trained with enough data yet to Combine Operations for the user. We were expecting the Gen-AI assistant to suggest removing the whole list manipulation block of nodes but it did not specify. Given the clear goal, we may need to try different approaches, e.g. fine tune the model or compare different language models.
Ever thought about having Dynamo generate workflows for your needs using Python nodes or auto-generated graphs? You can specify your goal to the Gen-AI assistant and have it provide the solution for you. The above is an example where the Gen-AI assistant automatically created a Python node in canvas containing the Python code to move a wall in Revit. What’s left for the user is to connect the Python node with the right input and continue the rest of the design process without having to worry about learning Python.
These are a few use cases our team believes could be helpful to our users. How would you like to leverage a Gen-AI assistant if provided in Dynamo? Please specify these or any additional use cases that would be valuable to you so our team can study what a Gen-AI assistant can bring to the larger community and prioritize the effort. Dynamo team would like to listen, especially @solamour @helena.wahlstrom @craig.long and me