HACKER Q&A
📣 jschveibinz

Anyone working on natural language interface to 3D CAD?


This seems like a powerful next step for automated design and manufacturing? Thanks for contributing…


  👤 frading Accepted Answer ✓
I'm working on a procedural design & animation tool for WebGL ( https://polygonjs.com ), and I've recently added some early CAD modeling capabilities ( https://www.youtube.com/watch?v=6AoL2xRLiOs&t=1s ). One of my next steps is now to add natural language to setup those nodes.

So it won't be just for CAD, but more general 3D (material creation, physics, particles, etc). And it is very early in my research, so I'm still unsure how far things can go, or how usable could a scene created by this technique be. But it would at the very least help discover features, and try ideas even faster.


👤 eindiran
I've seen a few interesting ones:

https://github.com/gd3kr/BlenderGPT - actually an attempt to make something useful, though its working with meshes and not step files.

https://github.com/JennyList/Breakfast-by-ChatGPT - project to get GPT to output OpenSCAD. Mostly just messing around but interesting attempt nonetheless.

If I were gonna work on a tool in that space, I'd try to get it running with eg FreeCAD macros or OpenSCAD before trying to get it to work with something like Solidworks.

For anything sufficiently complex, a natural language interface is going to be hard though. How do you get it to understand you want it toleranced in Y way vs X way? How do you get it to fix the non-manifold mess it created by destroying all the constraints when you asked it to fillet something? Not impossible certainly, but a lot of work for the library.


👤 is_true
I built an app to generate a 2d cad in autocad. The use case is when someone has to draw the plans for an existing construction.

It's not using natural language, but now it could easily be modified to support it.


👤 kleer001
It's not exactly CAD, but it's motion graphics and cg:

https://spline.design/ai

I suspect someone else is working on the accuracy necessary for actual CAD work.