AI Generated Models - Hype or Reality ?  

RE: AI Generated Models - Hype or Reality ?

1) yes

2) proprietary, cannot share, not to mention it is not publicly available at all

3) mixed, mainly image to model, can be also text to image and then image to model, this was just a small fun internal project.

Generally its doable and a matter of time and money to train the model

RE: AI Generated Models - Hype or Reality ?

Pics or it didn't happen 😉

RE:

Adding to the above reply, which reads as unnecessarily snarky.

I am still skeptical about the ability of LLMs to generate usable 3D models. In my experience, they represent a revolution in semantic interpretation, which should not be minimized -  but semantics only go so far. Put another way,  a neural network with sufficiently many inputs can generate text that looks "right-ish", or pictures that look "right-ish" - or even code that runs sometimes - but a 3D structure either stands or it doesn't, mechanical components either mesh or they don't.  They need to be right, not right-ish.

I have seen claims that models can be generated from LLMs writing OpenSCAD code. Having used the Github Co-Pilot against the Fusion360 API, what I have seen is that some of what it creates is usable, some is obviously wrong, and some looks right without actually being right. There is a huge difference between math.log_10() and math.log10(). In my experience, there is some time efficiency introduced in the coding process, but only if you can correct the output real time.

I don't see how you would ever be able to use this method to prompt the system to write a script to generate a model and then get an actual model on the other side without interference. Even with billions of lines of code as input and thousands of hours of training, the darn thing is still just predicting next sets of tokens from a given set of tokens using a statistical model. Any error in the prediction process will result in an unusable or unworkable model.

Mind you, I am open to being proved wrong. I just... need proof.

RE: AI Generated Models - Hype or Reality ?

I cannot provide you with any proof because as I said it is proprietary, I can say only generic stuff, unfortunately. The only thing I can say it was a request from one of the customers that stores certain data in some data platform.

Generally speaking it was just a set of agents (custom built and trained models on private data) which were trained from models to 3d renders and vice versa - from 3d renders or photos to model. Mix it with photogrammetry and laser scans, original design documents and you can have a warehouse of the mappings between the real objects to 3d models and model definitions. You create dedicated ML models and validation models, and this way you can have a tool for faster object generation. 

GPT models are in different domain and are just used in different context. The context is just different and thus is a core of creating a good model from the ground, and you require proper data to train it. That's why generic gpt models suck at certain tasks and need to be retrained to improve them. But in certain situations you need to start from different model from scratch and tou ned insane amount of clean data.

Lets say that the effect is similar to the Google Veo3 or Google Genie 3 in video or wold creation. Now swap it to the idea of model design. Now add automatic model validation based on the for example fluid simulation, and you auto iterate with the model creation and validation loop. So you start with a basic almost right model and you force run validation checks and regenerate thousands of models to with different small variations untile you fix those imerfections. Atwr reaching certain point you are ready to have a model for prototyping and you can fine tune it manually. Similiar things happen already in coding like CoPilot.

RE: AI Generated Models - Hype or Reality ?

And here it is https://develop3d.com/cad/autodesk-unleashes-neural-cad-3d-generative-ai-foundation-models/

RE: AI Generated Models - Hype or Reality ?

Just for laughs, this into chatGPT:

can you please generate a 3d-printable .step file of a 20 mm cube with one perpendicular 8 mm deep hole centered on every side with a diameter of 2.5 mm?

I actually got two answers with a request for feedback on the better one... first one had two holes in the correct direction, the second one four 🙂 

Still, even after fixing the sign errors this would have been much faster than doing it manually. 

Now with some experience on the human end, this may be indeed a mighty tool. ChatGPT can be reasoned with e.g. it initially refused to quote patent claims literally. I told it US patents are in the public domain and (after some thinking) I got what I wanted.

RE: AI Generated Models - Hype or Reality ?

As for ownership, anything an AI creates can't legally be owned since nearly 99.999% of what trained it is public domain; fair use trumps everything at that point. If I ask an AI to create an image of a girl sitting with her toes in the surf, whatever the AI generates came from someone else's work.  Now, prove that AI 'saw' something and created the art from personal memory, we'd have something to chat about.

Not an attorney, so YMMV. 

RE: AI Generated Models - Hype or Reality ?

Legal issues are already handled in the AI - this was pretty hot topic for the 2024 in some companies. The easiest thing was changing EULA and adding things related to AI there, the hardest was actually combing through the datasets and licenses and selecting which one can be legally used ( and this is is still happening and will be in the future).

Ass to it the fact that there are some huge private data collections that can be used to train the models in restricted environments or special setups if they are allowed publicly.

We already see models helping in design, but the output still requires human inspection, just like in any other places.

Its going to be a tool just like any other, and surely will reshape any industry. I just hope some managers will not go hyped and start to fire people thinking ai will replace them, to get people back after 2 years realizing it was a bad idea 🙂

RE: AI Generated Models - Hype or Reality ?

More importantly, when will we be able to filter them out of our results so we can avoid the avalanche of slop?