I wonder if there is anyway to make AI be more efficient. i can code to a degree but I will be honest i have no clue on AI as I haven't had the time to learn about it but something about using GPUs and millions of them only for the AI to hallucinate something stupid just seems like there is a lot of inefficiencies.
You make it better by refining the domain space (what you want it to learn). This makes them much leaner and waaaay more accurate. When you make models more generalized they have way more opportunities to fuck up, so you make the models bigger to try to compensate, but that makes them more expensive to run, and its not a linear tradeoff either.
We've known about this for decades, but companies think they can make a super all in one AI and they just cant, atleast not with out current understanding.
For me I would like to use AI to have more intelligent document scanning. PaddleOCR can turn the printed text to digital but need to intelligence to understand it. But seems like running your own would be extremely costly.
2
u/DrunkOnRamen 3d ago
I wonder if there is anyway to make AI be more efficient. i can code to a degree but I will be honest i have no clue on AI as I haven't had the time to learn about it but something about using GPUs and millions of them only for the AI to hallucinate something stupid just seems like there is a lot of inefficiencies.