logo

Can you self-host AI on Intel NPU or ARC (iGFX and proper card?

Posted by aweussom |3 hours ago |1 comments

aweussom 3 hours ago

Yes, I'd say so. Quite slow on NPU, of course, but still usable. And with the speed that good LLMs are getting smarter nowedays, it is a matter of months until we have something REALLY usable.

My Intel ARC iGFX spent about 7 hours analyzing 15.000 images. Slow, but it was done by the time I got up; So - fast enough!