eicker@lemmy.world to Technology@lemmy.worldEnglish · 1 month agoFederal Reserve Says AI Data Center Buildout Is Making Everything More Expensive: "I’m getting increasingly nervous that that’s just straight, old-fashioned overheating demand."futurism.comexternal-linkmessage-square18linkfedilinkarrow-up1178arrow-down16
arrow-up1172arrow-down1external-linkFederal Reserve Says AI Data Center Buildout Is Making Everything More Expensive: "I’m getting increasingly nervous that that’s just straight, old-fashioned overheating demand."futurism.comeicker@lemmy.world to Technology@lemmy.worldEnglish · 1 month agomessage-square18linkfedilink
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up6·1 month agoAnother factor is that model capabilities are topping out, but inference costs of cheaper models are absolutely plummeting. In other words, it’s a race to the bottom. And inference will become a dirt cheap commodity. …And what do we need all those datacenters for if inference is dirt cheap?
Another factor is that model capabilities are topping out, but inference costs of cheaper models are absolutely plummeting.
In other words, it’s a race to the bottom. And inference will become a dirt cheap commodity.
…And what do we need all those datacenters for if inference is dirt cheap?