Wudi@feddit.uk to Technology@lemmy.worldEnglish · 2 months agoCalifornia’s Universities Went All In on A.I. The Result Has Been Chaoswww.nytimes.comexternal-linkmessage-square27linkfedilinkarrow-up1129arrow-down15
arrow-up1124arrow-down1external-linkCalifornia’s Universities Went All In on A.I. The Result Has Been Chaoswww.nytimes.comWudi@feddit.uk to Technology@lemmy.worldEnglish · 2 months agomessage-square27linkfedilink
minus-squarephutatorius@lemmy.ziplinkfedilinkEnglisharrow-up1·2 months ago It takes a certain amount of electricity to run That’s not a constant across all LLMs. There are big differences between LLMs in how much inference you get per watt-hour.
That’s not a constant across all LLMs. There are big differences between LLMs in how much inference you get per watt-hour.