Key Takeaways
- Training GPT-3 (175B parameters) consumed approximately 1,287 MWh of electricity
- Training BLOOM (176B parameters) used 433 MWh, equivalent to 33 households' annual consumption
- PaLM (540B) training required 2,700 MWh
- Single ChatGPT inference query uses 2.9 Wh, 10x more than GPT-3.5
- GPT-4 inference costs 0.0004 kWh per query
- Llama 2 70B inference on A100 uses 700W GPU power, ~0.2 Wh per token
- US data centers consumed 200 TWh in 2023, 4% of total electricity
- AI-driven data centers to consume 1,000 TWh by 2026, 4% global electricity
- Google data centers: 18.3 TWh in 2022, 15% for AI
- Training GPT-3 emitted 552 tons CO2e
- Global AI carbon footprint 2.7% of electricity emissions
- Data centers 2% global GHG emissions, AI accelerating
- AI to consume 85-134 TWh by 2027 (0.5% global elec)
- Data centers + AI to 8% US electricity by 2030 (1,000 TWh)
- Global AI energy 1,400 TWh by 2030 (4% world electricity)
AI training and inference use significant energy and emit CO2.
Carbon Emissions
Carbon Emissions Interpretation
Comparisons
Comparisons Interpretation
Data Centers
Data Centers Interpretation
Future Projections
Future Projections Interpretation
Inference Energy
Inference Energy Interpretation
Model Training Energy
Model Training Energy Interpretation
Sources & References
- Reference 1ARXIVarxiv.orgVisit source
- Reference 2SEMIANALYSISsemianalysis.comVisit source
- Reference 3AI21ai21.comVisit source
- Reference 4MICROSOFTmicrosoft.comVisit source
- Reference 5OPENAIopenai.comVisit source
- Reference 6THEGUARDIANtheguardian.comVisit source
- Reference 7PATELUDAYpateluday.medium.comVisit source
- Reference 8HUGGINGFACEhuggingface.coVisit source
- Reference 9MIDJOURNEYmidjourney.comVisit source
- Reference 10MLFORSUSTAINABILITYmlforsustainability.github.ioVisit source
- Reference 11EPOCHepoch.aiVisit source
- Reference 12Xx.aiVisit source
- Reference 13MISTRALmistral.aiVisit source
- Reference 14BLOGblog.googleVisit source
- Reference 15QWENLMqwenlm.github.ioVisit source
- Reference 16IEAiea.orgVisit source
- Reference 17GOLDMANSACHSgoldmansachs.comVisit source
- Reference 18GSTATICgstatic.comVisit source
- Reference 19BLOOMBERGbloomberg.comVisit source
- Reference 20EIAeia.govVisit source
- Reference 21SUSTAINABILITYsustainability.aboutamazon.comVisit source
- Reference 22ENGINEERINGengineering.fb.comVisit source
- Reference 23NVIDIAnvidia.comVisit source
- Reference 24NATUREnature.comVisit source
- Reference 25DATACENTERKNOWLEDGEdatacenterknowledge.comVisit source
- Reference 26VERTIVvertiv.comVisit source
- Reference 27BLOGSblogs.microsoft.comVisit source
- Reference 28AIai.meta.comVisit source
- Reference 29TECHNOLOGYREVIEWtechnologyreview.comVisit source
- Reference 30ARTIFICIALINTELLIGENCEACTartificialintelligenceact.euVisit source
- Reference 31BLOGblog.eleuther.aiVisit source
- Reference 32GREENPEACEgreenpeace.orgVisit source
- Reference 33APPLEapple.comVisit source
- Reference 34IBMibm.comVisit source
- Reference 35ANTHROPICanthropic.comVisit source
- Reference 36MCKINSEYmckinsey.comVisit source
- Reference 37BAINbain.comVisit source
- Reference 38DEEPMINDdeepmind.comVisit source
- Reference 39LIVEMINTlivemint.comVisit source
- Reference 40LESSWRONGlesswrong.comVisit source
- Reference 41VISUALCAPITALISTvisualcapitalist.comVisit source
- Reference 42IDCidc.comVisit source
- Reference 43JONATHANRAWFORDSjonathanrawfords.comVisit source
- Reference 44CNBCcnbc.comVisit source
- Reference 45SPECTRUMspectrum.ieee.orgVisit source
- Reference 46STRUBELLstrubell.comVisit source
- Reference 47ALJAZEERAaljazeera.comVisit source
- Reference 48HDSRhdsr.mitpress.mit.eduVisit source
- Reference 49FORBESforbes.comVisit source
- Reference 50CBScbs.nlVisit source
- Reference 51IRISHTIMESirishtimes.comVisit source
- Reference 52VKTRvktr.comVisit source
- Reference 53ELECTRICITYelectricity.loveVisit source






