Jump to content

Colossus (supercomputer)

From Wikipedia, the free encyclopedia

Colossus is a supercomputer developed by xAI, an artificial intelligence (AI) company owned by Elon Musk. The company began construction on the computer in 2024 in Memphis, Tennessee, and are continuing to expand the project today. It is currently believed to be the world's largest AI supercomputer.[1] Its purpose is to train the company's AI language model, Grok, and support the social media service X. It also serves as a hub for Musk's other companies, including SpaceX.[2]

Background

[edit]

The supercomputer was launched in September 2024, at the former Electrolux site on 3231 Paul R. Lowry Road in South Memphis with the purpose of training the AI language model Grok.[2] Reportedly, within 19 days of the project's conception the company was ready to begin construction. In comparison, other data centers have taken an average of four years to finalize the plans for a project, ship the equipment, and have it installed.[3]

The site of the Colossus Supercomputer in South Memphis

A supercomputer is "high-speed and high-functioning computer system capable of performing tasks faster than regular computers." Like a brain, it takes in and puts out information and is capable of solving solving complex problems.[4]

The site was chosen because the abandoned Electrolux building could be repurposed to expedite construction.[5] Another advantage of the site was proximity to a nearby wastewater treatment facility providing a water source. As of February 2025 xAI plans to build an $80 million facility to process additional wastewater for use at the supercomputer.[6]

xAI

[edit]

Musk incorporated xAI in March 2023 with the stated purpose of understanding the "nature of the universe".[7] The team includes former members of OpenAI, DeepMind, Microsoft, and Tesla. Musk has a history of involvement in artificial intelligence; he was one of the founding members of the company OpenAI, although the extent of his financial contribution is unknown. He left OpenAI in 2018, reportedly to avoid conflicts of interest with his own company, Tesla. However, it has also been reported that he had made a bid for leadership at OpenAI and left when his proposal was rejected.[7] The exact reasons for his departure with the company remain unclear.

Elon Musk, founder of xAI

Both Dell Technologies and Supermicro partnered with xAI to build the supercomputer. It was originally powered by 100,000 Graphic Processing Units (GPUs) and was constructed in 122 days.[8] The chips were supplied primarily by the tech company Nvidia, which currently manufactures some of the most powerful processing chips on the market. Each GPU is housed within one of Supermicro's 4U Universal GPU Liquid Cooling Systems to prevent overheating.[9] Ninety-two days after the first 100,000 GPUs were built,[8] xAI announced that they had increased the system to 200,000 GPUs and that they intended to continue increasing the computer's processing power to 1 million GPUs.[10][11] Colossus is currently the largest AI training platform in the world.[8]

Grok

[edit]

Grok, xAI's AI language mode powered by Colossus, is intended to be "...your truth-seeking AI companion for unfiltered answers with advanced capabilities in reasoning, coding, and visual processing".[12] The chatbot is heavily inspired by science fiction; the name Grok derives from a term coined by author Robert A. Heinlein in his 1961 novel Stranger in a Strange Land to describe the ability  "...to understand intuitively or by empathy, to establish rapport with..." and it is modeled after the irreverent and dry humor of The Hitchhiker's Guide to the Galaxy.[13] Grok1 was initially launched in 2023, and several versions have been released since. The most recent, Grok3, was announced in February 2025 and is currently in its beta testing phase.[14]

X

[edit]

X (formerly Twitter) was acquired by xAI on March 28, 2025.[citation needed] As a result, the platform would be integrated further with xAI's models which are powered by Colossus. New features using this integration include a Grok-powered home feed and algorithm.[15][better source needed]

Choice of location

[edit]
Memphis skyline

Musk and xAI chose Memphis for this project primarily because it offered a ready-made home for Colossus in the former Electrolux site.[5] Musk was initially told that building the data center would take 18-24 months. He stated how this extended construction timeline “...means losing is a certainty…only option is to do it ourselves.” [16] Musk instead began looking for a vacant and existing building, and this was when he found the Electrolux factory in Memphis, Tennessee. The global appliance maker Electrolux first opened the facility in 2012, but it shut down in 2020 to relocate to Nashville.[17] The center is 785,000 square foot and was previously purchased by Phoenix Investors in December 2023 for $35 million.[17] Using an existing space rather than building one from the ground up allowed the company to begin working on the computer immediately. Tedd Townsend, Greater Memphis Chamber president and CEO, revealed to Forbes that xAI had considered seven or eight other sites before selecting Memphis.[18] Townsend also stated it took Musk about a week to finalize this decision to build the new supercomputer for xAI in Memphis. With this finalization completed in March 2024, the construction of the supercomputer started right away. The announcement that Colossus would be built in Memphis was made during a press conference in June.[2]

The building was not the only incentive xAI had to choose Memphis, however. In the Greater Memphis Chamber’s website, it also states that the company chose Memphis because of its “reliable power grid, ability to create a water recycling facility, proximity to the Mississippi (River) and ample land." [4] Altogether, the city had the ability to provide the massive amounts of energy needed to run the machine. The site continues to go into detail about how the AI company would benefit from the collaboration with local organizations such as Memphis Light, Gas and Water (MLGW), Tennessee Valley Authority (TVA), the City of Memphis, and Shelby County. It emphasizes the importance of these partnerships, especially once the supercomputer reaches full capacity, which will require millions of gallons of water daily and 150 megawatts of electricity.[2] The city also provided financial incentives to the company, understanding how the presence of the supercomputer could turn Memphis into a tech hub. The ability of the Greater Memphis Chamber to expedite approvals and negotiations also allowed for the project's quick initiation, which was deeply important to Musk and the xAI team.[19]

Environmental impact

[edit]

AI requires more electricity to complete even simple tasks compared to typical search queries.[20] A majority of the energy needed to generate the answers in AI queries comes from burning fossil fuels such as coal and gas, which are leading drivers of climate change.[20] The United States is currently home to a third of the all data centers worldwide. Utility companies are adding new gas plants, while older power plants are redeveloped to meet the demand in a booming AI industry. Clean energy deployments cannot keep pace with the rapid expansion of AI data centers.[21]  AI requires power from thousands of servers that are contained in data centers, such as Colossus, and these data centers require "extensive amounts of energy".[21]

At the site of Colossus in South Memphis, xAI applied to temporarily set up more than one dozen gas turbines, which would steadily burn methane gas.[2] However, according to advocacy groups, aerial imagery in April 2025 showed 35 gas turbines had been set up. These turbines have been estimated to generate about "421 megawatts, which compares to the capacity of an entire (TVA) power plant".[22] According to the Southern Environmental Law Center (SELC), the higher number of gas turbines and the subsequent emissions requires xAI to have a 'major source permit,' however, the company continues to operate with no permits at all.[23] In Memphis, Musk's xAI was able to sidestep some environmental rules in the construction of Colossus, such as operating without permits for the on-site methane gas turbines because they are "portable". The Shelby County Health department told NPR that "it only regulates gas-burning generators if they're in the same location for more than 364 days.[2] xAI plans to eventually draw power from MLGW.

In the historically Black neighborhood of South Memphis, poor air quality has given residents elevated asthma rates and lower life expectancy.[24] A ProPublica report found that the cancer risk for those living in this area already have four times the risk of cancer than what the Environmental Protection Agency (EPA) considers to be an acceptable risk.[24]

Along with high electricity needs, the expected water demand is over five million gallons of water per day in "... an area where arsenic pollution threatens the drinking water supply." This is reported by the non-profit Protect Our Aquifer, a community organization founded to protect the drinking water in Memphis.[25]

According to MLGW, their customers will reap some benefits from the xAI project as well. The project is expected to create around 300 high-paying jobs. Additionally, xAI is partnering with the City of Memphis, MLGW and TVA to construct a "... graywater/recycled wastewater facility that will take in treated wastewater and produce water suitable for cooling processes," putting recycled wastewater to productive use and reducing the daily draw on Memphis' aquifer by up to 10 million gallons per day.[26] Yet, there are no concrete plans for the promised wastewater facility, only the one-page factsheet shared by MLGW.[27]

Community response

[edit]

The plan to build Colossus in Memphis was kept secret from residents, City Council members, and environmental agencies in Memphis. Many did not find out about the project until the day before, or the day of as they watched the announcement on the local news.[2] Keshaun Pearson, president of Memphis Community Against Pollution stated that there is a historical lack of transparency and communication surrounding environmental issues in Memphis.[28] Some community members in Memphis have expressed concern about the potential for additional air and water pollution caused by the supercomputer. In a letter to the Shelby County Health Department, the Southern Environmental Law Center stated the emissions from the turbines make the facility "...likely the largest industrial emitter of NOx in Memphis..."[22] This is due to data supplied by the manufacturer showing that "...xAI emits between 1,200 and 2,000 tons of smog-forming nitrogen oxides (NOx)..."[22]

At a public Shelby County Commissioner's hearing on April 9, 2025, residents living near the site of Colossus voiced complaints about air quality noting that they have chronic respiratory issues related to living in a polluted section of Memphis. One woman said she smells "everything but the right thing and the right thing is the clean air." Other residents voiced frustration that Brent Mayo, the senior xAI official responsible for building out xAI's infrastructure, did not show up to the meeting to discuss concerns with the community.[29]

Keshaun Pearson also stated that "We're getting more and more days a year where it is unhealthy for us to go outside."[28] People living near the site of Colossus have said they were not offered the opportunity for a public review of the plans nor were they provided with information for how their community could potentially benefit.[2]

The community is concerned about strain on the power grid as well. In November 2024, TVA approved xAI's request for access to more than 100 megawatts of power, enough electricity to power 100,000 homes, to Colossus which is supplied by MLGW.[30] This fear is not unfounded, as the electric grid in Tennessee, including Memphis, has been strained during previous extreme weather events. In December 2022, MLGW imposed (then rescinded) rolling blackouts during several days of extreme cold that put a strain on the power grid.[31] In a letter to the TVA, the SELC "urged the agency to 'prioritize Memphis families' access to reliable power over the 'secondary purpose' of serving xAI".[28]

Current progress

[edit]
Tesla Inc. Megapack battery

In early December 2024, Ted Townsend detailed how the power of Colossus doubled in its processing capability. When it first went online, “it was using 100,000 Nvidia H100 processing chips.” [32] Still, this initial launch demonstrated Colossus to be the largest supercomputer globally. The expansion of this supercomputer has already been discussed and will be the second phase of the project. It is stated that it will add 320 new jobs. Not only that, but in its expansion, xAI also plans to increase Colossus to 1 million graphic processing units.[33] Since the current state of the supercomputer is using gas turbines for power, it is temporarily relying on them alongside Tesla Mega Packs. As part of this prospective expansion, xAI is also looking to add more Mega Packs, which could later allow the center to no longer depend on Memphis’s gas and water grid. Townsend also mentioned how xAI “is [also] expected to act as a data hub for Musk's other companies, including X and SpaceX.” [32]

The expansion continues as of recently, where xAI has purchased a 1 million sq ft site in the Whitehaven area of Memphis. This was announced by the Greater Memphis Chamber in early March 2025. [34] xAI employee Brent Mayo states how the addition of this property “...ensures [they will] remain at the forefront of AI innovation…in Memphis.” [34] The property was bought for almost $80 million and transferred specifically to CTC Property LLC, an affiliate of Musk's xAI. The Memphis City Council has also approved xAI's wastewater recycling plant expansion. Plans for this expansion were initially revealed by the Tennessee Department of Environment and Conservation when preliminary plans for the facility were filed on September 18, 2024, for this project “...between xAI, Tennessee Valley Authority (TVA), and Nucor Steel...” [35] At the time, xAI representatives detailed its estimated cost to be $78 million, which was to be privately funded. In March 2025, approval was officially granted for this expansion, including “...the sale of 13 acres for a wastewater recycling plant near the supercomputer in southwest Memphis.” [36] The final cost of the project was revealed to be $80 million for construction.

With xAI selecting Memphis as the site of Colossus, the companies Nvidia, Dell, and Supermicro reportedly have plans to set up operations in the Memphis market. This will make "the city the 'global epicenter of artificial intelligence.'"[37]

See also

[edit]

References

[edit]
  1. ^ Wicks, Myracle; Haywood, Tarvarious; Bolden, Bria (June 5, 2024). "Elon Musk's xAI to build multi-billion-dollar supercomputer project in Memphis". www.actionnews5.com. Retrieved April 25, 2025.
  2. ^ a b c d e f g h Kerr, Dara. "How Memphis became a battleground over Elon Musk's xAI supercomputer". NPR. Retrieved April 26, 2025.
  3. ^ Aaron Klotz (October 14, 2024). "Elon Musk set up 100,000 Nvidia H200 GPUs in 19 days - Jensen says process normally takes 4 years". Tom's Hardware. Archived from the original on March 30, 2025. Retrieved April 25, 2025.
  4. ^ a b "xAI". Greater Memphis Chamber. Retrieved April 27, 2025.
  5. ^ a b Fayard, Megan (February 19, 2025). "Elon Musk finally reveals 'why Memphis' for xAI supercomputer". WREG.com. Archived from the original on April 1, 2025. Retrieved April 26, 2025.
  6. ^ Gooding, Matthew (February 21, 2025). "Elon Musk's xAI plans $80m wastewater treatment plant to service Memphis supercomputer". www.datacenterdynamics.com. Retrieved April 26, 2025.
  7. ^ a b Henshall, Will (July 12, 2023). "What to Know About Elon Musk's New AI Company, xAI". TIME. Retrieved April 26, 2025.
  8. ^ a b c "Colossus | xAI". x.ai. Archived from the original on April 18, 2025. Retrieved April 25, 2025.
  9. ^ Dallin Grimm (October 28, 2024). "First in-depth look at Elon Musk's 100,000 GPU AI cluster — xAI Colossus reveals its secrets". Tom's Hardware. Retrieved April 25, 2025.
  10. ^ Hetzner, Christiaan. "Elon Musk's just fired up 'Colossus'—the world's largest Nvidia GPU supercomputer". Fortune. Archived from the original on February 4, 2025. Retrieved April 23, 2025.
  11. ^ Morris, Stephen; Kinder, Tabby (December 4, 2024). "Elon Musk plans to expand Colossus AI supercomputer tenfold". Financial Times. Archived from the original on December 4, 2024.
  12. ^ "Grok | xAI". x.ai. Retrieved April 26, 2025.
  13. ^ Sircar, Anisha. "The 'Unhinged' AI Chatbot: How Elon Musk's Grok Is Shaking Up Social Media". Forbes. Retrieved April 26, 2025.
  14. ^ "Grok 3 Beta — The Age of Reasoning Agents | xAI". x.ai. Retrieved April 27, 2025.
  15. ^ Elon Musk (April 25, 2025). "A much improved Grok-powered algorithm is coming. Should help a lot". X (formerly Twitter). Archived from the original on April 26, 2025. Retrieved April 27, 2025.
  16. ^ "xAI". X (formerly Twitter). Archived from the original on April 26, 2025. Retrieved April 27, 2025.
  17. ^ a b Green, Jordan. "Is Elon Musk's xAI coming to Memphis Electrolux site? Why facility has been vacant and what to know". The Commercial Appeal. Retrieved April 27, 2025.
  18. ^ Emerson, Sarah. "How Memphis Became the Site of Elon Musk's xAI Supercomputer". Forbes. Retrieved April 27, 2025.
  19. ^ Hanley, Steve (December 19, 2024). "Musk & xAI Colossus Brings Spike In Emissions & Demand For Electricity To Memphis". CleanTechnica. Retrieved April 26, 2025.
  20. ^ a b Kerr, Dara. "AI brings soaring emissions for Google and Microsoft, a major contributor to climate change". NPR. Retrieved April 26, 2025.
  21. ^ a b Galarza, Michaela (April 15, 2025). "To power AI, data centers need more and more energy". The Current. Retrieved April 26, 2025.
  22. ^ a b c Kolodny, Lora (April 11, 2025). "Elon Musk's xAI is polluting air in Memphis, using more gas turbines than permitted, advocacy group says". CNBC. Retrieved April 26, 2025.
  23. ^ Johnson, Chauncy (April 9, 2025). "Memphis xAI datacenter nearly doubles its gas turbines 'without any permit,' SELC says". WMC. Retrieved April 26, 2025.
  24. ^ a b Shaw, Al; Younes, Lylla (November 2, 2021). "The Most Detailed Map of Cancer-Causing Industrial Air Pollution in the U.S." ProPublica. Retrieved April 26, 2025.
  25. ^ "Protect our Aquifer". www.protectouraquifer.org. Retrieved April 26, 2025.
  26. ^ "Memphis Light, Gas and Water - Error". www.mlgw.com. Retrieved April 26, 2025.
  27. ^ Adams, Ben (November 4, 2024). "It's not too late for Elon Musk to take Memphis's environmental health seriously". Harvard Public Health Magazine. Retrieved April 26, 2025.
  28. ^ a b c Penn, Ivan; Conger, Kate (October 31, 2024). "Why a Memphis Community Is Fighting Elon Musk's Supercomputer". The New York Times. ISSN 0362-4331. Retrieved April 27, 2025.
  29. ^ Nugent, Desmond (March 31, 2025). "Shelby County Commission passes resolution for public hearing on xAI gas turbine request". WATN. Retrieved April 27, 2025.
  30. ^ Royer, David; Selph, Alan (November 7, 2024). "TVA approves xAI request for electricity supply". WREG.com. Archived from the original on November 11, 2024. Retrieved April 27, 2025.
  31. ^ Dries, Bill. "MLGW to start systemwide rolling blackouts, Strickland declares state of emergency". Daily Memphian. Retrieved April 27, 2025.
  32. ^ a b Strebig, Neil. "Memphis Chamber: Tech giants Nvidia, Dell and Super Micro looking to join xAI in Bluff City". The Commercial Appeal. Retrieved April 27, 2025.
  33. ^ "xAI Memphis Announces Expansion Of Supercomputer with Addition Of Tech Companies In Digital Delta". Greater Memphis Chamber. Retrieved April 27, 2025.
  34. ^ a b Davis, Deja (March 7, 2025). "xAI purchases 1 million-square-foot property in Memphis". WREG.com. Archived from the original on April 4, 2025. Retrieved April 27, 2025.
  35. ^ Strebig, Neil S (October 2, 2024). "Plans filed for $78 million greywater facility for xAI supercomputer in Memphis". Memphis Commercial Appeal. Retrieved April 27, 2025.
  36. ^ Cerda, Carolyn (March 19, 2025). "City council approves xAI expansion for wastewater recycling plant". FOX13 Memphis. Retrieved April 27, 2025.
  37. ^ Gooding, Matthew (December 5, 2024). "xAI targets one million GPUs for Colossus supercomputer in Memphis". www.datacenterdynamics.com. Retrieved April 27, 2025.
[edit]