AI Evolves on Its Own: Anthropic Warns "Out of Control Without a Pause"

*Editor's Note: 'AI PRISM' (Personalized Report & Insight Summarizing Media) is an "AI-based customized news recommendation and summary service" developed with support from the Korea Press Foundation. It selects and provides six customized news items by reader type.

1. "Self-Evolving AI May Become Uncontrollable": Anthropic's Warning

- Key Summary: Anthropic has proposed an international agreement that could slow or temporarily halt development, warning that failure to control AI recursive self-improvement (RSI) could cause enormous social disruption. Based on Claude, the Opus 3 model handled a four-minute software task in March 2024, but within about a year, Opus 4.6 has advanced to the point of instantly handling 12-hour tasks. A Google DeepMind researcher said, "Recursive self-improvement is quietly happening at nearly every major AI lab," with interpretations that, if it leads to stronger AI regulation, pressure from schedule delays and rising costs at related developers could materialize. Meta has unveiled its AI recursive self-improvement research, "HyperAgent," taking a stance that emphasizes its utility value, and prospects are that strategic divergence among Big Tech firms could deepen depending on the direction of the regulatory debate.

2. Capital Flight from Broadcom Shock and SpaceX… "First Support Line Is 8,000"

- Key Summary: Broadcom presented its third-quarter AI-related revenue outlook at 16 billion dollars, falling short of market expectations, and combined with news that the SOCAMM capacity in Nvidia's next-generation platform "Vera Rubin" could be halved from 1,536GB to 768GB, the KOSPI plunged 5.54%. Foreign investors recorded net selling for 20 consecutive trading sessions, with cumulative net selling reaching 70.2 trillion won, while Samsung Electronics (005930) closed down 6.40% and SK hynix (000660) closed down 9.92%. A senior strategist at BNP Paribas Asset Management forecast that average selling prices for DRAM and NAND would peak in the middle of this year and turn downward from early next year, with aggressive production expansion by China's ChangXin Memory and Yangtze Memory acting as an additional variable in memory supply and demand. Securities firms presented the KOSPI's first support line at the 8,000 level but warned that, depending on conditions, the correction could widen to the lower 7,000 level, while investor deposits stood at a record high of 139.6948 trillion won as of Thursday, suggesting individual buying capacity still exists.

3. Robots, Autonomous Cars, Cloud… Follow "AI Godfather" Jensen Huang's Path to See the Future

- Key Summary: Nvidia CEO Jensen Huang visited Korea on Friday and met with SK Chairman Tae-won Choi, LG Chairman Kwang-mo Koo, and Naver Chairman Lee Hae-jin, moving to build comprehensive AI infrastructure partnerships spanning AI data centers, communications infrastructure, and cooling systems. With SK Group, he is expected to cement joint development of custom memory and an AI factory partnership, and with LG Group, cooperation on chiller systems and energy storage systems (ESS) to solve data center heat and power problems. At his meeting with Hyundai Motor Group Chairman Euisun Chung on Monday, a roadmap for building a 3 billion dollar Nvidia AI technology center and physical AI application center is expected to be finalized, with analysts suggesting that directions for advancing autonomous driving and humanoid robots will also be discussed, using Saemangeum as a base. In the business community, expectations are emerging that this visit will elevate the status of Korean companies beyond mere parts suppliers to key partners in the global AI ecosystem.

4. AI Revenue to Jump 100-Fold in 5 Years? SpaceX's 2,600 Trillion Won Valuation Controversy

- Key Summary: Goldman Sachs presented the entire company's valuation at 1.78 trillion dollars (about 2,600 trillion won), based on a forecast that the AI division (xAI) of SpaceX would expand more than 100-fold from 3.2 billion dollars in 2025 to 322 billion dollars in 2030. In response, Morningstar valued SpaceX's fair value at about 780 billion dollars (about 1,200 trillion won), analyzing it as falling short of even half the target. xAI has experienced organizational instability with 10 co-founders departing within two years of its founding, and there are assessments that Grok has not secured the market influence expected compared to competitors such as OpenAI and Anthropic. S&P Dow Jones rejected a proposed rule change that would allow index inclusion immediately after the listing of mega-cap companies like SpaceX, so SpaceX, scheduled to list on the 12th, is expected to be able to undergo S&P 500 inclusion review at least one year later.