The real-time artificial intelligence (AI) search summary service 'AI Overview' of the portal Daum will be operated based on domestic AI semiconductors and a domestic Large Language Model (LLM). This is the first commercialization case of 'Full-Stack Sovereign AI' in South Korea.
Upstage, FuriosaAI, and Daum's operator AXZ revealed a case of commercializing Daum's 'AI Overview' service, which mounts Upstage's LLM 'Solar' by utilizing FuriosaAI's neural processing unit (NPU) 'Renegade (RNGD)', through an online conversation participated in by the CEOs of each company on the 15th.
AI Overview is a service where when a user enters a question into a search box, a search engine finds related documents, and the Solar model summarizes and provides them in real time. Even if users do not open multiple links one by one, the AI organizes and shows the core content first.
The companies explained that this three-party cooperation is highly significant in that domestic AI semiconductors, a domestic LLM, and a large domestic service are connected as a single stack and actually operated, marking the first commercialization case of Sovereign AI.
Lee Kun-soo, CEO of AXZ, explained, “While developing the AI summary, we advanced harness engineering so that only accurate and latest information can be delivered by controlling the chronic hallucination phenomenon of LLMs,” adding, “We are delivering the most relevant and latest information to the Solar LLM using a hybrid search that combines existing keyword search and vector search.”
AI inference is handled by FuriosaAI's Renegade NPU. FuriosaAI emphasized that through an optimized design, it can achieve performance on par with Nvidia H200 while producing an inference cost reduction effect of more than 50%.
Baek Jun-ho, CEO of FuriosaAI, explained, “Currently, we are processing about 500 million tokens per day with 3 server nodes and 24 chips,” adding, “Renegade plays the role of accelerating the inference of the Solar model in AI Overview.”
Baek said, “As AI services expand, token usage increases sharply, but utilizing NPUs is advantageous compared to GPUs in terms of power-to-performance efficiency and cost-to-performance efficiency,” adding, “Currently, it is producing a cost reduction effect of at least 1.5 times based on Total Cost of Ownership (TCO), and once optimization is completed, it will be able to lower token costs by more than half.”
The three companies plan to expand their cooperation to AI agent services in the future. AXZ plans to expand the AI Overview service beyond simple summaries to vertical services such as shopping and restaurants. It is also preparing to distribute 'one agent per person' to Daum users. For example, even if a user holding Samsung Electronics stock does not search directly, it will summarize and deliver news, corporate information, and competitor trends.
Kim Sung-hoon, CEO of Upstage, stated, “As a virtuous cycle structure is achieved where the service quality improves as more users use the service, which in turn secures more users, we hope for a lot of interest (in building the domestic Sovereign AI ecosystem).”
Baek also said, “From a strategic perspective considering the international situation, the combination of Sovereign AI semiconductors, models, and services is necessary,” adding, “Please actively consider using domestic NPUs in the AX process of companies.”
