Case Study: Kakao
Custom Solution to Support a Leading Internet Company’s Multi-Platform AI Business
Industry: Internet, Cloud Service Provider
Products: NF5468M5, NF5180M5, NF5280M5
Kakao is a global internet company based in South Korea, best known for its flagship platform KakaoTalk which supports free mobile instant messaging and call features for over 220 million users worldwide. Kakao’s sweeping business model also includes numerous platforms spanning travel, mobile banking, AI/blockchain, games, music, video, maps, and transportation.
Throughout Kakao’s expansion, it required new technology and platform development to meet the needs of its multifaceted business, growing scope and user base, massive data volumes and daily maintenance. These factors demand higher requirements on the computing performance, interconnection and scalability of the AI servers supporting the Kakao business. Artificial intelligence became one of its foremost priorities with its products Kakao i (AI platform) and Kakao Mini C (smart speakers). Kakao i’s capabilities include voice, visual and dialogue recognition, recommendation, translation, etc., which Kakao Mini C integrates to provide content recommendations like news, stock exchange, multimedia, and real-time popular searches.
Artificial intelligence development requires competitive features, model training and a comprehensive technology ecosystem. At the initial establishment of Kakao’s AI Lab, Inspur provided Kakao with a product portfolio solution – Inspur’s high-density NF5468M5 inference server at the core, supplemented by NF5180M5 and NF5280M5 general purpose servers – and passed the first test verification, thereby helping to kick off Kakao’s AI business model.
1) Product portfolio for various scenarios and a complete ecosystem
In order to satisfy the data layering and data storage demands of the client’s business, Inspur combined several different products: general-purpose NF5180M5 configured with different hard disks for data layering optimized the computation, operation and management functions of Hadoop cluster data, while the NF5280M5 model provided flexible configuration and high-density deployment. In addition to supporting multiple types of hard drives for data storage, it also provided audio service support by matching 4 TA GPU cards. When it came to meeting clients’ requirements for power redundancy, the NF5468M5-S was the best choice: 40 units adopting NVLink technology in a single machine can support up to 4 2200W power supplies, 4 PCIe-switches ensure load balancing, and superb scalability and heat dissipation design all contribute to excellent performance. In combining NF5180M5, NF5280M5 and NF5468M5-S models, Inspur was able to achieve customer requirements for adapting to various application scenarios like Hadoop, audio services, and AI computing.
2) Complete channel network & self-developed components guarantee agile delivery
Responding to the explosive growth of customer businesses, Inspur established a complete channel network and self-developed components to shorten the procurement cycle and achieve extremely agile delivery. Maintaining regular communication and training with channel partners in the early testing phase enhances their understanding of the systems at hand, and enables distributors to better comprehend customer requirements during the stocking and distribution process. Meanwhile, using components independently developed by Inspur, like SAS and PHY cards, not only shortens the supply cycle, but also reduces the overall cost. By controlling the entire process from production to launch, it took only 25 days from the customer’s order to the final deployment of the solution.
Results and Impact
As the technology continues to iterate and update, Kakao continues to enhance existing AI products Kakao i and Kakao Mini C while developing new AI platforms. By using the NF5468M5 of NVLink technology to build an AI training platform, the cluster performance and linear scalability of the Kakao i AI platform have increased by more than 30% compared with other servers. Kakao Mini C’s human-computer interaction has greatly improved as well. With continued real-time analysis of voice, user habits, and content data, it is able to provide more timely and natural responses to a broader range of user queries, providing a further optimized user experience.
With the computing performance and support provided by Inspur’s solution, Kakao is able to continuously analyze data to build user behavior models, depict user portraits, and push better customized content for users. Kakao’s AI products have since made vast improvements in Hadoop’s data operations, audio analysis, and AI calculations, bringing a wider range of AI applications to its business.