CTC, Ricoh, and Ricoh Japan Launch Ultra-Compact Desk-Side AI Server Equipped with Ricoh-Developed LLM

Itochu Techno-Solutions Corporation (CTC) and Ricoh Company, Ltd. have jointly developed a solution that combines a compact desk-side AI server with a Ricoh-developed Large Language Model (LLM) to enable secure and easy use of generative AI in on-premises environments. This solution allows for the construction of an AI environment regardless of location, supporting everything from model verification to operational use. It will be available starting today through Ricoh Japan Corporation.

In recent years, corporate adoption of generative AI has rapidly shifted from Proof of Concept (PoC) stages to practical on-site operations. However, challenges such as handling confidential data, verifying model accuracy, and the burden of environment setup have created a demand for implementation methods that balance safety and speed.

The AI server in this solution features an ultra-compact chassis that can be placed at a desk, offering high mobility and computing power for running large-parameter LLMs in an on-premises environment. By combining this server with a Ricoh-developed LLM—which achieves high performance despite being relatively compact with 27 billion parameters—the solution enables secure AI utilization in any location.

CTC handles the configuration of the AI environment, including pre-installing the Ricoh LLM and the generative AI development platform 'Dify,' while Ricoh Japan provides it as a package. This allows customers to start using AI easily without complex configurations.

This solution is ideal for customers who require on-premises AI due to the risks of handling confidential information, as well as for those conducting AI operational verification, test deployments for company-wide adoption, or implementation at the departmental or individual level.

Ricoh and Ricoh Japan aim to support digital transformation (DX) in offices and workplaces by providing 'usable and masterable AI' tailored to specific industries and tasks. They offer a lineup of solutions, including the 'RICOH On-Premise LLM Starter Kit,' which packages everything from environment construction to implementation and operational support. The launch of this new solution further expands their lineup.

Leveraging its extensive SI experience and infrastructure construction expertise, CTC supports the optimization of the implementation process for this solution. By utilizing partnerships with vendors, CTC minimizes lead times. Furthermore, by handling everything from the preparation of configuration sheets and manuals to pre-shipment operational verification and logistics management, CTC significantly reduces the workload on-site. The companies will continue to lower the hurdles for AI adoption and strengthen the provision of value-added services to advance the sophistication of AI utilization.