Edge Generative AI System
Advantech has the successful integration of the NVIDIA Generative AI Platform with Advantech's MIC-733-AO, based on NVIDIA® Jetson AGX Orin™. This integration enables AI developers to benefit from greater immediacy, enhanced security, and reduced internet costs compared to cloud-based generative AI. The NVIDIA Generative AI Platform offers a free foundational AI model, enabling customization and significantly reducing development time with the MIC-733-AO Edge Generative AI System.
Advantech's MIC-733-AO Edge Generative AI System, compatible with the NVIDIA Generative AI Platform, now efficiently runs large language models (LLMs), vision transformers, and stable diffusion locally, thanks to its NVIDIA® Jetson AGX Orin™. The platform's unique offerings span multiple layers, including accelerated computing, vital AI software, and pre-trained models, facilitating the creation, customization, and deployment of generative AI models suitable for various applications and locations.
With the NVIDIA Generative AI Platform, developers can leverage the retrieval-augmented generation (RAG) technique, connecting LLMs to a company’s knowledge base. This approach eliminates the need for traditional AI model training, allowing simple conversational interactions with the system to yield AI inferences, significantly shortening development time.