You can explore Nvidia’s latest AI tool, Chat with RTX, if your PC boasts a recent Nvidia graphics card. This tool leverages generative AI capabilities on Windows PCs, utilizing “Nvidia RTX acceleration”, and other cutting-edge technologies.
Nvidia’s Chat with RTX is hailed as “local, fast, custom generative AI” tailored for Windows PCs. This implies significantly enhanced user privacy compared to alternatives like Bing Chat, Google Bard, and ChatGPT. Moreover, Nvidia’s Chat with RTX operates offline, offering users added convenience.
Utilizing a locally operated AI chatbot on your PC offers distinct advantages over cloud-based alternatives commonly used today. Nvidia emphasizes that “provided results are fast – and the user’s data stays on the device.”
You have the flexibility to input your own dataset into the AI chatbot by storing local files on your PC. Supported file formats include PDFs, Notepad text files, and Word documents. Additionally, you can enhance the AI’s knowledge base by incorporating information from YouTube videos through the software’s settings by simply adding the video link.
Nvidia’s Chat with RTX utilizes retrieval-augmented generation (RAG) to enhance the accuracy of large language models (LLMs). It also leverages TensorRT-LLM software in conjunction with your GPU hardware to operate seamlessly on Windows 10 and 11 PCs. Once you’ve provided Chat with RTX with diverse documents, notes, and videos, you can effortlessly engage with the information using its intuitive AI chatbot interface.
System Requirements & Download Location for Chat with RTX
As it’s a locally-run AI chatbot, the download size is substantial, currently standing at 35.1GB. It includes two large language models: Mistral and Llama 2. You can download Chat with RTX from Nvidia’s website by following this link.
Once the download is finished, you can extract the compressed archive and then proceed with the installation of Chat with RTX. However, make sure to fulfill certain prerequisites beforehand.
Windows PCs equipped with Nvidia GeForce RTX graphics cards can utilize the new Chat with RTX AI tool, provided they meet specific hardware prerequisites. Nvidia clarifies that this is a “demo app,” hinting at the possibility of a more feature-rich version in the future. The system requirements for the Chat with RTX AI tool include:
- 16GB RAM (or higher)
- Nvidia RTX 30 series or RTX 40 Series graphics card (with 8GB+ VRAM capacity)
- GeForce Driver v535.11 or later
- Windows 10 or 11
What are your impressions of Nvidia’s latest AI chatbot? Have you had the chance to give it a try? Share your thoughts with us in the comments section below! The prospect of running a personalized AI chatbot powered by the GeForce RTX graphics card is undeniably enticing, and we’re excited to put this tool to the test in the upcoming days.
0 Comments