NVIDIA Developer Forums

GPU REQUIRED FOR Meta/Llama3-8b-instruct

Accelerated Computing NGC GPU Cloud Microsoft Azure Image

ramachandraus30 October 8, 2024, 8:07pm 1

What is the AZURE VM instance that I have to select for Meta/Llama3-8b-instruct model as there is very limited availability the NV series doesn’t work and for NC T4 I am getting memory errors

Topic		Replies	Views	Activity
NIM does not support llama-3.1-8b-instruct and llama-3.1-70b-instruct on GH200 On-Prem deployment Models nim , llama-31-8b-instruct , llama	1	86	November 7, 2024
Aunch NVIDIA NIM (llama3-8b-instruct) for LLMs locally Access/Accounts nim , llama3-8b-instruct	3	70	November 8, 2024
Profiles doesnt match machine even though specs are correct Models nim , llama-31-405b-instruct , llama	0	18	November 29, 2024
Issues while starting NIM container in A10 VM Models nim , llama3-8b-instruct	4	85	September 4, 2024
NIM - Llama 3 8B Instruct - Results were very weirdn Models nim	1	258	August 27, 2024
Can I use models like Llama-3-8B-Instruct-Coder with NIM? Models nim , llama	1	44	September 20, 2024
Unable to run TensorRT LLM on azure vm TensorRT	1	291	February 28, 2024
Recommend Compute for running a TensorRT-LLM using LLama2 13B & 70B model TensorRT	2	993	November 15, 2023
RuntimeError: NCCL Error 3: internal error - please report this issue to the NCCL developers GPU-Accelerated Libraries hpc , gpu , nccl	0	861	April 5, 2024
Azure N-Series Ubuntu VM - NVIDIA failing at boot NVIDIA Virtual GPU Drivers	2	1132	August 30, 2022

Powered by Discourse, best viewed with JavaScript enabled

翻译：