Blank output of deepseek

AI & Data Science NVIDIA NIM Models
1

I am using deepseek r1 for a project. The prompt is large and model takes around 5-6 minutes for the complete response. I found that sometimes it giving me blank string as output instead of OpenAI response type output.
The same prompt is sometimes giving blank string as output and the correct response at other times.
I am using
client.chat.completions.create(
model=“deepseek-ai/deepseek-r1”,
messages=[
{“role”: “system”, “content”: “You are a software developer.”},
{“role”: “user”, “content”: },
],
temperature=,
top_p=,
)

Has anybody faced similar thing?

2

I want to call NVIDIA DEEPSEEK through API. How to set the API url and model name?

3

Hi @gefei2 - please see the right hand panel on this page. deepseek-r1 Model by Deepseek-ai | NVIDIA NIM It gives the code for calling the API through python, langchain, node or shell script.

Python example:

from openai import OpenAI

client = OpenAI(
  base_url = "https://integrate.api.nvidia.com/v1",
  api_key = "$API_KEY_REQUIRED_IF_EXECUTING_OUTSIDE_NGC"
)

completion = client.chat.completions.create(
  model="deepseek-ai/deepseek-r1",
  messages=[{"role":"user","content":"Which number is larger, 9.11 or 9.8?"}],
  temperature=0.6,
  top_p=0.7,
  max_tokens=4096,
  stream=True
)

for chunk in completion:
  if chunk.choices[0].delta.content is not None:
    print(chunk.choices[0].delta.content, end="")