Trace LlamaIndex with BotGauge

Records LlamaIndex LLM calls and framework spans.


Extra	`[llamaindex]`
Verified framework versions	llama-index-core 0.14.25
Instrumentor installed by the extra	`openinference-instrumentation-llama-index 4.6.0`
Zero-code run	Traced

Also verified: llama-index-core 0.14.25 with instrumentor 4.5.2. The extra no longer installs that older instrumentor. See supported frameworks for how verification works.

In code

Call tracing.init(), attach the framework instrumentor to the provider it returns, and wrap the work in tracing.turn() and tracing.agent().

Install

terminal

pip install "botgauge[llamaindex]" llama-index-core==0.14.25 llama-index-llms-openai==0.8.3 openai==2.54.0

Add the code

app.py

import os

from botgauge import tracing
from llama_index.core.base.llms.types import ChatMessage
from llama_index.llms.openai import OpenAI
from openinference.instrumentation.llama_index import LlamaIndexInstrumentor

provider = tracing.init()
LlamaIndexInstrumentor().instrument(tracer_provider=provider)

llm = OpenAI(model=os.environ["OPENAI_MODEL"], api_base=os.environ["OPENAI_BASE_URL"])

with tracing.turn(session_id="ses_llamaindex"), tracing.agent("llamaindex-agent"):
    reply = llm.chat([ChatMessage(role="user", content="In one sentence, what is OpenTelemetry?")])
print(reply.message.content)

tracing.shutdown()

Run

terminal

python app.py

Needs BOTGAUGE_API_KEY, OPENAI_API_KEY, OPENAI_MODEL, OPENAI_BASE_URL.

Zero-code

Leave your app unchanged and start it with botgauge instrument. The sample still wraps the work in tracing.turn() and tracing.agent() so spans carry session and agent ids.

Install

terminal

pip install "botgauge[llamaindex]" llama-index-core==0.14.25 llama-index-llms-openai==0.8.3 openai==2.54.0

Add the code

app.py

import os

from botgauge import tracing
from llama_index.core.base.llms.types import ChatMessage
from llama_index.llms.openai import OpenAI

llm = OpenAI(model=os.environ["OPENAI_MODEL"], api_base=os.environ["OPENAI_BASE_URL"])

with tracing.turn(session_id="ses_llamaindex"), tracing.agent("llamaindex-agent"):
    reply = llm.chat([ChatMessage(role="user", content="In one sentence, what is OpenTelemetry?")])
print(reply.message.content)

Run

terminal

botgauge instrument python app.py

Needs BOTGAUGE_API_KEY, OPENAI_API_KEY, OPENAI_MODEL, OPENAI_BASE_URL.

View LlamaIndex spans live

Watch your LlamaIndex LLM and framework spans appear in BotGauge.

Try BotGauge →

See versions not verified if you run a different version, capture and redaction to control exported content, and troubleshooting if spans are missing.

Frameworks

More

Trace LlamaIndex with BotGauge

In code

Zero-code

​In code

​Zero-code

​Related

In code

Zero-code

Related