Exporting Chat Logs from Common LLM Logging Systems

This guide summarizes how to pull your conversational traces or logs out of popular LLM observability platforms so you can bring them into Hyperparam.

Langfuse

  • Use the Exports tab in the Langfuse UI to download data as CSV or JSON.
  • Available tables: traces, datasets, and audit logs.
  • Select the dataset, choose the file format, and click Export to start a one-time download.

Arize Phoenix

  • Navigate to the tracing interface, then open the Export panel.
  • Phoenix supports CSV downloads for trace tables.

LangSmith

  • Set up Bulk Data Export under Settings → Integrations.
  • Configure a destination such as BigQuery, Snowflake, AWS S3, or other supported warehouses.
  • The service pushes trace data on a schedule.

Datadog

  • Enable Log Archives for your Datadog organization and choose S3 or GCS as the sink.
  • Archives arrive as .json.gz files partitioned by time.
  • For ad hoc pulls, open Logs Explorer, run a query, and click Export to retrieve a JSON snapshot.

Grafana Loki

  • Install or open logcli, Grafana Loki's command-line client.
  • Run queries locally and redirect the response to disk:
logcli query '{app="llm"}' --limit=5000 --output=json > llm-traces.json
  • Use --output=raw if you prefer plain log lines.

Honeycomb

  • After running a query in the Honeycomb UI, choose Actions → Download Results to export CSV or JSON.
  • For large result sets, paginate through time windows or use the API to fetch segments iteratively.
  • The Events API supports programmatic extraction.
Exporting Chat Logs from Common LLM Logging Systems - Hyperparam