Skip to content

fix(client): paginate large dataframe span exports - #15584

Open
Hasnaathussain wants to merge 1 commit into
Arize-ai:mainfrom
Hasnaathussain:fix/11873-paginated-dataframe-export
Open

fix(client): paginate large dataframe span exports#15584
Hasnaathussain wants to merge 1 commit into
Arize-ai:mainfrom
Hasnaathussain:fix/11873-paginated-dataframe-export

Conversation

@Hasnaathussain

Copy link
Copy Markdown

Resolves #11873

The common unfiltered get_spans_dataframe() path now uses the existing cursor-paginated spans endpoint and combines all pages into the same dataframe shape. This avoids sending a large export through the legacy single-request query endpoint.

Queries that use the SpanQuery DSL or root_spans_only keep the legacy endpoint so their existing filtering semantics are unchanged. Both sync and async clients are covered.

Verification:

  • 41 spans resource tests passed
  • Ruff checks and formatting passed
  • Mypy passed for the spans resource
  • DCO sign-off included

Use the cursor-paginated span endpoint for unfiltered dataframe exports while preserving the SpanQuery DSL path. Add sync and async regression coverage for multi-page conversion.

Signed-off-by: Hasnaat Hussain <hasnaat.hussain.2@gmail.com>
@Hasnaathussain
Hasnaathussain requested a review from a team as a code owner August 22, 2026 04:40
Copilot AI lite review requested due to automatic review settings August 22, 2026 04:40
@github-project-automation github-project-automation Bot moved this to 📘 Todo in phoenix Aug 22, 2026
@dosubot dosubot Bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Aug 22, 2026

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@github-actions github-actions Bot added the triage issues that need triage label Aug 22, 2026
@github-actions

github-actions Bot commented Aug 22, 2026

Copy link
Copy Markdown
Contributor

All contributors have signed the CLA ✍️ ✅
Posted by the CLA Assistant Lite bot.

@Hasnaathussain

Copy link
Copy Markdown
Author

I have read the CLA Document and I hereby sign the CLA

@Hasnaathussain

Copy link
Copy Markdown
Author

recheck

github-actions Bot added a commit that referenced this pull request Aug 22, 2026
@Hasnaathussain

Copy link
Copy Markdown
Author

The visible checks for #15584 (CLA, external-issue labeling, and the four Read the Docs builds) are green. The Python, TypeScript, Playwright, Semantic PR, Claude review, publish, zizmor, and phoenix-sqlean workflows are held in action_required before any job starts on this forked PR. Could a maintainer approve the queued workflows when convenient? Local focused tests, Ruff, mypy, and diff checks pass; no code-caused failure is known.

@cephalization cephalization removed the triage issues that need triage label Aug 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:M This PR changes 30-99 lines, ignoring generated files.

Projects

Status: 📘 Todo

Development

Successfully merging this pull request may close these issues.

[BUG]: get_spans_dataframe() returns 504 and degrades Phoenix UI when fetching large span datasets

4 participants