Skip to content

Schema Migrations: wire in paused field into rpk#31077

Merged
pgellert merged 2 commits into
redpanda-data:devfrom
pgellert:slsr/rpk-sr-paused
Jul 14, 2026
Merged

Schema Migrations: wire in paused field into rpk#31077
pgellert merged 2 commits into
redpanda-data:devfrom
pgellert:slsr/rpk-sr-paused

Conversation

@pgellert

Copy link
Copy Markdown
Contributor

This PR updates the protobuf library rpk uses and surfaces the paused field of the config in rpk shadow describe outputs. Follow-up to #30984.

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v26.1.x
  • v25.3.x
  • v25.2.x

Release Notes

  • none

The core protobuf module now carries the paused field on
ShadowSchemaRegistryApi. Bump the go.mod dependency and the matching
buf.gen.yaml commit pin in lockstep (TestBufGenYamlCoreModuleVersion
guards the two against drift) and regenerate the proto comments.
@pgellert pgellert requested a review from a team July 13, 2026 13:27
@pgellert pgellert self-assigned this Jul 13, 2026
@pgellert pgellert requested review from a team, Copilot and nguyen-andrew and removed request for a team July 13, 2026 13:27
@pgellert pgellert requested review from a team, kbatuigas and r-vasquez as code owners July 13, 2026 13:27
@pgellert pgellert requested review from bartoszpiekny-redpanda and removed request for nguyen-andrew July 13, 2026 13:28
@pgellert pgellert added this to the v26.2.1-RC3 milestone Jul 13, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates rpk’s admin/v2 protobuf dependency and wires the new paused field for API-mode Schema Registry shadowing through rpk’s config types, mapping layer, and rpk shadow describe output, aligning rpk with the server-side schema introduced in the referenced follow-up work.

Changes:

  • Add paused to rpk’s ShadowSchemaRegistryAPI config model (JSON/YAML) and unmarshal tests.
  • Map paused to/from the adminv2 protobuf (SchemaRegistrySyncOptions_ShadowSchemaRegistryApi) and validate via mapper tests.
  • Surface paused in rpk shadow describe (table output + structured JSON/YAML describe output) and refresh protobuf inputs / generated comments.

Reviewed changes

Copilot reviewed 7 out of 9 changed files in this pull request and generated no comments.

Show a summary per file
File Description
src/go/rpk/pkg/cli/shadow/types.go Adds Paused to the Schema Registry API shadow config struct with JSON/YAML tags and inline docs.
src/go/rpk/pkg/cli/shadow/types_test.go Extends YAML/JSON unmarshal coverage to include paused: true for SR API mode.
src/go/rpk/pkg/cli/shadow/mapper.go Maps Paused into/out of the adminv2 protobuf message for SR API mode.
src/go/rpk/pkg/cli/shadow/mapper_test.go Updates mapping tests to assert paused round-trips correctly.
src/go/rpk/pkg/cli/shadow/describe.go Prints PAUSED in rpk shadow describe for SR API mode and includes it in structured describe output.
src/go/rpk/go.mod Bumps the buf.build/.../core/protocolbuffers dependency to a version that includes the new field.
src/go/rpk/go.sum Updates checksums for the bumped protobuf dependency version.
src/go/rpk/gen/protocomments/admin/v2/comments.pb.go Adds extracted protobuf field comment text for the new paused field.
buf.gen.yaml Updates the buf input module reference to the commit that contains the new proto field.
Files not reviewed (1)
  • src/go/rpk/gen/protocomments/admin/v2/comments.pb.go: Generated file

Surface the API-mode Schema Registry paused control in rpk, mirroring
the topic/consumer-offset/security/role sync options: add the field to
the user-facing config, map it both directions, and render it in
describe. Placement follows the sibling sync tasks (paused printed at the
top of the section, field near the top of the config struct).

Tested via the YAML/JSON unmarshal round-trips, the map/toCfg fixtures,
and TestShadowLinkConfigDrift, which walks the proto descriptor and fails
if the config struct is missing a field the proto carries.
@pgellert pgellert force-pushed the slsr/rpk-sr-paused branch from 81998d0 to 303068c Compare July 13, 2026 13:58
@pgellert

Copy link
Copy Markdown
Contributor Author

force-push: noop to retry snyk devex scan

@pgellert pgellert enabled auto-merge July 13, 2026 14:11
@vbotbuildovich

vbotbuildovich commented Jul 13, 2026

Copy link
Copy Markdown
Collaborator

CI test results

test results on build#87006
test_status test_class test_method test_arguments test_kind job_url passed reason test_history
FLAKY(PASS) InternalTopicProtectionLargeClusterTest test_consumer_offset_topic null integration https://buildkite.com/redpanda/redpanda/builds/87006#019f5bcc-44ca-408a-be8c-1733dc4d6f09 10/11 Test PASSES after retries.No significant increase in flaky rate(baseline=0.0031, p0=1.0000, reject_threshold=0.0100. adj_baseline=0.1000, p1=0.3487, trust_threshold=0.5000) https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=InternalTopicProtectionLargeClusterTest&test_method=test_consumer_offset_topic
FLAKY(FAIL) NodeWiseRecoveryTest test_node_wise_recovery {"dead_node_count": 1} integration https://buildkite.com/redpanda/redpanda/builds/87006#019f5bcc-44ca-408a-be8c-1733dc4d6f09 9/21 Test FAILS after retries.Significant increase in flaky rate(baseline=0.0225, p0=0.0000, reject_threshold=0.0100) https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=NodeWiseRecoveryTest&test_method=test_node_wise_recovery
FLAKY(PASS) NodeWiseRecoveryTest test_recovery_local_data_missing {"wait_for_final_manifest_uploads": true} integration https://buildkite.com/redpanda/redpanda/builds/87006#019f5bcc-44cc-495e-a0bb-f28b0ef95cb1 10/11 Test PASSES after retries.No significant increase in flaky rate(baseline=0.0229, p0=1.0000, reject_threshold=0.0100. adj_baseline=0.1000, p1=0.3487, trust_threshold=0.5000) https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=NodeWiseRecoveryTest&test_method=test_recovery_local_data_missing
FLAKY(PASS) NodeWiseRecoveryTest test_recovery_local_data_missing {"wait_for_final_manifest_uploads": true} integration https://buildkite.com/redpanda/redpanda/builds/87006#019f5bd1-2a2a-484a-9f0b-852ff2cfff66 18/21 Test PASSES after retries.No significant increase in flaky rate(baseline=0.0658, p0=0.3827, reject_threshold=0.0100. adj_baseline=0.1847, p1=0.2572, trust_threshold=0.5000) https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=NodeWiseRecoveryTest&test_method=test_recovery_local_data_missing
test results on build#87060
test_status test_class test_method test_arguments test_kind job_url passed reason test_history
FLAKY(FAIL) EndToEndCloudTopicsStorageModeToggleTest test_toggle_storage_mode null integration https://buildkite.com/redpanda/redpanda/builds/87060#019f5fc8-0269-4449-a404-9b654f7892ba 26/31 Test FAILS after retries.Significant increase in flaky rate(baseline=0.0238, p0=0.0053, reject_threshold=0.0100) https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=EndToEndCloudTopicsStorageModeToggleTest&test_method=test_toggle_storage_mode

@vbotbuildovich

Copy link
Copy Markdown
Collaborator

Retry command for Build#87060

please wait until all jobs are finished before running the slash command

/ci-repeat 1
skip-redpanda-build
skip-units
skip-rebase
tests/rptest/tests/cloud_topics/e2e_test.py::EndToEndCloudTopicsStorageModeToggleTest.test_toggle_storage_mode

@pgellert

Copy link
Copy Markdown
Contributor Author

/ci-repeat 1
skip-redpanda-build
skip-units
skip-rebase
tests/rptest/tests/cloud_topics/e2e_test.py::EndToEndCloudTopicsStorageModeToggleTest.test_toggle_storage_mode

@pgellert pgellert merged commit 62d5b56 into redpanda-data:dev Jul 14, 2026
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants