Skip to content

Clarify which cluster properties are configurable in Redpanda Cloud#627

Merged
micheleRP merged 2 commits into
mainfrom
clarify-cloud-cluster-property-allowlist
Jul 2, 2026
Merged

Clarify which cluster properties are configurable in Redpanda Cloud#627
micheleRP merged 2 commits into
mainfrom
clarify-cloud-cluster-property-allowlist

Conversation

@micheleRP

@micheleRP micheleRP commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

What

Clarifies which cluster configuration properties can be set in Redpanda Cloud (via rpk, the Cloud API, or the Terraform provider), and redirects users to the topic-level property for controlling maximum message size.

Prompted by a customer/field report: a BYOC user tried to set kafka_batch_max_bytes through the Terraform provider and hit REASON_INVALID_INPUT ... The properties [kafka_batch_max_bytes] are not allowed. The provider passes the property through correctly; the Cloud control-plane API rejects it because only an allowlisted subset of properties is accepted in cluster_configuration.custom_properties. The docs didn't state this, and the AI assistant recommended a cluster property that Cloud doesn't accept.

Changes

  • manage/cluster-maintenance/config-cluster.adoc
    • Limitations: note that only properties in the Cloud reference are configurable; setting others returns REASON_INVALID_INPUT.
    • New "Configure the maximum message size" section: use topic-level max.message.bytes; kafka_batch_max_bytes is not configurable in Cloud.
  • manage/terraform-provider.adoc
    • New "Configure cluster properties" section showing the cluster_configuration { custom_properties_json = jsonencode({...}) } syntax, the allowlist caveat, and the kafka_batch_max_bytes example, plus a Serverless/Azure note.
  • develop/topics/create-topic.adoc and get-started/whats-new-cloud.adoc
    • Correct the topic property name to max.message.bytes (was message.max.bytes / max_message_bytes).

Notes for reviewers

  • Open product question: is there any supported way to set a cluster-wide default max message size in Cloud (Console or API), or is topic-level max.message.bytes the only path? These edits state the topic-level path, which is accurate today.

🤖 Generated with Claude Code

Preview pages

Document that only the properties listed in the Cloud reference can be set
via rpk, the Cloud API, or the Terraform provider, and that setting others
(for example, kafka_batch_max_bytes) returns REASON_INVALID_INPUT. Add a
Terraform "Configure cluster properties" section with the cluster_configuration
custom_properties_json syntax, and point users to topic-level max.message.bytes
for message size. Correct the topic property name to max.message.bytes.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@micheleRP micheleRP requested a review from a team as a code owner July 1, 2026 19:10
@netlify

netlify Bot commented Jul 1, 2026

Copy link
Copy Markdown

Deploy Preview for rp-cloud ready!

Name Link
🔨 Latest commit e6a2568
🔍 Latest deploy log https://app.netlify.com/projects/rp-cloud/deploys/6a4569af556d1400083847f2
😎 Deploy Preview https://deploy-preview-627--rp-cloud.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@coderabbitai

coderabbitai Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Important

Review skipped

Auto incremental reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 6794e47a-d13a-49b4-9e0b-0677bff20ceb

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
📝 Walkthrough

Walkthrough

This change updates documentation to correct the topic property name for configuring maximum message size from message.max.bytes/max_message_bytes to max.message.bytes in two files. It also adds documentation clarifying cluster property configuration limitations, a new section on configuring maximum message size in Redpanda Cloud, and a new Terraform provider section describing how to configure cluster properties via cluster_configuration.custom_properties_json, including error behavior and platform availability constraints.

Estimated code review effort: 2 (Simple) | ~10 minutes

Changes

File Change Summary
modules/develop/pages/topics/create-topic.adoc Corrected property name to max.message.bytes
modules/get-started/pages/whats-new-cloud.adoc Corrected property name to max.message.bytes
modules/manage/pages/cluster-maintenance/config-cluster.adoc Updated Limitations section; added new "Configure the maximum message size" section
modules/manage/pages/terraform-provider.adoc Added new "Configure cluster properties" section

Related issues: None specified.

Related PRs: None specified.

Suggested labels: documentation

Suggested reviewers: None specified.

🐰 Nibbling docs with care, a property renamed just right — max.message.bytes now stands, cluster limits brought to light.

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly summarizes the main change: clarifying which Redpanda Cloud cluster properties are configurable.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Description check ✅ Passed The PR description follows the required structure with What, Changes, preview pages, and reviewer notes, though the issue link, deadline, and checklist are incomplete.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch clarify-cloud-cluster-property-allowlist

Comment @coderabbitai help to get the list of available commands.

Scope the REASON_INVALID_INPUT claim to the Cloud API and Terraform provider
(the paths evidenced in the field report) instead of also asserting rpk
behavior, and avoid claiming kafka_batch_max_bytes is unconfigurable via any
Cloud interface pending confirmation of Console behavior.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@Feediver1 Feediver1 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Final-pass review (docs-team-standards)

Overall: Accurate, well-scoped fix for a real field-reported problem, with a good property-name correction. No critical issues — one technical-accuracy item to confirm (the Terraform attribute name).

Context: cluster-properties.adoc is generated (includes streaming:reference:partial$properties/cluster-properties.adoc filtered to redpanda-cloud tags), so the "allowlist" = properties tagged redpanda-cloud in the streaming component.

What this PR does

Clarifies that only allowlisted cluster properties are configurable in Redpanda Cloud (setting others returns REASON_INVALID_INPUT), adds Terraform + max-message-size sections, and corrects the topic property name to max.message.bytes. Field-report-driven (a BYOC customer hit the error setting kafka_batch_max_bytes via Terraform).

Critical issues

None. Verified:

  • Both reference xrefs resolve (cluster-properties.adoc, object-storage-properties.adoc exist).
  • <<max-message-size>> anchor resolves — defined once, referenced once.
  • Property-name correction is complete and consistent — message.max.bytes and max_message_bytes fully gone from cloud-docs; max.message.bytes lands in all 4 spots. (Good catch: message.max.bytes is the broker name and max_message_bytes isn't real; max.message.bytes is the correct topic property.)
  • No contradiction — kafka_batch_max_bytes isn't listed in the Cloud reference, consistent with "not configurable."

Suggestions

  1. terraform-provider.adoc — verify. The provider attribute custom_properties_json (with jsonencode({...})) is new to the docs and appears nowhere else; the Cloud API path uses custom_properties (a JSON object, per existing examples). Please confirm custom_properties_json matches the current Redpanda Terraform provider schema/version — a wrong attribute name here would produce the exact REASON_INVALID_INPUT-class failure the PR aims to prevent. (Likely correct — providers often expose a _json string variant — but it's the one unverifiable claim.)
  2. config-cluster.adoc:22 — minor. The allowlist-rejection wording scopes to "the Cloud API or the Terraform provider," but the "Set cluster configuration properties" section lists rpk as a set-path, so a reader using rpk with a non-allowlisted property isn't told what happens. Deliberate softening (commit 2, pending rpk/Console confirmation) — fine to leave; consider adding "rpk behaves the same" once confirmed.

Impact on other files

  • Cross-repo (docs): the same wrong topic-property name (message.max.bytes / max_message_bytes) may exist in the self-managed docs repo's topic/reference pages. cloud-docs is fully corrected here; worth a quick check in docs.
  • No nav change; no new What's New entry needed — the PR correctly fixes the name in the existing What's New entry.

CodeRabbit

No CodeRabbit or human reviews posted yet.

What works well

  • Fixes a genuine technical error (broker-vs-topic property name) consistently across all four files — no stragglers.
  • Root-cause accurate — frames the allowlist as control-plane behavior and points to the right topic-level property.
  • Sensible claim-scoping (commit 2) — narrowed the REASON_INVALID_INPUT claim to evidenced paths (API/Terraform) rather than over-asserting rpk/Console.
  • Reuses the established audit_enabled example and cross-links config-cluster / terraform / create-topic cleanly.

🤖 Automated final-pass review via docs-team-standards pr-review.

@micheleRP micheleRP merged commit fa86641 into main Jul 2, 2026
6 checks passed
@micheleRP micheleRP deleted the clarify-cloud-cluster-property-allowlist branch July 2, 2026 15:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants