feat(helm): add separate MongoDB backup CronJob for linker_output and webpages_text#3141
Closed
feat(helm): add separate MongoDB backup CronJob for linker_output and webpages_text#3141
Conversation
… webpages_text Implements sc-42543. Creates a new mongobackup-linker CronJob that dumps linker_output and webpages_text collections into separate tarballs, with a 5-day rolling retention policy. Controlled by backup.mongo.linkerEnabled. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
🧪 CI InsightsHere's what we observed from your CI run for 2d0c167. 🟢 All jobs passed!But CI Insights is watching 👀 |
…d configurations Updated production-values.yaml to enable extras for MongoDB backup. Modified values.yaml to reflect the change from linkerEnabled to extrasEnabled. Removed deprecated linker dump scripts and associated CronJob configurations to streamline the backup process.
…e related scripts Updated production-values.yaml and values.yaml to rename the configuration from extrasEnabled to linkerOutputEnabled for MongoDB backup. Deleted obsolete scripts and CronJob configurations related to MongoDB extras to simplify the backup process.
BrendanGalloway
approved these changes
Mar 10, 2026
Collaborator
Author
|
Closing in favor of a single consolidated PR that combines history, linker_output, and webpages_text into one weekly CronJob. See sc-42396 for the new consolidated subtask. |
4 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Creates a new
mongobackup-linkerCronJob that independently backs up thelinker_outputandwebpages_textcollections — excluded from the main backup in sc-42542 — with a 5-day rolling retention policy.Code Changes
helm-chart/sefaria/templates/cronjob/mongo-backup-linker.yaml(new){deployEnv}-mongobackup-linker, scheduled at 02:00 dailybackup.mongo.linkerEnabledhelm-chart/sefaria/templates/configmap/create-linker-dumps.yaml(new)linker_outputandwebpages_textcollections separately into the shared volumehelm-chart/sefaria/templates/configmap/upload-linker-dumps.yaml(new)linker_output_DD.MM.YY.tar.gz,webpages_text_DD.MM.YY.tar.gz)helm-chart/sefaria/values.yamlbackup.mongo.linkerEnabled: falseandbackup.mongo.historyEnabled: falseNotes