2.35.0

[allanger]

Important updates

In this version the backup logic was updated. Now it should be possible to store backups not only in the google cloud storage.

I would not consider backups stable now, and the logic might change in the future.

Two new backup containers are introduced:

• https://github.com/db-operator/mydump-rclone
• https://github.com/db-operator/pgdump-rclone

rclone is used in both of them for uploading a backup to an external storage. To make rclone backed configurable, a new field was added to the database backup item: envFromSecret. The value of this field would be used in a cronjob as a source of environment variables, with which one could configure rclone.

Both rclone containers are using the same command to upload a backup:

rclone copyto "./${BACKUP_FILE_ARCHIVED}" "storage://${STORAGE_BUCKET}/${DB_NAME}/${BACKUP_FILE_ARCHIVED}"

This what a secret would look like when uploading a backup to a RustFS bucket

  RCLONE_CONFIG_STORAGE_TYPE: s3
  RCLONE_CONFIG_STORAGE_ACCESS_KEY_ID: <Access token>
  RCLONE_CONFIG_STORAGE_SECRET_ACCESS_KEY: <Secret Token>
  RCLONE_CONFIG_STORAGE_ENDPOINT: <Storage URL>
  RCLONE_CONFIG_STORAGE_FORCE_PATH_STYLE: "true"
  RCLONE_CONFIG_STORAGE_PROVIDER: Other

Secrets must be deployed to the same namespaces as Databases. Even though I understand that this design decision is far from being the best, I've decided to extend the old feature instead of writing a new backup controller, because currently I can't come up with a better design and I'm also limited on time.

The bucket for the backups should be specified on the instance level.

As I said, the feature is not stable, so I would be happy to get some feedback about improving the UX, extending it, and as well about how to implement the backup properly in the long term.

Thanks

What's Changed

• Update golang.org/x/exp digest to 9ea1abe by @kindabot in Update golang.org/x/exp digest to 9ea1abe #405
• Update kubernetes packages to v0.36.2 by @kindabot in Update kubernetes packages to v0.36.2 #391
• Make it possible to use different storages for backups by @allanger in Make it possible to use different storages for backups #274

Full Changelog: 2.34.0...2.35.0

---

This discussion was created from the release 2.35.0.