I sound like a broken record with every client when I talk to about the resilience of their production environments. It’s very simple in theory, however in practice many organizations fail.
Ask yourself these checklist questions for your MySQL backup and recovery process?
- Do you have MySQL backups in place?
- Do you backup ALL your MySQL data?
- Do you have consistent MySQL backups?
- Do you have backups that include both static snapshot and point in time transactions?
- Do you review your backup logs EVERY SINGLE day or have tested backup monitoring in place?
- Do you perform a test recovery of your static backup?
- Do you perform a test recovery to point in time?
- Do you time your backup and recovery process and review over time?
- Do you have off-site copies of your backups?
- Do you backup your primary binary logs?
In the past month I’ve discovered clients that have an online only business (i.e. Their MySQL data is their only tangible asset), they perform daily backups but they don’t have binary logging enabled. I’ve also discovered an example of backup logs not being checked, and an underlying mysqldump error was resulting in an incomplete backup, yet the backup script apparently completed successfully.
Disaster is inevitable.
If you don’t score 8 or better in the above checklist in your business, you are at higher risk. If you are a owner/founder/executive this should keep you awake at night if your not sure of your business viability. If your organization needs help, please contact me for assistance.
- Can you recover from a small or large disaster?
- Do you have confidence in your DR plan?
- Do you know how long your DR plan will take.
- What does your online business look like or operate during your DR time?
Mark R says
5. Do you review your backup logs every day?
No, we just have monitoring which alerts if the backups fail. This is in practice a better thing to do (provided your monitoring has been tested, of course, which ours has)
You are correct, a tested monitoring system is sufficient. I’ve adjusted my point 5 to reflect your suggestion.
Shlomi Noach says