6 ms·
Just this week I was looking for a better solution that would back up my RDS database to S3. I'm currently using mysqldump, but the RDS instance size has grown
by mcos 14y ago
Just this week I was looking for a better solution that would back up my RDS database to S3. I'm currently using mysqldump, but the RDS instance size has grown extremely large and so, it has become unwieldly. Hopefully this will help with that.
- mseebach 14y agoIt might not be appropriate for you, but a good way to handle MySQL backups is to maintain a mirror. This has the added benefit of being available as a fail-over and as a secondary instance where you can run reports or test long-running queries on current data without the risk of taking prod down.
- mcos 14y agoThanks, I've already tried that. My main issue is EBS performance when writing the dump file to disk. The backups themselves don't impact on database performace much, but writing up to 20 Gigs of a dump file to an EBS disk on a nightly basis is extremely slow. Maybe this Data Pipeline service will help bypass that.
- jeffbarr 14y agoHave you set up Provisioned IOPS for the volume?
- 1SaltwaterC 14y agoHave you tried piping the dump directly to a compression tool? We use pbzip2 for our dumps which works great if you have some CPU power to spare. The largest was around 8 Gigs uncompressed, but the total size of the plain text dumps is over 20 Gigs. Hardly an issue for EBS that way. Did kill the DB for a few minutes several times before using cstream to cap the dump bw.
- jacques_chester 14y ago> It might not be appropriate for you, but a good way to handle MySQL backups is to maintain a mirror. DELETE * FROM business_critical_data; WHERE obsolete = true; You were saying? :D
- mseebach 14y agoWell, with a functional mirror to run manual queries against, you wouldn't be running the risk of running such a query on your prod DB anyway. But yeah, you still need a dump.
- jacques_chester 14y agoThere's lots of disaster reports that start with "shouldn't" and "normally we wouldn't" :) http://www.taobackup.com/ http://www.taobackup.com/
- iamjustlooking 14y agoYou can run your daily/hourly backups on the mirror and not impact performance on your main database.
- jacques_chester 14y agoRight. But the grandparent comment was suggestive of the possibility that he or she wanted the mirror to fulfil multiple roles, including being the backup.
- Negitivefrags 14y agoThe mirror is to run the backups on, not the backup itself.
- dsl 14y agoCHANGE MASTER TO MASTER_DELAY = 3600; Your slave will always be 5 minutes behind the master. You were saying?
- jacques_chester 14y agoIf this is your tactic, I'd think the binary log would be the winning way to rollback a bad delete.