How to Easily Delete Large S3 Buckets?
AWS Tips & Tricks, Cloud Computing

Deleting an Amazon S3 bucket can be a difficult task. It is even a bigger task if it has a large number of objects in it because you cannot delete non-empty buckets.

Automated solutions such as ‘S3cmd’ or ‘S3nukem’ would either break or take weeks to delete an S3 bucket depending on its size and the number of objects in it.

The best approach is to use AWS, which comes with the benefit of a self-service platform and provides an option of setting lifecycle policy for S3 objects.

AWS lifecycle policies help in defining actions on Amazon S3 during an object’s lifetime. For example, transitioning objects to another storage class, archiving them, or deleting them after a specified period.

Using a shared prefix (that is, objects that have names that begin with a common string), you can define the lifecycle policy for all objects or a subset of objects in the S3 bucket. And using a lifecycle policy, you can define actions specific to current and non-current object versions.

Note: The objects inside the AWS S3 would be gone forever after a day.

This solution is not instant but it takes a day to execute, which is faster than other solutions.

Here’s How to Set Lifecycle of an S3 Bucket

  • Log in to the AWS Management Console and open the Amazon S3 console at https://console.aws.amazon.com/s3/.
  • To create a lifecycle policy for a bucket, choose the name of the bucket from the Bucket name list.

 

How to Easily Delete Large S3 Buckets?

  • Choose the Management tab, and then choose Add lifecycle rule.

 

How to Easily Delete Large S3 Buckets?

 

  • Give the rule a name and click Next if you want to delete the whole bucket. Also, you can set the lifecycle rule for objects with a specified name prefix (that is, objects with names that begin with a common string), limit the lifecycle rule scope to one or more object tags, and combine a prefix and several tags.

 

How to Easily Delete Large S3 Buckets?

 

  • Click Next on the Transitions tab without any changes.
  • Select the options as shown in the image below.

 

How to Easily Delete Large S3 Buckets?

 

  • Verify the settings for your rule under Review. 
  • If you need to make changes, choose Previous. Otherwise, click Save.

 

How to Easily Delete Large S3 Buckets?

 

From now on, AWS does the dirty work for you. S3 will do its own housekeeping, and after a day, everything inside your bucket will be deleted.

This approach can be used if you regularly create stacks with CloudFormation or Terraform, and the buckets won’t delete if there are objects in them.

Instead of writing scripts and adding to the workload you can easily setup lifecycle rules to take action on the AWS S3.

There are a number of things that can be accomplished using lifecycle rules. You can read more about them below.

Object Lifecycle Management

How Do I Create a Lifecycle Policy for an S3 Bucket?

 

AWS Workflow Automation

TotalCloud automates actions on AWS resources and services using its unique cloud graph engine.

Sign up for a free trial

Top Categories
Stay up to date on the latest stories case studies and videos
You might also like
Helpful Tips For Deploying an App Using AWS Elastic Beanstalk
Editorial Note: This is a guest post by Ashley Lipman from TheBlogFrog, a platform to find Internet’s best blogs across v...
Read More
Testing the Waters of AWS EC2 C5D Instances
Ever since Amazon announced AWS EC2 C5D instances, we — as AWS practitioners — have been digging deep into the ...
Read More
Emojis in AWS Instance Names
This Gen Z Dev here is addicted to emojis so much he uses them for AWS instance names as well! And again he comes up with t...
Read More
ElastiCache or Self-hosted Redis on EC2: Which is the One For You?
Often, there comes a time when you have to choose between managed services versus self-hosted services, especially in the c...
Read More
Top AWS Lambda Gotcha You Must Know Before Configuring Them
“Once you set it, you forget it.”   Often, we see several cloud practitioners quote this line about serverless tec...
Read More