Delete files from folder in S3 bucket - amazon-web-services

Question

I have an AWS S3 bucket test-bucket with a data folder. The data folder will have multiple files.
I am able to delete the files in the S3 bucket.
But what I want is to delete the files in the data folder without deleting the folder.
I tried the following:
aws s3 rm s3://test-bucket/data/*
Also checked using --recursive option, but that does not work.
Is there a way I can delete the files in the folder using AWS CLI?

Answer 1

Following aws cli command worked:
aws s3 rm s3://test-bucket --recursive --exclude="*" --include="data/*.*"

Answer 2

you can do it using aws cli : https://aws.amazon.com/cli/ and some unix command.
this aws cli commands should work:
aws s3 rm s3://<your_bucket_name> --exclude "*" --include "<your_regex>"
if you want to include sub-folders you should add the flag --recursive
or with unix commands:
aws s3 ls s3://<your_bucket_name>/ | awk '{print $4}' | xargs -I% <your_os_shell> -c 'aws s3 rm s3:// <your_bucket_name>/% $1'
explanation:
list all files on the bucket --pipe-->
get the 4th parameter(its the file name) --pipe-->
run delete script with aws cli

Answer 3

aws s3 rm s3://bucket/folder1/folder2/ --recursive --dryrun
From what I see happening when I try it, adding the slash at the end means delete below folder2, not including folder2.

Answer 4

We can remove all files including sub-folders as well from AWS-S3-BUCKET
In Node.js by using the below function.
the same command can be used in AWS-CLI by configuring AWS in the command-line.
function removeAllFilesFromBucket(){
const S3_REGION = "eu-west-1";
const S3_BUCKET_NAME = "sample-staging";
let filePathBucket = S3_BUCKET_NAME+'/assets/videos';
let awsS3ShellCommand = 'aws s3 rm s3://'+filePathBucket+' --region '+S3_REGION+' --recursive';
var { exec } = require('child_process');
exec(awsS3ShellCommand, (err, stdout, stderr) => {
if (err) {
console.log('err',err);
return;
}else{
console.log('Bucket files and sub-folders Deleted successfully !!!');
console.log(`stdout: ${stdout}`);
console.log(`stderr: ${stderr}`);
}
});
}