Skip to main content

Data Exfiltration from AWS S3 Buckets

Data Exfiltration from AWS S3 Buckets

You will have no doubt heard by now about the recent Booz Allen Hamilton breach that took place on Amazon Web Services – in short, a shocking collection of 60,000 government sensitive files were left on a public S3 bucket (file storage in Amazon Web Services) for all to see. We are all probably too overwhelmed to care, given all the recent breaches we have been hearing about in the news. But with this breach it was different, it involved a trusted and appointed contractor whose job it was to follow security policies, put in place to avoid such incidents. So was this incident accidental or malicious? More, later about the tools we can use to tell the difference between the two. First, lets recap what happened.

The Incident

According to Gizmodo, the 28GB of data that was leaked not only contained sensitive information on recent government projects, but at least a half dozen unencrypted passwords belonging to government contractors with Top Secret Clearance – meaning anyone who got their hands on these unencrypted passwords could in turn move through security controls to get access to further sensitive data. Ok, so now we’re not just talking about 60,000 files sitting on a S3 bucket, but the potential of a bigger breach.

When you have so much sensitive data that is questionable and considered potentially compromised in a breach, where do you start in your investigation?

Scouring the maze of data in the cloud

Amazon Web Services (AWS) has a couple of basic native logging and monitoring tools that help you search for data in its public cloud. AWS CloudTrail is a tool that allows you to monitor API calls made to AWS services in your account. AWS CloudWatch can be used for monitoring and alerting for particular events you designate. Both of these tools are good for a basic level of analysis of a security events. In a small finite data source of events and logs, you can come to some sense of what transpired in a security incident. But where these tools fall short is in scale and visualization. Most data lakes are vast and consolidate data from many different sources. Gaining insights from that data for a particular incident usually involves scouring through a vast amount of data and in a repetitive fashion – each pass through the data brings you one step closer to a potential answer, or sometimes nothing at all. All along, you are running out of time and the pressure is on to find the smoking gun.

Finding The Smoking Gun

Data Exfiltration from AWS S3 Buckets

Sift Security offers not only the capability to manually search through your data lake, but to get starting points for investigations from the anomaly detection and visualize your data in our graph.

The screenshot above shows an example of the type of visualization available in Sift Security’s CloudHunter product. We ingest your CloudTrail data and run anomaly detection to point out behavior that may be malicious with no configuration needed. In this case, we alerted that the user launched an EC2 instance with an AMI that was never used before. By adding that alert to the visualization, we can see that the “demo-contractor” was able to retrieve S3 credentials from the EC2 instance and download the “github-credentials.txt” file.

If Booz Allen Hamilton was using Sift, they would have immediately been alerted when the permissions on the S3 bucket were changed, and even if that was ignored, they would have been alerted again when somebody downloaded any files from the bucket.

The Bottom Line

Humans make mistakes, and cloud infrastructure can change from one minute to the next. As we continue to utilize cloud infrastructure, we will continue to encounter cases like this. Whether a leak like this is accidental or malicious, the job of a security incident responder will only get harder. It’s time to revolutionize the tools that help us do our job in a better way. Sift Security recognizes this problem and is leading the revolution by reinventing the way we search for data and respond to security incidents in the cloud. Learn more about what Sift Security and what CloudHunter can do for you.

Popular posts from this blog

Sift Security Tools Release for AWS Monitoring - CloudHunter

We are excited to release CloudHunter, a web service similar to AWS CloudTrail that allows customers to visually explore and investigate their AWS cloud infrastructure.  At Sift, we felt this integration would be important for 2 main reasons:
Investigating events happening in AWS directly from Amazon is painful, unless you know exactly what event you're looking for.There are not many solutions that allow customers to follow chains of events spanning across the on-premises network and AWS on a single screen. At Netflix, we spent a lot of time creating custom tools to address security concerns in our AWS infrastructure because we needed to supplement the AWS logs, and created visualizations based on that data.  The amazing suite of open source tools from Netflix are the solutions they used to resolve their own pain points.  Hosting microservices in the cloud with continuous integration and continuous deployment can be extremely efficient and robust.  However, tracking events, espec…

Sift Security and WannaCry

😢 The WannaCry ransomware attack has left security teams around the world scrambling to make sure they are protected and to assess whether they have been victimized. To protect themselves, organizations need to have visibility into which systems are vulnerable and be able to rapidly roll out patches.  To understand whether they have been targeted, they need visibility into the channels over which the ransomware is distributed.  To understand whether they have been infected, they need visibility into the endpoints.
Over the past weekend, I was bombarded with questions from current customers, potential customers, former colleagues, friends, and family.  Am I vulnerable? How do I protect myself? How do I know if I’ve been hit? What do I do if I’ve been hit? What can you do to help me?
This post focuses primarily on the last question. What can we at Sift Security do to help an organization respond to a massive ransomware attack? I break this down into four categories, visibility, analyt…

Next-Generation SIEMs

Intelligence, Speed, Simplicity, AutomationOverviewMajor network and security trends, including exponentially increasing network traffic, cloud architectures, complex attack surfaces, and advanced adversaries, have created new challenges for security operations in adapting to this changing threat landscape.
Increased Traffic, Hybrid Cloud Architectures, and Sophisticated Adversaries Are Overwhelming SOCs
The Security Operations Center is faced with alert overload, often paralyzed with too much information to filter, prioritize, and act upon. The end result is an inability to find the true risk amongst thousands of alerts every day with the largest of organizations easily facing millions of alerts per day.Incident responders are challenged at finding relevant information or seeing the relationships amongst disparate indicators of compromise that are buried within logs, causing delays in assessing, understanding, and mitigating incidents.T…