Skip to main content

Sift Security white paper about big data and anomaly detection

Sift Security white paper about big data and anomaly detection

Big Data and Data Science Security White Paper

We are excited to announce our first white paper, describing the unique strengths of Sift Security's data science technology. There are a lot of overblown promises about big data in every industry, including cybersecurity, so we wanted to give you some concrete information about what we do and why it works.

Read the paper to learn about:

  • The relational graph that transforms reams of system logs and netflow data into meaningful connections between entities like users, hosts, and processes. We put the flood of flashing alerts from antivirus and firewall products into proper context, where serious threats stand out like bright clusters.
  • The anomaly detection pipeline, based on recent mathematics research at Stanford and MIT. It's scalable, of course, and works out of the box to start finding suspicious patterns of behavior. While many anomaly detection products require a period of perfect clean data to learn "normal" behavior, our product can operate on real data collected from an enterprise, even one already under attack.
  • The feedback loop running on top of our other algorithms that helps the product get more accurate with use. Over time, Sift Security customizes its estimates of risk to the specifics of a company’s environment.

Of course we can't give away all the details in a blog post! To learn more, get your own copy of the white paper: email contact@siftsec.com.

Popular posts from this blog

Sift Joins Netskope, the Cloud Security Leader

Four years ago, we started Sift with the mission of simplifying security operations and incident response for the public cloud. In that time, we have assembled a fantastic team, created an innovative cloud detection and response solution, and have worked with many market-leading customers. I’m delighted to share that we’ve taken yet another step forward — as announced today, Sift is now officially part of Netskope. You can read more about this on Netskope CEO Sanjay Beri’s blog or in the official announcement on the Netskope website.
For our customers, investors, partners, and team, this is an exciting new chapter. Let me tell you why we’re so excited.  Since the beginning, Netskope has had an unmatched vision for the cloud security market. Having started in 2012, they initially focused on SaaS security and quickly followed that with IaaS security capabilities. Six years later, they are now more than 500 employees strong and used by a quarter of the Fortune 100. They are a leader in …

Sift Security Tools Release for AWS Monitoring - CloudHunter

We are excited to release CloudHunter, a web service similar to AWS CloudTrail that allows customers to visually explore and investigate their AWS cloud infrastructure.  At Sift, we felt this integration would be important for 2 main reasons:
Investigating events happening in AWS directly from Amazon is painful, unless you know exactly what event you're looking for.There are not many solutions that allow customers to follow chains of events spanning across the on-premises network and AWS on a single screen. At Netflix, we spent a lot of time creating custom tools to address security concerns in our AWS infrastructure because we needed to supplement the AWS logs, and created visualizations based on that data.  The amazing suite of open source tools from Netflix are the solutions they used to resolve their own pain points.  Hosting microservices in the cloud with continuous integration and continuous deployment can be extremely efficient and robust.  However, tracking events, espec…

Integration with Amazon GuardDuty

What is Amazon GuardDuty?
Amazon GuardDuty is a continuous security monitoring platform that analyzes and processes VPC flow logs, AWS CloudTrail event logs and DNS logs. It uses threat intelligence feeds, such as lists of malicious IPs and domains to identify malicious activity within your AWS environment.
You can enable the GuardDuty Service through your Amazon Console. Once there, you are then presented with the GuardDuty dashboard, as shown in the example below:














Finding are rated as High, Medium or Low on the dashboard and have the following meaning:  

Highfindingsindicates that the resource in question is compromised and is actively being used for unauthorized purposes.

Medium findings indicates suspicious activity, for example, a large amount of traffic being returned to a remote host that is hiding behind the Tor network.

Low findingsindicates suspicious or malicious activity that was blocked before it compromised your resource.

Integrating CloudHunter with GuardDuty

CloudHunter integr…