Headquartered in Boston, Klaviyo, Inc. is a fast-growing SaaS eCommerce marketing company that obsesses over helping brands grow faster. Quality of service and uptime are critically important to Klaviyo and their customers, who depend on the Klaviyo service to access, store, analyze, and use transactional and behavioral data to power highly-targeted email and advertising campaigns.
To ensure service quality and continuously improve the user experience, Klaviyo collects and analyzes enormous volumes of log data. With customers more than doubling year over year, Klaviyo turned to ChaosSearch to overcome the continuously growing challenges around data management.
The Klaviyo system generates Amazon Elastic Load Balancing (ELB) log data, which they had been storing on Amazon S3 and analyzing with Amazon Athena. By the beginning of 2019, they were analyzing over 75 TB of log data in Amazon S3, which was becoming prohibitively expensive with Athena. The high query costs were causing them to:
As a result, they launched a strategic initiative to select and implement a log management alternative to Athena, which would make it affordable to retain and analyze 100s of TBs of log data.
After a three-month evaluation process, Klaviyo selected ChaosSearch as their new log analytics platform for the following reasons:
Klaviyo’s use cases included search and analysis of a subset of their Amazon ELB logs and their application logs. After seeing the power of the ChaosSearch platform, Klaviyo determined that they could completely replace their Athena implementation with ChaosSearch.
After a few months of use, Klaviyo made ChaosSearch its search platform coupled with Amazon S3 for operational and unstructured data. This made data operations significantly easier, by establishing Amazon S3 as the central data repository, with ChaosSearch as the standard analytics platform analyzing Amazon S3 data in-place. With this strategy, Klaviyo’s Amazon S3 environment grew rapidly as developers realized the value, and began to use both Amazon S3 and ChaosSearch for new use cases and more frequency.
If your log data is in Amazon S3 buckets, you can activate ChaosSearch against it as-is. There is no new external database to install. No data to migrate. No ETL to set up. Just index and search.
To begin your free trial of ChaosSearch, visit chaossearch.io today.