Enabling a Scalable Data Driven Search Infrastructure

Unlimited capacity for search and analytics at low cost

About Jitterbit

Jitterbit is the API transformation company that accelerates innovation by combining the power of APIs and integration. The Jitterbit API integration platform enables companies to rapidly connect SaaS, on-premise, and cloud applications and instantly infuse artificial intelligence into any business process. With Jitterbit, integration moves at the speed of business as needs evolve. Jitterbit has been in business for more than 10 years and 50,000 users trust Jitterbit to connect the digital systems they use every day. A leader in the Gartner Magic Quadrant for Enterprise Integration Platform-as-a-Service, Jitterbit is also ranked #1 in Customer Satisfaction for Cloud Data Integration on G2 Crowd.

The Challenge: Overcoming the barriers to cost-effectively scale and manage log and event data

Jitterbit’s growing customer base continues to generate an increasing volume of log and event data as they integrate more systems together in new ways, building APIs and growing their businesses as a result of these new integrations. With this growth, there was an increased desire to observe, measure, and action log and event data generated from these activities. Jitterbit had a multitude of homegrown logging solutions that had grown organically over the years, and wanted to centralize these on a modern stack to make it easier to productize new features for customers.

Jitterbit standardized on the open source ELK (Elasticsearch, Logstash, Kibana) Stack to accomplish their goals, thinking this would be the fastest and most cost-efficient approach to their logging challenge. Initially seeing good results, as data scaled they began to incur significant infrastructure and human capital costs required to manage their growth in data. They also wanted to open up the search data window from 7 days to 90 days, to provide customers with access to a longer tail of data with more granularity around search and analytics. What they needed was a cost-effective, consolidated, and centralized logging solution that would eliminate the manual overhead of managing an open source database while at the same time opening up data retention from days to months.

The Solution: A searchable data platform at low-cost and high-performance

The Jitterbit data team realized it needed a cloud-native solution that could search and analyze terabytes of data records in near real time. After an extensive POC, the team selected ChaosSearch. ChaosSearch offered a unique opportunity for Jitterbit to solve their exploding data challenges and provide new opportunities to perform analytics on data across any time horizon. ChaosSearch is a SaaS data platform that turns AWS S3 storage into an Elastic cluster without the administrative and tuning requirements of traditional ELK. And since it’s based on Amazon S3 as a backing store, ChaosSearch is scalable, redundant, secure, and cost-effective.

ChaosSearch also inherits all the security, reliability, and powerful S3 features like intelligent storage tiering as well as global availability in Amazon data centers in Europe, Asia, and the Americas. The ChaosSearch architecture employs a stateless compute fabric with patent-pending indexing technology that operates in close proximity to the customer’s S3 storage (in region) to provide search and analytics while ensuring data stays within these geographies. Jitterbit was able to completely replace their ELK infrastructure, save money, and eliminate the management overhead of an open source database while opening up access to months of data for their customers.

The Result: Richer insights for a fraction of the cost and effort

The bottom line impact was an 80% reduction in total cost while opening up an unlimited data window for their customers to access. ChaosSearch's search as a service model provides a zero-maintenance infrastructure. Database management, data sharding, patches, security, and data scaling are a thing of the past for Jitterbit.

The Future: Machine learning and data lakes

Jitterbit has been able to unlock the power of data in S3 with ChaosSearch. Jitterbit can now store more log and event data with longer retention and expose this data to their customers for further analytics. ChaosSearch's unlimited data retention will allow Jitterbit to use larger datasets to train machine learning models and bring the power of artificial intelligence and new innovative features to their customers. ChaosSearch's platform can provide broader value beyond log and event data for Jitterbit as they start to think about a data lake strategy that brings the power of AI to their customers.

To begin your free trial of ChaosSearch, visit chaossearch.io today.


SaaS API Integration


Alameda, CA


200+ Employees


Scalable log and event management


  • Concurrent, contention-free access to terabytes of log and event data at low cost
  • Unlimited capacity for search and analytics
  • Reduction in operations overhead
Managing and maintaining ELK clusters gets expensive fast as data storage grows. ChaosSearch is a self-managed solution for warm log storage and allows for longer data retention and availability of queryable data.
Betsy Bilhorn SVP Products at Jitterbit