Project Title: Seamless Migration of MongoDB & Elasticsearch to AWS EKS for BatchService.com

Client: BatchService.com – a leading prop-tech company providing advanced lead generation and skip tracing tools for real estate professionals.

Challenge:
BatchService was running high-cost managed services—MongoDB Atlas and Elastic Cloud—with growing infrastructure demands:

MongoDB clusters between 0.5 TB and 1 TB.
Elasticsearch clusters exceeding 12 TB.
Monthly infrastructure spend over $30,000.
Limited flexibility, performance tuning options, and compliance concerns (HIPAA, PCI-DSS).

Objectives:

Migrate all data to AWS EKS with zero downtime.
Improve scalability, observability, and cost efficiency.
Ensure data integrity and meet compliance requirements.

SquareOps Solution:

Designed and executed a zero-downtime migration strategy using MongoDB replica sets and Elastic Cloud on Kubernetes (ECK).
Migrated over 12 TB of data (~5B+ documents) across 15+ production and 10 staging clusters.
Used live sync for MongoDB and snapshot-restore + reindexing for Elasticsearch.
Built robust Grafana dashboards to monitor 200+ metrics including query latency, IOPS, and replica lag.
Set up automated, encrypted backups to AWS S3 with both collection- and index-level granularity.
Implemented full security compliance:
- Encryption in transit and at rest (TLS, AWS KMS)
- Role-based access controls (RBAC)
- Full audit logging

Results:

Zero data loss during the migration.
30% faster query performance and 99.99% uptime post-migration.
~27% cost reduction, saving ~~$8,000/month (~~$96,000/year).
Full ownership of infrastructure with improved scalability and visibility.
Achieved HIPAA and PCI-DSS compliance standards.

Impact:
SquareOps enabled BatchService to move from expensive, limited managed services to a fully controlled, scalable, and cost-efficient self-managed infrastructure on AWS. The project not only improved performance and reduced costs, but also provided the operational transparency and compliance needed to scale confidently.

SquareOps

Write a review for SquareOps

Please fill the form below

Budget

Quality

Schedule

Communication