Job Title: OpenSearch Engineer
Location: New York, NY
Position Overview
We are seeking a highly skilled OpenSearch Engineer with strong experience in AWS, .NET, or Python to design, build, optimize, and manage search and analytics solutions. The ideal candidate will have hands-on expertise with distributed systems, large-scale search infrastructures, and application development, while supporting enterprise-grade observability and indexing pipelines.
Key Responsibilities
- Design, deploy, and manage OpenSearch clusters for high availability, scalability, and performance.
- Create and optimize index mappings, analyzers, tokenizers, relevance models, and search queries.
- Implement OpenSearch ingestion pipelines using Logstash, FluentBit, Beats, or custom ETL.
- Architect and manage cloud infrastructure using:
- Amazon OpenSearch Service
- EC2, S3, Lambda, IAM, CloudWatch, Kinesis, MSK
- Automate provisioning using Terraform/CloudFormation (nice to have).
- Implement secure access controls, VPC design, and encryption strategies.
- Build real-time streaming pipelines for logs, metrics, and application data.
- Develop backend services, APIs, and data pipelines in Python and .NET (C#).
- Write microservices that interface with OpenSearch queries and aggregations.
- Build automation tools for cluster maintenance, indexing, and monitoring.
- Integrate OpenSearch with enterprise applications using SDKs/REST APIs.
Required Skills & Qualifications
- 6–8 years of hands-on experience with OpenSearch (or Elasticsearch).
- Strong knowledge of:
- Search indexing concepts
- Query DSL
- Aggregations
- Relevance tuning
- Solid experience with AWS cloud services.
- Strong programming skills in:
- Python
- .NET/C#
- Understanding of distributed systems and cluster architecture.
- Experience with CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins).
- Strong troubleshooting, analytical, and performance optimization skills.
- Knowledge of containers (Docker) and orchestration (Kubernetes/EKS) is a plus.