Description
We are on the lookout for a Senior Software Engineer to join our Elasticsearch - Distributed Systems team and focus on how Elasticsearch provides scale, performance, and resilience. This team owns how nodes in an Elasticsearch cluster communicate, and how data are indexed, allocated, and replicated across nodes.
Improving Elasticsearch’s components that support concurrent and consistent indexing across multiple machines.
Maintaining our cluster coordination system to keep performance high even though nodes come and go from the cluster and data moves around, while maintaining the safety and liveness properties of the system as a whole.
Pushing the limits on the number of shards, nodes, and petabytes that Elasticsearch can handle today
Looking into all kinds of issues, including performance or concurrency issues, and proposing solutions.
Supporting our support engineers with the harder problems.
You will be responsible for improving the scalability, performance, and resilience of Elasticsearch’s distributed systems. This involves designing, implementing, and testing new features and components, as well as troubleshooting and resolving issues that arise.
To be successful in this role, you should have a strong background in distributed systems and consensus algorithms, as well as strong skills in core Java and the standard library of data structures and concurrency constructs. You should also have a deep technical proficiency in algorithms and be able to understand and work on complex, highly distributed systems.
Additionally, you should be able to own projects from beginning to end, covering both technical design and working with others to develop needed components.
Bonus points for having experience with data stores, search, analytics, Lucene, strong knowledge of the JDK, and asynchronous event-driven network frameworks such as Netty.