data platform Engineer - sparkopswerks

WHO WE ARE
Opswerks specializes in making data center and cloud operation teams thrive. Our philosophy is about making technology "werk"​ for our customers by tailoring solutions to their exact needs. We believe that products, services, tools and processes should serve the needs of people, NOT the other way around.
Our global team of service architects, infrastructure admins and software engineers have built and operated some of the world's largest, most scalable environments over the past two decades. From 24/7 monitoring to infrastructure design to application development, our team of talented, creative and dynamic people has got it all covered.
Join us at opswerks. Together, we can make technology "werk" for the people.
We are currently looking for an experienced Big Data Platform Engineer who understands Spark Jobs and has working knowledge of Apache Airflow. Part of your responsibility is to enable and empower users of Big Data Platform by helping them in abstracting Platform & Spark Job issues.
YOUR ROLE
Be a member of a 24x7 shifting rotation
Be the primary engineering interface to support customer's deployment Platform and its end-users complex problems
Work confidently and self-directed in a fast-paced environment
Build tools/develop solutions for challenging and business-critical problems
Work with a wide range of customers' software and engineering teams to support their workflows in the existing platform
Write clear and consumable documentation
Perform root cause analysis. Identify and resolve underlying problem patterns, while driving to develop automated and self-healing solutions
You'll be embedded in a team of talented engineers both at opswerks and its customers that are already focusing on development, quality, performance, reliability, infrastructure, security, and compliance.
YOUR QUALIFICATIONS
Bachelor's degree or higher education
5+ yrs of experience with Linux
3 to 5 yrs of experience in executing and/or debugging Spark Jobs
Working knowledge with Data Pipelines Workflow automation like Apache Airflow's Scheduler, BashOperator, and Directed Acyclic Graph (DAG)
Experience with Big Data like Apache Spark, Hadoop, etc
Experience working on or building connectors from Spark to data sources like AWS S3, Hadoop HDFS, or Object Storage
Experience working on projects with cross-functional teams
You automate things rather than doing it twice.
Excellent analytical and problem-solving skills
Experience dealing with customer issues and with excellent verbal and written communication skills
PLUS POINTS
Hands-on experience with container orchestration systems like Kubernetes, Docker, or Apache Mesos
Experience in programming languages preferably in Scala, Java, or Python
Experience with build automation, source control and CI/CD tools (GitHub, Artifactory, Jenkins, Secrets, etc)
Strong knowledge in Splunk Log Management tool
Bossjob

Cebu City, Cebu
Permanent
Full-time