sr. Data EngineerCobden and Carter International Inc

The Mobile Services Team is looking for world class engineers with Big Data experience to join our technology innovation group focused on the rapid development of cloud based end-to-end mobile applications and services. Responsibilities Include: Develop and improve existing data stores and ETL pipelines and services Monitor, troubleshoot, and resolve issues in the data pipeline Extract, Transform , and Load (ETL) large amounts of structured and unstructured data Perform extensive research and analysis to make optimal architecture and design decisions Analyze data warehouses and create ad-hoc queries on demand as needed by business requirements Write highly scalable and clean code with integration and unit tests Collaborate and perform code review, code walkthroughs, and knowledge sharing Document new features and issues Communicate effectively with Product Management, QA and Operations Ideate, innovate, and implement improvements and automation of current systems and processes Lead and Participate in Agile team and work with other developers to deliver best results Experience Requirements: BS or MS in Computer Science or equivalent experience 5 years' experience in Software Development using Java, Scala or Python is required Extensive experience in implementing scalable and reliable ETL pipelines on Cloud Platforms using Big Data Technologies such as Apache Spark, Hadoop, Apache Kafka Experience transforming data in various formats ( JSON,CSV, PARQUET, YAML, Avro, Orc) Experience managing and scheduling workflows (Apache Airflow experience is preferred) Experience with working on Cloud Data Warehouses such as Amazon Redshift, Google BigQuery, and Data Lakes/Delta Lakes Experience with stream processing technology like Kafka, and Spark Streaming Ability to analyze and simplify complex code and algorithms in Java, Scala or Python Ability to adapt and learn different technologies that best solves the problem whether it is written in Python, Java, Scala, etc. Ability to perform ad-hoc complex SQL queries and query optimization Team player with strong communication skills Desire to learn fast and pick up latest technologies and tools Experience with data visualization software (Tableau, Qlik) is a plus Experience with Data Reconciliation and Machine Learning is a plus
Monster

Metro Manila
Permanent
Full-time