data Engineering Manager - streamingGlobe Telecom

At Globe, our goal is to create a wonderful world for our people, business, and nation. By uniting people of passion who believe they can make a difference, we are confident that we can achieve this goal. Job Description Provides management and techn At Globe, our goal is to create a wonderful world for our people, business, and nation. By uniting people of passion who believe they can make a difference, we are confident that we can achieve this goal. Job Description Provides management and technical guidance to the ETL team. The Lead drives the development and implementation of ETL processes within a complex and multi-platform environment. The lead will also help and mentor the team of developers as well as guide the team by providing technical input. The Lead will also help ensure compliance with data governance standards across the enterprise. Duties and Responsibilities The Data Engineering Manager provides management and technical guidance to the Data Engineering Team. The Lead drives the development and implementation of automated data pipelines within a complex and multi-platform environment. The lead will also help and mentor the team of developers as well as guide the team by providing technical input. The Lead will also help ensure compliance with data engineering best practices and data governance standards across the enterprise. Key Responsibilities The responsibilities of this position will include but not limited to: Defines, prioritizes and allocates resources tracks and provides status reports of work assignments, projects, and programs performed in support of the Data Engineering team. Review business and technical requirements and ensure the data integration platform meets requirements Apply industry best practices for automated data pipeline design and development Lead design, development, and implementation of end-to-end complex automated data pipeline system using common Big Data Tools such as (but not limited to) Apache Spark, Talend, Kafka, Airflow, NiFi i and Hadoop Tools Plan and lead Data Engineering development efforts for team utilizing tools mentioned above Implement monitoring and measurement of data quality as defined by business rules Ensure adherence to architectural governance standards and practices Develop best practices, standards of excellence, and guidelines for programming teams Ensure compliance to the DevSecOps practice. Conduct System Testing - execute job flows, investigate system defects, resolve defects and document results Identify needs, secure commitments, and monitor the progress of deliverables. Create a productive environment that promotes the initiative, innovation, continual learning, and development of key personnel for future advancement Provide a level of effort estimates for new initiatives and change controls in order for projects to be evaluated, budgeted and tracked for success. Monitor staff to ensure departmental standards are followed, including identification of areas needing process improvement or innovation. Provide technical expertise in the management team for data engineering related topics Provide technical expertise and guidance in keeping the Data Engineering up to date on technology and best practices. Requirements: Work Experience Bachelor's degree in Computer Science or an information technology related fields 8 years Java Experience Java experience is a must 8 years of experience in ETL development and management 3 years Kafka experience In-depth experience in automated data pipeline design, implementation, and support. Experience with Big Data Platforms. Experience establishing and building operational data stores and analytic data stores (enterprise data warehouse) Strong SQL & PL/SQL skills with the ability to solve highly complex challenges Advanced technical experience and business knowledge in various SDLC methodologies including waterfall, iterative, agile software development life cycle or related disciplines/processes is preferred. Experience in DevSecOps Process Good communication and interpersonal skills for interacting and collaborating with developers, analysts, and business staff throughout the organization. Ability to communicate clearly in writing to document data requirements and translate into technical solutions. Level of Knowledge In-depth knowledge of Tier 1 Data Engineering tools is preferred, e.g. Talend, Apache Spark, NiFi, Kafka, Airflow. Working knowledge of Apache Spark, Distributed computing and other Hadoop-related concepts Advanced technical and business knowledge in software development life cycle, quality assurance, project management, and other related disciplines/processes. Understanding of data engineering design and development best practices. Understanding of data governance, master data management best practices. Make Your Passion Part of Your Profession. Attracting the best and brightest Talents is pivotal to our success. If you are ready to share our purpose of Creating a Globe of Good, explore opportunities with us.
Monster

Philippines
Permanent
Full-time