senior Data EngineerCGI

Position Description: Ready to join an outstanding culture that cares about diversity and inclusion, corporate social responsibility and gives the freedom to innovate, influence decisions, and chart an exciting career? CGI is more than just an IT c Position Description: Ready to join an outstanding culture that cares about diversity and inclusion, corporate social responsibility and gives the freedom to innovate, influence decisions, and chart an exciting career CGI is more than just an IT company. Be part of a team that supports the local community with the ability draw on global best-in-class talent! Benefits include a share purchase program, profit sharing, wellness credits, training and development programs, and flexible work schedules and locations. CGI is looking for a Data Engineer for its growing team in Western Canada to help our customers on their digital transformation journey! This position is ideal for someone who is looking to take on a challenging role in delivering complex data engineering for AI, machine learning, and analytic solutions on various cloud platforms with clients. The successful candidate will demonstrate a breadth of understanding established and emerging data engineering technologies and experience. Experience with complex data integration, DevOps, DataOps, big data processing, predictive analytics, and data visualization in the energy industry are expected. Your future duties and responsibilities: We help our clients with numerous types of projects covering a variety of different business scenarios including supporting data for business intelligence, data governance and management, customer relationship management, asset management, and enterprise resource planning. The data engineer will have the skills to communicate and deliver modern data engineering products to solve different business problem while building close relationships with both client and CGI team members: Develop new systems to provide real-time streaming analytics and event processing pipeline based on high velocity data architecture to handle throughput over millions of events per second Develop enterprise grade data lake to support both business analytical needs and next generation data infrastructure Develop data integration toolkit to build and manage automated and efficient data pipelines that will consume data from backend services into data repositories and various formats to be consumable by reporting systems and analysts Help create and implement DataOps, DevOps, and CICD best practices Support data science teams in developing and deploying new algorithms Create infrastructure to monitor and manage data integrity and data systems health Leverage and contribute to industry best practices including proper use of source control, code reviews, data validation and testing Create and implement engineering best practices and collaborate in the design of effective streamlined processes with partner teams Required qualifications to be successful in this role: 5+ years of experience in data management, data engineering and/or software engineering working with SQL, Python, Scala, Java, Databricks, Snowflake/Snowpipes, Azure Data Factory, Informatica, AWS Pipelines, and Cloud technologies (Azure, AWS, or GCP) Experience in designing, implementing, automating and maintenance of large-scale data pipeline processes, providing proficiency with concepts like idempotency, retry and backoff strategies, data parsing techniques, invalid data handling, data staging, code reuse Experience in developing containerized data applications and hosting data systems in container orchestration platforms like Kubernetes. Experience deploying data infrastructure Experience in a DataOps, DevOps, CI/CD environment with technologies and platforms such as Git, Jenkins, Docker/Kubernetes, and others is an asset Experience in rapidly prototyping a data product from scratch and leading the implementation in production. Experience with recognized industry patterns, methodologies, and techniques assets Experience working with RDBMS technologies including MySQL Experience with data warehousing technologies (SQL Server, Snowflake and/or Redshift) Experience with infrastructure including Azure & AWS (S3, Gen2 Data Lake, CloudWatch, Monitor, RedShift, Synapse, CloudFormation, Resource Manager), Terraform, Kubernetes, Docker, Bazel Experience with a broad range of data sources such as RESTful APIs, SOAP, XML, JSON, client stream, transactional, video, SCADA Experience with ML stack, including PyTorch, Plotly / Dash, Parquet, DVC, and Dask Skills: SQL Python Java Scala Azure Data Factory Snowpipes Informatica AWS Glue AWS Kinesis Kafka Kubernetes Databricks Snowflake Github DataOps & DevOps Skills: Data Engineering Advanced Analytics Container Technology Data Analysis Data Warehousing DevOps What you can expect from us: Insights you can act on While technology is at the heart of our clients' digital transformation, we understand that people are at the heart of business success. When you join CGI, you become a trusted advisor, collaborating with colleagues and clients to bring forward actionable insights that deliver meaningful and sustainable outcomes. We call our employees 'members' because they are CGI shareholders and owners and owners who enjoy working and growing together to build a company we are proud of. This has been our Dream since 1976, and it has brought us to where we are today - one of the world's largest independent providers of IT and business consulting services. At CGI, we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer, we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist. Ready to become part of our success story Join CGI - where your ideas and actions make a difference.
Monster

Philippines
Permanent
Full-time