senior Data EngineerCGI

Meet our professionals CGI USA - Finding Balance Position Description: We are looking for a Senior Data Engineers to work with their Data Scientists and build out complex data ingestion pipelines. We are language-agnostic and are open to Senior Da Meet our professionals CGI USA - Finding Balance Position Description: We are looking for a Senior Data Engineers to work with their Data Scientists and build out complex data ingestion pipelines. We are language-agnostic and are open to Senior Data Engineers with experience in Python, Java, or Scala. The ideal candidate must have extensive experience with building ETL pipelines in AWS and exposure to big data technologies like Spark, Hive, Databricks and Kafka. Any experience with cloud-based data warehouses or building data lakes is a plus as well. Your future duties and responsibilities: . Develop object-oriented, high-performance Python applications to meet the analytics and production data needs of the business. . Utilize Python data frameworks such as Pandas to populate the enterprise data lake using structured formats. . Configure, develop, and deploy streaming and batch AWS data solutions using tools such as Glue, Athena, Lake Formation, Kinesis. Optimize data applications to run on storage and compute frameworks such as s3, EMR, Redshift . Drive automation through data integration across on-premise, and cloud based systems and processes . Design, develop, and maintain ELT data pipelines required to populate dimensional data models in cloud-based columnar, data warehouse. . Partner with business stakeholders, Data Scientists, and Business Intelligence (BI) developers to define data requirements and data quality solutions to ensure accuracy of all metrics and master data. Document data lineage and ensure conformance to data governance principles. . Provide technical guidance to team members on moderate to highly complex data applications and on working with large scale data platforms . Triage and resolve complex data quality issues across all areas of data solutions. Required qualifications to be successful in this role: . Engineer should be very familiar with advanced concepts and have relevant, hands-on experience in many of the following areas to be a successful contributor on the team 1. Working knowledge of Python specifically data structures, flow controls, pandas 2. AWS Cloud and Big Data Technologies like Spark, Hive, Databricks and Kafka 3. Strong SQL skills including DDL, DML, Joins, Regex, Window functions 4. Experience with Git, Github and Jenkins. Nice to have: 1. Data Migration and transformation Principles and tools, preferably Apache Airflow/ AWS Glue 2. Data Warehouse and Data Modelling (Star and dimensional modelling etc.) 3. Understand Principles of Data Concurrency and Consistency 4. Ability to manage numerous requests concurrently and strategically, prioritizing when necessary. 5. Good communication and presentation skills. 6. Dynamic team player. Skill Set Data Engineering 7+ Excellent Python + Pandas 7+ Excellent AWS cloud 5+ Excellent Spark, Hive, Databricks and Kafka 4+ Excellent SQL 6+ Excellent Devops - Github/Jenkins 5+ Excellent DESIRED QUALIFICATIONS/NON-ESSENTIAL SKILLS REQUIRED Agile/Scrum Minimum Education Required: Bachelors Degree #DOUBLEEAST #DICE #LI-MP1 What you can expect from us: Build your career with us. It is an extraordinary time to be in business. As digital transformation continues to accelerate, CGI is at the center of this change-supporting our clients' digital journeys and offering our professionals exciting career opportunities. At CGI, our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create. Be part of building one of the largest independent technology and business services firms in the world. Learn more about CGI at . No unsolicited agency referrals please. CGI is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity and gender expression, familial status, political affiliation, genetic information, or any other legally protected status or characteristics. CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at . You will need to reference the requisition number of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a requisition number will not be returned . We make it easy to translate military experience and skills! Click to be directed to our site that is dedicated to veterans and transitioning service members. All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. Qualified applicants with arrest and conviction records are welcome to apply. CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI's legal duty to furnish information.
Monster

Philippines
Permanent
Full-time