Location
Remote Philippines
Office Address
Project Description
1. Acceleration of Self-Service Portal.
- Perform existing data portal for data ingestion to event hub and expand current service to be able to put it on Kafka and add automation of batch data ingestion. Also includes Data Quality Checks.
2. Acceleration of the move from Datastage to Databricks using automated conversion tooling
Responsibilities
Designs and develops BI and Analytics solutions
Performs data analysis, data architecture, data engineering
Takes ownership of complex data-level or database incidents and problems and provides resolutions in a timely manner
Provides advisory and consultation services to determine the right solution
Utilizes best practices, work plans, checklists and defined processes
Proactively supports application teams
Performs optimization
Participates in project technical reviews
Leads or participates in work product reviews
Engages SMEs or vendors to provide assistance to resolve more complex incidents as required
Skills
Must have
Azure data platform and components: Azure Data Factory, Databricks, Blob Storage, Synapse, SQL DB/DW, Event Hubs, etc
AWS data platform and components: S3, Redshift, Spectrum, Athena, Aurora, CLI, etc
GCP data platform and components: BigQuery, Dataflow, Dataprep, Pub/Sub, etc
Big Data: Hadoop, Hadoop ecosystem, Spark, Scala, etc.
Language and Toolset: SQL, Python, PySpark, ELK (Elasticsearch, Logstash, Kibana)
Data Integration, Extract-Transform-Load (ETL), Data Ingestions, Data Cleansing, Data Preparation, Database
Data Warehouse, Data Lake, and Business Intelligence (BI) concepts
Nice to have
- Scala Skills
- Python Skills
- Azure Data Factory
- Background on Cloud/ Platform services
- Project Management
- Agile Methodologies
Azure DevOps and Datastage
Languages
English: B2 Upper Intermediate
Seniority
Regular
Relocation package
If needed, we can help you with relocation process. .
Work Type
DWH Development
Ref Number
VR-62669
Luxoft
Remote Philippines
Office Address
Project Description
1. Acceleration of Self-Service Portal.
- Perform existing data portal for data ingestion to event hub and expand current service to be able to put it on Kafka and add automation of batch data ingestion. Also includes Data Quality Checks.
2. Acceleration of the move from Datastage to Databricks using automated conversion tooling
Responsibilities
Designs and develops BI and Analytics solutions
Performs data analysis, data architecture, data engineering
Takes ownership of complex data-level or database incidents and problems and provides resolutions in a timely manner
Provides advisory and consultation services to determine the right solution
Utilizes best practices, work plans, checklists and defined processes
Proactively supports application teams
Performs optimization
Participates in project technical reviews
Leads or participates in work product reviews
Engages SMEs or vendors to provide assistance to resolve more complex incidents as required
Skills
Must have
Azure data platform and components: Azure Data Factory, Databricks, Blob Storage, Synapse, SQL DB/DW, Event Hubs, etc
AWS data platform and components: S3, Redshift, Spectrum, Athena, Aurora, CLI, etc
GCP data platform and components: BigQuery, Dataflow, Dataprep, Pub/Sub, etc
Big Data: Hadoop, Hadoop ecosystem, Spark, Scala, etc.
Language and Toolset: SQL, Python, PySpark, ELK (Elasticsearch, Logstash, Kibana)
Data Integration, Extract-Transform-Load (ETL), Data Ingestions, Data Cleansing, Data Preparation, Database
Data Warehouse, Data Lake, and Business Intelligence (BI) concepts
Nice to have
- Scala Skills
- Python Skills
- Azure Data Factory
- Background on Cloud/ Platform services
- Project Management
- Agile Methodologies
Azure DevOps and Datastage
Languages
English: B2 Upper Intermediate
Seniority
Regular
Relocation package
If needed, we can help you with relocation process. .
Work Type
DWH Development
Ref Number
VR-62669
Luxoft
Other Info
Philippines
Permanent
Full-time
Permanent
Full-time
Submit profile
Luxoft
About the company
Position regular Data Engineers recruited by the company Luxoft at , Joboko automatically collects the salary of , finds more jobs on Regular Data Engineers or Luxoft company in the links above
About the company
