azure Data EngineerNeudesic Technologies

Migrate the application data from the existing application database on Sybase to new application databases on Azure SQL
Design, build, test, and support the project using Databricks, ADF, Azure Data Lake, PySpark
Quickly understand the business functionality and associated data models
Design, build, test, and support the data migration framework using Python & Airflow.
Develop or re-use the python-based migration framework to migrate the data from the current SQL Server database to a new application database
Responsible for understanding the data mapping/migration logic and work with SMEs where required
Perform data cleansing, data validation, sanity checking, and unit testing associate with it
Perform production cutover approach from a technical perspective
Advice on best practices about data management/migration
Develop Databricks Notebooks and create Delta Lake tables with optimization techniques