Participated in implementation cloud Data lake for CBSA, designed and developed. Worked on multiple projects include Lvs, Carm, RTA, Elvis and on multiple datasets migrating to data lake
Implement data migration strategy to migrate multiple databases and data sets into cloud Data Lake include Ibm Db2, SQL Server, Sybase, Oracle.
Wrote system design architecture and document PDA design specifications for data sets migration on cloud
Created Proof of concept and implementation solutions and strategies on Development and test environments. Worked on multiple data sets and data formats. Migrated data into Raw bucket in Json and converted to Parquet format using Glue etl.
Build Aws Aurora servers, PostgreSQL instances, build ec2 instances installed clients, upload and migrate data, created data pipeline, policies, inline policies.