Customer's Challenge
A top provider in specialty insurance needed to modernize and centralize its entire data stack by migrating to a cloud-based solution. With little to no experience in cloud computing and with such a massive migration effort ahead of them, they needed a partner with the expertise to help them complete the migration successfully.
phData's Solution
phData completed a 48-week data engineering engagement that included fully migrating the client’s SQL Server database to the Snowflake AI Data Cloud while utilizing modern data stack technologies like Qlik Replicate for data replication, dbt for data transformation, DataOps.live for streamlined data operations, and Power BI for data visualizations.
Results
Once the engagement was complete, the client had their entire SQL database fully migrated to Snowflake, all of their transformation pipelines modernized with Qlik Replicate and dbt, and all of their SSRS reports seamlessly transitioned to PowerBI, along with the establishment of a continuous integration and continuous deployment (CI/CD) pipeline.Â
They were able to sundown their entire legacy environment while benefiting from an entirely cloud-based data stack that boasted faster execution times, better reliability, and much less maintenance than before.
The Full Story
One of the largest specialty insurance providers had a significant problem on its hands. They wanted to modernize their data stack, but migrating their current system would be an enormous undertaking. With thousands of tables, SSIS packages, and hundreds of BI reports to convert, they did not have the knowledge or capacity to pull a migration of this magnitude off.Â
They needed help.
Knowing there was no time to waste, phData immediately collaborated with the client to design a new information architecture and help stand up and connect their accounts in Snowflake, dbt, Qlik, and DataOps. Once the foundational items were complete, phData went on to:
- Convert hundreds of stored procedures and functions from SQL Server to Snowflake
- Utilize Qlik Replicate to migrate historical data for tables
- Re-engineer and migrate all SSIS pipelines to Qlik and dbt
- Perform data validation with the Great Expectations data validation tool
- Refactor dozens of SSRS reports into Power BI
- Orchestrate all data pipelines using Tidal
- Design and implement CI/CD deployment pipelines using DataOps
- Run both systems in parallel until the migration was complete and provided cutover support
Why phData?
When facing such a massive and intricate migration project, the client recognized the need for a partner with exceptional expertise and data engineering skills to ensure success. Enter phData, the ideal choice thanks to their vast experience with Snowflake and their innovative (and free) phData Toolkit. This powerful set of automation tools enabled the team to standardize and streamline much of the work, allowing them to complete the project swiftly and efficiently.
Take the next step
with phData.
Learn how phData can help solve your most challenging data analytics and machine learning problems.
