What Is Fivetran and How Much Does It Cost?
In today’s increasingly data-driven world, businesses need reliable and efficient ways to collect, analyze, and draw insights from their data. With so many data integration tools available in the market, it can be difficult to determine which one is the best fit for your organization. Fivetran, a cloud-based automated data integration platform, has emerged as […]
How to Integrate Bitbucket and Matillion ETL
Matillion has a Git integration for Matillion ETL with Git repository providers, which can be used by your company to leverage your development across teams and establish a more reliable environment. In this blog, you will learn how you can set up your Matillion ETL to be integrated with BitBucket and used as a Git […]
How to Migrate from dbt Core to dbt Cloud: phData’s Simplified Approach
At phData, we’re starting to see a sharp increase in clients who are looking to migrate to dbt Cloud from dbt Core. This is due to a number of reasons, which we covered in a previous blog post, but in short, it’s primarily due to a need to accelerate platform adoption outside of central IT […]
How to Automate SQL Tests in Matillion With phData’s Automated Testing Tool
How many times have you faced a situation where you performed countless tests to guarantee that your Matillion development was working as expected, but at some point, after you completed the tests, you needed to make some new changes in the workflows? Due to the changes you made, you now need to redo all of […]
Data Quality: The Missing Link in Your Cloud Data Migration
This blog was co-written with our partners at Anomalo. Congratulations—at last, you’ve finished your cloud data migration and it feels as if you just bought a brand new car! You can go from 0 to 60 in how many seconds? Hopefully, your cutting-edge cloud data warehouse comes with the latest and greatest safety features, too. […]
Why Upgrade to dbt Cloud over dbt Core?
So you’ve heard all the talk around dbt, but now you’re working to determine if you should go with dbt Core or dbt Cloud and you’re wanting to know what advantages dbt Cloud has over the free dbt Core offering. Upon a quick trial and look at dbt Cloud, the primary things you might notice […]
Automating Your Transformation Pipeline with dbt
So you’ve built your first set of transformations in dbt, but now you need to figure out how to automate your deployment and code changes to your various environments. However, you’re not sure where to even start planning, let alone making sure that you’re sticking to best practices (whether that’s running your code on a […]
Reducing the Time to Value of your dbt Deployment with Slim CI
So you’ve been using dbt for a bit now… You have all of your transformations in dbt and your deployments are executing flawlessly, plus you noticed your development velocity has greatly increased. However, as your dbt repo has grown, you’ve begun to see that your deployments are taking even longer. You’ve spent a lot of […]
Is dbt a Good Tool for Implementing Data Models?
Within data engineering, one of the most frequent tasks is modeling data into data marts and data products. Traditionally, if a company wanted to model some data, there were two types of resources available that could accomplish this: data engineers or data analysts. However, the approach that a data engineer would take to model data […]
What is Data Engineering? Everything You Need to Know in 2022
What is Data Engineering? Everything You Need to Know in 2022 It’s easy to overlook the amount of data that’s being generated every day — from your smartphone, your Zoom calls, to your Wi-Fi-connected dishwasher. It is estimated that the world will have created and stored 200 Zettabytes of data by the year 2025. While […]
