How to Calculate Continuous Data Ingestion Costs Using Snowpipe in Snowflake

Snowpipe is a continuous data ingestion utility provided by the Snowflake Data Cloud that allows users to initiate any size load, charging their account based on actual compute resource usage. With this pricing model, you only pay for what you use but the trouble is, this can make it difficult for users to estimate Snowpipe […]

How Do I Optimize My Snowpipe Data Load?

Let’s talk about optimizing Snowpipe pipelines. For those unfamiliar, Snowpipe is the Snowflake Data Cloud’s solution for near real-time or continuous data ingestion.  Although Snowpipe is mostly controlled by Snowflake in terms of data load and compute (virtual warehouse), some tweaks can be applied to ensure data ingestion/transformation is optimal.  In this blog, we will […]

How to Implement Association Rule Mining in Snowpark

Have you ever wondered how recommendations popup as you click on products while shopping online? Think about that “frequently bought together” window you see when you go to check out.  If so, you’re in luck. In this article, we introduce the algorithm commonly used by large e-commerce companies like Amazon to uncover associations between products—known […]

How to Connect to Snowflake Using Spark

Spark processes large volumes of data and the Snowflake Data Cloud is a modern data platform, together they help enterprises make more data-driven decisions. But how does one go about connecting these two platforms? Whether you’re interested in using Spark to execute SQL queries on a Snowflake table or if you just want to read […]

How to Implement Slowly Changing Dimensions in Snowflake

In this blog post, we’re taking a journey into the realm of slowly changing dimensions (SCDs), specifically within the Snowflake Data Cloud. We’ll explore the different types of SCDs (with example scenarios for each type) and discuss how to implement the most frequently used SCDs (Type 1 and Type 2) in Snowflake. What Are Slowly […]

How Do I Build Data Governance in Snowflake?

Snowflake Data Governance

The world will have created and stored 200 Zettabytes of data by 2025, which is the equivalent of every person on the planet carrying around 400 iPhones. Half of that will be stored in cloud environments. As more and more data is created by systems, devices, and transactions, the complex challenges surrounding that data haven’t […]

Demand Forecasting Models In Snowpark

Welcome back to our blog series on Snowpark, the latest product from the Snowflake Data Cloud. In this post, we aim to highlight the use of demand forecasting with Snowpark by applying the most popular time series forecasting model (ARIMA), implemented in Java.  We will then use Snowpark to forecast in Snowflake the future demand […]

How Do I Understand a Role Hierarchy in Snowflake? Pt. 6

A graphic that has 3 business people icons with the text, "Access controls in Snowflake Part 6"

Thanks for visiting our series on access controls in the Snowflake Data Cloud. If you missed our previous blog on viewing privileges granted to a role in Snowflake, be sure to check it out. In this post, we’ll show you how to understand an existing role hierarchy in Snowflake. Snowflake has a powerful access control […]

Snowflake ML: How to do Document Classification with Snowpark

An abstract image of data and vectors

Join us on this technical walkthrough as we determine the practicality of the Snowflake Data Cloud and Snowpark for machine learning use-cases. Document Vectors With the success of word embeddings, it’s understood that entire documents can be represented in a similar way. In this case study, we will build a vector that represents a document […]

Is Snowflake Good for Machine Learning?

A picture of a brain to represent machine learning and the Snowflake data cloud logo

You may be wondering whether the Snowflake Data Cloud will help your organization with its machine learning (ML) initiatives.  The short answer to this question is a resounding “yes!” To fully answer this question, however, it’s important to recognize that most ML applications generally follow a common lifecycle. Snowflake is in fact great for ML because it […]