Tag: Google BigQuery

Orchestrating dbt Pipelines with Google Cloud: Part 2

dbt pipelines

In part 1, we defined and deployed two data services to Cloud Run. Each service provides endpoints that perform specific tasks, such as loading a file to BigQuery or running dbt models. In this post, we’ll define and deploy some…

Read More >

Orchestrating dbt Pipelines With Google Cloud: Part 1


In my previous post I showed you how to use dbt to expedite data preparation tasks on Google BigQuery. This time, I’ll show you how to integrate those dbt pipelines into workflows that load, validate and transform data.    …

Read More >

Data preparation with dbt and BigQuery

Raw incoming data needs to go through a series of data preparation steps before it can be used for analysis. These steps include tasks such as type casting, renaming columns, cleaning values and identifying duplicates. Writing code to perform these…

Read More >

How to migrate from Teradata to Google BigQuery

Google BigQuery is a serverless, highly scalable, low-cost enterprise data warehouse that helps data analysts become more productive. It enables extremely fast analytics on a petabyte scale. And its pay-as-you-go model makes it attractive for organizations looking to move away…

Read More >

Hadoop to the cloud: Is it time to make the move?

When Hadoop was introduced, it promised a faster time to insight because of simpler modeling using cheaper hardware. But over time, organizations have been finding that Hadoop’s complexity and need for specialized skills are adding cost and headaches. Now instead…

Read More >

Gaming company benefits from increased responsiveness with help from Pythian’s Google BigQuery experts

When Skillz, a leading mobile eSports platform connecting 2.6 billion gamers across the globe, sought Pythian’s help with reducing storage costs, they learned they could not only reduce costs but also gain a more responsive application while providing an improved…

Read More >

Personal finance company develops secure data sharing with assistance from Pythian’s experts

A large personal finance company benefitted from Pythian’s expertise to help them share data securely and keep customer information safe. Pythian provided Google BigQuery expertise and developed innovative solutions to ensure secure multi-tenancy access to their data. The finance company…

Read More >

Data modeling for cloud DW

In this blog post, I would like to share some options that you can consider to model your cloud DW for better query performance.  With a traditional EDW, we would either come up a STAR, Snowflake or similar schemas. These…

Read More >

Advice from analytics pros: “Plan for 1000 sources of data and don’t move it any more than you have to”

“Plan for 1000 sources of data” and “Don’t move data any more than you have to.” These were just two of the many interesting best practices shared with a room of IT executives at TDWI’s Orlando analytics leadership summit earlier…

Read More >