Author: Scott McCormick

With Pythian’s Enterprise Data Platform (EDP) QuickStart, customers extract exceptional business value. It demonstrates tangible proof that their data can be quickly integrated into the platform and used to drive powerful insights. Implemented in days and fully customized in less…

Google Cloud storage provides a secure storage layer that is a cost-effective foundation of the platform.    When you ingest raw data into the platform, it is stored in a cloud storage bucket in its raw data format before any…

Pythian’s EDP QuickStart for Google Cloud couples a modern, integrated, cloud-native analytics platform based on Google BigQuery with the professional services required to customize it to your needs. Pythian turns your data into insights by leveraging your data sources and…

When architecting a data platform that will be utilized across an enterprise, it is important to design with scale, operational efficiency, and platform growth in mind from the beginning. Think big picture during the platform’s inception, define a clear vision…

Enterprises recognize that becoming truly data-driven will propel innovation, transformation, and differentiation. However, the modern analytics journey can be complicated and take many years, making swift results challenging.    Balancing the desire for quick wins with the skills needed to…

Many organizations hear “third-party data” and jump to the consumption of external data for augmenting their in-house generated and curated datasets. But there’s another aspect of third-party data, which is providing it back to others for their consumption. This is…

You’ve already moved some of your workloads to the cloud—probably the ones that were easiest to migrate, or the ones that provided a quick win. But your most complex workloads are probably still sitting in an on-prem data warehouse. While…

This post is part two of describing (near) real-time data processing for BigQuery. In this post, I will use Dataform to implement transforms as well as ASSERTS on the data and unit testing of BigQuery code and SQL statements. Part…

This post describes (near) real-time data processing for BigQuery with unique and other check constraints, and unit testing. This is part one of two, and describes the real-time ingestion of the data. Part two will describe how to implement ASSERTS…

Controlling Cloud Composer Costs and Performance Managing, optimizing and balancing cloud cost vs. performance is an ongoing challenge for all cloud architects and administrators. The variety and complexity of tools available can sometimes be daunting, so much so that many…