Tag: BigQuery

Episode 59 Shownotes Welcome to another episode of the Datascape Podcast. Cloud consultant Megha Bedi joins us from Meerut (near New Delhi) to discuss Google Cloud migrations and architecture. Megha’s impressive track record includes data and cloud project management, data…

Episode 58 Shownotes Welcome to another episode of the Datascape Podcast. In today’s episode, Brazilian native Felipe Ferreira joins us from Canada to delve into gaming data technology and analytics. Felipe has extensive experience in development, database administration, business intelligence,…

You’ve already moved some of your workloads to the cloud—probably the ones that were easiest to migrate, or the ones that provided a quick win. But your most complex workloads are probably still sitting in an on-prem data warehouse. While…

In the enterprise resource planning (ERP) market, SAP is the recognized market leader, with a massive installed base around the world. But much of that installed base is running on-premises ERP. As part of its commitment to the future of…

Most corporations have huge amounts of data in RDBMS (relational database management system). When considering a RDBMS data transfer and you only need a subset of data to migrate to the cloud, follow this very efficient and easy data ingestion…

This is the final in a series of three articles on the importance and characteristics of FinOps for managing cloud spend, its business justifications and what it all means for your organization. Click to read the first or second posts. …

Looking for how to prepare for the latest version of Google Cloud Professional Architect Certification?  Wondering if you are ready to give it a shot? If yes, then this post might help you ace your certification.  I’ll briefly summarize my…

Introduction Machine learning projects start by building a proof-of-concept or a prototype. This entails choosing the right dataset (features), the appropriate ML algorithm/model and the hyper-parameters for that algorithm. As a result of a POC, we would have a trained…

This post is part two of describing (near) real-time data processing for BigQuery. In this post, I will use Dataform to implement transforms as well as ASSERTS on the data and unit testing of BigQuery code and SQL statements. Part…

This post describes (near) real-time data processing for BigQuery with unique and other check constraints, and unit testing. This is part one of two, and describes the real-time ingestion of the data. Part two will describe how to implement ASSERTS…