Author: Kai Wei

Partitioning in Hive tables

Partitioning a large table is general practice for a few reasons: Improving query efficiency by avoiding to transfer and process unnecessary data. Improving data lineage by isolating batches of ingestion, so if a ingestion batch failed for some reason and…

Read More >