Data-Quality
Why INSERT IGNORE should not be used
Let’s say you’re building a reference table from source data, e.g. a silver medallion table from a primary source. In this example I am using a file of random locations on the globe extracted from OpenStreetMap (OSM) as my primary source.
Read moreWhat Constitutes Clean Data?
Clean data is one of those terms everyone uses and few define precisely. Row counts match? No nulls in key columns? Values within expected ranges? All useful checks — and all insufficient once you move from a table view to a visualization view.
Read moreData Masking 101
I continue to dig up and share this simple approach for production data masking via SQL to create testing data sets. Time to codify it into a post. Rather than generating a set of names and data from tools such as Mockaroo , it is more practical to use actual data for a variety of testing reasons.
Read more