In the first part of this big data manipulation series - which you may want to read first if you haven’t read it yet; Big Data Manipulation for Fun and Profit Part 1 - we discussed at some length the various terminologies and some of the ideas surrounding big data, or more specifically as it relates to handling, transforming, mangling, munging, parsing, wrangling, transforming and manipulating the data. Often these terms are use interchangeably and often their use overlaps. We also looked at the first set of Bash tools which may help us with work related to these terms.
This is a companion discussion topic for the original entry at https://linuxconfig.org/big-data-manipulation-for-fun-and-profit-part-2