upvote
A former coworker was evaluating the cleanliness and structure of some non-free GeoIP data that took the form of several large CSV files. He was writing nested loops in Go that parsed the CSV and evaluated the predicates that interested him, and it was arduous and not going as quickly as he would like.

I told him to slurp it all into a sqlite database and to express his data integrity questions as SQL queries.

It was still a pain in the ass for him, but leveraging that tool made things go a lot better.

reply