After those tedious works (and clueless hours of staring at massive and messy data for sure), I got a data set with columns containing geo information and it was ready for mapping. Because of the maximum storage of my CartoDB account, I randomly selected 10k rows and imported it to CartoDB. Bang! Here comes the map!

Final thoughts

  1. Don’t judge a book by its cover. Clean-looking data might contain lots of useless stuff.
  2. Try Test-Break-Fix-Apply Programming when wrangling with large data sets.
  3. Other than Google and StackOverflow, CartoDB is my new friend now.