In part 1 of this article I showed how I used AWK on the command line to work up daily rainfall data for my home town, Ulverstone in Tasmania. I wasn't ready to analyse the data, because there were quite a few missing-data days. Some were part of accumulated-total series, where the rainfall total…

AWK is my tool of choice for processing plain-text data, so when I wanted to look closely at daily rainfall data for my home town, I fired up a terminal. In this two-part article I explain how the rainfall data were beaten into shape, mainly with AWK, so I could do my analysis. The commands shown…

I was preparing a slide presentation and wanted to show a block of random 8-bit bytes, like this: Naturally I didn't just type out that block of text on a slide, which would have taken maybe 10 minutes, or copy and modify some byte-text I found online. Of course not. Instead I spent hours dreaming…

When writing or editing scientific-type text in LibreOffice Writer, I rely a lot on its spellchecker. Unfortunately, the scientific terms I'd like to check aren't in the default dictionaries behind LibreOffice's spellchecking routine. There are two ways out of this dilemma. The first is to deal…

I use the YAD dialog program quite a lot in my shell scripts. Written and maintained by Victor Ananjevksy, YAD is easy to use and has dozens of handy options. In previous Linux Rain articles demonstrating YAD (here, here and here), I used only the default YAD buttons, "Cancel" and…

In my data-cleaning work I often make up tallies of selected individual characters from big, UTF-8-encoded data files. What's the best way to do this? As shown below, I've tried grep/sort/uniq, AWK and Ruby, and AWK's the fastest. The trials also revealed an unexpected problem with the uniq program…

I've just built my own GUI calculator (script below). OK, you're probably thinking "WHY? There are plenty of perfectly good GUI calculators for Linux. Why build another one?" And my answer is "Because the available calculators are way too powerful and don't do what I want…

You might be surprised to learn that there are programs for running presentations in a terminal. No, I don't mean opening PowerPoint or Impress slides one after the other, as images in a frame-buffered console. I mean presenting slides coded for the terminal, in a terminal. Interesting idea? It…

My wife has been in the same Scottish Country Dancing group for many years, and back in 2005 she began keeping a record of the dances done at each meeting. She lists a fair bit of information in her "dances done" spreadsheet (screenshot below). She recently asked me "Would it be…

I carry a Garmin Etrex 10 when I go bug-collecting. It's a handheld GPS receiver without many frills, and I only use it to record the latitude and longitude of each of my collecting sites as a waypoint. At the start of a field trip I delete all previous waypoints. When I do this, the trip's…