Downloading Yahoo Groups

Yahoo Groups used to be the way people with a common interest kept in touch before Facebook killed every other life form in its ecosystem and became the dominant social media for everyone over thirty.  Having spent a bucket of cash on the system a decade ago, Yahoo finally decided to cut its losses and ditch it, with the result that all the groups are going to go away and may not be accessible any more from mid-December 2014. If you want to download all the discussions on your group, you have until then to do so. Here’s how.

Prepare the Downloader

  1. If you’re not using Google Chrome, this won’t work for you.  So start by installing that, if necessary.
  2. You should have a toolbar under the address bar. If you don’t, click the three-dots menu on the top right and choose Settings.  Scroll down to Appearance and activate Show bookmarks bar.
  3. You should have an Apps button on the toolbar.  If you don’t, right-click the toolbar and choose Show Apps shortcut.
  4. Go to this page and download the ZIP file called YahooMessagesApplication-[version].zip.
  5. When it downloads, extract it to your desktop or somewhere else so you can find it easily.  It will appear as a folder named YahooMessagesApplication.
  6. Click the three-dots menu on the top right, then More Tools, then Extensions.
  7. Click Load unpacked and find the YahooMessagesApplication folder. Open that and click Select Folder.
  8. The Downloader is now installed in you browser and you’re ready to download a group.

Download a Yahoo Group

  1. Go to your Yahoo Group and log in.  You have to be a member of the group for this to work, but you don’t have to be the administrator.  I’m going to assume that your group is called exciting_group.  It will appear at the URL https://groups.yahoo.com/neo/groups/exciting_group/info.  Obviously, you should substitute the real name of your group exactly as it appears in your URL wherever I put “exciting_group” from here on.
  2. Scroll down to Message History and click on the very last message.  It will display a subject, an excerpt, an author, a date and a message number.  For example, it might look like this:

    Gosh, this group is quiet lately

    I notice that not many people are posting in the Exciting Group any more. Could it be that Facebook has taken over? That would be…
    Fred Nurk · Jan 7, 2009 · #12345

  3. Take note of that highest message number. We’ll be using that later.
  4. Click the Apps shortcut on your toolbar, and choose Yahoo Messages Export.
  5. Where it says Group, put in exciting_group (or whatever your group is called).  Don’t put the whole URL — it will fail in an uninformative way.  (Thanks to Rachel for finding this out for me!)
  6. For the Start Num, put 1.
  7. For the End Num, put something low like 20, just so we can test that it works.
  8. Click Download.
  9. The Downloader will now download the first twenty messages. This shouldn’t take long.  It will update as it goes: Retrieving message #1 in group exciting_group, then Retrieving message #2…, and so on up to 20.
  10. If it fails, you’ll get an error message.  Try again. Try a smaller number, perhaps.  Remember, you don’t want to download all umpty-thousand messages at once because just one error will make it fail, and then you have to start over.  Do it in batches; it’s fiddlier, but safer.
  11. If it succeeds, it will say We downloaded 20 messages.  Hit Save.  This will create a text file in MBOX format (more about that below).
  12. Redo steps 6-11 with the next set of numbers — say, 21 to 500, then 501 to 2000, then 2001 to 5000.  As you gain confidence you can download more per batch.  But remember: if you tell it to download everything from 1 to 19,249,430 in one go and it fails on message #19,249,424, then you just wasted your afternoon and you’ll need to try again.  Slow and steady wins the race.  When you get to your top message number as noted in step 3, you’re finished.
  13. When you’re done, you’ll have a bunch of files called exciting_groupmessages.txt, exciting_groupmessages (1).txt,  exciting_groupmessages (2).txt and so on.  Each of these is an MBOX file.

Use the saved files somewhere else

There’s no point having an archive if you can’t do anything with it.  Your options are:

  • Slurp it into a mailman mailing list, if you have such a thing.  (Note for Lochac people reading this: Masonry has the facility to deal with MBOX files. Contact Nicodemus for the next step.  If the preceding two sentences mean nothing to you, ignore them.)
  • View it with a mail program like Thunderbird or Outlook.  These have the ability to import MBOX files.  It’s safe to glue all the files together if you want to, or just import each one separately.
  • Save it as text. MBOX is basically human-readable, give or take some formatting. It’s better than losing everything!

Potential hiccups

  • Be sure to get the Yahoo Messages Export, not the Yahoo Members Export. They look similar, but the latter one doesn’t have the start/end number box, so you can tell it’s not the right one.
  • You will probably notice that out of 1000 messages, maybe 997 or 998 will download and two or three will not.  The Downloader will happily tell you which one(s) it missed, but for the most part there’s loads of redundancy in this system so you don’t need to worry about going back and getting every last one.  The skips are caused by some sort of network issues that is out of our control.
  • If you try doing this as a normal member rather than a moderator/admin of your Yahoo Group, all the email addresses will be obfuscated. If you want the email addresses, get the mod/admin to sign you up as one.  Or just don’t worry about it — the addresses are probably obsolete by now anyway, given how old some of these groups are.  It’s the message content you care about.
  • Yahoo bought the Groups system from eGroups in 2010.  Many of the MBOX-format dates will say 2010 instead of the actual year.  Fortunately, programs that read MBOX format files can handle this weirdness. It will only be an issue when you eyeball the file and wonder why there’s nothing there from before nine years ago.  Don’t panic – it’s just a harmless quirk of how Yahoo did the import.

Any problems? Email me on paul@huoncs.com.au.

Building A Local Web Development Environment in Windows

If you’re planning to develop websites in PHP, it’s inconvenient to have to set up remote hosting: you’re paying for your time, and dealing with the lag of uploading every change to a server somewhere else in the world.  Better to have a local server that you can mess around with.

For any kind of web development, you need a web server, a database and a programming language. Generally there’s no reason to deviate from the standard: Apache, MySQL and PHP.  Luckily there are packages that will install this for you; less luckily the process is made complicated by occasionally poor documentation.  So let’s get the steps right and avoid the complications.

I’m making some choices for you.  You can trust that I’m terribly clever and have looked into the options at length before finding the best possible choices, or you can just guess that I settled upon something that was good enough and couldn’t be bothered to change.  A bit of both is true: I did try a few other options, on the advice of other web developers, but I gravitated back to what I know because it does seem to suit my way of working.

First choice: WAMPserver.  It’s a French open source project, with its good and bad points. One of the worst of the bad points is that the installation instructions are translated from French, and the translators missed an essential paragraph, without which the rest is more or less useless.  I did six years of French in high school and it’s quite a short paragraph so I worked it out, but to save you the trouble I’ll give you the steps myself.

Second choice: let’s not just install the latest PHP version (7.3.5 as of June 2019) but also a few older ones.  PHP is famous for making major, breaking changes in minor point releases, and a lot of the service providers you will eventually install your finished products on are thus a little nervous about upgrading to the latest and greatest.  So we’ll grab a late version of PHP 5 as well as a few point releases of PHP 7.

Third choice: assume WordPress. You can get benefit out of these instructions even if you’re not setting up a WordPress installation, but my primary focus will always be on getting WordPress to work so that’s what you’ll get here.

Installing WAMPServer

We start at the secondary repository of Wampserver files. This isn’t the official project page, but has their seal of approval.  The first file you want is labelled Wampserver x.x.x yy bit zzz – Apache x.x.xx – PHP x.x.xx/x.x.xx/x.x.xx/x.x.xx/x.x.xx – MySQL x.x.xx – MariaDB x.x.xx, where the x.x.xx parts are various version numbers and the yy bit zzz part is your computer’s processor.  Hardly anyone has 32 bit computers any more, so you’ll probably want 64 bit x64 there.  Download it, but don’t install it yet.

The bit I alluded to above, the essential instruction that didn’t get translated into English, has to do with the support software that WAMPserver needs.  The reason you don’t want to install the file you just downloaded immediately is because it doesn’t work without the support software.  That software is provided by Microsoft, and is freely distributable but can’t be directly included in the installer.

(In fact it probably could have been included, and the reasons for not doing so used to make sense but are a bit redundant now, but this is a free project and sometimes you just have to sigh and accept that not everyone thinks the way we do.)

Scroll down to the section headed Tools, and download and run the program labelled Checks VC++ packages installed.  This will save a lot of effort in the next step.

When you run that, you’ll get a big plain dialog box that, at least at first, will probably run off the bottom of your screen.  It will list all the redistributable packages that need to be installed so that WAMPserver can run.

 

Now the game of Whack-A-Mole begins.  Pick an item at random from the list.  Go to the bottom of the repository page, and find the matching item.  Download and install it.  Then do it again, for each file in the list.

Sadly, you can’t install multiple files simultaneously.  Every installation is a special snowflake that does not play well with others. By all means download as many at once as your net connection will allow, but when you install you install one by one.

It is true that you have to install the 32 bit packages, even on 64 bit Windows.  The reasons for that are complicated and dull.  Sigh and accept.

Eventually, you’ll run out of items on the list.  You can close the popup, even if you can’t see the buttons, by clicking it and hitting Tab then Enter.  Then you just rerun the program again, and carry on with the process.

Eventually, you will see this delightful message:

That means you can finally install the actual WAMPserver installer that you downloaded what feels like months ago.

 

Do I Have A Virus?

There’s an old rule called Betteridge’s Law of Headlines.  It says “Any headline that ends in a question mark can be answered by the word no.” So, for example, if the headline is “Can chocolate cure cancer?” you can save the trouble of reading the article.  So if you want to save yourself time right now, you can answer the question “Do I Have A Virus?” with “No”, and voila! Free time!  If, however, you would like a little more detail, read on…

(more…)