Open Thinkering

Menu

Tag: Project Reclaim

HOWTO: Ditch Gmail for self-hosted webmail

Update (January 2015): Although the self-hosted approach detailed in this post worked really well for the six months I tried it, I’m now using Fastmail.


Introduction

On Friday, I decided to ditch Gmail. It had been a long time coming, to be honest.

I’m not really interested in having a debate whether or not I ‘should’ do this, or whether it’s objectively a good thing to do. I just had an epiphany when I realised that almost all of my data (e.g. search, email, analytics) was going via Google’s servers. It’s like some kind of legitimised man-in-the-middle attack.

Instead of Gmail, I’m using webmail on my own domain and (shared) server. It was a pretty straightforward process. Here’s how to do it:

  1. Set up self-hosted email inbox
  2. Forward (and archive) email
  3. Import folders and email
  4. Update email addresses around the web

1. Set up self-hosted email inbox

I’m using Reclaim Hosting, which comes with something called ‘CPanel’ installed. This makes it much easier to install and maintain apps and services.

Sign up for a web host that has CPanel. Login, and go to the ‘Mail’ section of CPanel:

cpanel-email

Click on the ‘Email Accounts’ option. Fill in the email address and password – for example, I chose [email protected]

cpanel-email-configure

You can now access your new email inbox by appending ‘webmail’ to your domain name – e.g. dougbelshaw.com/webmail. You have a choice of interfaces to access your email inbox. I chose Roundcube:

roundcube

2. Forward (and archive) email

The first thing you want to do is make sure that you continue to get the email sent to you in one place. To do that, you need to forward all of the email that comes to your Gmail account to your new self-hosted email inbox.

In Gmail, click on the gear icon and go to ‘Settings’. Once there click on ‘Forwarding and POP/IMAP’:

gmail-forwarding

Choose ‘Forward a copy of incoming mail to…’ and input the self-hosted email you set up in Step 1. You’ll have to confirm that account by clicking on a link that Google send to your new email address.

I chose to ‘archive Gmail’s copy’. It’s up to you what option you choose here.

3. Import folders and email

This is the bit that takes the longest. In fact, you can leave this running overnight and/or be doing Step 4 while this is happening.

Unless you’re declaring email bankruptcy, you’ll need to transfer your existing emails and folders from Gmail to your new self-hosted email account. Step 2 only redirects all new emails received.

First, you’ll need to use an email client like Mozilla Thunderbird (cross-platform) to download all of your Gmail folders and emails. To set it up, download Thunderbird and then launch it.

You’ll see something like this:

thunderbird-first

You’ve already got an email address, so click ‘Skip this and use my existing email’.

setup-gmail

Add your Gmail account first by entering your name, email address and password. Remember, if you’ve got two-factor authentication turned on for your Google account, you’ll need an ‘App password’ from your security page.

The default option is to connect via ‘IMAP’ which is what we want so leave it as it is and press ‘Done’. You should then see Thunderbird importing all of your folders and emails. This will take a long time.

thunderbird-gmail-folders

Note: ‘folders’ in Gmail are known as ‘labels’.

Now you need to add the self-hosted email account you set up in Step 1. To do this go to the menu and choose ‘New’ and then ‘Existing Mail Account’:

thunderbird-new-account

You’ll see the same box from when you added your GMail account. This time add your email address and password to the account you set up in Step 1.*

thunderbird-setup-self-hosted

Click ‘Done’ and you now have both your Gmail and self-hosted email account syncing with Thunderbird.

Now you need to select all of your Gmail folders/labels and drag them to your self-hosted account.

move-folders

Be careful to drag them onto the email address rather than ‘Inbox’ – otherwise the folders you drag will become sub-folders of your inbox rather than folders in their own right. Of course, you can always just drag them to ‘Archive’ if you don’t care.

Now wait. Possibly a very long time if you’re on a slow connection and/or you have lots and lots of emails and folders.

4. Update email addresses around the web

While your email and folders are transferring – and, to be honest, over the next few days/weeks – you’ll need to update your email address with the accounts you have around the web. There’s no great hurry for this, as your Gmail messages will be redirected to your new email inbox, but it’s nice to get things sorted.

You may also want to do one or more of the following:

  • send a ‘please update your addressbook!’ email to your contacts
  • use an email auto-responder on your Gmail account for a while
  • add a message about having a new address to your email signature

EDIT: Remember, if you don’t tell people about your new email address, your emails will still be going via Google’s servers (thus negating the point of the exercise…)

Conclusion

Did you manage to follow these instructions? Have you got a different/better way of doing it? I’d love to hear from you in the comments section below (or via this Hacker News thread)!


*Apart from believing in Open Source software (and working for Mozilla), one of my reasons for using Thunderbird is that it provides auto-setup for a much wider range of services than other mail apps. Also, the reason you see ‘SSL’ here is because I set up https on my domain using StartSSL. That’s outside the scope of this tutorial, but is also probably unnecessary if you’re planning to access your inbox via the webmail interface.

Banner image CC BY David Huang

Project Reclaim: a pragmatic update

Project Reclaim: September 2012

Boone Gorges, who originally started me on the path towards reclaiming my own data, has posted an update on his Project Reclaim. I thought it was about time I did the same.

I’d already mapped out the various tools I use (see updated version above), consolidated my blogs and experimented with openphoto.me. Just over a week ago I moved web hosts from Bluehost to Hippie Hosting. The latter is a co-operatively owned web hosting service.

There are, however, at least FIVE services that I’m not planning to move away from at the moment.

The first, and probably most obvious of these, is Twitter. At the moment it’s pretty much impossible to export my tweets in a meaningful way from the service. But a social network is nothing without community, so I’ll be there until something better comes along. (I don’t, however, use Facebook apart from a place to link to my newsletter or blog posts)

Next we have Dropbox. I really do love this service as it means I’ve got all of my stuff everywhere I am. We’ve also started using it within the Learning team at the Mozilla Foundation. I could try ownCloud or similar but when it comes to having my documents and sharing them easily with others, I want as little friction as possible.

Third is mobile-only social network called Path. All of my family now use this to post photos, videos and updates. It keeps us all in touch. Whilst it would be really nice to be able to get my data out of here quickly and easily the beautiful interface and benefits outweigh anything else at the moment.

Fourth we have Google’s services. With the proviso of switching off my search history and encrypting my searches, I’m fairly happy to use GMail, Google Drive and Google Calendar at the moment. Actually, that’s a bit disingenuous – they’re central to my workflow. I also use Google+ occasionally. Whilst I’m slightly uneasy with the situation, at least I can export my data quickly and easily using Google Takeout.

And finally comes Slideshare. I’ve experimented with using HTML5 slides but (a) they take while to put together, (b) I recently went over 100,000 views on Slideshare (one-hundred thousand!), and (c) I haven’t (currently) got the skills to make HTML5 slides as aesthetically pleasing as a a Keynote/Slideshare combo.

Conclusion

I’m going to continue with Project Reclaim as I think it gives me a steer in choosing the technology I use on a day-to-day basis. However, I’m going to be pragmatic about it. I could decide to use identi.ca instead of Twitter but, whilst that would give me a warm smug glowing feeling of openness, it would cut me off from contacts I find extremely useful and valuable.

You’ve got to balance these things out.

One thing that has been launched recently which is a huge boon to those looking to be more in control of their own data is ToS;DR. As TechCrunch pointed out, the biggest lie on the internet is that people read and agree to tortuously-long Terms of Service agreements. Instead, they’re more like “too long; didn’t read” (TL;DR). The Unhosted venture reviews Terms of Service agreements and rates them on various factors.

It’s definitely worth a look.

Project Reclaim: experimenting with openphoto.me

openphoto.me

As part of my ongoing Project Reclaim, and spurred on by D’Arcy Norman’s recent post on abandoning Flickr, I’ve been playing with openphoto.me.

In a similar way to the idea behind Unhosted, you bring your own data (i.e. photos) and the application does something with it (i.e. display them nicely, allow you to share them easily). I’m using Dropbox, but you can use Amazon S3, Box.net and more.

I like openphoto.me. I’ve uploaded two sets, one public and one private. The private one is of my children and shared only with family. The public one is of some photos I took down at Druridge Bay yesterday.

Where do you store your photos? Why?

css.php