GNU/consensus/Secure Messaging Scoreboard

How Secure Can Messaging Be?

Currently "secure messaging" is a loose term that according to Wikipedia is already achieved if your connection to your server or cloud is encrypted, regardless of the many intermediate nodes that could devise a way to intercept that communication and the server itself which most likely is obligated to provide surveillance interfaces by law or otherwise uses virtual machine technology or provides backdoor functionality in the hardware. That of course cannot be what we regard as Secure Messaging – software that protects the Secrecy of Correspondence as enshrined in most constitutions and human rights charters. With regard to the consensus developed in Berlin 2013 the criteria should be:

1. End-to-end encryption
2. Perfect Forward Secrecy
3. Social graph and transmission pattern obfuscation (= Protection of Metadata or simply "Anonymity")
4. Self determined data storage (= No cleartext data on servers)
5. No software backdoors (= Free software or at least open source)

Unfortunately there are very few technologies capable of providing this mix of requirements.

Motivation

The Electronic Frontier Foundation published a Secure Messaging Scorecard as the first phase of a promising campaign about Secure and Usable Cryptography. That is a good first step, but in the wrong direction: it fails to take into account NSA blanket surveillance programs such as PRISM, as if the plethora of new spying information could cover the scandal of NSA corporate partners. The bulk collection of communication metadata is a threat to democracy, as it undermines several basic civil liberties such as the Freedom of Assembly. While encryption is about the thoughts being shared, metadata is about the actual people. The EFF scorecard does not even mention metadata protection and none of the listed solutions are truly capable of that.

Moreover, it provides a false sense of legitimacy to proprietary software that is audited independently by, wait for it: "an internal security team", while unticking most of the free software for not having received any formal security audit. This incentivizes companies into auditing proprietary software that users should not use in the first place (since most companies are by US law required to introduce surveillance backdoors while publicly claiming the contrary) rather than promoting the auditing of free software, the only that can by its transparency provide credible privacy.

When confronted with this, the EFF tries to minimize the situation--they have their reasons, explained at What Makes a Good Security Audit, and yes counting on extraordinaire individuals to do the right thing should be enough (unless they move on, etc.).

The scorecard can be useful for professionals who understand the implications, but to the casual user it is not at all clear how the availability of audits is completely pointless if the availability of source code and independently built executables is not given. In that sense the scorecard puts everyone and everything in the same bag, flattening the landscape of messaging solutions and ultimately achieves the unpleasant goal of whitewashing proprietary softwares which by design should not even exist as they try to provide constitutionally relevant functionality they cannot possibly fulfil such as secure private messaging. The supreme courts of the world should declare such software illegal.

Our approach will therefore focus on building upon existing community work, and focusing on threat models and core features to discriminate among messaging solutions. We understand the objective of the EFF's Secure Messaging Scorecard, and respect their choice of starting from where the users are. But we disagree on how to present such solutions. Hopefully our work will prove useful to the EFF at some point.

We'll be using the following sources for our scoreboard:

1. the in-depth analysis of Secushare Capability Comparison.
2. the rich and community-maintained catalogue of alternative solutions at PRISM ⚡ Break.

See also the related Comparison of Secure Mail technologies.

Which apps and tools actually keep your messages safe?

Quoting from EFF's scoreboard: In the face of widespread Internet surveillance, we need a secure and practical means of talking to each other from our phones and computers. Many companies offer “secure messaging” products—but are these systems actually secure? No, they are not.

In order to keep things simple, we consider two categories: #Compromised and #Broken (#OK is an extra one to show upcoming or geeky alternatives):

• COMPROMISED messaging systems are proprietary and "open" solutions without oversight on the software code, the system's operation, or presenting fatal flaws in their architecture. This category is a simple list of solutions that should be avoided because they won't deliver what they promise. If we have time and interest, we can describe why it is so more precisely, although most of them are documented elsewhere.
• BROKEN messaging systems are (mostly) free software solutions that can be fixed to provide an acceptable level of privacy, and those are compared for the kind of threats they can thwart, and the ones they cannot. This can be useful for users who want to defend against specific types of threats, and for developers to choose what direction to take depending on the objectives set forth among their communities.
• OK messaging systems are free software solutions that are designed with privacy in mind, but also with thwarting global surveillance as a primary objective. That means any two interlocutors using these systems could not be matched by an all-seeing-eye watching both sides of the communication, and doing black magic counting packets and monitoring flows.

Criteria

One important thing you need to remember at all times: this is not a restaurant order, where you pick numbers and receive food. Those criteria are there to help you discriminate tools according to your needs, but your wants will get the last supper if you let them. Choose convenience or the cake with the cherry on top at your own risk.

Threat model

Our goal is whatever it needs to impede bulk surveillance. Our solutions probably cannot protect you if you are specifically targeted by authorities, but we want to keep you out of the unreasonable dragnet which is currently threatening the ability of entire populations to enact their basic rights. Most technologies being advertised by best-intended experts and media, let alone companies, do not actually fulfil the necessary requirements.

Legend

Each Line has the following columns:

Legend of table 2

Acronym		Description	Correspondence with EFF's SM Scorecard
SN	System Name	The name of the software, application, or service considered.	NA
ST	System Type	Whether it's a proprietary or free software, a phone application, a web service, or else.	NA (Is the code open to independent review?)
UX	Usability	Whether it's easy to use or requires skillz (easy, medium, hard).	?
MD	Metadata protection (Anonymity)	Whether the fact that you are having secret conversations is openly visible or properly protected. Whether your social graph can be harvested or not.	NA
CV	Contact Verification	Whether you can verify the identity of your interlocutor, and ensure you are indeed talking to the right person.	Can you verify contact's identity
FS	Forward Secrecy	Whether past communications are protected if the encryption key is compromised	Are past comms secure if your keys are stolen?
DD	Documented Design	Whether the security design is properly documented and available.	Is security design properly documented?
SA	Security Audit	Whether the code has been audited for security issues recently (linked to the report if it's public)	Has there been any recent code audit?

We left EFF's "Encrypt in transit?" column out because any application that does not use any encryption at all is compromised, and not part of the table. We left out EFF's "Encrypted so the provider can't read it?" column as well, because any application that does not use end-to-end encryption is a serious threat, and considered #Compromised.

Here we go...

Compromised

There is one simple criterion for considering a compromised messaging system: it's made by a company that it depends on, and you don't know how it works. Security by obscurity is as good as you can't find the switch. Then, you're caught naked in the bright light.

Apple Facetime

malware company and PRISM target

Apple iMessage

malware company and PRISM target

AOL AIM

Legacy proprietary software from AOL, a PRISM target

BlackBerry Messenger

Proprietary software and hardware from Research in Motion

Ebuddy XMS

Adware: does not use end-to-end encryption

Facebook Chat

Spyware company and PRISM target. Does not use end-to-end encryption

Google Hangout "off the record"

Spyware company and PRISM target. Does not use end-to-end encryption, not to be confused with OTR

Hushmail

Good reputation. So what? Nixon had a good reputation too.

iPGMail

Proprietary PGP app for iOS. Great idea, that's better than nothing at all. Keep in mind that by putting your GPG key on your iThing, you're compromising it.

Kik

Adware: does not use end-to-end encryption. 150 million products love Kik.

Mxit

From the EFF's SMS: does not use any encryption in transit

QQ

From the EFF's SMS: does not use any encryption in transit

Broken

Broken Messaging Systems

SN	ST	UX	MD	CV	FS	DD	SA
BlackBerry Protected	Proprietary platform (SW and HW)	easy	No	Yes	No	No	Yes	No
ChatSecure+Orbot	GPLv3+ XMPP+OTR for Android	easy	Partial	Yes	Yes	Yes	Yes	Yes
Cryptocat	AGPLv3+ Web browser extension	easy	No	Yes	Yes	Yes	Yes	Yes
Jitsi + OStel	LGPL application	medium	No	Yes	Yes	No	Yes	No
Mailvelope	GPLv3+ Web browser extension	easy	No	Yes	Yes	No	Yes	Yes
Off The Record (OTR)	E2EE
Telegram-FOSS	easy	No	Yes	Maybe	Maybe	Yes

Demoted

Goldbug was demoted from OK messaging systems. Previous investigation by gargramp on the cypherpunks mailing-list revealed obscure origins and questionable ethics for this software. Golbug is a communication system for desktops using opportunistic routing over P2P. It lacks anonymity features and is not recommended at this point.

OK

Woohoo! All is not bleak on Planet Earth! They are some people interested in addressing our electronic communications issues. Some of them actually think straight, long term, and are willing to find solutions that will last and actually improve our human condition beyond sharing cat pictures. No, there's nothing there yet. When we have a widely deployed 1.0, let's do that.

All OK messaging systems share the following features:

OK Messaging Systems Features

Feature	Class	Description
Free Software	Required	A free license ensures the code is accessible for use, review, sharing, and modification.
End-to-End Encryption	Required	No one else than you and your correspondent can read your conversation.
Metadata Protection	Required	The social graph of people communicating among each other is protected from inspection (= digital freedom of assembly).
Authentication	Required	You are assured your correspondent is always the same person.
Forward Secrecy	Required	If you lose control of your private keys, no previous conversation is compromised.
Deniability	Optional	Messages are guaranteed to be authentic during the conversation, but can be forged afterwards.
Instant	Optional	Messages are delivered to the recipient in near real-time. This frequently reduces your metadata protection, so it's not necessarily a worthwhile aim.

Mostly Working Messaging Systems

System Name	Type	Primary Use	Availability
			Desktop	Mobile
Bitmessage	Mail system based on blockchain broadcasting	Asynchronous conversation and forums	Desktop	No
Briar	Mail system based on opportunistic encounters	Asynchronous conversation and forums	Prototypical	Prototypical
Cables over Tor or I2P	Mail system using hidden services on either Tor or I2P	Asynchronous conversation	GNU systems	No
Freemail over Freenet	Mail system based on distributed storage in an anonymity network	File storage, Asynchronous conversation	GNU systems	No
I2P-Bote	Mail system using a DHT on the I2P Anonymity Network	Asynchronous conversation	Desktop	Android
RetroShare over Tor	Social communications tool on an anonymity network	Serverless synchronous and asynchronous conversations and forums	Desktop	No
Ricochet over Tor	Instant Messenger on an anonymity network	Serverless synchronous conversations only, end-to-end encrypted and forward secure	Desktop	No
secushare over GNUnet	Social communications tool on an alternative Internet routing stack	Anything social, in near real-time if necessary	Prototypical	No
Tox over Tor	Social communications tool on an anonymity network	Video conferencing	Yes	Yes