Friday, October 24, 2014

Not wrong to be forgotten

A few more points after the illuminating debate at the Cambridge Union Society last night (23.10.14).

i) so people are still hung up on the notion that,
because the internet/web/cloud can copy/store things so cheaply,
then deletion is impossible -

first off, that isn't necessarily so,
but even assuming it is,
its tantamount to arguing that
because we can now 3D print guns, we don't have to bother with gun control law...

- in fact, if there is a reason to remove data from publication
(its required by law - because its  defamatory or wrong,
or its required by ethics because the use is no longer relevant,
or its required by emotions - it would hurt someone's feelings again and again)
then the imperative is to embed the right in a law so that we incent people to withold their copies
(which is not the same as _erasure_ but is quite possible, and easily enforced

keeping a copy of my ex-partners photos private is fine (i do) -
re-broadcasting them 35 years later is not.

ii)  preventing search producing a hit on content from i) isn't pointless -
its just a weaker version of stopping people re-publishing stuff
the european court finding was blurry on this
because of the definitions of stakeholders in current law. poor.

iii) the argument that there are many search engines and meta-search,
and that the internet "routes around damage"
so people will setup sites like "blockedbygoogle"
minutes after something is not returned by search, is irrelevant -

if we get the law right, and the right put into action, then technology can work -

scale out of distributing rules for filtering spam (e.g. see how ApamAssinsin shares filter rules, see how ingress filtering and BGP policy checks work, see how legal censorship works etc etc and see how collaborative filtering and recommendation engines work), and
other tricks works vert well (no, not 100% -but we aren't arguing 100% -
we're arguing shifting the balance so
a) people think a bit about this,
plus
b) law that gives victims teeth, so deliberate flouting
earns the perpetrator fines/criminal records, public opprobrium etc

personal clouds, with personal control of flow of data through cloud, and
making the relationships between people and between people and organsations
(whether government or corporate)
more symmetric in terms of control of flow and lifetime of data)
is essential

people get confused about "google do x" or "person re-tweets y" -
the size of the agencies shouldn't
matter - anyone can leverage the internet to scale out cheap copying of data to many,
but should they?, is the question to ask?,
to whom? who is the entitled audience, now? or later? -
see next points:


iv) people are confused that this is censorship -
certainly currently the legal framework, and its "enforcement" by Google is a form of censorship,
because the "right to know" (i.e. public interest)
isn't being tested by an organisation that _represents_ public interest,
in any accountable way - sure, that's a bug, but we can fix that too - that doesn't mean
the right to be forgotten is wrong either

popular journalism (especially in recent years) has not helped :-)

Wednesday, October 15, 2014

Right to be forgotten & trolls & hobbits & elves

A two-part blog today

1. Right to be forgotten.
This is a very bad phrase. The right should be to not be reminded (as much).
The false dichotomy is just that - the binary decision between "remember and not remember".
Neither humans nor technology remember things accurately.

a) Every encoding is a decoding (Maurice Zapp, of Euphoric State University, in David Lodge's fictional Small World) - recall is revisionist for humans. It is also revisionist in technology - you may decide to do an audit (who read the file, when ? these are often recorded or appended to meta data) - where were the people looking at the data? why. Should we sort the results of a search to show more recently accessed data higher? this will affect others. Just as it does with your own grey matter!
b) We need to forget things - its part of coping with trauma, even just at the level of embarassment
c) We evolve (and we all evolve) so stuff we did that they agreed with then, we and they may not agree with anymore. Why should we be faulted now for what was ok back then?

Ref:
Delete, by Viktor Mayer-Schönberger

Better solutions - social nets should use interaction/activity based weights to decide what is recalled easily - stuff should fade - this copes with public figures naturally (as they interact with world but about their public duties, not their private lives) as well as the private individual online - if I havn't seen you for 25 years, I won't naturally recal lstuff about you - if you show up asking mefor a reference, maybe some stuff will come "flooding back" - this maps also to natural cognitive resource limits that are known about in humans, and implements a nice form of relevance filtering easily. THis also implements "unfriending without tears" on online social media - you just ddidn't interact with someone (like or mention or comment on their timeline) so they slowly fade from memory - many systems already are implementing things a bit like this, but for somewhat misguided reasons - lets fix it - its easy!

2. Trolls
There's a saying from 30 years or more of newsgroups (Usenet, if you go back that far):
"Don't feed the trolls"

So trolling is getting worse - this is not surprising - there's more people in the hills (which have eyes) than ever. These people don't know from Adam (and they are probably eating the apple). Why do they troll - to share in your glory? who knows....but they can because of what I might call Internet Induced Empathic Disorder - they are alienated, and they don't know you are a person - many of them do stuff they wouldn't dream of doing in the same room as you - this is well known. Its worse where there are too many terrible cultural examples (see the Russian Social Media abuse below, but nearer to home, see BBC's :Have your say" comments  or Youtube's hilarious children from hell type comments on videos there (remindes me of the evil devils on rollerblades in the hilarious film, Dogma!)

How to fix? Engage or Ignore? I don't believe the troll's target is the right person - we need to have a social response - peer pressure - show the troll where they sit, surrounded by hobbits and wizards (and elves) - that'll wake them up, or else turn them to stone, come sunrise.


Ref:
Protest 2.0 - networked negoative consolidation

Wednesday, October 08, 2014

The Lottery of Babel and the Library of Babylon

On every floor of the tower, it is sometimes said, a different language is spoken. once a month, the floor manager buys a ticket for the lottery. if the ticket wins, the language stays the same. otherwise, a new language is chosen, and everyone on that floor must learn it. the chances are rare that the language stays the same for 2 months in a row, let alone a lifetime. however, it is rumoured that sometimes this has happened. Indeed, it is said that there are dizzy heights and possibly sepulchrous depths in the tower where denizens of neighbouring floors have found they spoke the same language as each other for a time. the lottery is administered, of course, by a priesthood, who either understand all the languages, or else have their own universal tongue and each learn the language of a handful of floors. nobody knows which.

few people on each floor are capable of learning a new language every month, and so most people cannot truly understand one another. sometimes, a group get together and try to keep the old tongue alive. these cathars claim too that there are no priests and there is no lottery. they are quickly suppressed.


In the library of babylon, the most sacred works of all religions are kept. the more common books, such as the bible, the torah, the koran, the vedas and so on occur in many versions. the rarer religions, or ones for whom there are few remaining living followers, often have a single copy, or even only a partial segment of the Ur text. the organisation of the library is chaotic. the librarians wanted to organise the text in order of date, but could not agree on whose calendar to employ. then a small group  proposed alphabetizing the entire collection, but were resisted by those who pointed out that there were more ways of writing than there were religions.

the theological experts suggested that there was a tree of religions, not to imply "older" or more "fundamental", but that one could see many similarities in the gods - the indo-european polytheists at least, and the abrahamic religions.

the chief librarian suggested that this was merely the result of errors that crept in during the copying of texts due to the biases of the monks at the time.

as a result, no-one can vouch for the correctness of any of the religious tracts. reform and born-again are thrown together in confusion. there is a ground swell of opinion that the library must be burned, as it represents the ultimate sacrilege. the librarians have all deserted the buildings, which stretch far across the sands to the sea, where the boats full of foreigners are arriving. it will not be long now.

Monday, August 25, 2014

I Need a Vacation

I went away (as we do) for 2 weeks to Paleochora, Crete and then 1 week in La Villa, Fosciadora, Garfagnana so I should be feeling great, n'est ce pas? well up til the last minute in each place, all was v. good, but then, in each case, there's a long drive to an airport, waiting around for a plane, and a long drive home from the airport in England. Then there's no food in the house and everything smells of damp and cat. Then there's a pile of obscure letters on the doormat. Then there's kids' results to open and ponder.

Then there are rental car add-on bills in the e-mail which appear to be made up out of thin air (thank you Maggiore, yes that's you - bogus bill about twice the amount of the quote on the booking).

Then there's email - two weeks away and 1300 mesages to deal with, at least 100 of which actually require thought - 1 week away, and another 450 messages - this is in august, for godsakes, when most people should be on a beach or by the pool, but no, they are writing research proposals, drafting theses, preparing responses to research funding agency calls, discussing research code releases, posting papers from conferences (yes that's you SIGCOMM, right in the middle of august and in Chicago, where no sane person would go except to see Buddy Guy, and then not in mid-summer). And my vacation away mail told people (and I told all my colleagues I'd be offline too).

I think that German Company that started to delete all e-mail for people on vacation has the right idea - work/life balance tricks like that are essential for some sort of sanity. I actually had a vacation message that said that once, but still people resent stuff after I know they got my auto-response.

Modern Technology is not progress - repeat after me:)

Thursday, August 14, 2014

NPfIT - NP Hard and Not Fit for Purpose

In an interesting report from the Cambridge MPhil for Public Policy student group, on the largest IT project failure ever, so far, a lot of historical detail is dredged up, and a number of useful conclusions drawn under headings like Haste, Design, Culture & Skills, which are pretty hard to disagree with.

Some stuff goes unsaid, but reading between the lines, one might ask

1. were no "references taken up" for the people who were shortlisted for the contract? I mean I know BT pretty well, and I'd never hire them for a systems integration job like this - sure, for the spine/N2 (which worked fine, and afaik, were loosely modelled on SuperJANET), but not to bring together an unknown outfit with a dodgy sounding name (iSoft - wannabe Microsoft:) and Fujitsu (ok, make decent clone PCs once then, but large databases etc? Not really).

2. So I realize it was a while ago, but even then, we had rapid growth internet outfits with many services (like google and apple and onlone gaming) who had built customer relation databases (with ok security) for 100s Millions of users, which managed a lot of stuff that scaled out, and could address the srts of needs the NHS requirements said (oh, ok - the requirement capture was one of the biggest failings in the whole thing, of course) - one thing that open source, internet/cloud companies do is to stay agile, so they can interface to legacy systems (as they get big enough to acquire them - e.g. google buying youtube or the maps system, or microsoft buying skype) - in the same way, rather tan imposing a central design on an heterogeneous set of health services, interfacing between them woould have been just fine...

3. How bad was Lorenzo? Didn't anyone do a code inspection ever? It sounds a bit like the Obamacare sign-on system fiasco - but why? I mean lashing up a bunch of patient recor databases into mongodb, mysql or whatever (let alone Oracle or Ingres or some big iron dbase) is not rocket science. Its done by Internet startups 100s of times a year and is hardly ever the reason they fail.

Of course, the other component that work (Picture Archiving / Comms) worked because there is much less heterogeneity in those systems - image standards exist and you just need web/email access to glue systems together....so lucky no-one managed to balls up that part, eh!

Anyhow, nice report, but would be nice to hear more about the contract failures (lack of penalty clauses with enough teeth)....

Sunday, July 20, 2014

forget me, forget me not - how to implement?

some haev argued that
copyright takedown == right to be forgotten
(ie. not quite the same as censorship - just enforcement of access control
by the data owner (in case of PII, person is owner of rights to access some
facts about themselves, unless there's a compelling argument for public knowledge) -
there are other arguments for and against, but this analogy (whatever its flaws) might be useful for estimating the cost of the right to be forgotten (as per EU court ruling)

whatever the many of pros and cons on the topic, but how to implement?
well, if you upload film, music (or stills) to youtube, and are worried about copyright, don't:
google have made it their business to acquire legal copies of Just About Everything digital, and will eventually match whatever you've uploaded to a copy they have in house - they will then discover if there is a rights holder (that isn't you) and, if they havn't already done so, will contact said owner, and ask/ngotiate
 a) do they want content taken down b) do they want analytics c) do they want advertising revenue -
in fact, google can and do optimise this by region by doing blanket agreements with large publishers of digital content.


so to do the same for stories in webpages (and search results) concerning individuals could be done exact same way (probably is) - the technical cost might be a bit higher because you need to
keep a per page (per region) filter entry. The bigger cost (by far) is establishing genuine rights holder (data subject) and whether there's a public interest angle or not - this requires judgement (rather than just money:) so I think its interesting that Google is doing this now...

but the negotiation is where this differs and that's a really tricky business...

Thursday, July 17, 2014

Mutually Assured Distraction

A lot of commentary on the current fad for extra-territorial mass surveillance misses the point - the reason countries are doing this isn't just because they can, its because they can't currently be held to account.

In the old days, spies would be caught from time to time, and executed (or exchanged). Now, the spies aren't in the other territory, and plausible deniability means you can't even use extradition agreements between allegedly friendly countries (e.g UK &US) to get them bought to book/justice. This shows up in other domains than mere military intelligence:

1. Drones
2. Finance
3. Energy

Sadly for all these, the level of technological development of a country really doesn't have to be that great to gear up to use a bunch of 100$ radio control quadcopters, or a cunning HFT instrument, or even just the ability to turn off the gas pipeline to a neighbour - of course, there are expensive versions of these weaponised tools (e.g. BAe Systems drones that US uses in Pakistan are quite pricey - surprisingly so given cost of crop spraying, or outside sports broadcast drones, really - but then the MoD/DoD were always targets for ripoff pricing) - also the US threatens banks who don't reveal US taxpaying customers accounts/transactions details with massive fines if the bank has a stateside operation (of course, swiss and german banks just close down US tax payer accounts rather than face this), and Putin wields the russian gas wealth like the playground chess playing bully he is:)

But the low cost versions are just as bad.

Hence, talking about this needs to move up a level, methinks, as the realpolitik of using this stuff is not going to go the way of nukes, quite the reverse, since the Use of Weapons of this type doesn't lead to Mass Destruction, just death by a thousand strikes......

Wednesday, July 09, 2014

Horizon Digital Economy annual shindig - some ideas...

so we had the Horizon annual conference last 2 days in Nottingham, and jolly good it was too - esp. two v. good "industry" talks, one on New Media from local 21st century 'cinema' people in notts, the other from the link guy for NHS data projects which was v. v cool

couple of ideas sproinged up during discussions

1. the loneliness of the long distance spectator - instead of filing a long strung out event (marathon run, tour de france etc) from central, string together a set of friends and family of a given participant into a narrative...lovely idea  - whole new experience for all concerned - main problem is legal consent (if spe, participants have prior agreement, e.g. with news media channels) - should be fairly easy tho to think through

2. informedConsent.com - a startup idea - we are suffering from ethics questionnaire fatigue - we need a pool of people who agree to be study groups for repeated things (a la Nielsson ratings biz model) and just deal with their informed consent once (or occasionally) for all those twitter/facebook/email/emotionsense/mypersonality etc etc

3. Embrace Messy

Lots of studies of systems (esp. internet of things or other tech embedded in everyday life) involve lots of noise - e.g. multiple occupancy houses etc etc - why bother trying to be a control freak nailing down who is who (e.g. with fascistic rfid tagging of everyone or even worse, invasive use of cameras or mikes and face speaker/gait/gesture recognition etc) - embrace the mess - for example, lots of people in my house use computers at random, so we all get each others' profiles/recommendations - this is amusing and, indeed, gives us a community feel about who likes/watches/listens to what!! this is good not bad:)

the fact that it also acts as cover traffic is also good for fuzzing (plausible deniability:)

Friday, June 20, 2014

35 years of irresponsible research

Yesterday, I went to the very cool science museum london future room to attend the very cool Responsible Innovation project's flagship event showing off their rather good ideas on how we in the tech sector (the hated ICT term unfortunately due to funding agency's presence) should include some sort of notions of responsibility (e.g. to people, e.g. ethics and society) into our work in innovating (i.e. don't just do it because you can, but choose what to do because you should and what not to do because you should not:)

being a grumpy old git yesterday, I had to intervene in various curmudgeonly ways, but on the whole, I thought the proceedings were constructive, optimistic and helpful, and surprisingly, a lot of people in the audience seemed positive too:)


So here's some comments on the event

Marina Jirotka (University of Oxford) introduced the project - a few things I didn't like
1/ they were filming and we were told if we didn't want to be filmed, not to ask questions - that's a bit of a technology fail up front:)
2/ the noise level fro mkids running around in the science museum would have made life difficult for anyone with significant hearing loss (e.g. me, which is why i was sitting in the front row being annoying)

Marina showed a REALLY cool video showing affective robots as a use case example of hat can be good, but then bad - i didn't say it at the time, but Robots have been done to death in the Sci Fi (our ethical storifiers) community - not just going back to the Golem of Prague, but Asimov's Zeroth law, and then things like Aliens Synths (good and bad in Alien 1 and 2) and BLade Runner's Replicants (and Philip K Dick's dissection of what makes us human and them not (empathy!). and even humans falling in love with robots (see one of the original I Robot stories - or for a more oblique version, see John Wyndham's story abotu smart monkeys painting and revealing adultery in a family) see also Sladek's Roderick & Roderick at Random for a lot of discussions of robots in society
Indeed, one distinguishing feature of the Geek/Tech (ICT) sector is the addiction of many practitioners to the morality tales that we get from 100 years of Sci Fi (HG Wells, Jules Vern to Star Trek and Dr Who - many featuring techno ideas 50 years before they are realized, with a full exploratory discussion of their pros and cons - for more recent stuff, look at Pat Cadigan's  work, e.g. Synners or Charlie Stross's Accelerando....for other areas of concern including mixed reality and new economic forms...or even Eternal Sunshine of a Spotless Mind
 Sir Nigel Shadbolt (University of Southampton)
Sir Nige is ever the optimist - I asked him about being forgotten - why do we need to save everything personal - he bought up the difference between Commons and Public goods and private goods (see question later about 17th century models:) which was a good answer - I asked why we just talk about data and not just processing - for example, why can't I direct th digital camera stream to my phone (which knows where I am in the room and has enough processing to remove the pixels with video of me and send back to the net without me, for example - many other examples, given the copious amount of CPU cycles out there where we could personalize and filter the interweb in ways that reflect our preferences for what is seen by who about stuff that concerns US! we could even build Social Machines (e.g. for democratic or dictatorial households or meetings) to determine what rules for processing and storage apply:)
Note, Technicolor routinely customies digital movies for over 30 different locales in europe (e.g. substitute for a coke can, Orangina in France, or IrnBru in Scotland) - so substituting for my image in known location in a (fixed) camera view is really quite trivial:)
 Artist display - Barbara Gorayska - quite a cool performance/installation in the break
PANEL: How do we innovate responsibly in a digital world?
Chair: 
Lizzie Coles Kemp (Royal Holloway, University of London) - great synthesizing chair person!
Panel:
  • Daniel Stauffacher  (ICT4Peace) - very cool stuff - like the IRTF's GAIA group (see research group which will meet soon )
  • Derek MacAulay  (Horizon Institute, University of Nottingham) -- Gave a nice chat about Horizon model of personal cloud etc 
  • John Hand  (EPSRC) - the funders viewpoint - I mentioned the NSF as an Ethics for STEM programme that's more general that EPSRC should look at...
  • Anthony House  (Google) quoted Tim O'reilly "Create more value than you capture" and also got asked a great question about breaking concrete that cements us to 17th century values:)
  • Judy Wajcman (London School of Economics) - a GREAT talk about women and about time (why should everything that's faster be better:)

Q&A:  Questions to the panel
I asked "since many areas like banks/finance, government/war, pharma/medical, energy/global warming, as well as cloud/privacy, don't take ONE BLIND BIT OF NOTICE of what would be socially responsible, why should we in the tech (ICT) community bother?
Several questions followed, which were a bit less blunt....

The gist of the answers was that we could lead/set an example, but also that businesses if large need to keep their brand clean so theres is mileage (economic) in being ethical, plus small outfits would like help ("tell us what to do")

of course, not just being motivated by profit (Pikketty got namechecked) was good - i'd have love to have heard Precariat views too:)
 WRAP UP: Tristram Riley-Smith (University of Cambridge) wrapped up with the Science/Evidence-> Policy story which was good stuff

I'd have like to have heard about making the law responsibile too (GCHQ said "we don't break the law" - not on paper, bt in a moral sense they do:)
[shout out here to PIs Campaign to test this in European Court

Wednesday, June 18, 2014

Duty Cycles Finished

We depend more and more on Solid State Storage, and more and more devices use rechargeable batteries.

What if one day, everything went wrong at the same time?

Why this is not unlikely?

Simple - the devices are made and sold in batches. They have a duty cycle limit (there are a maximum number of write cycles you can apply to Flash memory and there are maximum number of discharge/recharge cycles you can run a battery through). The chances are likely because of the law of large numbers - most people buy things at xmas or other holidays, so manufacturing and usage are synchronised.

Devices (like cars) are built so that components fail on the guarantee lifetime boundary (or just after).

The law of large numbers (central limit theorem) says that this is something that will apply to lots of stuff....

So picture this (cue Blondie music) a day in december, 2024, all the electric cars and phones and networks and power systems and internet of things die. And cannot be rebooted. Ever. Again.

Friday, May 30, 2014

Solution to the Google Glass Privacy Problem

It's obvious that Google Glass is the only way we will solve the dementia problem of the future, but the current worry on many peoples' mind is the ominpresent privacy risk - as written about so cogently in Dave Eggars' book, The Circle, this is not acceptable.

I propose a solution, not very different than several technologies I invented many years ago such as the Hairt and the Gurl (a clear pre-cursor to the Glass, and obviously prior art sufficient to bust any patent on it:)

The solutions is that every Glasshole shall be given a regulat supply of enough kits for everyone in every social encouter that might cause embarassment for innocent bystanders (colleagues, sexual partners, family etc) - a suitable kit is already available for around 5 bucks - see google tache proposal, for one fine product.

This would also make many pub situations infinitely more entertaining.

Thursday, March 20, 2014

the net is a very gendered engenderment

so thinking back, its hard to remember any women associated with the creation of the internet - lots of "fathers of x" and so forth

yet in the 70s and early 80s, computer science was nearly 50/50 gender balance (in jobs I had an university courses and departments)

so why did this happen?

and how would the net be different if it had been designed/discovered/invented by women?

answers on a woven tapestry embroidered with holerith string band music

Tuesday, March 18, 2014

Towards an Aesthetic for Conspiracy Theories

So we need to lay down some terms for these conspiracy theories, that enable people to get them right (lets say we want to start a few bogus ones and see how they run, for example:-)

Rule 1. Lack of evidence proves that there is a cover up.
This is an essential rule of the conspiracy theorist - its part and parcel of the next rule:

Rule 2. A conspiracy theorist should strive to make their story unfalsifiable.
Falsifiable theories are for Popperians seeking objective knowledge, not for the hunter for objectionable ideas.

Rule 3. Ideally, a conspiracy theory should have great (in the sense of broad) explanatory power or applicability - it ought, at one fell swoop, to encompass several problematical domains (missing aircraft, beleaguered news readers, confused celebs). Conspiracy theories make the inexplicably complicated, suddenly comprehensible to a complete dolt.

Rule 4. Any decent conspiracy theory resonates with some fundamental cultural meme, especially one that engenders fear, uncertainty and doublets. Hence myths from eldritch times, alien technology, hidden rules of numbers and the odd way some people look at you when you talk about this in the context of UKIP's chances at ruling Scotland, are essential.

Rule 5. There is a cover up, which means that there are coverer uppers. There is some group (Illuminati, Opus Dei, the French, the Arms/Drugs/Car manufacturers, UKIP) who know something, and are not telling us.

Rule 6. A good conspiracy theory exploits the principle of maximum astonishment (see also Rule 3). On the other hand, a conspiracy theory might sound occasionally plausible for a moment - for example, the fact that mice, cats, dogs and horses are just different stages in the growth of the same creature, or that the names of passengers on flight MH370 were the same as the travellers on the Marie Celeste, or that 3D printers contain secret scanners to make sure you don't ever copy people, especially not members of UKIP.

Sunday, December 22, 2013

Search Me

In the UK, we had/have a deplorable police practice called "stop and search"

now this was ostenisbly so people suspected of carrying {drugs, knives, guns, islamic-extremism, irishness} cold be caught - unlike the US, this was targetted - of course, the net effect was to alienate various groups (especially the last 2) even more.

ironically, one of the things about the british police people like is that you could ask them staff - "ask a bobby" was a common piece of advice - the {time, location, help, etc}...and generally, they would be helpful (still are sometimes) - also, them not carrying guns makes them a bit more accessible:)

So now, if you search the internet via some engine {Google, Bing, Yahoo! etc}, what you look for will no doubt be part of the encroaching polis-state's total information awareness - as someone said at the IETF, when flying to Vancouver recently, he'd set off from another airport very early, and was about to send his partner an {e=mail, SMS, checkin} saying "this airport is SO dead", and then thought "do i really really want the NSA to put their interpretation on that".....

how weird to live in this world.

so the {NSA, GCHQ, Disney, etc} collect all our utterances.....but you can't go ask them for anything.

note that despite this, 9/11, 7/7, and poor Rigby's murder occurred. all that money spent by the surveilance state, but they can't reveal what they know in case the bad guys know that they know who the bad guys are and where they live.

come on, its our money, and we know you know where everyone lives, so how about you use it t round up the usual suspects for once before they commit some outrage, eh? just once. to prove you didn't spend it all on drink and drugs

Dave Eggars puts it in to context with a nice article discussing the swings of history and the story of Bernstein and the Front....for me, what we need is an extremist liberal take over of government which locks up and persecutes all the surveillance people for a couple of years, to give them a taste of what they are going to enable, but to point out that if it was an extremist right wing takeover, it would never end.

Sunday, December 08, 2013

terms and conditions, part II

1. We were wondering why there's no service that explains all online services' Terms&Conditions in Plain English once and for all (using a common set of terms:)

e.g. you own everything you put here on google's blogger service; or you own nothing you put here on google's blogger service. When you die, it is all deleted; or when you die, it is all in the public domain; etc etc

2. We were also wondering why there is no service that explains to you your privacy settings in one simple infographic, once and for all

e.g. using a simple visualisation of which people  who you don't know from Adam can see something you post or tag or blog, when a friend of a friend responds, reposts/ tags etc  - i.e. a simple venn diagrammy type thing with your ego net extending at least to friend of friend, then with pictures of people further away in the you-centric infosphere, and so on.

Of course, one answer to these two questions is that there isn't really an honest way to make money from such a service - or at least, not in a way that would a) induce trust and b) not cause all the existing service providers to set their best lawyers on you...

So I'm thinking this is an excellent project for cloud legal people at QMUL - we can get law students each year to do a project translating T&C for for the lay person, and explaining about property and privacy for the great public users of the unwashed Interweb....

3. Single sign on - hmmmm - how do we do this with really fast revocation? I quite like the two-gadget approach (you need a fitbit like device that talks to your smart phone - without both, AND you, then all bets are off....

Monday, November 25, 2013

The Role of Religion in Revolutionary Network Architectures

I'm looking forward to the forthcoming IAB workshop on Internet Technology Adoption and Transition for lots of reasons (catch up with many people, navel gaze about important topic, maybe even find out what works and what doesn't)!)

However, I'm looking through all the papers that will be presented and am worried that we are missing a very big factor in technology's success or failure, and that is faith.

The papers to be presented break into 4 rough groups
1. Economics -
     e.g. how do markets and commons interact.?...
     how do various tricks bundling, regulation play out?

2. Process -
     what do patents do to things?
     how does the ietf capitalize (or not) on research?

3. Ecology
     does the hourglass emerge always?
     how is diversity helpful (or  hindering)?

4. Technology
   what makes a protocol tick well?
   what pieces of the current experimental world (ICN, bitcoin) will make it to      prime time?

All good, but all roads that have been trod several times before in the communities - in general, economics has not had a great track record in prediction, and bio-inspired stuff is fun, but again doesn't match the details.
It is always worth studying the process and use cases are well worth documenting of course, but what bugs me is that there are so many potential failures we havn't looked at, and what do they have in common?

For me, it is the lack of a fervour, and what is more, persistence in the face of strong adversarial reaction - when we started deploying IP (I am not talking about the mega-ARPA projects, I am talking about the "going into schools at weekends" and "laying out community nets in small towns" movements in the mid 1980s), we were conducting a missionary movement - I recall also giving courses on TCP/IP to hoards of commercial folks despite their seniors in their companies still buying all sorts of CCITT (now ITU) and ISO (now nowhere to be seen) products being pushed by big companies and government agencies (GOSIP - Government OSI Procurement, was the official religion).

We persisted on this for 20 years - we still do....but we are now the official religion.

so now what happens if you want to introduce new tech, you need to make it the underdog - IPv6, no good at all - DNSSec secure BGP? hopeless basket cases. You need something that
a) is really barking mad, but might just work
and
b) has the feel of overthrowing an older dogma
and
c) inspires faith, even when the evidence is thin....

but you also need to think long term - 20 years is too short - its generational.
And most of us in the game are from the previous generation, and we need to get out the way.....but of what?



Saturday, November 23, 2013

future of the net & its impact on birth and death of industries

Yesterday, I attended an interesting meeting between policy maker/implementors, and techie/geeky people to discuss this fine topic (again - previous meeting was blogged earlier here under the topic of collective intelligence

this time, we split into two groups first, and laid out our wares to each other as techies all in one room, and policies all in the other, and then came together.

1. Techie discussion was perhaps more far reaching - long term problems like the use of the Internet as a metaphor for organising other sectors (decentralisation, symmetry between clients and servers/peer progressive) for energy, government, education, crowd sourcing/funding, journalism etc etc...

Some v. interesting stuff on power-law distributions in networks, and how these impact the way power itself plays out across a web of organisations, and if we do adopt the internet metaphor for these other secotrs, what that would do to wealth (in all senses of the word).

2. Then the policy people summaries their topics, which were much more about immediate problems the net brtings in their space under the general headings of

Personal - Does the net impact our cognition?; why do some things succeed and some fail? does the net replace people & jobs?

Business -does the net replace businesses or just optimise them?

Government - who is going to lead on regulation and governance?; is the net just too big to control;?
specifics (who is going to pay for rural broadband? how should public broadcast be funded?)

There was sme discussion about transport area stuff (esp. under optimnisaing both the operations and the large decision making - e.g. HS2). There was some discussion about censorship and darknets.

The main conclusions the tech people draw on these discussions (and tried to lead the policy people towards) were largely optimisitic

Again, background reading
1. Jaron Lanier's "Who Owns the Future"monetizing your personal data instead of being owned by the net
2. Cory Doctorow the war on general purpose computing and appliances
3. The Interconnectedness of Everything

Crucial background was on defending systems against bad guys. I'm not so optimistic about this aspect of the net

Thursday, November 07, 2013

F.U. NSA

More than  a decade ago I was involved in the Internet standards (being on the IAB) and we responded to the RIPA excessive intrusions in the US (and elsewhere) quite robustly - see for example with RFC1984 (so aptly numbered by the late, lamented Jon Postel - see IAB's statement on crypto)).

So then we thought that was that.

Some of us built some cool network monitoring technology (e.g. Endace) which was originally used (innocently) for long term understanding of the evolution of internet traffic characteristics (and led to fine conferences like PAM and IMC (this years conf)

So it became apparent that some agencies in funny big round buildings in the US and UK were buying lots of this kit (esp. when they insisted that companies that built and programmed it only have US citizen employees).

So these, and other worries about wiretap by good and bad agencies led many Cloud service providers (think social media, search, webmail, etc) to turn on HTTPS by default - after all  much of the Internet runs over unsecured physical infrastructure, and much of its use is now a big carrier of transactions of financial worth (home shopping, home banking, whole sale information business too), so loss of identity is no joke - we were aware of the threat - or so we thought

We complied with lawful intercept requests - why would we not? we aren't the bad guys - we want to be a contributer to a healthier, wealthier, greener, happier, safer world. THat's the kind of people we are in the Internet Staff. 

And so, now having stirred the IETF with one big swizzle stick, the NSA and their cronies are going to reap the whirlwind - BUT, this won't just be that they can't wiretap anymore (we did that mostly with HTTPS going on by default, although we can harden systems (like my institution has just done) against MITM attacks too, better - no, we are going to make the WHOLE net and CDN and Cloud go dark - you know why this is BAD, dear #nsa morons? because it means you wont even be able to catch genuine bad guys any more - if you'd cooperated with us instead of attacking us, we wouldn't have had to have done this.

Now they are not only doubly wasting our money, the unintended consequence of having to harden the net against these hardened criminal nut agencies, is that the bad guys will go dark along with the good, not by default - permanently, ubiquitously, eternally, with forward and backward secrecy.

Not even evidence will be gettable - even with warrants.

Well done, NSA and GCHQ. This happened under your watch, not ours.

well hard



Sunday, November 03, 2013

human machine improved collective intelligence....



[Background reading list:
http://www.amazon.co.uk/lm/RQZNXYWO3LEX1/ref=cm_sw_r_fa_lm_hbnDsb0P80MXH
warning- lots!!!]

1. I am very skepticle of some of the far out machine
intelligence/singularoty folks (kurzweil et al) -

They hark back to the big AI errors of the 1960s,
and all the advances in real machine "intelligence"
that appear to be clever have been made on the back of
a) a lot of data and fast processors
and
b) some very simple mechanisms - e.g. Bayesian Inferencing

Of course, there's some very clever algorithmic work
making big systems go fast -
Just for example, facebook run around 3000 interactive jobs
a day in their entire graph (1 billion users)
to explore various business questions - the tools
(data centers with a million cores,
map/reduce and Pregel style highly
distributed/parallel or large
memory system processing frameworks) 
are not like anything in the past, 
but nor are they anything to do with AI, 
nor do they exhibit any emergent properties we don't expect:)

2. In hybrid human/machine thinking, 
such as we do now with big data in commerce 
(google, aforesaid facebook) and Big Science 
(LHC, Astronomy, Genomics, Proteomics etc) 
there are plenty of cool things to do, 
but they don't involve large groups of people, 
rather small numbers of skilled smart people 
with a LOT of silicon slaves...

3. So in the collective space, what do we have? 

Things like twitter for news, 
Wikipedia as a knowledge base, 
Kickstarter for investment, 
Liquid for democracy, 
EBay for commerce, etc and so on -  
These are emergent social thinking machines, its true - 
and they evolved/emerged out of web systems  - 
so what changed since Vanavar Bush's seminal article, 
As We May Think?
http://www.theatlantic.com/magazine/archive/1945/07/as-we-may-think/303881/

A bunch of things, really 
but they havn't been codified/captured very well...
which are the meta-behaviour constraints that have evolved to
control bad behaviour in online social worlds, 
e.g. to reduce trolling, 
help people defend against fishing and grooming, 
and to damp down flame wars and so on - 

IBM, back in the day, did a study of the
use of Lotus notes in a lot of customer sites, 
and ended up buidling some nice systems that, 
with human help, reduced the 
incidents of antisocial colleapse:
People were allocated roles 
(the "lightening conductor" was one role I liked,
who would take the heat when someone was becoming abusive -
like proxy victim!);
Studies of bulletin board use 
(Usenet News, the Well and so on, 
in the 60s and 70s 
showed informal evolution of similar roles, albeit informally...

So wikipedia now has lots of distributed controls 
to prevent edit wars, 
and liquid and ebay have a bunch of heuristics 
that do a lot of damage limitation.
These systems look a bit kludgy:- 
they evolve to meet needs;
they look a lot like immune systems; 
it looks like they work! 

Systems like recommendation networks, 
and reputation systems (with +ve and -ve) 
which use strategy-proof algorithms (like pagerank)
seem promising, although obviously Wikipedia 
is interesting in that they don't use explicit 
named author&reputation, so its a lesson in
another approach that can work too.

So these involve preventing the 
collapse of group comms into chaos, 
or domination by small vocal groups, 
but don't necessarily demonstrate improved intelligence 
over traditional think thanks/meetings of minds 
(the royal society, the academy of science in US , 
and ad hoc groupings formed to solve particular problems - 
e.g. NASA's moon mission, the IPCC, 
and DARPA's autonomus car (precursor to google cars), 
the LHC, the genome, the search for HIV vaccine, etc etc

I don't have anything to offer that solves the 
problem of increasing intelligence above existing human levels, 
but stopping groups becoming more stupid than the dumbest member 
seems a goood start. 
Also, it depends on your goal - 
if the goal is to have a society with
collective intelligence on the average human level, 
but with buy-in because everyone is involved,
engaged and owns it, then that seems good enough...

Stuff with nanotech meets quantum computing meets singularity 
is not relevant really (in my opinion). All it does (for me) 
is scale up the technolgty we have to day. There's no indication 
that it makes computational thinking easier. 
It just means we can stay on the curve we are on led by Moore's Law 
and other amazing engineering feats of improving performance that
computing has managed in storage and communications as well as
processing...


By the way, a nice paper on the non-utopic use of bitcoin by some
friends (and an ex student) of mine:
http://cseweb.ucsd.edu/~smeiklejohn/files/imc13.pdf
and I am sure this is just a step in the arms race there...

we just finished a modest EU project in this area which might provide
a few more useful pointers (perhaps:)
http://users.cs.cf.ac.uk/Recognition.Project/

Saturday, October 19, 2013

Why Big Data Bugs Me


I've been talking to a bunch of serious social science people and it
appears there's a ground swell of backlash against naive big data hype

1. we did this paper to try and capture some of this which we call
HDI

2. kate Crawford (see also ted talk) continues a nuanced revision of
what big data's place should be  limited to, and here, how:-e.g.
Big Data Governance
also see Acquistis talk and I also really like Janna Malamud Smith's nuanced book on Private Matters

3. For any "interesting" big data (i.e. about people, not about
particles or weather:), we have major major problems with ground
truths of the data - just starting from selection bias (data mining
twitter or any online material ignores, systematically, the 25% people
who don't use the net - of course, these are in the main, but not
exclusively, the poor, so if you're setting social policy based on
what people online say, then you're ok if your a tory (sorry:) but
anyone else better worry....

but its much more insidious than

4.  On the NHS data, if you claim to be doing logitudinal, cross
population studies, and you don't compare the NHS records to (say) the
center for longitudinal studies' data, then you are missing out
healthy people - this is a bit of an issue if you are trying to do
public health, as the healthy people are the ones that might contain
clues about what to do constructively to do prevention
whereas people that get various syndromes will have a wide variety of
factors that may or may not have contributed...

However, to track the healthy people, you'll need lots of lifestyle data,
which the GP/NHS record wont have whereas a proper study (with random
trials of various things) would do, and would do with informed
consent...

Basically, for me, the rush to explit data (in these ways - no
criticism of the natural scientists who use big data all the time
perfectly reasonably) is motivated by a) laziness
and b) cheapskate attitude the above would suggest...

In government, of course, a big problem is that proper use of
logitudinal studies takes several electoral cycles to produce
results, so the "powers that be" are basically "has beens" by the time
the cool new knowledge start to roll in, so they don't get to claim
credit....

this is, of course, the biggest challenge to liberal democracies today
(how to make evidence based policy that has planning horizon of 1-10
decades:)

Oxford Uni have some thoughts on this last problem, although my take is a bit more radical...

viz

The reen and pirate  party in germany are causing the big parties to adopt a
thing called Liquid Democracy - this is crowd sourcing engagement, and
appears to generate long term stable decision making/sticking capabilities
in society that may turn out to be the eventual outcome of the careful
thinking in some parts behind the (less crazy parts of the) occupy and
Indignados and related moves (there's others in russia and some interesting
cover ones in China and in the Islamic countries (not just the obvious Arab
spring ones)....

I personally think that liberal democracy in its current form is incapable
of carrying out long term planning- but  some organisations (that aren't just 
Opus Dei or the Mafia) are able to do it in inclusive ways, and we should figure out how to construct
such systems as needed - long term planning (e.g. for reaching WHO targets
for eliminating diseases) appears to work in some cases - so why not in
others, and how does new tech help (or hinder)?

In my particular discipline, this is what is called "games on graphs" (think
Conways game of life played out over complex topological/topographic spaces)
- we have some ideas why some patterns (memes) are dynamically stable and others
collapse and some take over (endemic) so why not use this stuff....

how does a religion persist for 1000 years? why does a clearly broken idea like free market economics based on rational choice theory last 30 years? How come liberal democracy has survived so long?

time for syndicalist anarchism based on maths:)




Tuesday, July 16, 2013

The Prismer (with apoligies to patrick mcgoohan -- http://en.wikipedia.org/wiki/The_Prisoner)

One of the points about #Prism is that the various national security agencies (#NSA, #GCHQ etc) are using it mostly to get meta-data on conversations involving foreigners - however, the conversations must be between those foreigners and citizens, so they are, by trivial corollary, getting meta-data on citizens. The 2nd conclusion is that between agencies who cooperate (e.g. UK and US), they can merge the two views to get a view on everyone, without even breaking their own constitutions (well, ok the UK doesn't have one). So the step to a "global market in espionage sigint" has been largely completed. of course, the irony is that the real enemies of freedom have had enough tradecraft to avoid leaving meta-data trails, since ancient roman times (e.g. undercover religions - living in "crypts") so they won't show up - no, the old adage is the opposite of the case: if you are innocent, nothing of yours will be hidden - if you are guilty of something, it ain't going to show up on any of their screens unless you are seriously stupid. Of course, the most guilty of all, the people wasting our tax money on this system, instead of doing their job (humint on real bad guys) and turning our society into a toxic moral slag heap, they sure as hell won't shw up on any screens either - they all are too busy looking at all the espionage porn of normal peoples' lives to get caught by each other - or do any good whatsoever.

Thursday, June 20, 2013

internet of things = SDN + hypergraph

basically, almost any service in the future internet of things can be decomposed into a graph (food/waste, health monitoring/control, environmental, security/access through doors/windows, power network, air con, etc etc) and a set of on/off operations (a few involve set points - like thermostats, but if you assume a network which provides heat, then that is just on/off at some level of granularity)

so we could do this all with SDN applied to a hypergraph - the specific graphs would be VPNs and openflow specifications would say how permissions and TE work, then you just use same tech to run ALL the IoT apps across the VPNs - then your home hub/service center (or cached/cloned copy on your smart phone, or car computer) would just be the controller for this - the state (and audit trail/history) can be written/read to an append only (cf. git/irminsule) database which can therefore be easily replicated for high availability/low latency access, and then you are done....all other tools work
in the right direction...

Where devices might be a bit more complex, we might want to build a simple semantic description system (but many are going to be like the setpoint controller - even your PVR/home digital media recorder) - how many more patterns can there be? well, think how many physical actuators there are (include remote controls for existing legacy devices) and what state/actuator model they have - not many....

IoT - game over...

j.

Thursday, April 18, 2013

quantity v. quality in social 'science' research + big data

My cousin Antony pointed me at the work of Tarde (and earlier, Leibniz) on the concept of monads

A paper by Latour (see
http://www.bruno-latour.fr/node/144
for background and google for the full paper/chapter)


so social nets as graphs can see aggregates and individuals as properties of
the set of edges and verticies - so that lets us unify this model - provided we
capture sufficiently rich types of edges (kinship relationships, types of
friendships, encounters, co-membership of clubs, geo-spatial relations,
psycological, etc etc)

it also mighr help explain the dicomty in economics/history where most the
time, most effects are caused by large group behaviour (a la marxist analysis)
but from time to time, indivuduals wirled great influence and impact outcomes
(classical) - so this is just when someone is a hub at a time when opinions are
"hypercritical" ?-- balanced between one extreme and another -- when that
person can sway a large number around them because of their centrality and
degree....

hmm... .. ..

fits with the whole peer-progressive thing too

so this is where small data (and anecdotes and narratives) meet big data

and its also why the butterfly's wingflap causing a  hurricane could be something we'd eventually model properly (after all, a trillion butterfly wingflaps happen every year without hurricanes, so its a matter of modeling the right butterfly, or the right Genghis Kahn).

I'm also pointed at Sandra Gonzalez Bailon's paper on this:
http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2238198


I also like Kate Crawford's very nice talk on this topic ....

http://www.youtube.com/watch?v=irP5RCdpilc




Monday, March 18, 2013

from napster to friendster - its all still piracy - according to Jaron Lanier

Just reading Jaron Lanier's new tome, "Who Owns the Future", which is, unsurprisingly, pretty good - one nicely put argument is about money as information (and its transformation as a record of past work into a model of future promises) - but the more striking point for me, especially in view of recent arguments about privacy and micropayment systems for cloud (OSN) services instead of eyeball time and surveillance analytics, is that when
you download some music for free, your appropriation deprives the author and performer of potential future revenue, but when the OSN company decide they can monetize all your pictures, life story, and interests, this is no different in reality, yet if you do a lot of music/game/movie piracy, you will get in legal trouble, whereas when wholesale invasion of privacy and monetizing of your personal informational property occurs, the big corporate pirates are rewarded by Wall Street investment.....

note.. there is now some doubt being cast on what is being charged by these guys for your life - so this is interesting, as it calls into question the price we'd have to pay for a privacy preserving service (i.e. it isn't the revenue google and fb are currently making divided by the number of users, because they revenue reflects possibly absurd profit margins, which are completely unnecessary once we dispense with adverts and analytics - lets say it could be as little as 1/10th of their current revenue - that'd be peanuts


reference:-
paper estimating worthlessness of paying for boosting search rank result
plus press covverage



Wednesday, March 06, 2013

Robot Ethics

so there's a lot of guff about in recent techblogs droning on about robots (drones) and ethics

here's a very simple thought experiment which doesn't need Terminator/Skynet to present a dilemma Real Soon Now

Cars are being fittted with devices that detect if they are heading for an obstacle and actve the brakes automagically to safely stop.....

However, if not all cars have such a tech, then the car behind might re-end you

the front and rear impacts represent different risks (the crumple zones in a car are more designed to absorp impact in front, rather than rear)

so if you detect an obstacle ahead, and a car behind and (assuming cooperation) a car behind with, or without a robot safety braker...do you choose to brake less so that you amortize the impact over two cars?

so do you want a robot to act in the interests of ALL passengers in all vehicles, or "selfisly" on behalf of "this car only"???

I.e. if we design robot brakers according to Asimov's laws, do we want the 4th law as well as the usual 1st three
[see the 4th law for ethical synthetic humanism, #101]

Tuesday, February 19, 2013

CACM and the ACM Digital Library (&Open Access)

The february issue of the CACM contains a letter about proposals and trending ideas for ACM's digital library access in the current context where many academic/government research funding agencies are increasingly seeking free and open access to tax payers' funded work - the article skates over two possible  aspects - see Open Access position statement...

1. Some funding agencies will not pay for "gold" (author pays) - this is excluded if an institute has its own repository (e.g. Cambridge University has a copyright library and DSpace and other systems and has been around a bit longer than the ACM.....
2. Most of the DL content is authored, reviewed, edited, and even copies are hosted by ACM members - a very simple system would be to cover the costs of the DL completely from membership and conference/journal subscription income, but still allow 100% open access (open links and copies) - there's no evidence that systems that do this (Usenix, ArXiv, Wikipedia) fail. It behoves the ACM Publications Board to a) let us know what this would cost in terms of increases ACM and SIG membership annual fees and b) to estimate the impact (negative or possibly positive) on membership numbers....

Some SIGs (like SIGCOMM, since I was chair) have published fully open access to all the conference papers for a long time with no apparent negative impact on the SIG's membership or attendance at events (possibly positive, although that would be anecdotal only)

I think it would be interesting to canvas the entire ACM membership on this - there's a strong collegiate tradition in the ACM, and the idea of a "wholly membership owned not-for-profit free (green) open access digital library of the main repository of 75 years of Computer Science, would probably be very attractive to many people.

Looking at the rest of the issue, you can see many articles and papers of current interest that show what a lively and relevant organisation the ACM is and how timely much of the CACM material is - for example, earlier this week in Cambridge we had talks about dark silicon (and what ARM is doing about it), and lo and behold, there it is in the Research Highlights section, in the clearest and most accessible possible terms...and should be available to anyone in the world concerned with the future of our subject -

power, parallelism or reliability?

Monday, February 18, 2013

Mechanism Design, Incentives, and N-Sided Markets for N>2


I'd like to say that the Internet was born free, but everywhere is in
value-chains, but that would be naive and simplistic.

The purpose of this note is to elicit discussion and clarity on how we could
re-design existing systems in the Internet that use advertising to cover costs
(and make a profit) and replace the income by some other system. For example,
one could consider a system where people pay subscriptions (or even pay-per-use) to an
online service such as search, e-mail or social media. A simple economic
analysis would say that such a system could replace a 2-sided market (with the
service provider facing the customer for free, but advertisers for revenue -
i.e. a 3-body  system) with a single, simple market, where transparency,
competition and market efficiencies would find the right price.
Such a system would also not need to exploit side effects such as the
monetising users' personal data, to be viable and sustainable.

Such a view is naive in the extreme, and I have two reasons that I think why.

The first is micro-economic, and is about the value-chain of components in the
system. The second is macro-economic, and is more theoretical (and I'd like to
hear back from experts if it is technically correct).

Let's look at the first problem, which concerns the primary business of some of
the organisations involved in this complex world:

1. Let's think about a daily activity of a couple of billion of the worlds smart
phone carrying netizens, and see what stakeholders (at least in part) are involved.

Goods/Services -> Advertisers -> search/OSN -> ISP -> Cellular provider ->Handset -> Handset OS -> App/App SDK
                 <- analytics="" div="" nbsp="">
                                     v
                                 cloud infrastructure 

Obviously this is a hugely simplified picture. When you use an app on your
iDroid, (e.g. the HappyFrogs game), that you downloaded from an AppShop for
free, it presents you with adverts. These adverts come from the cloud and
provide revenue for the app implementer and the cloud provider. You probably
have a nearly-all-you-think-you-can-eat data plan with your cellular provider.
You probably also have a DSL line and WiFi at home - you might pay 30 zinglots
a month for the former and 10 for the latter. Occasionally (e..g once per
month), you get billed for going over your mobile data plan. Once in a while
(e.g once per year) you forget that while abroad, you might have to pay 50
zinglots to see a few adverts.

This is allegedly a 2-sided market. Obviously it isn't that simple since there
are payments for components in the system, and the people being paid are
incented to let you send/receive more data (to keep up with the latest speeds
and so on).  Hence as much as 30% of traffic to your phone maybe "unwanted"
adverts. And a lot of traffic from your phone is fed into analytics and sold as
market research.

Proponents of a subscription system for the services (and payment for games
either buying or renting) claim that this misguided incentive would go away and
the system would settle into some Utopic Adams/Hayak friendly perfect market.

This is pretty naive. The cost of the cellular system and its profits were
predicated on voice and SMS. (I'd note that when one of the largest companies
acquired its license for 3G spectrum, it paid 2-3% of the GDP of a large
European nation for it. It then wrote that down the next year. Spectrum
licenses of a decade or more are just another wrinkle in the picture).

So what you pay for your cell phone is a little high but not too much
(regulators in Europe have market tested the 3G providers and they are
competing - prices are decreasing, performance increasing - hey, they are even
competitive with fixed line broadband - there's some headroom in the backhaul
networks in some countries too, as the step-up increases in capacity sometimes
lead the increases in demand, although sometimes they lag too).
Another important facet of cellular is that, like the fixed line phone
companies before, the cell-phone net for voice is subject to lawful intercept
laws. The counter side is that people expect jolly-good-privacy. Cell phone
providers have not "failed" to deploy location based services - they have
actively avoided any service that might make them appear to their customers as
being Big Brother. Of course ,this laid them wide open to handset OS and App
vendors doing all sorts of cool location based services, but being in the
pocket of the user, the perception of Apple/Googledroid/Microbird's AGPS based checkin systems was as a friendly personal thing, not a cold brazen impersonal
corporate spy. So note that _privacy_ was a part of the value of the cellular
phone service providers business case.

The point here is that the cell phone business pre-dates and has businesses
which are separate from the 2-sided market of advert/game/user.

So the second outfit, the cloud service provider, also has other businesses.
Let's just think of search. Once upon a time there was google search. It beat
off Altavista by being better at stopping sites "gaming" the search ranking
algorithm. To do this, instead of pagerank, a whole slew of complex heuristics
had to be developed. In some sense, what Google (and any other eyeball catching
company) had to do was to predict what users really want. To do this, it has to
look at users AND in great detail at what they click on really, as opposed to
what order things show up on their search screen results. Bingo - click-on is
the true value. So now we have click-thru revenue from adverts for things and
auctions for positions of those things and rank order. A market in search, and
loss of data privacy.

So note that loss of privacy was also an essential side effect of a cloud
service provider's business case.

So in all this, the users personal data, the value of any and all the little
people's identity is a tiny tiny piece. Indeed, the additional price to be
extracted from users if we were to switch them to subscription
is a minuscule step up from what is currently being paid every month by them
(both phone/home side and big data/cloud side customers). It ain't worth
getting out of bed for. It doesn't matter how small you make the transaction
overheads either. Clearly they can be made zero given you already have user
accounts and payments for going over data plan volume caps etc etc...

2. N-Side markets, for N>2

Combinatorial Auctions, Collusion, and Confusion

My second argument is that we don't now how to do mechanism design
for a system of more than 3 customers. I claim this because I've read some of
the literature on combinatorial auctions, and see that the problem is
computationally hard. This means that all sorts of heuristics/approximations
and even machine learning have to be used to try and solve problems. However,
the key difficulty is that we don't have any algorithms that have explanatory
value. We don't know what the outcome will be and when we get it, we don't know
why we have it. This is no use for a regulator - this has already stalled 4G
spectrum Auctions in some countries where the set of potential licensees and the
government couldn't figure out whether a particular structure of auction would
lead to any companies buying (e.g. this bit of spectrum in these states, that
bit in those states) going bankrupt, or getting a white elephant or what have
you. This matters, as businesses like to plan.

I claim that even without the value chain flow of personal data from the user
edge into the analytics cloud, the system is a many-sided market and we cannot
propose any mechanism that would incrementally line up all the pieces, 
unless we have a flag day and say we declare all the systems to have to operate
transparently from a given instant, and how likely is that to happen.

We could hope for some simplifying step - for example, if we were to force some
of the components in the network to combine (e.g. cellular+ISP+cloud), then
there would be a 2-sided system which could be collapsed down easily through
incentive alignment (e.g .simple vickrey auction of service between customer
and advertiser would determine price of privacy:).


There are many cloud providers and many ISPs and Cellular providers. However,
some of them are already implicated - for example, google and apple both build
handset OSs, run online services, control AppShop developers, and to some
extent, dictate terms to cellular providers (at least implicitly). Perhaps a
gently nudge could get us the rest of the way there....surreally, t his might
be a Good Thing.

3. Unintended consequences.

There would be many. I leave it as an exercise for you, dear reader, to think
of as many as you like.


Saturday, February 16, 2013

Who Are We - Who am i++

So I've updated my reflections on both Eric Schmidt's visit (see the Humanitas video of Google Chief's talks in Cambridge early 2013) plus my take on some of the discussions at the Dagstuhl Seminar on Decentralised Privacy and OSNs (see Dagstuhl's excellent Website for more info there) and here's the document that resulted....

My cousin Antony (a trained ANthropologist and Computer Scientist!) pointed me at this interesting revival of Tarde's use of the Monad notion, which seems somewhat relevant!

Blog Archive

About Me

My photo
misery me, there is a floccipaucinihilipilification (*) of chronsynclastic infundibuli in these parts and I must therefore refer you to frank zappa instead, and go home