Thursday 22 August 2013

Caught on Camera

This autumn I'm going to present a six part television series for Channel 5 called Caught on Camera.

The announcement was made on the Channel 5 corporate website earlier today: 

CAUGHT ON CAMERA

In Caught On Camera, intrepid journalist Nick Wallis joins police forces across the country to reveal how CCTV and technological advances are recording more and more criminal activity. From petty street-crime to gangland murder we reveal the shocking footage and the real crimes that are Caught on Camera in the UK – by the public as well as the police – as well as exploring the devious tactics of pickpockets, shoplifters and con artists. The message of the series is simple: criminals beware, one way or another, you’re going to be Caught on Camera.

An in-house production by 5Production
TX Autumn 2013
Commissioned by Emma Westcott, Commissioning Editor Channel 5

Obviously I was delighted to be asked to do this. Hopefully you'll hear more about it closer to transmission date.

.

Wednesday 14 August 2013

Post Office Second Sight report into Horizon

This blog post has been prompted by the July release of an interim report by the forensic accountancy firm Second Sight into the Post Office's Horizon computer system. 


copyright www.nickwallis.com
A Post Office, earlier today
I have been working on this story for a long time, and I'm finally beginning to see what it is.

My involvement started back in November 2010 when I received a call from a man whose pregnant wife had been sent to prison on the basis of computer evidence generated by Horizon. It led to an investigation broadcast on 7 Feb 2011 on my BBC Surrey show and on BBC1 South's Inside Out programme.

Following the broadcast of the investigation and a subsequent article published in Private Eye magazine, the Post Office announced it would be appointing Second Sight, a forensic accountancy firm, to look at Horizon and how well it's working.

The MP for North East Hampshire, James Arbuthnot, who featured in our initial broadcast, was one of the prime movers in all this. He effectively leaned on the Post Office, possibly pointing out the increasing level of media interest in the story, until they agreed to do something.

Second Sight's appointment was announced in June last year. Matt Prodger, the BBC's home affairs correspondent, had been gathering material on Horizon, and was able to react to this by broadcasting some of the interviews he had already recorded with Subpostmasters who had found their lives turned upside down by their experience.

In the meantime I stayed in touch with the Justice For Subpostmasters Alliance, and continued to receive correspondence from Subpostmasters who stumbled across my initial blog post on the subject.


copyright www.nickwallis.com
Ha! Well! Ha! Yes! Ha!
The Second Sight interim report into the Horizon accounting system is a short and thankfully jargon-free document. And it is damning.

On the fundamental issue of whether software glitches have caused disruption within Horizon, the report is unequivocal.

"We are aware of 2 incidents where defects or 'bugs' in the Horizon software gave rise to 76 branches being affected by incorrect balances or transactions which took some time to identify and correct."
Paragraph 8.2.b, Second Sight interim report

So, in a relatively short investigation Second Sight has uncovered two instances of software glitches affecting computer systems in multiple Post Office branches.

This contradicts the statement the Post Office gave to Inside Out South two years ago, which claimed:

"The Horizon computer system is absolutely accurate and reliable"

When we first broadcast the complaints against the Post Office we were in a tricky place, legally. We had no proof there was anything wrong with Horizon, or that there ever had been. All we had was the word of a series of individuals, some of whom were now convicted criminals, none of whom were computer experts.

There was a public interest in broadcasting the information we had, but it had to be balanced against the fact that we didn't have a single shred of hard evidence - no whistleblower, no smoking gun, no paper trail, nothing. The Post Office, for its part, could point to a 100% success rate when it came to making prosecutions, noting that every time they took a case to court, the jury had concluded beyond reasonable doubt that the Subpostmasters in the dock were criminals. The Post Office refused all interview requests for our Inside Out programme.

Whilst trying to raise wider enthusiasm for this story in the months following its initial broadcast I had a chat with Stephen Mason, a barrister specialising in the presentation of electronic evidence in court. In fact, he wrote the book on it.

copyright www.stephenmason.eu
Stephen Mason
Mr Mason believes the legal system is failing when it comes to computer evidence.

Firstly because prosecution and defence lawyers don't understand what they're being presented with, and therefore don't know how to examine it properly, and are therefore unable to ask the right questions of the relevant experts in court.

Secondly, there is an underlying legal presumption that computer evidence is infallible, based on the assertion that "machines do not lie". The wording is odd, because it appears self-evident. Of course machines do not deliberately misrepresent, unless built to do so.

But legally this has come to mean that "machines do not make mistakes" ie if a mechanical device has done the same thing hundreds or thousands of times in exactly the same way, it is not a defence to say it must have started doing something differently. This idea was conceived well before anyone started programming computer software, and was meant to represent basic mechanical devices (say, a cash register), rather than the interlinked electronic eco-systems we depend on nowadays.

Thirdly, there is a widespread public perception that electronic evidence is infallible, hence the readiness of juries to convict on computer records alone.

I asked Mr Mason directly if it was conceivable that the Horizon system was throwing up random glitches, the central allegation of our Inside Out piece. "Yes of course." he replied.

Turns out, from chatting to people who work in IT, these sort of "legacy" (ie old) systems can be extremely problematic. Over a period of time, they degrade. The older they are the more problems can be expected, especially when you start bolting new features and interfaces onto it. But finding someone who works in this area (or more pertinently worked on Horizon itself) who would be prepared to break cover seemed impossible.

I asked the journalist I worked with at Private Eye about all the IT cock-up stories they'd run over the years - where did they get their whistleblowers from? He told me none of the information they received had ever come from anyone inside an IT company. It mainly leaked out through unions and politicians.

I suppose if you work in IT and you see a problem with a system you go to management or charge clients a fortune to fix it. It would be career suicide to go public.

Interestingly, Second Sight's report was picked up by the programmer forum slashdot. It's well worth reading the discussion there.

I also spotted this, from Angus Marshall, a "digital forensic examiner/expert witness" (who I have since contacted) on a motoring discussion forum:

"A few years back, I assisted with one case where a sub-postmaster was accused of defrauding the benefits systems by cashing vouchers and keeping the money for himself. The whole case revolved around a discrepancy between the Post Office system and the DWP system. Given that DWP's "error handling" consisted of throwing away any records that it didn't like the look of, without recording anything about them, we managed to get that "evidence" ruled unreliable and inadmissible pretty quickly.

It took about 4 hours of meetings with two of the system programmers - one DWP and one Post Office to discover that no-one had ever bothered to check that the data interchange specs. actually matched on both sides - and they'd never been told to consider the evidential requirements of their systems.

Both systems were (are) run by the same company, btw."

It has become apparent to me that the Horizon story is laying bare the logical inconsistency which governs the way non-IT people (including journalists, juries, lawyers, prosecutors and Post Office directors) think about technology.

We believe the commercial IT systems which affect our daily lives are durable to the point of being incapable of material error. We have to, or we'd never get in a car.

This belief is borne out by experience. Every time I go to the cashpoint, it works. Every time I buy something at the supermarket, it works. Every time I take a flight, it lands. What we're perhaps not aware of is the army of people making sure the software involved in these interactions is solid, by testing and re-testing, ironing out bugs and maintaining the systems at an optimum level.

So Horizon can go wrong or be misused. But so can any other computer system. With Horizon, are we looking at a computer system that is much worse (or more badly-maintained) than equivalent systems being used elsewhere, or are we focusing our attention on the wrong issue?

Let's assume that Horizon is no more unstable than any other bank's accounting system. Let's assume "random" software glitches occur once in every billion banking transactions (or whatever the industry-standard acceptable level of risk is) everywhere.

So what happens in every other banking system?

Nobody knows.

It all happens internally.

Losses are recorded, managers are alerted, customers are compensated (where appropriate) and codes are re-written/employees are re-trained to mitigate against future re-occurence.

Reports are produced, decisions about IT contracts and/or the investment in IT maintenance/support/training are made and the losses are written off. The risk of random IT glitches affecting the balance sheet is effectively spread amongst the bank's shareholders.

Indeed, we know Horizon "lost" more than two million quid in Crown Post Offices (the big city POs) in the 2007/8 financial year, and the figure was simply chalked against turnover.


copyright www.nickwallis.com
A non-Crown Post Office, today
With non-Crown Post Offices (ie all Sub Post Offices) it's different. Thanks to the extraordinary nature of the Subpostmaster contract, all the risk for any computer-generated accounting discrepancy falls on the individual Subpostmaster.

Culturally, the PO would far rather pursue individual postmasters for money its accounting system says it's owed than examine the possibility of errors within its own system. Whatever the personal cost to the individual postmaster concerned.

The Second Sight report picks up on the PO's culture of bureaucratic intransigence, and its effect on Subpostmasters who have had to try and deal with it:

eg: "Second Sight has asked POL [Post Office Ltd] to deliver... responses that would prove as easy to understand [as our own case review reports] that addressed the spirit, as well as the letter, of the Subpostmasters' complaints; and that were backed by evidence. Whilst the responses received from POL can be seen to be thorough, they are long and highly technical documents. In some cases, they present counter-assertions, based on Standard Operating Procedures and Controls, rather than tangible evidence of what actually happened."
From paragraphs 5.2 and 5.3, Second Sight interim report

"Many of the Subpostmasters we have dealt with remain aggreived and dissatified with what they see as POL's defensive and unsympathetic response. Whereas we had expected that some form of closure would be reached between POL and the Subpostmasters [whose cases we are looking at], this has so far not been achieved."
Paragraph 5.7, Second Sight interim report

There is also some satisfaction at giving the Post Office a taste of its own medicine:

"It is of course hard for POL to prove the negative (i.e. that [Horizon's] controls have not been circumvented) but it is only fair to say that POL now finds itself in the same situation that has faced all of the Subpostmasters who have submitted cases. They too, were unable to prove that the shortages or transactions that they reported to POL... were not the result of their own (or their employees') errors or criminal activity."
Paragraph 5.5, Second Sight interim report

Translation: suck it up and give us the information we want.

There's more:

"We can't help concluding that had POL investigated more of the "mysterious shortages" and problems reported to it [by its own Subpostmasters] with the thoroughness that it has investigated those reported to it by 2nd Sight, POL would have been in a much better position to resolve the matters raised, and would also have benefited from process improvements."
Paragraph 7.3, Second Sight interim report

Translation: if you'd have given a **** when your Subpostmasters raised these issues rather than sent in the prosecutors, not only would we not be here, you'd have far more robust and efficient systems.

Explicitly:

"When POL does investigate cases, there is often a focus on 'asset recovery solutions' without first establishing the underlying root cause of the problem. This is also an example of a missed opportunity to be in a much better position to resolve problems and to benefit from process improvements."

From the overall tone of the report it's clear Second Sight have some sympathy with the Postmasters' plight.

Seema Misra

Second Sight are being very thorough. On the day their report came out I received a call from the Today programme asking if I could recommend a Subpostmaster who would make a good guest. I gave them the name and mobile number of Seema Misra, the lady in West Byfleet who was sent to jail whilst pregnant because she refused to plead guilty to theft (I would love to see the stats for the severity of punishment handed out to asian Subpostmasters against their white counterparts, but I guess each case is different...).

Since being released from prison, Seema has moved the family out of Surrey and re-trained as a make-up artist.


copyright www.nickwallis.com
Seema (r) and Davinder Misra
The day Seema appeared on the Today programme she got a call from Second Sight. They'd heard her talking about her case and wanted to review it before their final report.

'Ivy'

Earlier today I spoke to another Subpostmaster (let's call her Ivy) who had problems with Horizon and avoided prison by the skin of her teeth. Ivy says since the Second Sight report came out it's been "exciting".

She pointed immediately to prosecutions against three Subpostmasters (Susan Knight, Tom Brown and Kym Wyllie) which have been dropped since the interim report came out "due to lack of evidence".

The Justice For Subpostmasters Alliance called this "the first demonstration that we have seen that POL are serious about resolving these issues", and seems to suggest a wind change in the PO's strategy.

Ivy says she's still disgusted by the way the PO treated her but thinks they now seem to be aware that "something has to happen, because we're not going to go away."

Ivy has also had regular conversations with a man from Second Sight. She says when Second Sight man first met her she was sure he thought she was a "bandit", but the more he heard about her story, the more he was shocked, and that this pattern is being repeated higher and higher up the food chain.

But it does seem to me at the moment that the focus of Second Sight, POL and the politicians is on the way Subpostmasters are treated by the PO and the terms of the Subpostmaster contract, rather than Horizon's ability to function properly.

I asked Ivy if Second Sight man thought there was something inherently unstable within Horizon's software. Ivy is sure he does, but thinks the final report won't say problems with Horizon are "what's the word.... systemic."

Finally I asked her if she thinks the worm has turned, and that she might one day get her conviction quashed. She told me she didn't know what to think right now, but it "would be nice, at least, to get back some of the money I lost."

Alan Bates

During our conversation Ivy could not speak highly enough of Alan Bates, who runs the Justice For Subpostmasters Alliance, calling him "a hero". Alan is also roundly praised in the 2nd Sight report. He keeps a very low media profile, but he's always happy to natter on the phone. I asked him what's going on now Second Sight's report is in the public domain. He pointed me in a number of directions:

First of all he reiterated his unhappiness with Second Sight's investigation being commissioned and paid for by the Post Office. He thinks the PO's patronage was reflected in the interim report which went through more than 20 revisions before publication and was "reviewed and reviewed and reviewed by the Post Office until they had reviewed it flat."

Alan also told me that next week the Post Office is going to announce a case review process for Subpostmasters which has been developed with the JFSA and Second Sight. It will deal with existing and historic grievances, and could lead to independent mediation of individual cases.


BBC
Jo Swinson MP, 9 July 2013
Alan also recommended we keep an eye on the government in all this. The day after the 2nd Sight interim report was released the Minister for Postal Affairs, Jo Swinson, gave a statement to the Commons. "It's a very watchable 45 minutes" says Alan. I've just watched it. It is. It gets particularly good at 17m55s when MPs weigh in on behalf of their Subpostmaster constituents demanding better answers from the minister.

Alan is pretty sure the government is now a) aware of the scale of the problem (whatever 2nd Sight conclude that to be) and b) wants a swift resolution, because it is trying to sell bits of POL off and can't have this hanging over it. To that end, the government wants another interim update in October.

Finally, Alan mentioned that POL are advertising for a new computer system. "To replace Horizon?" I asked. "Well it doesn't specifically say that," he replied "but I'll send you the full advert and you can see for yourself. It's certainly a big contract."

Conclusion

To me, the Second Sight report represents one thing. Movement. There are an awful lot of people who have suffered, some considerably, as a result of being put in an impossible position. And it does seem as if the problems with Horizon, the Post Office's attitude and the risk-loading of the Subpostmaster contract is finally being taken seriously at the highest levels.

On a wider scale, this story has also reinforced to me the importance of journalism. The people who have been crushed in this case are worked hard, pay their taxes and before becoming Subpostmasters had no stains on their characters - the sort of people who naturally go to authority when things go wrong.

When they found themselves being prosecuted for "crimes" they often alerted the Post Office to in the first place, they believed they would be exonerated.

It is only with extreme reluctance, after they had lost their homes and jobs and been convicted as criminals, they contacted the media. These are not wily, media-savvy people we are talking about. They have no support networks or effective unions. They would naturally trust a police officer, a judge or a company director over a journalist every day of the week.

As a result their belief in society has been shattered. They see the justice system, company prosecutors and supposedly benign employers as heartless and wrong.

That's not to say this isn't all very curious. If the Horizon computer system is degrading into unreliability, it is doing so very slowly. As the Second Sight report states:

"The Horizon system involves approximately 68,000 users and processes over 6 million transactions every day. The entire population of over 11,800 branches was notified about the proposed investigation by 2nd Sight and this resulted in 14 additional cases being accepted for investigation. Whilst in no way minimizing [sic] the potential importance of the cases under review, this level of response suggests that the vast majority of Subpostmasters and branches are at least reasonably happy with the Horizon system."
Paragraph 1.11, 2nd Sight interim report

There is also, of course, the possibility that some of the people I have read about, spoken to and dealt with were knowingly defrauding the Post Office for personal gain. I haven't read the court documents or seen the evidence in every single case.

What I do know is that many hitherto blameless people have been suspended, sacked or convicted purely on computer evidence, by prosecutors working within a justice system inclined to believe in the infallibility of computers. Without doubt a large number of Subpostmasters are isolated, poorly-trained and tied into deeply unfair contracts by a company which seems to have a Dickensian "asset-recovery led" approach to industrial relations.

This story will go on for years. There are many who have lost everything through no fault of their own. The JFSA believe they deserve redress, which involves convictions being quashed, money returned and reputations restored. We are a long, long way from that, but perhaps the Second Sight investigation, the interim report and the way in which it has been received will offer the campaigning Supbpostmasters and their supporters a glimmer of hope.

*********************

Further reading: 

Select Committee inquiry written and oral evidence - Feb 2015 
Private Eye pieces about the Select Committee inquiry

Full transcript of Adjournment Debate - Dec 2014  
Private Eye piece about the adjournment debate
The One Show Commissions - Dec 2014
Legal fisking of the 2010 Seema Misra trial by Stephen Mason written in 2016
Second Sight Briefing Report pt 2 - Exclusive
Second Sight interim report July 2013 
My first BBC film on the subject in 2011

Transcript of my first BBC radio piece on the subject in 2011
Justice for Subpostmasters Alliance 
Computer Weekly Timeline 

.

Sunday 11 August 2013

Love to love you. Baby.

Popjustice is a reliably bonkers website. If you can get to the end of the About section without smashing your screen, well done.

When Popjustice tweeted this...


... I clicked on the link. Before you do:

Imagine you are 18 years old and your grandfather, who has dropped by for the weekend, says:

"Remember when we made the newspaper front pages, thirty five years ago, because they heard we had stumbled across the ability to turn base metal into gold? Well, we didn't. We failed. We tried, and we nearly did it. The results were very impressive. But, essentially, we failed."

And you nod, and you say (because, in my mind, you are Peter the Goatherd from the Heidi books) "Yes Grandpa. I wasn't alive then, but I remember that's what made you famous around the world, and brought you the riches you have kindly bestowed upon this family."

"That's right." says your Grandpa, "That's right..."

He beckons you over, and his voice drops. "Last night... for the first time... we got the formula to work..."

You stop, wide-eyed with amazement.

"It isn't all that different. It's just... thirty-five years ago... we didn't have the tools to do what we are doing now..."

You stare at him, wondering what is going to happen next.

"I want you to tell me what you think of this..." he says, opening a box he has set down in front of you.

F*** my old boots. There is magic coming out of that sound system. Magic.

.

Wednesday 7 August 2013

Christian O'Connell Edinburgh comedy show "radio" review


Christian O'Connell has been getting good reviews (Chortle: "a decent fist", The Independent: "solid", The List: "moments of genius") for his Edinburgh show, which runs for another couple of weeks. There is also a wonderful interview with him in The Stage, which is revealing and rather touching.

Here is the "radio-skewed" review of his set I sent to RadioToday, which they said they'd run and don't seem to have done. Seems a shame to waste it. If you're really bored you can see how it compares to the review of the same show I wrote for the Dorking Advertiser.

Okay, RadioToday review follows:

"Being funny on the radio is a very different discipline to being funny on stage - but with this set Christian O'Connell proves he can do both.

Christian's one-hour Edinburgh show inhabits the same blokey universe he cultivates on his Absolute Radio breakfast show. It's a world populated by men staring aghast at the encroachment of responsibility on their ever-diminishing island of fun.

The show is based on Christian's discovery of a list he wrote at the age of 13, describing various things he would like to achieve by the time he reaches 40. The list has provided copious material for his breakfast show this year and provides a series of useful jumping off points for his set.

References to the day job are well-handled. He has a routine about teaching his daughter how to deal with bullies at school  ("all you have to do is show them this - my Q1 2013 RAJAR results - and they'll see  my year-on-year audience share has increased 17.6%. So you can tell them I do have listeners…"), as is the what-happened-next story following David Cameron's potty-mouthed outburst on Absolute Radio in 2009.

Other subjects include Kelly LeBrock (with a brilliant one-liner about her former husband Steven Segal), Darth Vader, Ferris Bueller, marriage, fatherhood and online porn. The latter becomes something of a theme throughout the set (I'm not judging) and Christian's stories about hunting through bushes for magazines as a teenager ("in the 80s we didn't have Google - we had to forage") were very good.

The show ends with a listener email (in Edinburgh it will end with a video, which wasn't quite ready for this preview), which is deranged enough to be hilarious in itself, but is then superbly deconstructed to ensure the evening finishes on a high.

It's not for everyone - the woman sitting next to me went long periods without laughing, presumably because she'd never been a 13 year old boy or a 40 year old man. But for someone like me, who was a 13 year old boy and who also turned 40 this year, the material rang true, far too often.

If you like what Christian does on the radio and you are going to Edinburgh, make sure you see this. It's rude, it's honest, it's funny and as the redoubtable Comedy Cottage host Sajeela Kershi said to me after his set, far better than many other experienced comedians.

End note: Christian very kindly sent me the finished video this morning. It's ramshackle and charming and sums up his set, but being honest, I reckon he should finish on the listener email. 

Christian O'Connell is appearing at the Udderbelly, Bristo Square, Edinburgh, from 31 July to 20 August  2013

Tuesday 6 August 2013

The man who saved 40,000 lives


Eli Beer
Every week I download a bunch of podcasts and listen to them at the gym. They are mainly radio/comedy podcasts - Frank Skinner and Richard Herring being current favourites.

I also download (among others) R4's Moneybox, the FT's Banking Weekly and TEDtalks.

TED is an organisation dedicated to getting the leading speakers in the world together to better inform their already very well-informed audience about stuff that is important. I might be right in saying that an invitation to talk at TED means that you are a world-leader at something interesting, and you have the ability to tell people about it in an interesting way.

The TEDtalk I downloaded this week is by a passionate man with a ridiculously good personal story and an inspirationally simple idea. His name is Eli Beer. Listen to his 10 minute talk here:


The talk exists as a video. But I think you would get more out of it if you discovered it in the same way I did, as a piece of audio, with no preconceptions about this man or any idea what he was going to talk about. It's far more effective.

Why on earth Eli's system doesn't exist in London, I have no idea. 

.