Big Data Events

The Big Data discussion builds momentum in Official Statistics.

In October 2012 at the UNECE High-level Seminar on Modernization of Statistical Production and Services (HLG) in St.Petersburg Big Data popped up. A strategic paper was asked for.

22 February 2013 the United Nations Statistics Division’s (UNSD) organised the Friday Seminar on Emerging Issues, especially Big Data.

Soon after a very good paper on Big Data was delivered by the HLG.

And in September 2013 the Heads of European Statistical Offices (DGINS Directors General of the National Statistical Institutes) adopted the Scheveningen Memorandum.

Scheveningen Memorandum
Big Data and Official Statistics

‘The DGINS
CONSIDERING
1. Recent innovations in the information and communication technologies have been leading to an increasing degree of digitization of economies and societies at all levels that offer new opportunities for the compilation of statistics.
2. The use of Big Data for statistical purposes challenges the European Statistical System to effectively address a variety of issues.
3. The demand for timely and cost efficient production of high quality statistical data increases, as well the need for new solutions to declining response levels.
4. Official statistics should incorporate as much as possible all potential data sources, including Big Data, into their conceptual design.
5. The distinguishing aspect of many Big Data sources is that they are not confined to national borders and, as such, represent unique opportunities for collaboration at European level as well as on global level.
6. Many European initiatives have a link to Big Data, including the European
Commission’s ambition for developing a strategy for the European data value chain, the on-going EU Data Protection reform and the Horizon2020 program.
7. The implementation of new methods of production of European statistics represents an objective of the European Statistical Programme 2013-2017 (1) and aims at efficiency gains and quality improvements, including increased timeliness.

(1) Regulation (EU) No 99/2013 of the European Parliament and of the Council of 15 January 2013 on the European statistical programme 2013-17, OJ L 39, 9.2.2013, p. 12–29

The DGINS
1. Acknowledge that Big Data represent new opportunities and challenges for Official Statistics, and therefore encourage the European Statistical System and its partners to effectively examine the potential of Big Data sources in that regard.
2. Recognise that Big Data is a phenomenon which is impacting on many policy areas. It is therefore essential to develop an ‘Official Statistics Big Data strategy‘ and to examine the place and the interdependencies of this strategy within the wider context of an overall government strategy at national as well as at EU level.
3. Recognise that the implications of Big Data for legislation especially with regard to data protection and personal rights (e.g. access to Big Data sources held by third parties) should be properly addressed as a matter of priority in a coordinated manner.
4. Note that several NSIs are currently initiating or considering different uses of Big Data in a national context. There is a momentum to share experiences obtained from concrete Big Data projects and to collaborate within the ESS and beyond, on a global level.
5. Recognise that developing the necessary capabilities and skills to effectively explore Big Data is essential for their integration into the European Statistical System. This requires systematic efforts like appropriate training courses and establishing dedicated communities including academics for sharing experiences and best practice.
6. Acknowledge that the multidisciplinary character of Big Data requires synergies and partnerships to be effectively built with experts and stakeholders from various
domains including government, academics and owners of private data sources.
7. Acknowledge that the use of Big Data in the context of official statistics requires new developments in methodology, quality assessment and IT related issues. The European Statistical System should make a special effort to supports these
developments.
8. Agree on the importance of following up the implementation of this memorandum by adopting an ESS action plan and roadmap by mid-2014 that should be further integrated into the Statistical Annual Work Programmes of Eurostat.’
.

ESS Big Data Event Roma 2014

And now comes the ESS Big Data Event from  31 March-1 April 2014. It offers keynotes and seminars dealing with several of the Scheveningen topics. See the programme and the concept paper.
2014-01-25_BIGDATAevent.

The European Data Forum (EDF) Athens 2014

Some days before the ESS Event the annual European Data Forum will take place in Athens, March 19-20 2014. Big Data will be a topic there, too.

2014-01-25_EDF.

A practical example: Using Social media analysis for statistics

During the DGINS meeting 2013 in the Netherlands some examples of Big Data usage for statistical insights were accessible as presentations.
The Dutch Statistical Office CBS and Coosto the social media monitoring and engagement tool dived into the digital ocean of social media data and made some comparisons.

2014-01-25_bigdatasocialmedia

2014-01-25_smanalysis

2014-01-25_ecoclmate.

2014-01-25_smunemployment.

Big data and official statisics: A conclusion from Els Rijnierse’s  presentation on traffic big data:

2014-01forget

United Statisticians of Europe

 Head of Elstat (Statistics Greece) faces an official criminal investigation

Kerin Hope (Athens) from  Financial Times reports (27.11.2011):  
‘The head of Elstat, Greece’s new independent statistics agency, faces an official criminal investigation for allegedly inflating the scale of the country’s fiscal crisis and acting against the Greek national interest.
Andreas Georgiou, who worked at the International Monetary Fund for 20 years, was appointed in 2010 by agreement with the fund and the European Commission to clean up Greek statistics after years of official fudging by the finance ministry.
“I am being prosecuted for not cooking the books,” Mr Georgiou told the Financial Times. “We would like to be a good, boring institution doing its job. Unfortunately, in Greece statistics is a combat sport.”’

.

Statement of the European Statistical System Committee

 on recent developments concerning ELSTAT in Greece

ESS Logo

Press Release  07.02.13

‘Statement of the Members of the European Statistical System (composed of Eurostat and National Statistical Institutes of EU/EFTA Member States) on recent developments concerning ELSTAT in Greece. 

We the undersigned, who collectively as members of the European Statistical System Committee are responsible for overseeing the production of European Statistics to be in compliance with the highest professional standards throughout the European Union, wish to express our deep concern at recent developments with regard to ELSTAT in Greece, which
we believe can affect not only the integrity of official statistics in that country, but also the functioning of the European Statistical System as a whole.

While fully respecting the independence of national judicial systems and abstaining from commenting on on-going court cases, we are concerned that political debates surrounding judicial action taken against the Head of the Greek statistical office (ELSTAT) and the calling into question of the validity of data which have repeatedly passed the stringent quality checks applied by Eurostat to ensure full compliance with European law seem to disregard commonly agreed European procedures. …

… We are confident that Greek authorities will do everything necessary to protect the independence of ELSTAT, its management and its staff from political and all other interference and support ELSTAT in ensuring that statistics in Greece are produced in line with the principles of the European Statistics Code of Practice.

The European Statistical System will very closely observe the further developments in the Greek statistical system.

The Director General of Eurostat and the Presidents/Directors General
of National Statistical Institutes of the European Union and EFTA’

-> full press release of ESSC (European Statistical System Committee) and link page

.

Background information.

Eurostat 2010 Visit to Greece Report

EDP = Excessive Deficit Procedure

————–

‘… from August 2010, when I took up my post, and for five consecutive biannual publications, the Greek public finance statistics have been accepted by Eurostat without any reservations, following the envisaged checks and validations, and the reliability of these statistics is not doubted by any European or international institution. This holds true also for the fiscal deficit
of 2009, for the calculation of which Eurostat has repeatedly and formally declared that it has been carried out in accordance with the rules and methodology that are provided for in a binding manner in European Law….’