Big Data Events

The Big Data discussion builds momentum in Official Statistics.

In October 2012 at the UNECE High-level Seminar on Modernization of Statistical Production and Services (HLG) in St.Petersburg Big Data popped up. A strategic paper was asked for.

22 February 2013 the United Nations Statistics Division’s (UNSD) organised the Friday Seminar on Emerging Issues, especially Big Data.

Soon after a very good paper on Big Data was delivered by the HLG.

And in September 2013 the Heads of European Statistical Offices (DGINS Directors General of the National Statistical Institutes) adopted the Scheveningen Memorandum.

Scheveningen Memorandum
Big Data and Official Statistics

‘The DGINS
CONSIDERING
1. Recent innovations in the information and communication technologies have been leading to an increasing degree of digitization of economies and societies at all levels that offer new opportunities for the compilation of statistics.
2. The use of Big Data for statistical purposes challenges the European Statistical System to effectively address a variety of issues.
3. The demand for timely and cost efficient production of high quality statistical data increases, as well the need for new solutions to declining response levels.
4. Official statistics should incorporate as much as possible all potential data sources, including Big Data, into their conceptual design.
5. The distinguishing aspect of many Big Data sources is that they are not confined to national borders and, as such, represent unique opportunities for collaboration at European level as well as on global level.
6. Many European initiatives have a link to Big Data, including the European
Commission’s ambition for developing a strategy for the European data value chain, the on-going EU Data Protection reform and the Horizon2020 program.
7. The implementation of new methods of production of European statistics represents an objective of the European Statistical Programme 2013-2017 (1) and aims at efficiency gains and quality improvements, including increased timeliness.

(1) Regulation (EU) No 99/2013 of the European Parliament and of the Council of 15 January 2013 on the European statistical programme 2013-17, OJ L 39, 9.2.2013, p. 12–29

The DGINS
1. Acknowledge that Big Data represent new opportunities and challenges for Official Statistics, and therefore encourage the European Statistical System and its partners to effectively examine the potential of Big Data sources in that regard.
2. Recognise that Big Data is a phenomenon which is impacting on many policy areas. It is therefore essential to develop an ‘Official Statistics Big Data strategy‘ and to examine the place and the interdependencies of this strategy within the wider context of an overall government strategy at national as well as at EU level.
3. Recognise that the implications of Big Data for legislation especially with regard to data protection and personal rights (e.g. access to Big Data sources held by third parties) should be properly addressed as a matter of priority in a coordinated manner.
4. Note that several NSIs are currently initiating or considering different uses of Big Data in a national context. There is a momentum to share experiences obtained from concrete Big Data projects and to collaborate within the ESS and beyond, on a global level.
5. Recognise that developing the necessary capabilities and skills to effectively explore Big Data is essential for their integration into the European Statistical System. This requires systematic efforts like appropriate training courses and establishing dedicated communities including academics for sharing experiences and best practice.
6. Acknowledge that the multidisciplinary character of Big Data requires synergies and partnerships to be effectively built with experts and stakeholders from various
domains including government, academics and owners of private data sources.
7. Acknowledge that the use of Big Data in the context of official statistics requires new developments in methodology, quality assessment and IT related issues. The European Statistical System should make a special effort to supports these
developments.
8. Agree on the importance of following up the implementation of this memorandum by adopting an ESS action plan and roadmap by mid-2014 that should be further integrated into the Statistical Annual Work Programmes of Eurostat.’
.

ESS Big Data Event Roma 2014

And now comes the ESS Big Data Event from  31 March-1 April 2014. It offers keynotes and seminars dealing with several of the Scheveningen topics. See the programme and the concept paper.
.

The European Data Forum (EDF) Athens 2014

Some days before the ESS Event the annual European Data Forum will take place in Athens, March 19-20 2014. Big Data will be a topic there, too.

.

A practical example: Using Social media analysis for statistics

During the DGINS meeting 2013 in the Netherlands some examples of Big Data usage for statistical insights were accessible as presentations.
The Dutch Statistical Office CBS and Coosto the social media monitoring and engagement tool dived into the digital ocean of social media data and made some comparisons.

.

.

Big data and official statisics: A conclusion from Els Rijnierse’s  presentation on traffic big data: