Goodbye Statistical Yearbooks …. ?

The end for the traditional statistical yearbooks – be they printed or as ebooks – is approaching gradually.

The German yearbook has recently been hit. The last edition had its farewell at a press conference on 30 October 2019:
“Digitisation is shaping the statistics of the 21st century. The expansion of our digital communication is necessary if we want to remain the leading provider of statistical information about Germany. We say goodbye to the Statistical Yearbook, which stood for our activities for almost seven decades. The yearbook goes, but the data remains. They are already available via our online services in greater abundance than ever before. ….
One thing is clear: Rigid reference books are hardly in demand today. The trend is towards up-to-date, digitally available information. The information is researched online.”
Source: Press conference destatis, 30 October 2019. Original in German.

Digi…. ?

The rationale for abolishing printed yearbooks is always the same: digit(al)ization continues, users have new needs and go online.

The three D’s.

What is meant by digit(al)isation?

‘Digitization essentially refers to taking analog information and encoding it into zeroes and ones so that computers can store, process, and transmit such information. …
  We refer to digitalization as the way in which many domains of social life are restructured around digital communication and media infrastructures.”
Instead, … digital transformation … refers to the customer-driven strategic business transformation that requires cross-cutting organizational change as well as the implementation of digital technologies.

In the final analysis, therefore, we digitize information, we digitalize processes and roles that make up the operations of a business, and we digitally transform the business and its strategy. Each one is necessary but not sufficient for the next, and most importantly, digitization and digitalization are essentially about technology, but digital transformation is not. Digital transformation is about the customer.

Source: Forbes

---

Digital alternatives

There is no doubt that the Internet as a source of information is a priority, the first step does not go to the bookshelf, but digitally, to the smartphone, tablet or PC.
Digitization has taken place, everything is available in binary form.
And also digitalization in the form of digital types of information and communication: There are comprehensive websites of statistical institutions, some with more, some with less sensitive user guidance. And there are many interactive databases of these institutions, too.
When users get to these sources, they await some work to find their way around, searching databases, before a table, a file or a simple website appears on the (often too small) screen.

Table-based yearbooks

After the end of the German Statistical Yearbook, there is a comprehensive alternative offer for the content: More tables, graphs and methodological explanations can be found on the web – with a little more effort, not concentrated. it’s like leaving a small, manageable town and having to find your way around a big city. And it is no longer a physically tangible object, guaranteed to be accessible over a long period and no longer – as a book can be – a visible showpiece and image carrier of the institution.

Statistisches Jahrbuch Deutschland 2019

Yearbooks with stories to tell

A specialty of traditional yearbooks is their texts. They offer a certain kind of storytelling. This is quite demanding because it is more than just boring retelling of table contents and it must not get involved in controversial or even politically colored explanations. Describing the context in the various thematic areas and pointing out remarkable developments make them stand out. They help to get a quick first orientation in the extensive data.

Here are a few examples of such storytelling yearbooks and how they – whether discontinued or not – have responded to the trend to digit(al)ization.

Canada till 2012

The Canadian Statistical Yearbook was an early standard for yearbooks that wanted to present a country and its international position in an attractive and widely understandable form.
‘Presented in almanac style, the 2012 Canada Year Book contains more than 500 pages of tables, charts and succinct analytical articles on every major area of Statistics Canada’s expertise. The Canada Year Book is the premier reference on the social and economic life of Canada and its citizens.
This publication has been discontinued as of April 2013. The last issue of this publication was November 2012.The Canada Year Book 2006 to 2012 is available online in html and pdf formats.’

After some changes, it was closed in 2013. There is no digital alternative, unless – similar to the German solution – there is a thematically ordered overview of data, analyses, and references

Netherlands

The Dutch statistical yearbook was early converted from a printed to a PDF version. Abolished under the title Yearbook, but then continued as Trends in the Netherlands in 2014.

Yearbook 2014

The yearbook went, ‘Trends in the Netherlands’ came – even with more storytelling than before. To be found on the homepage.

Trends in the Netherlands 2019

Switzerland

The Swiss Statistical Yearbook is one of the last international editions still to be printed. And it is a comprehensive, multimedia, thematically organized reference work: infographics, extensive texts, tables, references in two languages and abstracts in two other languages make it widely accessible.

Digitalization has not passed this yearbook by either. Older editions can be consulted on the Office’s website and the text of the current yearbook is included as an introductory panorama in each of the thematic pages on the web.

Thematic homepage

The Panorama: An excerpt from the current printed yearbook, format pdf:

Panorama: Textual introduction

Eurostat

Most existing yearbooks entered the era of digit(al)ization entirely through file lists and interactive databases or through PDF versions. Eurostat has been going the other way for several years. The idea of a storytelling book functioning as a unit has been implemented digitally from the very beginning. And last but not least, with an educational intention that promotes statistical literacy. This edition is therefore also called Statistics Explained.

In each topic, this website finally leads to the all-embracing world of digital data and databases.

---

What else …. ?

Statistical yearbooks encounter digit(al)ization in very different ways: they disappear into (interactive) databases on the web, survive as PDF editions (more or less well integrated into websites) or celebrate a kind of resurrection in web-based book-like products.
The strengths of yearbooks (especially those based on storytelling) are thus more or less lost: For example, a professionally curated, guaranteed reliable, easily usable and explained introduction to the essential data topics in one place and guaranteed to be available for many years to come. And an ever more extensive and better presented world of data on the Internet has emerged. An accessible wealth of information, of which one could hardly dream a few years ago.

But no matter how developed this data offer may be, it still lacks some simplicity and quick access to the right data. Anyone who has ever searched for data on different topics and over different periods knows how frustrating this can be. Which in the mass of partly similar files is the right one? How can various topics be combined in databases? How can the different time series be combined?
Is it the right data for the question asked, can I use it without risk? Perhaps there are nuances in the method or definition of the data and they should not be compared with other data?

But often users don’t even come to the official sources, because the most common change in user behavior is googling. And the result may be a single figure or a large amount of links to very different sources

… digital transformation.

Statistical institutions are making great efforts in the field of digital innovation, as shown not least by the sometimes very attractive offerings. Many are working on so-called experimental statistics: Coding data faster and better with the help of artificial intelligence, creating and extracting indicators from big data and much more. All this should make the production of statistical data more efficient, less dependent on human intervention (and human error) and faster. In the field of data dissemination, such experiments are still lacking, at least to this day.

Are all these innovations the often mentioned digital transformation?
At best, they are elements of it.

What digital transformation can users dream of?
Perhaps that statistical information is produced in a rapid and uninterrupted process (like in a pipeline) and is provided with semantic information in such a way that a simple search over topics and periods delivers an unambiguous result and refers to important context information. That even in a digital transformation human intervention will still be necessary (at the latest in presentation, explanation, and support), is not a paradox: Perhaps the overall package of digital transformation also includes non-digital elements, dedicated print products that skilfully lead into the digital world.

There’s more

State of Open Data in Europe

The European Commission (Directorate General for Communications Networks, Content and Technology) just published the second Open Data Maturity Report.

‘Open Data refers to the information collected, produced or paid for by public bodies which can be freely used, modified, and shared by anyone for any purpose.’ (all pages from the report, p.6)

‘The two key indicators used to measure Open Data Maturity are Open Data Readiness and Portal Maturity.
— The first key indicator, Open Data Readiness, assesses to what extent countries have an Open Data policy in place, licensing norms and the extent of national coordination regarding guidelines and setting common approaches.
— The second key indicator, Portal Maturity, explores the usability of the portal regarding the availability of functionalities, the overall re-usability of data such as machine readability and accessibility of data sets, for example, as well as the spread of data across domains.
The two key indicators as well as the sub-indicators are shown in the table below.

(pp.6 and 10)

Open Data Maturity in Europe 2016: The results

Overview by countries:

Results from the Open Data Maturity Assessment for the EU28+ countries 
for 2016 (p.59)

From European Data Portal, all the details here.

(p.59)

And one more result blog about stats enjoys:

About Re-Usability

One of the criteria for open data maturity is the re-usability of data and especially machine readability of data. Six questions focus on this item:

‘When looking at the data on the European Data Portal, over 49 different file formats are used. The most used data formats are CSV, HTML and WMS. The fourth most used data format is PDF. PDF is one of the few data formats that is not machine-readable. The following most frequent distributions are ZIP, JSON, XLS and XLSX, followed by WFS and XML. Numbers range from nearly 49,000 CSV formats to just over 23,000 JSON formats to the least used 263 shape formats. Most data formats are or are related to a spreadsheet, which enables to analyse the data more swiftly.’ (p. 49).

That is not enough and the report recommends:

‘On the more technical side, some improvements are still necessary. To further develop automated processes each national portal should have an API in combination with a complete metadata profile. This allows a portal to share the data with data users more easily. This can for instance enable harvesting data directly from public administrations in an automated fashion, saving efforts in manual uploading of data and limiting errors when editing data and metadata manually.  … Typos or different spellings can limit the discovery of data. Here activities conducted at EU level on controlled vocabularies can be of interest to learn from in order to increase semantic interoperability. ‘  (p.63)

There is more

PDF is poor, XLS is better, CSV even better, also JSON and APIs; and metadata are of crucial importance. The European Data Portal gives a good example: it organizes the datasets in the triple format (RDF) and offers an SPARQL search.

But there is more.

Not only the datasets could foster semantic interoperability but also the data in these sets. Linked data and adequate formats can assure this interoperability and with this extended machine readability and use of data. So why not add this criterion to the questionnaire (Question 7.6 +) and lead the national portals in this direction?

Linked data? Tim Berners-Lee explains

And related: https://blogstats.wordpress.com/2016/02/03/open-data-portals-news/

AoS: The new Atlas of Switzerland … and more

On June 20th, 2016 the moment arrived to unveil the new Atlas of Switzerland (AoS):

Simone Niggli-Luder (orienteering athlete and multiple world champion), Sarah Springman (Rector of the ETH Zurich), Marc Chardonnens (Director of the Federal Office for the Environment). (Foto AG)

AoS Version 4

The new Atlas of Switzerland AoS is (since 2000) already version 4.

“The AoS is mandated by law by the Swiss Federation to visualize themes from different fields such as socio-economy, ecology, history and energy, etc. in an ongoing long-term project. Since its beginning in 1961, the aim of this Swiss national atlas is to offer cartographically sound maps in combination with additional information to the general public in order to visualize visible and hidden structures and processes.” (Source: Atlas of Switzerland goes online and 3D – Concept, Architecture and Visualization. Methods. René Sieber, Marianna Serebryakova, Raimund Schnürer, Lorenz Hurni. EuroCarto 2015)

Version 4 is a step forward. It
– is based on a platform open for third parties’ products,
– is available online and
– presents information on a globe model and in 3D.

Platform

The AtlasPlatformSwitzerland (APS) is the architectural framework for future AoS products. It also offers the possibility to publish affiliated atlases from other institutions; one example is the Hydrological Atlas of the University of Bern.

Online

After downloading the client software (for te moment Windows only), thematic maps can be selected from the online archive and viewed.
Besides the navigation in the Atlas itself an easy access to these maps is also given on AoS’ Website:

Presentation

And here comes the fascinating part of the new Atlas: The presentation based on an earth model and also in 3D.

“The core of this APS – the so-called APSglobe – consists of a 3D virtual globe (osgEarth) with basic tools for navigation, visualization, and querying.” (http://www.atlasderschweiz.ch/portfolio/).

A globalized example shows the flights from Zurich in 3D:

 

Another map presents population density in two and three-dimensional views:

.

 

Drilldowns show settlement structures  (here the train station Bern) with the possibility of navigating through cities and of changing perspectives:

Hydrological Atlas

On the same Atlas Platform, the University of Bern publishes its Hydrological Atlas of Switzerland using all the possibilities of navigating and presentation.

.

More maps: Statistical Atlas of Switzerland

There’s another Atlas with hundreds of thematic maps based on statistics:

More about Statatlas in the –> Leporello

 

 

Open Data: Global Goals, Local Impact

Upcoming Open Data Event

IODC16 Madrid. Global goals, local impact

The 4th International Open Data Conference, IODC16 will take place in Madrid. October 6-7, 2016. It will be ‘designed not as a single statement on open data, but rather as a curated record of discussions and debates, providing a snapshot of key issues and setting out a path forward based on the visions, ideas, and agreements explored at IODC 2015′ in Canada.

Reporting IODC 2015

From the 2015 report:

‘More than 1000 participants from 56 different countries took part in the 3rd International Open Data Conference (IODC) in Ottawa from May 28-29, 2015 . Hosted by the Government of Canada, the International Development Research Centre, and the World Bank, IODC brought together open data experts to understand the global impact of open data, coordinate action, and share best practices.’ p.5

‘A few years ago, debates about open data centered on dataset formats and data portals—not any more . Today, the open data debate covers an increasingly broad spectrum of topics: from comprehensive principles for open data and the measurement of impact, to the development of common standards, and critical issues such as privacy, multilingual data communities, and indigenous knowledge.’ p.30

Using Linked Open Data LOD

An example showing how LOD helps break down silos: Florian Bauer’s presentation in IODC 2015 ‘Using Open Data Thesauri to Connect Climate Platforms’.

‘Data + Environment = Mobilizing Knowledge
Addressing climate change and environmental sus-
tainability is a knowledge-intensive enterprise . With
billions of data points from scientific research and mil-
lions of journal articles published in many different
languages over recent decades, organizing all that in-
formation, and getting it to the right people at the right
time requires both active intermediaries and shared
knowledge infrastructures . The Climate Knowledge
Brokers (CKB) group is building on the Renewable En-
ergy and Energy Efficiency Partnership’s (REEEP) mul-
tilingual climate thesaurus to tag and enrich content
from different document repositories, using a shared
Linked Open Data taxonomy . This helps to break down
the silos that keep information apart, building a stron-
ger open data ecosystem.’

Open Data Standards. LOD?!

‘In collaboration with Iniciativa Latinoamericana por los Datos Abiertos (ILDA), Open North interviewed governments and civil society organizations in 10 low- and middle-income countries to get a sense of their progress, challenges, needs and interests with respect to open data standards. After reviewing the previously identified gaps in standardization in light of the interview results, we proposed 32 draft recommendations, which we now invite stakeholders to discuss, comment on, and eventually implement.’ (Guest post on the Blog IODC 2016 from James McKinney of Open North).

The bad news for LOD is: It’s only nice to have in these countries. The good news is: LOD is on the radar even in countries with not so many resources. The five-star step in the WEB needs time.

On page 40/41 the report ‘Identifying recommended standards and best practices for open data’ (By Stéphane Guidoin (Open North), Paulina Marczak (Open North), Juan Pane (ILDA) and James McKinney (Open North).) gives the following recommendation.

‘Implementation
● When  possible,  government  could  provide  data  using  linked  data  format  like  RDF  or JSON­LD
● Data  tools  should  support  existing  ontologies  and  vocabularies  and  adopt  the relevant ones when possible
Discussion
On one  hand,  linked  data  and use of existing vocabularies is  perceived a significant  aspect  of open  data.  With linked  data,  it is possible  to  significantly  increase  the  automation  capabilities since data attributes become much less ambiguous.
On  the  other  hand,  linked  data  almost  did  not  appear  in  the  answers of  either government  or consumer  interviewees,  and  most  of  the  government  agencies  appeared  to  already  have difficulties  to  comply  with  more  simple  simple  recommendations.  Finally  linked  data  is  more difficult  to  use  and  require  more  advanced  tools  to  be  used  that  average  citizens,  CSOs  and even developer do not always know.
As  a consequence, use of linked data is presented as a “nice to have” recommendation and can be added to, but should not replace more accessible formats like tabular data.’

 

Extended Population Statistics

Providing accurate population stats is a quite difficult task. Censuses, registers, samples – these methods have their strengths and weaknesses;  definitions and variables are complex and changing over time. What is a family? What is sex or gender?

And there is a tool that brings a new aspect into the discussion 😉 : people in space.

 

E-Citizenship and E-Population

Statisticians are working a lot on structuring realty in order to count the right things. But reality is not at all stable, changes are going on all the time and statistics have to decide which changes have to be followed.

So population Statsticians had to adapt to new family models, had to recognize that ‘male’ and ‘female’ is not sufficient and now a new type of people is popping up: e-Citizens.

Estonian e-residency

‘The Republic of Estonia will be the first country to offer e-residency. People from all over the world will have an opportunity to get a digital identity provided by the Estonian government – in order to get secure access to world-leading digital services from wherever you might be.’ From: ‘Become an Estonian E-Resident’

‘An e-resident can use and enjoy the same great digital services that allow Estonians to do anything and everything digitally–sign all documents,launch and
manage companies, do the banking, encrypt files, etc.’

Digital Society – Digital Population?

With a simple ID-Card you become an E-Estonian and a member of the digital society. And who will count this new kind of population?

http://e-estonia.com/

EU Open Data Portal. An Evaluation.

Evaluating the EU Open Data Portal

‘The Department of Library and Information Science at the Complutense University of Madrid (Spain) has published a study that analyses and evaluates the European Open Data Portal.’ . Report presentation: http://www.epsiplatform.eu/content/analysis-and-evaluation-european-union-open-data-portal-0 or direct download:  http://revistas.ucm.es/index.php/RGID/article/download/99-118/42697. ____________________________________________________________________________________________________

Some interesting findings summarized below:

Editors

As with most of the other Open Government Data Portals the bulk of data comes from statistical agencies, here from Eurostat: .

Top 10

Number 1 is a translation help for all EU languages (‘translation memory, TM; i.e. sentences and their professionally produced translations’) .

Formats

Evaluation of data formats  follows Tim Berners-Lee’s 5star schema. .

5star for metadata queries

Semantic (****)  or even Linked (*****)  Data are not part of the portal’s data repository. BUT the description of the data with metadata follows 5star requirements and the EU Portal offers a SPARQL endpoint. Great! https://open-data.europa.eu/en/linked-data

Let’s learn SPARQL!

Statistics and Our Understanding of the World

Our understanding of the world around us is shaped by the numbers we use to measure it.

Official statistics’s objective are to measure and to describe this reality – whatever this is – and its transformation. Concepts and survey methods are tools helping to do this.
These tools are themselves changing and developing through time and so is our understanding of the world. This quite complex interrelation is best understood by studying the history of statistics.

Three new books focus on this topic.

Zachary Karabell, The Leading Indicators: A Short History of the Numbers That Rule Our World, Simon&Schuster 2014

A short excerpt from the introduction:

‘For almost a century, people have been inventing statistics to measure our lives, and since the middle of the twentieth century, our understanding of the world has been integrally shaped by those numbers. Our statistical map, however, is showing signs of age. In our desire to have simple numbers to make sense of a complicated world, we forget that our indicators have a history—a reason that they were invented in the first place—and that history reveals their strengths and limitations just as our own personal histories do. Knowing how we came to live in a world defined by a few leading indicators is the first step to assessing whether we are still well served by them. ….. The temptation, then, is to find new formulas, better indicators, new statistics. The search for better numbers, like the quest for new technologies to improve our lives, is certainly worthwhile. But the belief that a few simple numbers, a few basic averages, can capture the multifaceted nature of national and global economic systems is a myth. Rather than seeking new simple numbers to replace our old simple numbers, we need to tap into both the power of our information age and our ability to construct our own maps of the world to answer the questions we need answering.’

Diane Coyle, GDP. A brief but affectionate history, Princeton University Press. 2014

From introduction:

‘GDP is the way we measure and compare how well or badly countries are doing. But this is not a question of measuring a natural phenomenon like land mass or average temperature to varying degrees of accuracy. GDP is a made-up entity. The concept dates back only to the 1940s. ….

Yet the primacy of GDP as the measure of economic success has been increasingly challenged, not so much by politicians or economists as by people who see it as the primary symbol of what’s gone wrong with the capitalist market economy. For example, environmentalists believe it leads to an overemphasis on growth at the expense of the planet, “happiness” advocates think it needs to be replaced with indicators of genuine well-being, and activists such as those in the Occupy movement argue that a focus on GDP has disguised inequality and social disharmony.

There are certainly several reasonable critiques of GDP and the role it has come to play in guiding economic policy. These also include questions about how complicated the statistical construction of GDP has become, and what such a complex abstraction can actually mean. But GDP is also, as this book will show too, an important measure of the freedom and human capability created by the capitalist market economy. GDP indicates, although imperfectly, innovation and human possibility. And it is an important measure of our creativity and care for one another in an economy based more and more on services and intangibles. In 2000, the U.S. Bureau of Economic Analysis declared GDP to be “One of the Great Inventions of the 20th Century.” It is an understandable exaggeration.
This book explains GDP and describes its history, sets out its limitations, and defends it still as a key indicator for economic policy. It is certainly a better indicator than some of the fashionable alternatives (like “happiness”) that have been proposed. I also ask whether GDP alone is still a good enough measure of economic performance—and conclude not. It is a measure designed for the twentieth-century economy of physical mass production, not for the modern economy of rapid innovation and intangible, increasingly digital, services. How well the economy is doing is always going to be an important part of everyday politics, and we’re going to need a better measure of “the economy” than today’s GD.’

 

Philipp Lepenies, Die Macht der einen Zahl. Eine politische Geschichte des Bruttoinlandsprodukts, Suhrkamp 2013

A political history of GDP …

Aus der Einleitung:

‘Das Bruttoinlandsprodukt (BIP) ist die mächtigste Kennzahl der Menschheitsgeschichte. Keine andere statistische Größe hat jemals eine ähnliche Wirkung entfaltet. Vordergründig ist das BIP nur das Maß der wirtschaftlichen Leistung einer Volkswirtschaft, der in einer Zahl ausgedrückte Wert aller in einer Periode hergestellten Güter und Dienstleistungen. Aber zusammen mit dem Wachstum, das die Veränderungsrate des BIP angibt, ist es viel mehr als bloße Statistik. Das BIP dient als Hauptindikator für Entwicklung und Fortschritt. Positives BIP-Wachstum ist nicht nur erklärtes Ziel fast jeder Regierung, sondern gilt oft auch als der einzig mögliche Ausweg aus einer ökonomischen Krise. Die Wirtschaft und die Politik der Welt definieren sich in hohem Maße über das BIP.

Dabei ist das BIP keine sich selbst erklärende Zahl wie die Temperatur in Celsius, der letztjährige Ausstoß von Treibhausgasen in Tonnen oder der Kaloriengehalt des eigenen Frühstücks. Es ist das Ergebnis einer Berechnungsmethode, die bestimmte wirtschaftliche Aspekte erfasst, andere jedoch nicht. Es beruht auf einer Interpretation dessen, was Leistung und was Volkswirtschaft heißt. …

Die besondere Position des BIP resultiert aus seiner politischen Akzeptanz. Deswegen sind der Zeitpunkt und die Umstände relevant, die dazu geführt haben, dass die Idee des Bruttosozialprodukts als sinnvolle Technologie des Regierens erkannt und seine Berechnung endgültig zur politischen Arithmetik wurde.’

 

 

Embrasser l’univers

From the New York Times:
“PARIS — Google, which organizes the world’s information digitally, is linking up with a precursor that aimed to do something similar, on paper.
It plans to announce Tuesday [13 March 2012] that it is forming a partnership with a museum in Mons, Belgium, dedicated to a long-ago venture to compile and index knowledge in a giant, library-style card catalog with millions of entries — an analog-era equivalent of a search engine or Wikipedia. …
… Long before them, in 1895, two Belgians, Paul Otlet and Henri La Fontaine, began the project that grew into the Mundaneum. Their card catalog, initially called the Universal Bibliographic Repertory, compiled links to books, newspaper and magazine articles, pictures and other documents from libraries and archives around the world. People were able to submit queries via the mail or telegraph. The collection expanded to 16 million cards, and Mr. Otlet and Mr. La Fontaine envisioned a “city of knowledge,” complete with museum exhibits and other archival material. …
…The partnership is part of a broader campaign by Google to demonstrate that it is a friend of European culture, at a time when its services are being investigated by regulators on a variety of fronts.’

2012. What challenges?

What challenges will bring us 2012 ?

Mobile – social – open data and metadata –  making data findable and attractive (visualisation!)!

mobile

‘Web technologies have become powerful enough that they are used to build full-featured applications; this has been true for many years in the desktop and laptop computer realm, but is increasingly so on mobile devices as well. A W3C document summarizes the various technologies developed in W3C that increase the power of Web applications, and how they apply more specifically to themobile context.’

See also this blog post about mobile: https://blogstats.wordpress.com/2011/12/01/mobile-is-not-the-future-its-now/

social

There a lots of opinions and predictions about the role of social media. Here’s one in 11 points:

Many statistical agencies use social media, mostly as an additional information channel.

I.e. UK http://www.facebook.com/statisticsONS and nearly all are on twitter

.

open data and metadata

The open (government) data movement gained further momentum in 2011 and will do so in 2012, too.

See also:

• Berners Lee speaking https://blogstats.wordpress.com/2011/02/24/linked-data-its-not-a-top-down-system-berners-lee-and-opengov/
• open data and official statistics: A presentation http://www.box.com/s/y0b619ro3b3m0oppx61x
• and a blog post  https://blogstats.wordpress.com/2011/07/05/open-data-some-perspectives/

findable and attractive

Finding the appropriate data in three clicks and understanding these data is a eternal challenge – not only for officuial statistics’ websites.

A lot has been done. See the new websites of Italy (ISTAT) and others (please update the information about new websites and put the links in a comment, thanks). More to come 2012 as Germany (destatis), Australia and Denmark and others (please … ) plan to bring their new websites.

Visualisation is a major topic in this context. Statistical offices present their interactive and visual content in overviews (i.e. destatis or FSO of Switzerland) and use more and more third party applications like NComVa (Italy, Eurostat) or Google public data (Catalunya).

Some thoughts on visualisation ..

.

And there’s an issue whose importance is often underestimated. Not to forget:

statistical literacy!

.

*****

**

Finally, I wish you all the best for 2012!

.

Cinema Madrid – Google, Yahoo! and Bing go Semantic Web

Search on Google  for cinema or weather in a region and you will get more than a link: the weather forecast and the showtimes for today or tomorrow … .

.

Increasingly, search engines are going to provide more than just links, that is the information looked for. To do so Google already uses (since 2009) semantic markup on web pages in order to present search results with information instead of links to sites containing that information. Such so-called rich snippets describe people,  reviews,  products, recipes, etc.

Wolfram Alpha has this ambition, too. But Wolfram follows another road: Incoming search questions are analyzed via language recognition, linked to the Wolfram Alpha knowledgebase which then delivers corresponding content:

For weather Spain Wolfram Alpha does even better than Google 😉

And now we see a step forward by Google & Co in direction of the Semantic Web: Second of June 2011 Google, Bing and Yahoo! announced  schema.org, a ‘new initiative to create and support a common set of schemas for structured data markup on web pages. Schema.org aims to be a one stop resource for webmasters looking to add markup to their pages to help search engines better understand their websites.’

This is the next step after rich snippets and one further step towards the Semantic Web in action. But: Google unfortunately doesn’t use an existing standard like RDF! 😦

Many new markup categories will be added. Something relevant for statistical sites? Perhaps ‘GovernmentOrganization’ and ‘DataType’.

Providers of websites have now to decide how they will integrate such new markup in their content in order to get a good representation in search engines.