Open Data Portals: News

There are new or refurbished open data portals to be announced.

opendata.swiss

Switzerland just published opendata.swiss in a new look for a better presentation of data. See the press release.

snip_opendataswiss

snip_swissopendataabout

europeandataportal.eu

The European Commission published some months ago the European Data Portal.

snip_EuropeanDataPortal

europeandataportal.eu is much more than a collection of open data. It is an ecosystem with lots of documents explaining and promoting open data.

snip_euportalaims

SPARQL inside!

The portal offers metadata as linked open data with an SPARQL endpoint for powerful searching.

snip_sparql

select ?theme (count(?theme) as ?count) where {?s a dcat:Dataset . ?s dcat:theme ?theme} GROUP BY ?theme LIMIT 100  gives all  data categories/themes and their number of datasets .

Impact studies

Most of all these data are already published on other websites. The advantage of such open data portals are a centralized access and clear licence information, A main intention is to attract developers, to foster data usage and with this economic growth.

A Swiss study (January 2014) assesses the economic impact of Open Government Data: ´The report determined that the economic benefits from OGD for Switzerland lie most likely between CHF0.9 B and CHF1.2 B´.

snip_ogdstudie       All the details >>> here  (look for the extended executive summary).

European Study (November 2015) within the context of the launch of the European Data Portal got these results: “The aim of this study is to collect, assess and aggregate economic evidence to forecast the benefits of the re-use of Open Data for the EU28+. Four key indicators are measured: direct market size, number of jobs created, cost savings, and efficiency gains. Between 2016 and 2020, the market size of Open Data is expected to increase by 36.9%, to a value of 75.7 bn EUR in 2020. The forecasted number of direct Open Data jobs in 2016 is 75,000 jobs. From 2016 to 2020, almost 25,000 extra direct Open Data jobs are created. The forecasted public sector cost savings for the EU28+ in 2020 are 1.7 bn EUR. Efficiency gains are measured in a qualitative approach. ”

snip_EUimpactSee the details >>> here

Next: LOD

Open and machine-readable formats help to access data and foster the economic impact. Even better when the data have metadata in a standardized description. Linked Open Data (LOD) in RDF format provide this; europeandataportal.eu uses this format describing the harvested datasets (metadata). The next step will and must be data in this format in order to link masses of data in the linked data cloud.

With data.admin.ch a first step is been made in Switzerland.

snip_dataadmin

Linked Data? In europeandataportal.eu’s ecosystem well made videos present explanations:

snip_learnLOD

 

 

Optimism with Data

What will our future be like? Is there no or some hope that things evolve in a good direction? Will we make progress?

Data play a crucial role in answering these questions.

Steven Pinker (Harvard University, Department of Psychology) in his answer to the EDGE question of 2016 considers that Quantifying Human Progress is the most interesting recent (scientific) news:

But the most interesting news is that the quantification of life has been extended to the biggest question of all: Have we made progress? Have the collective strivings of the human race against entropy and the nastier edges of evolution succeeded in improving the human condition?’

‘Human intuition is a notoriously poor guide to reality. …. But the cognitive and data revolutions warn us not to base our assessment of anything on subjective impressions or cherry-picked incidents. As long as bad things haven’t vanished altogether, there will always be enough to fill the news, and people will intuit that the world is falling apart. The only way to circumvent this illusion is to plot the incidence of good and bad things over time. Most people agree that life is better than death, health better than disease, prosperity better than poverty, knowledge better than ignorance, peace better than war, safety better than violence, freedom better than coercion. That gives us a set of yardsticks by which we can measure whether progress has actually occurred.

The interesting news is that the answer is mostly “yes.” …. Economic historians and development scholars (including Gregory Clark, Angus Deaton, Charles Kenny, and Steven Radelet) have plotted the growth of prosperity in their data-rich books, and the case has been made even more vividly in websites with innovative graphics such as Hans Rosling’s Gapminder, Max Roser’s Our World in Data, and Marian Tupy’s HumanProgress.’

What may be true for the world must not be true for the individuals.
Let’s have a look at these mostly well-known data sites:

Max Roser: Our World in Data

‘Max Roser is the founder of OurWorldInData. He is an economist working at the University of Oxford. His background is in economics, geoscience and philosophy. His research is focusing on the long-term growth and distribution of living standards.’

‘On my website I am presenting the long-term data on how we are changing our world. The idea is to tell the history of our present world – based on empirical data and visualised in graphs.’

snip_worldindata-about-method

‘Most of the long-run trends are positive and paint an optimistic view of our world. Topic by topic, the empirical view of our world shows how the Enlightenment continues to make our world a better place. It chronicles how we are becoming less violent and increasingly more tolerant. The data displays how new ideas continue to improve living standards, allowing us to live a healthier, richer and happier life. It is the story of declining poverty and better food provision in a world we care about.

The empirical view on our world shows how misplaced doom and defeatism is and my aim is to encourage those who work to make our world a better place still. At the same time my hope is also to help to change the mind of those of you who do not think that we are creating a better world. By looking at the empirical data I want to explain why I am optimistic about how we are changing our world and why I think it is worthwhile to engage in the global long-term project of Enlightenment. Although most trends are clearly going in the right direction I also show where this is not the case. In a world of hysteria we cannot focus on what is important, but a fact based view on our world should help us to focus on the topics that are most important.’  http://ourworldindata.org/about/

snip_roser-health

Human Progress.org

Human Progress’ mission statement (http://humanprogress.org/about):

‘Evidence from academic institutions and international organizations shows dramatic improvements in human well-being. These improvements are especially striking in the developing world.
Unfortunately, there is often a wide gap between the reality and public perception, including that of many policymakers, scholars in unrelated fields, and intelligent lay persons. To make matters worse, the media emphasizes bad news, while ignoring many positive long-term trends.

We hope to help in correcting misperceptions regarding the state of humanity through the presentation of empirical data that focuses on long-term developments. All of our wide-ranging data comes from third parties, including the World Bank, the OECD, the Eurostat, and the United Nations. By putting together this comprehensive data in an accessible way, our goal is to provide a useful resource for scholars, journalists, students, and the general public.

While we think that policies and institutions compatible with freedom and openness are important factors in promoting human progress, we let the evidence speak for itself. We hope that this website leads to a greater appreciation of the improving state of the world and stimulates an intelligent debate on the drivers of human progress.

Note: HumanProgress.org is a project of the Cato Institute with major support from the John Templeton Foundation, the Searle Freedom Trust, the Brinson Foundation and the Dian Graves Owen Foundation.’

Some data:

snip_humanprogress-infographics.

Gapminder

And here is top-star Hans Rosling with his gapminder.org where he deconstructs misleading, ’60-years-behind-reality’ opinions with data.

An example: Hans Rosling asks: Has the UN gone mad?

‘The United Nations just announced their boldest goal ever: To eradicate extreme poverty for all people everywhere, already by 2030.
Looking at the realities of extremely poor people the goal seems impossible. The rains didn’t fall in Malawi this year. The poor farmers Dunstar & Jenet, gather a tiny maize harvest in a small pile on the ground outside their mud hut. But Dunstar & Jenet know exactly what they need to break the vicious circle of poverty. And Hans Rosling shows how billions of people have already managed. This year’s “hunger season” may very well be Dunster’s & Jenet’s last.
Up-to-date statistics show that recent global progress is ‘the greatest story of our time – possibly the greatest story in all of human history. The goal seems unrealistic to many highly educated people because their worldview is lagging 60 years behind reality.’

snip_roslingpoverty

snip_gapminder-panic

.

A focussed view: OXFAM’s new study

‘An Economy for the 1%

 Runaway inequality has created a world where 62 people own as much wealth as the poorest half of the world’s population – a figure that has fallen from 388 just five years ago, according to an Oxfam report published on January 18th.
How pivilege and power in the economy drive extreme inequality and how this can  be stopped. The global inequality crisis is reaching new extremes.The richest 1%now have more wealth than the rest of the world combined.
Power and privilege is being used to skew the economic system to increase the gap between the richest and the rest. A global network of tax havens further enables the richest individuals to hide $7.6 trillion.’ -> Methodology
snip-oxfam2016
OXFAM’s conclusion:
‘The fight against poverty will not be won until the inequality crisis is tackled.’

Income distribution. Data on Max Roser

snip_wealt-roser
‘A lesson that that we can take away from this empirical research is that political forces at work on the national level are possibly important for how incomes are distributed. If there was a universal trend towards more inequality it would be in line with the notion that inequality is determined by global market forces and technological progress where it is very hard (or for other reasons undesirable) to change the forces that lead to higher inequality. Inequality would then be inevitable. The reality of different inequality trends within countries suggests that the institutional and political framework in different countries play a role in shaping inequality of incomes.’

 

 

 

 

Blog about Stats 2015 in review

The WordPress.com stats helper monkeys prepared a 2015 annual report for this blog.

Here’s an excerpt:

The concert hall at the Sydney Opera House holds 2,700 people. This blog was viewed about 14,000 times in 2015. If it were a concert at Sydney Opera House, it would take about 5 sold-out performances for that many people to see it.

Click here to see the complete report.

In Love with Data

An amazing, year-long, analog data drawing project made by two women: Giorgia Lupi and Stefanie Posavec.

‘Each week we collect and measure a particular type of data about our lives, use this data to make a drawing on a postcard-sized sheet of paper, and then drop the postcard in an English “postbox” (Stefanie) or an American “mailbox” (Giorgia)!’

An example: Week 14 by Stefanie

card-time-titlecard-time

card-time-explain

About the project

‘The process:
Every week we choose a topic we want to explore about our days and lives, and on Monday start our separate-but-parallel data collection.

The data-collecting ends the evening of the following Sunday, and through the course of the following week we analyse our data and draw our postcard, all the while collecting the next dataset.

On Monday we scan and drop our data postcard into the mailbox/postbox and start to plan the next week’s drawing!

The postcards:
The data drawing is shown on the front of the postcard, while the back always includes a “how to read it” key to enable the other to understand the data collection and insight behind the drawing.’

The Book

data-book

 

‘The book explores the role that data plays in our lives and originates from a correspondence between the two authors – both data visualisation artists who met at a data conference and chose to keep in touch by sending weekly postcards composed of data visualisations in place of words. The result is described as “a thought-provoking visual feast”.’

Next: Dear Data two

Data two ‘project was inspired by Dear-Data.com, a wonderful collaboration between Giorgia Lupi and Stefanie Posavec. We (Jeffrey Shaffer and Andy Kriebel) decided to follow in their footsteps and coincidentally, Andy recently moved from California to London, England.’

Attention please!

They all use statistics …  in the media, in politics, in sports. But they mostly forget that statistics, especially official statistics, are made by professionals in a quite demanding, time- and resource-consuming process. The WO/MAN-IN-THE-MIDDLE, the professionals, providing information and knowledge from facts remain hidden (despite Googles’ statement that statistician will be ‘the sexy job in the next ten years)


snip_20151124213156

Source: 'Statistics – A universal language', Swiss Statistics, Neuchâtel

How to promote the statisticians’ work?

This question is a perennial topic in the statistics community.  And the answers are manifold. Some examples:

Show the results!

Dissemination of statistics is widely developed and of high quality. Websites of statistical institutions present rich information – from simple facts to interactive presentations and visualisations.

New media play its role, too.  And they are important. Feeds and tweets are omnipresent (-> Some examples of official statistical tweets).

See Statistics Netherlands’ experience: ‘In addition to the normal distribution of news reports, Twitter has become a standard way for Statistics Netherlands to distribute day-to-day information. The number of followers of @statistiekcbs grew from 14,000 in early 2014 to almost 56,000 by the end of the year. In December, Statistics Netherlands’ tweets were viewed a total of 3.6 million times which represents an average of almost 120,000 per day. In the final months of 2014, news reports were being retweeted on an average of 100 times a day. `(Statistics Netherlands Annual Report for 2014, p.9)

Yes, ok … but the professionals behind these presentations are not visible. Even as brilliant presenters as Hans Rosling let us forget how the facts for his beautiful visualisations were prepared.

About us

Selfies of statistical institutions are standard on their websites. These presentations are short and normally without a marketing touch.

There are some examples, where a self-portrait gets an own website and presents more than static information about the institution. The European Statistical System (ESS)  publishes a website serving as a ‘single entry point to relevant information on the organization and activities of the ESS’ and its partner organizations. An RSS feed provides updates and readers can follow the work of more than 30 statistical institutions … so long as they provide their news to the website.

snip_essheader

snip_essvision

Launching a campaign is another way to attract attention. This is mostly chosen for periodical Census. So for instance in the US, Germany or the UK. There are also mini-campaigns. ‘Statistics counts for you’ is such an example.

snip_20151126131832Clicking on the animated teaser in the homepage opens a new website with the message and a summary of available statistics. There’s no offer to communicate with the reader via news-tweets or newsletters.

And finally there are also examples of more interactive and user-oriented approaches.

CBS Corporate News

is a specific website ( http://corporate.cbs.nl ) and a beautiful presentation of Statistics Netherlands,  showing activities and achievements in six fields by choosing the relevant filters (like projects, events&congresses, new services, innovative developments, user relations and international affairs). It’s attractive, personal, interactive and provides updates via a newsletter.

snip_cbscorpfilters

snip_cbscorpabout

Chronostat

is an interactive, multimedia presentation of Statistics Switzerland’s activities and products.

snip_chronostat

Five filters for topics (Personalities, Publications, Swiss History and Statistics, Achievements and Methods) and filters for years back to the beginnings of Statistics Switzerland in 1860 let readers follow multiple aspects of Statistics. With this timeline it provides an archive.

snip-chronostat2

Update it!

The be-all and end-all of statistical self-portraying are updating. Updated information presents an active institution and maintains the contact with users and interested groups. It fosters understanding for the work behind the statistical information and prevents from cutting necessary resources.