Training on Smart Data models

Tomorrow at day 0 of the FIWARE summit there will be a training session about Smart Data Models.
Slides are freely shared here

This training will be delivered face to face.

  • Intro:
    • Board and what is Smart Data Models Program
    • Current Status
    • Contributos and dissemintions
  • Agile standardization
    • Current standardization status
    • M.A.S.: Manifesto for agile standardizationç
    • Standardization in a digital market
  • Data model contents
    • Contents of a data model
    • Schema: review
    • Additional documents: examples, contributors, adopters, notes*
    • Generated documents: model.yaml, examples, README, context
  • Data Model creation
    • Incubated repository.
    • From csv, json or open data portals
    • Tests
  • Data Model moderation
    • Data model moderation
  • Future
    • pysmartdatamodels
    • New services. Integration
    • New data models. Mapping of standardizations
    • Other services for the contributors

Announcements widget. Just thanks

Not all changes in the data models are reported with a blog post, Twitter dissemination o LinkedIn post. But if you notice there is a widget in the right part of the front page (scroll down till Announcements) where these tiny changes are reported (see the image or browse the front page).

Most of them are issues, suggestions or PR solved thanks to the collaboration of the community. They make the data models better for all.

We cannot say thanks individually to all of them but please feel our gratitude.

You can download all of the tiny annoncements from this simple text file.

Just thanks

Connecting Open Data Soft open data with Smart Data Models for drafting new data models

Many of the datasets published in open data portals are extensively used elsewhere. Well-maintained portals have managers that document the data structure and provide definitions of the types and contents of every field in these datasets. These are some of the requirements for the successful publication of a new Smart Data Model.

With this simple python script (and others to come) at the utils folder it can be drafted a JSON schema compliant with the Smart Data Models Program contribution manual. It is an early version (not everything is updated) but you can check it out.

 Parameters:
– base url of the ODS portal
– dataset_id of the dataset
Returns:
A draft json schema compliant with Smart Data Models Program,

some limitations: it does not translate descriptions (required in English)
some data types
It prints the schema and also returns (if possible a file named schema.json)

test it with this command
SDM_OpenDataSoft_schema_converter.py https://data.ameli.fr/ effectifs

 

New customization option for context

The Smart Data Models Program does not define canonically and uniquely the terms used in the data models. There are many ontologies and vocabularies providing solutions to this issue.

For those users of linked data solutions, every subject includes a context.jsonld file (see example) with long IRI for the terms used in the data models. Besides this, the IRI provided are in fact URL to pages with additional information about the term (see example).

not only this but also two services are available on the tools menu on the front page.

  1. Merging several contexts and detecting conflicts. (for merging several context from different subjects)
  2. Mapping a context with external ontologies. (mapping a local context from SDM to any external ontology). These are the ones available but more could be easily created on demand.

But when mapping an existing open and adopted standard now it is possible to customize the context generated by using a new file notes_context.jsonld (see this empty example) at the root of the subject. It will replace the automatic IRI for a term with the customized one.

Help to early contributors

If have approached the Smart Data Models Program (SDM) for the first time and you want to become a contributor there are some technical concepts that you need to know about the elements compiled at SDM.

Once checked this presentation maybe you want to review the contribution manual

 

New Structure of the main menu

After growing in options and service, it was necessary to update the main menu (not only to make it more legible), but also to make it more natural.

Explore the tools section where all the available services are listed together

Documentation contains everything related to the documentation generated at the SDM and that can be necessary for several tasks

About include mostly the same elements (the starting point and FAQs)

Search remains the same because is one of the most used resources

Community for the interconnection between users and contributors.

New data model request to learn how to start

 

 

 

Mapping with core public service vocabulary URI available

Every data model in the Smart Data Models program can be mapped with external ontologies and there is a service on the main menu to achieve that.

See main menu -> @context -> generate an external @context

After the publication of data models of CPSV-AP now it is possible to map with their URI thanks to the mapping file.

CPSV-AP

 

New subject CPSV-AP and 8 new data models

There is a new subject in the CROSS Sector domain, CPSV-AP, related to public services. In fact, is making available the Core Public Service Vocabulary Application Profile (CPSV-AP).

CPSV-AP

  • BusinessEvent. This class represents a Business Event, which specializes Event. A Business Event is a specific situation or event in the lifecycle of a business that fulfills one or more needs or (legal) obligations of that business at this specific point in time. A Business Event requires a set of public services to be delivered and consumed in order for the associated business need(s) or obligation(s) to be fulfilled. Business Events are defined within the context of a particular Member State. In other words, a Business Event groups together a number of public services that need to be delivered for completing that particular event.

  • Cost. The Cost class represents any costs related to the execution of a Public Service that the Agent consuming it needs to pay.

  • CriterionRequirement. Not all public services are needed or usable by everyone. For example, the visa service operated by European countries is not needed by European citizens but is needed by some citizens from elsewhere, or public services offering unemployment benefits and grants are targeting specific societal groups. The CPSV reuses the Core Criterion and Core Evidence Vocabulary (CCCEV – https://joinup.ec.europa.eu/release/core-criterion-and-core-evidence-vocabulary-v100) for this class. The CCCEV provides more details but the Criterion Requirement class has three mandatory properties.

  • Evidence. The Evidence class is defined in the Core Criterion and Core Evidence vocabulary (CCCEV) as any resource that can document or support a criterion response. It contains information that proves that a criterion requirement exists or is true, in particular evidence are used to prove that a specific criterion is met. Although the wording of the definition is different, the semantics are an exact match for CPSV’s Input class which it replaces. Evidence can be any resource – document, artifact – anything needed for executing the Public Service. In the context of Public Services, Evidence is usually administrative documents or completed application forms. A specific Public Service may require the presence of certain Evidence or combinations of Evidence in order to be delivered. In some cases, the Output of one service will be Evidence for another service. Such relationships should be described in the associated Rule(s).

  • LifeEvent. The Life Event class represents an important event or situation in a citizen’s life where public services may be required. Note the scope: an individual will encounter any number of ‘events’ in the general sense of the word. In the context of the CPSV-AP, the Life Event class only represents an event to which a Public Service is related. For example, a couple becoming engaged is not a CPSV-AP Life Event, getting married is, since only the latter has any relevance to public services.

  • PublicOrganization. The CPSV-AP reuses the Core Public Organization Vocabulary (https://joinup.ec.europa.eu/asset/cpov/asset_release/all) that defines the concept of a Public Organization and its associated properties and relationships. It is largely based on the W3C Organization Ontology (http://www.w3.org/TR/vocab-org).

  • PublicService. A Public Service is a mandatory or discretionary set of activities performed, or able to be performed, by or on behalf of a public organization, publicly funded, and arises from public policy.

  • Rule. The Rule class represents a document that sets out the specific rules, guidelines or procedures that the Public Service follows. It includes the terms of service, license, and authentication requirements of the Public Service.

Draft your data model from a csv payload (test)

There is a new service for the creation of schema of a data model when the input is a csv payload.

It is available in the home -> Draft a data model -> Create a data model from csv payload

If you detect any issue or you want to make a suggestion, please send it to info@smartdatamodels.org

test it here