Updated all data models to the last version of json schema

NOTE: We did yesterday 17-9 the changes. Unfortunately we made a mistake and now we have to revert all these changes, do it again properly and push. this Friday will be ready if not earlier.

NOTE2: It is already updated. Its Wednesday 15:30. Hopefully this time we made no errors.

The single-source-of-truth  of the data models is the json schema (file schema.json). This json schema has a tag ‘$schema’ indicating the meta schema the schema is compliant with.

Now all data models have been updated to the last one “https://json-schema.org/draft/2020-12/schema

Therefore some errors provided by validators due to the obsolete previous value have been removed.

Thanks to the user Elliopardad in GitHub for its contribution and to the community of json schema for its support.

As we announce earlier we are one of the project listed in its global landscape of projects.

pydantic export now available

The directory /code/ (see image with one example)  in every data model has now a new draft export the pydantic export.

Pydantic is a Python library that provides data validation and settings management using Python type annotations, allowing you to define data models that enforce type constraints and validate data automatically.

Now in most (if not all) data models you have such export to use it freely. Mind that is a first version and errors could happen (It is welcomed if you find any error or just make a suggestion)

The Smart Data Models Initiative Embraces JSON Schema as the Core Component for Interoperable Smart Solutions

The Smart Data Models (SDM) initiative, led by FIWARE Foundation in collaboration with IUDX, TM Forum, and OASC, has firmly established JSON Schema as the core component and single source of truth for creating exports in YAML, SQL, and soon RDF. This strategic move aligns the SDM initiative with the growing JSON schema community, enabling a wider adoption of this powerful data modeling standard.

The SDM initiative is an open collaboration aiming to promote the adoption of a reference architecture and compatible common data models across various sectors, starting with Smart Cities. By leveraging JSON schema as the foundation, the initiative ensures that the data models developed are not only technically robust but also interoperable with a wide range of semantic and linked data initiatives.

“The adoption of JSON schema as the core component of the Smart Data Models initiative is a significant step forward in our mission to enable interoperable smart solutions,” said Alberto Abella (Data Modeling Expert, FIWARE Foundation). “This collaboration with the JSON schema community will further strengthen the initiative and drive the widespread adoption of these common data models.”

In addition to the JSON schema-based data models, the SDM initiative also creates comprehensive specifications in eight languages, including English, French, German, Spanish, Italian, Korean, Chinese, and Japanese. This multilingual approach ensures that the data models are accessible and usable by a global audience, fostering international collaboration and knowledge sharing.

“The alignment of the Smart Data Models initiative with the JSON Schema community is a testament to the power and versatility of this data modeling standard,” said Benjamin Granados (Community Development Senior Manager – Open Technologies, JSON Schema Community, Postman). “We are excited to work closely with the SDM team to further enhance the adoption and integration of JSON schema across various smart applications and services.”

The Smart Data Models initiative welcomes contributions from the public. The data models are licensed under a royalty-free, open-source model, permitting free use, modification, and sharing. This collaborative approach fosters innovation and the creation of interoperable smart solutions, which can be replicated and scaled across various sectors and regions.

For more information about the Smart Data Models initiative and its adoption of JSON schema, please visit the official website at https://smartdatamodels.org or follow the initiative on X @smartdatamodels or in Linkedin.

Version 0.8 of the pysmartdatamodels package

Due to the new configuration of files of the package pysmartdatamodels it will be no longer required to use the from clause (initially)

Therefore now to import the package in python it will be simply

import pysmartdatamodels as sdm

Accordingly the examples of code in all data models are being changed, including a comment on this version change.

This updated of the examples o code will be announced soon.

Public tender clause document

Some of the users of the Smart Data Models are public entities. Those entities are willing to use Smart Data Models in the provisioning of their IT systems.

They can do it because SDM are open licensed models not depending on any software maker but in public standards and the license of the data models allows them to customize the models and to share the modifications with only attributing the authors.

Here you can see and comment a draft document with some examples of the technical clauses for public tenders (currently only in Spanish and English)

It is open for comments and suggestions

This document arised as a consequence of a webinar held past May 16th with the Spanish Network of Smart Cities (RECI).

Examples of code associated to every data model

In order to make easier the use of the Smart Data Models now in every repository in GitHub there is a new directory named ‘code’ that contains for the python code using the pysmartdatamodels  for the architecture in the image below.

The idea is a code that fills several attributes of the data model with suitable values and insert them into a context broker installed by default.

The code for installing an instance of the context broker is also included as comments in the header of the code

The code is generated automatically (like most of what we do)

You can see an example of this code here

https://github.com/smart-data-models/dataModel.Transportation/blob/master/EVChargingStation/code/code_for_using_dataModel.Transportation_EVChargingStation.py

Of course there could be many things that could be improved and extended. Let us know in this mail account or in the usual support channels.

In the future if there are interest we could create also in other languages. Please let us know if you have interest on this possibility.

New version of pysmartdatamodels python package 0.7.1

The changes in this new version are:

– Including new function validate_dcat_ap_distribution_sdm
– Updating the comments of most of the functions
– Some code improvements by jilin.he@fiware.org
– Included a new directory with templates for the creation of a data model. Not used yet but next version they will be used for the creation of local data models. Available at my_subject directory
– Fixing the missing dependency of ruamel.yaml package

It also has an updated version of all data models (but you can get this also by running the function sdm.update_data() with the old versions)

The source code for the new version 0.7.1 is here at the data-models repository

 

 

pysmartdatamodels updated to 0.7

The new version does not provide new functionalities but an indication, including drafted code, about what is missing or in progress to the package can grow according to your needs.

The source code for the new version 0.7.0 is here at the data-models repository

There are 4 new functions drafted with the headings inputs and outputs and some recommendations for development.

1) validate_payload(datamodel, subject, payload)
2) create_QR_code(datamodel, subject)
3) include_local_datamodel(schema, subject, datamodel, contributors (optional), adopters (optional), notes(optional))
4) submit_datamodel(subject, datamodel, contributors (optional), adopters (optional), notes(optional), example_payload, notes_context, public_repository, credentials)

we will be glad to receive code or questions implementing this and we will include the authorship

Minor extension of pysmartdatamodels 0.6.4.1

There is a minor new version of the package pysmartdatamodels.

Now it allows to have in the metadata of a data model the direct links to the specification in the 8 languages.

you can access thanks to the function list_datamodel_metadata and accessing the objects with the keys, spec, spec_DE, spec_ES, spec_FR, spec_IT, spec_JA, spec_KO and spec_ZH

from pysmartdatamodels import pysmartdatamodels as sdm
subject = "dataModel.Weather"
dataModel ="WeatherForecast"
metadata = sdm.list_datamodel_metadata(dataModel, subject))
print(metadata["spec_ES"]

You can install the update

pip install –upgrade pysmartdatamodels

New version of pysmartdatamodels package 0.6.4 with adaptations to Data Spaces

There is a new version of the python package pysmartdatamodels

to use it you have just to type

pip install pysmartdatamodels

in your system

Besides the update in the list of data models it includes two new functions
look_for_data_model that allows approximate searches for a data model based on their name
list_datamodel_metadata that returns the metadata of a data model including context link, data model version, model tags, link to the schema and to the yaml version of the schema, title, description, $id, required, links to the examples, link to the adopters, link to the contributors of the subject and a link to the sql export of a data model

These new functions are the result of some requests of data spaces managers and several others will be included soon to help you out in the management of the semantic contents of a data space.

A code example of these two new functions

from pysmartdatamodels import pysmartdatamodels as sdm

subject = "dataModel.Weather"
dataModel = "WeatherForecast"
# Look for a data model name 
print("22 : ")
print(sdm.look_for_datamodel("WeatherFora", 84))
# retrieve the metadata, context, version, model tags, schema, yaml schema, title, description, $id, required, examples, adopters, contributors and sql export of a data model
print("23 : ")
print(sdm.list_datamodel_metadata(dataModel, subject))