The already existing U data quality assessment data model has now some metrology parameters.
– completeness
– timeliness
– accuracy
– precision
Thanks to the Waterverse project and Grigoris Stathopoulos, the contributor.
The already existing U data quality assessment data model has now some metrology parameters.
– completeness
– timeliness
– accuracy
– precision
Thanks to the Waterverse project and Grigoris Stathopoulos, the contributor.
NOTE: We did yesterday 17-9 the changes. Unfortunately we made a mistake and now we have to revert all these changes, do it again properly and push. this Friday will be ready if not earlier.
NOTE2: It is already updated. Its Wednesday 15:30. Hopefully this time we made no errors.
The single-source-of-truth of the data models is the json schema (file schema.json). This json schema has a tag ‘$schema’ indicating the meta schema the schema is compliant with.
Now all data models have been updated to the last one “https://json-schema.org/draft/2020-12/schema”
Therefore some errors provided by validators due to the obsolete previous value have been removed.
Thanks to the user Elliopardad in GitHub for its contribution and to the community of json schema for its support.
As we announce earlier we are one of the project listed in its global landscape of projects.
The directory /code/ (see image with one example) in every data model has now a new draft export the pydantic export.
Pydantic is a Python library that provides data validation and settings management using Python type annotations, allowing you to define data models that enforce type constraints and validate data automatically.
Now in most (if not all) data models you have such export to use it freely. Mind that is a first version and errors could happen (It is welcomed if you find any error or just make a suggestion)
The Smart Data Models (SDM) initiative, led by FIWARE Foundation in collaboration with IUDX, TM Forum, and OASC, has firmly established JSON Schema as the core component and single source of truth for creating exports in YAML, SQL, and soon RDF. This strategic move aligns the SDM initiative with the growing JSON schema community, enabling a wider adoption of this powerful data modeling standard.
The SDM initiative is an open collaboration aiming to promote the adoption of a reference architecture and compatible common data models across various sectors, starting with Smart Cities. By leveraging JSON schema as the foundation, the initiative ensures that the data models developed are not only technically robust but also interoperable with a wide range of semantic and linked data initiatives.
“The adoption of JSON schema as the core component of the Smart Data Models initiative is a significant step forward in our mission to enable interoperable smart solutions,” said Alberto Abella (Data Modeling Expert, FIWARE Foundation). “This collaboration with the JSON schema community will further strengthen the initiative and drive the widespread adoption of these common data models.”
In addition to the JSON schema-based data models, the SDM initiative also creates comprehensive specifications in eight languages, including English, French, German, Spanish, Italian, Korean, Chinese, and Japanese. This multilingual approach ensures that the data models are accessible and usable by a global audience, fostering international collaboration and knowledge sharing.
“The alignment of the Smart Data Models initiative with the JSON Schema community is a testament to the power and versatility of this data modeling standard,” said Benjamin Granados (Community Development Senior Manager – Open Technologies, JSON Schema Community, Postman). “We are excited to work closely with the SDM team to further enhance the adoption and integration of JSON schema across various smart applications and services.”
The Smart Data Models initiative welcomes contributions from the public. The data models are licensed under a royalty-free, open-source model, permitting free use, modification, and sharing. This collaborative approach fosters innovation and the creation of interoperable smart solutions, which can be replicated and scaled across various sectors and regions.
For more information about the Smart Data Models initiative and its adoption of JSON schema, please visit the official website at https://smartdatamodels.org or follow the initiative on X @smartdatamodels or in Linkedin.
Due to the new configuration of files of the package pysmartdatamodels it will be no longer required to use the from clause (initially)
Therefore now to import the package in python it will be simply
import pysmartdatamodels as sdm
Accordingly the examples of code in all data models are being changed, including a comment on this version change.
This updated of the examples o code will be announced soon.
Some of the users of the Smart Data Models are public entities. Those entities are willing to use Smart Data Models in the provisioning of their IT systems.
They can do it because SDM are open licensed models not depending on any software maker but in public standards and the license of the data models allows them to customize the models and to share the modifications with only attributing the authors.
Here you can see and comment a draft document with some examples of the technical clauses for public tenders (currently only in Spanish and English)
It is open for comments and suggestions
This document arised as a consequence of a webinar held past May 16th with the Spanish Network of Smart Cities (RECI).
In order to make easier the use of the Smart Data Models now in every repository in GitHub there is a new directory named ‘code’ that contains for the python code using the pysmartdatamodels for the architecture in the image below.
The idea is a code that fills several attributes of the data model with suitable values and insert them into a context broker installed by default.
The code for installing an instance of the context broker is also included as comments in the header of the code
The code is generated automatically (like most of what we do)
You can see an example of this code here
Of course there could be many things that could be improved and extended. Let us know in this mail account or in the usual support channels.
In the future if there are interest we could create also in other languages. Please let us know if you have interest on this possibility.
The changes in this new version are:
It also has an updated version of all data models (but you can get this also by running the function sdm.update_data() with the old versions)
The source code for the new version 0.7.1 is here at the data-models repository
The new version does not provide new functionalities but an indication, including drafted code, about what is missing or in progress to the package can grow according to your needs.
The source code for the new version 0.7.0 is here at the data-models repository
There are 4 new functions drafted with the headings inputs and outputs and some recommendations for development.
1) validate_payload(datamodel, subject, payload)
2) create_QR_code(datamodel, subject)
3) include_local_datamodel(schema, subject, datamodel, contributors (optional), adopters (optional), notes(optional))
4) submit_datamodel(subject, datamodel, contributors (optional), adopters (optional), notes(optional), example_payload, notes_context, public_repository, credentials)
we will be glad to receive code or questions implementing this and we will include the authorship
There is a minor new version of the package pysmartdatamodels.
Now it allows to have in the metadata of a data model the direct links to the specification in the 8 languages.
you can access thanks to the function list_datamodel_metadata and accessing the objects with the keys, spec, spec_DE, spec_ES, spec_FR, spec_IT, spec_JA, spec_KO and spec_ZH
from pysmartdatamodels import pysmartdatamodels as sdm
subject = "dataModel.Weather"
dataModel ="WeatherForecast"
metadata = sdm.list_datamodel_metadata(dataModel, subject))
print(metadata["spec_ES"]
You can install the update
pip install –upgrade pysmartdatamodels