{"id":6739,"date":"2022-08-22T14:42:47","date_gmt":"2022-08-22T12:42:47","guid":{"rendered":"https:\/\/smartdatamodels.org\/?p=6739"},"modified":"2022-08-22T14:42:47","modified_gmt":"2022-08-22T12:42:47","slug":"connecting-open-data-soft-open-data-with-smart-data-models-for-drafting-new-data-models","status":"publish","type":"post","link":"https:\/\/smartdatamodels.org\/index.php\/connecting-open-data-soft-open-data-with-smart-data-models-for-drafting-new-data-models\/","title":{"rendered":"Connecting Open Data Soft open data with Smart Data Models for drafting new data models"},"content":{"rendered":"<p>Many of the datasets published in open data portals are extensively used elsewhere. Well-maintained portals have managers that document the data structure and provide definitions of the types and contents of every field in these datasets. These are some of the requirements for the successful publication of a new Smart Data Model.<\/p>\n<p>With this simple python <a href=\"https:\/\/github.com\/smart-data-models\/data-models\/blob\/master\/utils\/SDM_OpenDataSoft_schema_converter.py\">script<\/a> (and others to come) at the <a href=\"https:\/\/github.com\/smart-data-models\/data-models\/blob\/master\/utils\/\"><em>utils<\/em> folder<\/a> it can be drafted a JSON schema compliant with the <a href=\"https:\/\/bit.ly\/contribution_manual\">Smart Data Models Program contribution manual<\/a>. It is an early version (not everything is updated) but you can check it out.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-6742 alignleft\" src=\"https:\/\/smartdatamodels.org\/wp-content\/uploads\/2022\/08\/Selection_041.png\" alt=\"\" width=\"621\" height=\"379\" srcset=\"https:\/\/smartdatamodels.org\/wp-content\/uploads\/2022\/08\/Selection_041.png 895w, https:\/\/smartdatamodels.org\/wp-content\/uploads\/2022\/08\/Selection_041-300x183.png 300w, https:\/\/smartdatamodels.org\/wp-content\/uploads\/2022\/08\/Selection_041-768x469.png 768w, https:\/\/smartdatamodels.org\/wp-content\/uploads\/2022\/08\/Selection_041-574x350.png 574w, https:\/\/smartdatamodels.org\/wp-content\/uploads\/2022\/08\/Selection_041-150x92.png 150w\" sizes=\"auto, (max-width: 621px) 100vw, 621px\" \/>\u00a0Parameters:<br \/>\n&#8211; base url of the ODS portal<br \/>\n&#8211; dataset_id of the dataset<br \/>\nReturns:<br \/>\nA draft json schema compliant with Smart Data Models Program,<\/p>\n<p>some limitations: it does not translate descriptions (required in English)<br \/>\nsome data types<br \/>\nIt prints the schema and also returns (if possible a file named schema.json)<\/p>\n<p>test it with this command<br \/>\nSDM_OpenDataSoft_schema_converter.py https:\/\/data.ameli.fr\/ effectifs<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Many of the datasets published in open data portals are extensively used elsewhere. Well-maintained portals have managers that document the data structure and provide definitions of the types and contents of every field in these datasets. These are some of the requirements for the successful publication of a new Smart&#8230; <a class=\"continue-reading-link\" href=\"https:\/\/smartdatamodels.org\/index.php\/connecting-open-data-soft-open-data-with-smart-data-models-for-drafting-new-data-models\/\">More&#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[105,107,109,113,115,119,117,88,143,111,125,182],"tags":[],"class_list":["post-6739","post","type-post","status-publish","format-standard","hentry","category-cross-sector","category-smart-cities","category-smart-energy-domain","category-smart-environment","category-smart-manufacturing","category-smart-robotics","category-smart-water","category-smart-sensoring","category-smartaeronautics","category-smart-agrifood","category-smartdestinations","category-smarthealth"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":2482,"url":"https:\/\/smartdatamodels.org\/index.php\/new-subject-datamodel-dcat-ap-for-connection-with-open-data-portals-catalogue-data-model\/","url_meta":{"origin":6739,"position":0},"title":"New subject dataModel.DCAT-AP for connection with open data portals. Catalogue data model.","author":"maestro","date":"28\/05\/2021","format":false,"excerpt":"There is a new subject into Cross Sector domain for mapping the DCAT-AP 2.0.1 standard into smart data models. This is the standard for catalogs and other elements to be shared from open data portals. See the specification of this standard. The first data model is the CatalogueDCAT-AP which has\u2026","rel":"","context":"In &quot;Cross Sector&quot;","block_context":{"text":"Cross Sector","link":"https:\/\/smartdatamodels.org\/index.php\/category\/cross-sector\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":579,"url":"https:\/\/smartdatamodels.org\/index.php\/connection-with-european-open-data-portal\/","url_meta":{"origin":6739,"position":1},"title":"Connection with European open data portal","author":"maestro","date":"31\/08\/2020","format":false,"excerpt":"The European open data portal is possibly the biggest open data portal in the world with more than one million free datasets coming from 36 countries. One of the mechanisms to access its data is the use of the standard of DCAT-AP standard 2.0 which defines its catalogue of resources.\u2026","rel":"","context":"In &quot;Cross Sector&quot;","block_context":{"text":"Cross Sector","link":"https:\/\/smartdatamodels.org\/index.php\/category\/cross-sector\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":7001,"url":"https:\/\/smartdatamodels.org\/index.php\/training-on-smart-data-models\/","url_meta":{"origin":6739,"position":2},"title":"Training on Smart Data models","author":"maestro","date":"12\/09\/2022","format":false,"excerpt":"Tomorrow at day 0 of the FIWARE summit there will be a training session about Smart Data Models. Slides are freely shared here This training will be delivered face to face. Intro: Board and what is Smart Data Models Program Current Status Contributos and dissemintions Agile standardization Current standardization status\u2026","rel":"","context":"In &quot;Cross Sector&quot;","block_context":{"text":"Cross Sector","link":"https:\/\/smartdatamodels.org\/index.php\/category\/cross-sector\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":409,"url":"https:\/\/smartdatamodels.org\/index.php\/open-issues-for-all-data-models\/","url_meta":{"origin":6739,"position":3},"title":"Open issues for all data models","author":"maestro","date":"21\/05\/2020","format":false,"excerpt":"There is a new widget on the front page titled \"Open PR and issues\" there you can browse all the Pull requests contributed by the community and the open issues across all the data models. Updated every 5 minutes This way you can be informed about evolution going on and\u2026","rel":"","context":"In &quot;Cross Sector&quot;","block_context":{"text":"Cross Sector","link":"https:\/\/smartdatamodels.org\/index.php\/category\/cross-sector\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2989,"url":"https:\/\/smartdatamodels.org\/index.php\/3-new-data-models-in-frictionlessdata-subject-csvdialectfrictionlessdata-dataresourcefrictionlessdata-and-tableschemafrictionlessdata\/","url_meta":{"origin":6739,"position":4},"title":"3 new data models in FrictionlessData subject CSVDialectFrictionlessData, DataResourceFrictionlessData and TableSchemaFrictionlessData","author":"maestro","date":"24\/08\/2021","format":false,"excerpt":"The adaptation of the frictionless data standard is completed with these three new data models in the datamodel.FrictionlessData subject CSVDialectFrictionlessData. The CSV dialect descriptor. Converted for Smart Data Models initiative from original frictionless data DataResourceFrictionlessData. Data Resource. Converted for Smart Data Models initiative from original frictionless data TableSchemaFrictionlessData. A Table\u2026","rel":"","context":"In &quot;Cross Sector&quot;","block_context":{"text":"Cross Sector","link":"https:\/\/smartdatamodels.org\/index.php\/category\/cross-sector\/"},"img":{"alt_text":"","src":"https:\/\/frictionlessdata.io\/img\/frictionless-color-full-logo.svg","width":350,"height":200,"srcset":"https:\/\/frictionlessdata.io\/img\/frictionless-color-full-logo.svg 1x, https:\/\/frictionlessdata.io\/img\/frictionless-color-full-logo.svg 1.5x, https:\/\/frictionlessdata.io\/img\/frictionless-color-full-logo.svg 2x"},"classes":[]},{"id":2324,"url":"https:\/\/smartdatamodels.org\/index.php\/open-session-about-smart-data-models-monday-1400\/","url_meta":{"origin":6739,"position":5},"title":"Open Session about Smart Data Models. Monday 14:00","author":"maestro","date":"12\/05\/2021","format":false,"excerpt":"Every week till there will be a 30 min live session to : Make questions about any of the data models Sharing experiences (maximum 5 minutes) The agenda for the first 5-minutes slots is this. The 3 Introduction of the Smart Data Models Updates of the week (new services and\u2026","rel":"","context":"In &quot;Cross Sector&quot;","block_context":{"text":"Cross Sector","link":"https:\/\/smartdatamodels.org\/index.php\/category\/cross-sector\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/posts\/6739","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/comments?post=6739"}],"version-history":[{"count":1,"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/posts\/6739\/revisions"}],"predecessor-version":[{"id":6743,"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/posts\/6739\/revisions\/6743"}],"wp:attachment":[{"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/media?parent=6739"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/categories?post=6739"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/smartdatamodels.org\/index.php\/wp-json\/wp\/v2\/tags?post=6739"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}