Connecting Open Data Soft open data with Smart Data Models for drafting new data models

Many of the datasets published in open data portals are extensively used elsewhere. Well-maintained portals have managers that document the data structure and provide definitions of the types and contents of every field in these datasets. These are some of the requirements for the successful publication of a new Smart Data Model.

With this simple python script (and others to come) at the utils folder it can be drafted a JSON schema compliant with the Smart Data Models Program contribution manual. It is an early version (not everything is updated) but you can check it out.

 Parameters:
– base url of the ODS portal
– dataset_id of the dataset
Returns:
A draft json schema compliant with Smart Data Models Program,

some limitations: it does not translate descriptions (required in English)
some data types
It prints the schema and also returns (if possible a file named schema.json)

test it with this command
SDM_OpenDataSoft_schema_converter.py https://data.ameli.fr/ effectifs