Nasqueron Datasources: Difference between revisions

From Nasqueron Agora
mNo edit summary
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
'''Nasqueron Datasources'' is a collection of tools and libraries, mostly written in Rust, to fetch and enrich data.
'''Nasqueron Datasources''' is a collection of tools and libraries, mostly written in Rust, to fetch and enrich data.


== Datasources ==
== Datasources ==
Line 8: Line 8:
It also can enrich data from Wikidata, to qualify ways and offer rich typography labels.
It also can enrich data from Wikidata, to qualify ways and offer rich typography labels.
During that operation, it can generate [https://www.wikidata.org/wiki/User:Dereckson/FANTOIR_maintenance_report a maintenance report].
During that operation, it can generate [https://www.wikidata.org/wiki/User:Dereckson/FANTOIR_maintenance_report a maintenance report].
See [[fantoir-datasource]] for how to use instructions.


=== Helper components ===
=== Helper components ===

Latest revision as of 01:42, 18 January 2023

Nasqueron Datasources is a collection of tools and libraries, mostly written in Rust, to fetch and enrich data.

Datasources

Datasources components

FANTOIR (fantoir-datasource)

fantoir-datasource is a CLI tool to import the FANTOIR database into PostgreSQL. It's built with pipeline as a code in mind, so we can run it when a new FANTOIR version is released.

It also can enrich data from Wikidata, to qualify ways and offer rich typography labels. During that operation, it can generate a maintenance report.

See fantoir-datasource for how to use instructions.

Helper components

The datasources repository contains the following libraries:

  • The opendatasoft-explore-api crate allows to query the Opendatasoft Explore API from Rust code. This API software is for example used for data.economie.gouv.fr for open data.

A SPARQL client can also be extracted from fantoir-datasource to be published as a standalone library (and so be used in outside projects).

Dependencies

The following relations exist in our components:

  • fantoir-datasource uses opendatasoft-explore-api to check if a new version is available and get the URL

Contribute

The Nasqueron Databases project on DevCentral is used for any issue, code idea, bug or task.

Repository to clone: datasources

Contact: Dereckson is willing to help you if you need to discuss this project.

Licences

Source code is released under BSD-2-Clause license.

The datasets we provide tooling for and consume are and must be licensed under free culture licences, tailored for sui generis database rights:

  • LO (e.g. FANTOIR)
  • ODbL (e.g. OpenStreetMap)

The datasets we produce are licensed under:

  • when a copyleft applies, for example when a dataset is ODbL, ODbL
  • when no copyleft applies, because all sources allow redistribution under any license: CC-BY 4.0