PyDriosm: an open-source tool for downloading, reading and PostgreSQL-based I/O of OpenStreetMap data
| Main Author: | Qian Fu |
|---|---|
| Format: | info software Journal |
| Terbitan: |
, 2020
|
| Subjects: | |
| Online Access: |
https://zenodo.org/record/4288404 |
Daftar Isi:
- PyDriosm is an open-source tool for researchers/practitioners to easily download and read OpenStreetMap (OSM) data in popular file formats such as protobuf binary format (PBF) and shapefile, which are available for free download from Geofabrik and BBBike. The package also provides a convenient way for PostgreSQL-based I/O and storage of parsed OSM data. 2.0.2 (24 November 2020) Main changes since v2.0.1: added a parameter 'max_tmpfile_size' to the classes GeofabrikDownloader and BBBikeDownloader, to set the maximum size (which defaults to 100 MB) of in-memory temporary file while instantiating both the classes added a new function validate_shp_layer_names() to the module utils optimised import statements for all modules For more details, check out PyDriosm 2.0.2 documentation. Release history: 2.0.1 (19 November 2020) Main changes since v2.0.0: optimised import statements for the modules downloader and reader 2.0.0 (19 November 2020) This release introduces a brand new PyDriosm, which is a highly modified version of the predecessors tagged "1.0.x". Note that v2 is NOT compatible with the earlier versions labelled v1. Main changes since v1.0.20: featured with the following three new modules: downloader, modified from the former download_GeoFabrik and download_BBBike, for downloading data reader, modified from the former read_GeoFabrik, for reading the data ios, modified from the former osm_psql and dump_GeoFabrik, for PostgreSQL-based I/O and storage of the data renamed the rest of the modules, fixed known bugs and added a number of new functions/classes created PyDriosm documentation hosted at Read the Docs. 1.0.20 (27 January 2020) Note that v1.0.19 was deprecated and removed from Releases on GitHub. Main changes since v1.0.18: modified the following class and functions with bug fixes: OSM in the module osm_psql regulate_input_subregion_name() in download_GeoFabrik psql_osm_pbf_data_extracts() in dump_GeoFabrik parse_osm_pbf() and read_osm_pbf() in the module read_GeoFabrik removed the function split_list() from the module utils updated the package data 1.0.18 (9 January 2020) Main changes since v1.0.17: modified the module download_GeoFabrik, allowing it to download data of a deep or a shallow set of subregions modified the following functions with bug fixes: get_subregion_table() in the module download_GeoFabrik find_osm_shp_file(), merge_multi_shp() and parse_osm_pbf() in the module read_GeoFabrik integrated the function collect_bbbike_subregion_download_catalogue() into collect_bbbike_download_catalogue() in the module download_BBBike added a new module update set up default parameters for PostgreSQL connection updated the package data tested the package in Python 3.8 1.0.17 (29 November 2019) Main changes since v1.0.16: modified the following functions with bug fixes in the module download_GeoFabrik: collect_subregion_info_catalogue() get_default_path_to_osm_file() modified the following functions with bug fixes in the module read_GeoFabrik merge_multi_shp() read_shp_zip() read_osm_pbf() updated the package data 1.0.16 (6 October 2019) Main changes since v1.0.15: fixed known bugs updated the package data 1.0.15 (29 August 2019) Note that v1.0.14, v1.0.13 and v1.0.12 were deprecated and removed from Releases on GitHub. Main changes since v1.0.11: added a new method .db_exists() of the class OSM; modified the method .create_db(), allowing it to check if a database exists modified the following functions with bug fixes in the module read_GeoFabrik: extract_shp_zip() read_shp() read_shp_zip() updated the LICENSE 1.0.11 (4 April 2019) Note that v1.0.10 and v1.0.9 were deprecated and removed from Releases on GitHub. Main changes since v1.0.8: added a parameter 'database_name' that allows customised database name when dumping data to PostgreSQL added a function regulate_table_name() that regulates PostgreSQL table names removed duplicates from the list of the smallest subregions fixed a minor bug for creating a default data directory modified the following functions (with bug fixes): get_default_path_to_osm_file() in the module download_GeoFabrik parse_layer_data() in the module read_GeoFabrik dump_osm_pbf_data_by_layer() in the module osm_psql psql_osm_pbf_data_extracts() in the module dump_GeoFabrik 1.0.8 (18 Mar 2019) Note that v1.0.6 and v1.0.7 have been removed from Releases on GitHub. Main changes since v1.0.5: Fixed minor bugs in the following functions: parse_layer_data() psql_subregion_osm_data_extracts() read_shp_zip() retrieve_subregions() added regulate_input_data_dir() made major changes to functions and fixed a few potential bugs 1.0.5 (11 March 2019) Note that v1.0.4, v1.0.3, v1.0.2 and v1.0.1 were deprecated and removed from Releases on GitHub. Main changes since v1.0.0: added a parameter 'chunk_size' to the function dump_osm_pbf_data() in the module osm_psql, which allows users to parse/read/dump data in a chunk-wise way in the module dump_GeoFabrik: added a new function retrieve_subregions(), which retrieves a list of subregions of a given region name from the 'region-subregion index' added a 'sleeping time' to the function psql_subregion_osm_data_extracts() integrated the function read_parsed_osm_pbf() into read_osm_pbf() in the module read_GeoFabrik modified the function gdal_configurations() in the module settings added a new function split_list() to the module utils 1.0.0 (4 March 2019) Initial release. The earlier versions up to v0.2.9 have been deprecated.