Merge requests · umwelt-info / metadaten · GitLab

Über Open CoDE Software Wiki Diskussionen GitLab

Store compressed HTTP responses on disk and allow to replay them instead of making network requests

!57 · created Aug 12, 2022 by Adam Reichold
- Merged
- 12
updated Aug 17, 2022
Retrieve full records in the CSW harvester and unify the record parsing with the GeoNetworkQ harvester.

!51 · created Aug 09, 2022 by Adam Reichold
- Merged
- 4
updated Aug 16, 2022
Use an ordering of the license enum which better facilitates schema evolution

!58 · created Aug 14, 2022 by Adam Reichold
- Merged
- 2
updated Aug 15, 2022
Moved all writing of dataset metrics into indexer to allow recomputing them without reharvesting

!55 · created Aug 12, 2022 by Adam Reichold
- Merged
- 3
updated Aug 12, 2022
Disable usage of LZ4 compression in the index as our index will comfortably fit into memory for the forseeable future.

!47 · created Aug 07, 2022 by Adam Reichold
- Merged
- 3
updated Aug 12, 2022
Demonstrate how to handle a metadata change without having to reharvest the complete index.

!48 · created Aug 09, 2022 by Adam Reichold
- Merged
- 2
updated Aug 12, 2022
Track licenses and collect metrics about them.

!43 · created Aug 05, 2022 by Adam Reichold
- Merged
- 3
updated Aug 12, 2022
Implement pagination of search results to enable viewing all of them.

!33 · created Jul 30, 2022 by Adam Reichold
- Merged
- 3
updated Aug 09, 2022
Enable parking_lot usage of tokio and once_cell as we already pull it in via scraper.

!42 · created Aug 05, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Add randomized delay to harvester timer to reduce unintented load spikes at the sources.

!46 · created Aug 07, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Add GeoNetwork harvester based on the Q Search API endpoint.

!29 · created Jul 28, 2022 by Adam Reichold
- Merged
- 9
updated Aug 09, 2022
Enable an end-to-end request timeout to avoid hanging the harvester on lost requests.

!35 · created Aug 01, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Extend the harvester to collect summary metrics to be displayed by the server.

!27 · created Jul 27, 2022 by Adam Reichold
- Merged
- 3
updated Aug 09, 2022
Record per-dataset access statistics.

!10 · created Jul 22, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Raise an error if no handles could be parsed, e.g. if the document structure changed.

!41 · created Aug 04, 2022 by Adam Reichold
- Merged
- 5
updated Aug 09, 2022
Add a global limit to in-flight requests and load shedding to the server.

!21 · created Jul 25, 2022 by Adam Reichold
- Merged
- 3
updated Aug 09, 2022
Extend list of authors to have alternative points of contact available.

!26 · created Jul 27, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Store term positions to enable phrase searches.

!34 · created Jul 31, 2022 by Adam Reichold
- Merged
- 3
updated Aug 04, 2022
Add scraper for BfS' Doris.

!40 · created Aug 04, 2022 by Adam Reichold
- Merged
- 2
updated Aug 04, 2022
Add with_retry helper function to handle spurious failures

!12 · created Jul 23, 2022 by Adam Reichold
- Merged
- 3
updated Aug 04, 2022

Prev
1
…
38
39
40
41
42
43
Next