Merge requests · umwelt-info / metadaten · GitLab

Über Open CoDE Software Wiki Diskussionen GitLab

Add a global limit to in-flight requests and load shedding to the server.

!21 · created Jul 25, 2022 by Adam Reichold
- Merged
- 3
updated Aug 09, 2022
Extend the harvester to mail a summary of its activity to a configured address.

!20 · created Jul 24, 2022 by Adam Reichold access-stats
- Closed
- 3
updated Jul 29, 2022
Parse the DCAP-AP.de license vocabulary to generate a build representation of common licenses.

!19 · created Jul 24, 2022 by Adam Reichold
- Closed
- 2
updated Aug 09, 2022
Use LZ4 to compress datasets as it is already part of the dependency closure.

!16 · created Jul 23, 2022 by Adam Reichold
- Closed
- 1
updated Aug 07, 2022
Add harvester configuration to version control.

!15 · created Jul 23, 2022 by Adam Reichold
- Merged
- 2
updated Jul 29, 2022
Keep previous snapshot of datasets around to enable manual rollbacks.

!14 · created Jul 23, 2022 by Adam Reichold
- Merged
- 2
updated Jul 29, 2022
Use Rayon to load datasets for indexing using multiple threads.

!13 · created Jul 23, 2022 by Adam Reichold
- Merged
- 2
updated Jul 29, 2022
Add with_retry helper function to handle spurious failures

!12 · created Jul 23, 2022 by Adam Reichold
- Merged
- 3
updated Aug 04, 2022
Record per-dataset access statistics.

!10 · created Jul 22, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Better logging of the distinction between the overall number of datasets and the actually transmitted datasets.

!8 · created Jul 22, 2022 by Adam Reichold
- Merged
- 2
updated Jul 29, 2022
Use Rayon to load datasets for indexing using multiple threads.

!6 · created Jul 21, 2022 by Adam Reichold remove-things
- Closed
- 1
updated Jul 23, 2022
Reduce depedency closure and remove inefficient initial CKAN harverster

!5 · created Jul 21, 2022 by Adam Reichold
- Merged
- 2
updated Jul 29, 2022
Add initial CSW harvester.

!4 · created Jul 21, 2022 by Adam Reichold
- Merged
- 4
updated Jul 29, 2022
Add an alternative code path to harvest CKAN sources

!1 · created Jul 20, 2022 by Adam Reichold
- Merged
- 2
updated Jul 21, 2022

Prev
1
…
40
41
42
43
44
Next