Merge requests · umwelt-info / metadaten · GitLab

Über Open CoDE Software Wiki Diskussionen GitLab

Enable parking_lot usage of tokio and once_cell as we already pull it in via scraper.

!42 · created Aug 05, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Add randomized delay to harvester timer to reduce unintented load spikes at the sources.

!46 · created Aug 07, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Add GeoNetwork harvester based on the Q Search API endpoint.

!29 · created Jul 28, 2022 by Adam Reichold
- Merged
- 9
updated Aug 09, 2022
Enable an end-to-end request timeout to avoid hanging the harvester on lost requests.

!35 · created Aug 01, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Extend the harvester to collect summary metrics to be displayed by the server.

!27 · created Jul 27, 2022 by Adam Reichold
- Merged
- 3
updated Aug 09, 2022
Record per-dataset access statistics.

!10 · created Jul 22, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Raise an error if no handles could be parsed, e.g. if the document structure changed.

!41 · created Aug 04, 2022 by Adam Reichold
- Merged
- 5
updated Aug 09, 2022
Add a global limit to in-flight requests and load shedding to the server.

!21 · created Jul 25, 2022 by Adam Reichold
- Merged
- 3
updated Aug 09, 2022
Extend list of authors to have alternative points of contact available.

!26 · created Jul 27, 2022 by Adam Reichold
- Merged
- 2
updated Aug 09, 2022
Store term positions to enable phrase searches.

!34 · created Jul 31, 2022 by Adam Reichold
- Merged
- 3
updated Aug 04, 2022
Add scraper for BfS' Doris.

!40 · created Aug 04, 2022 by Adam Reichold
- Merged
- 2
updated Aug 04, 2022
Add with_retry helper function to handle spurious failures

!12 · created Jul 23, 2022 by Adam Reichold
- Merged
- 3
updated Aug 04, 2022
Add initial README to simplify onboarding

!38 · created Aug 03, 2022 by Adam Reichold
- Merged
- 6
updated Aug 03, 2022
Add a comment on why Source has a manual Debug impl.

!36 · created Aug 01, 2022 by Adam Reichold
- Merged
- 2
updated Aug 03, 2022
Initial harvester for Wasser-DE

!37 · created Aug 03, 2022 by Adam Reichold
- Merged
- 9
updated Aug 03, 2022
Add xtask infrastructure to simplify local development work flow.

!32 · created Jul 29, 2022 by Adam Reichold
- Merged
- 2
updated Aug 02, 2022
Generally enable a German-language stemmer on the index to increase recall.

!30 · created Jul 28, 2022 by Adam Reichold
- Merged
- 2
updated Jul 29, 2022
Transmit a user agent header so that people know who to contact if we inconvience them.

!25 · created Jul 26, 2022 by Adam Reichold
- Merged
- 2
updated Jul 29, 2022
Keep previous snapshot of datasets around to enable manual rollbacks.

!14 · created Jul 23, 2022 by Adam Reichold
- Merged
- 2
updated Jul 29, 2022
Use Rayon to load datasets for indexing using multiple threads.

!13 · created Jul 23, 2022 by Adam Reichold
- Merged
- 2
updated Jul 29, 2022

Prev
1
…
37
38
39
40
41
42
Next