Commit Graph

918 Commits

Author SHA1 Message Date
felix
b9fb9d8a63 Flush landing-zone leidinggevenden and mandatarissen
We do want to avoid inconsistencies popping up; i.e. bestuurseenheid
label gets upated, but that won't be reflected in the landing zone
since the information by the producers is not produced anymore,
potentially bringing very confusion situations
2025-03-24 17:15:37 +01:00
felix
be4d2c04b0 Added Location for export of the public delta-stream 2025-03-10 16:57:20 +01:00
Claire Lovisa
59b0e6ae5c Add missing codes to public producer 2025-03-06 11:49:22 +01:00
mirdono
9a71662b49 feat: add timed governing bodies for new legislature for AGBs
The governing bodies for an AGB have the same legislature as the corresponding
municipality. This adds new time specialised governing bodies for the
new (current) legislature for Raad van bestuur and Algemene vergadering.
2025-02-26 12:56:26 +01:00
mirdono
c72093ad4b feat: set end date for AGB's governing bodies
The governing bodies for an AGB have the same legislature as the corresponding
municipality. This sets the end date for the existing Raad van bestuur and
Algemene vergadering governing bodies.
2025-02-26 12:52:35 +01:00
felix
ea85a77865 Fix: move bestuursorgaanclassificatiecode to public graph. 2025-02-20 11:55:30 +01:00
mirdono
764638431f Merge branch 'development' 2025-02-18 10:15:55 +01:00
Claire Lovisa
b66278aec5 Restore betrokken lokale besturen 2025-02-17 16:15:17 +01:00
felix
20bc051103 Refine migrations 2025-02-13 17:37:52 +01:00
felix
8f57a160e0 update migration name 2025-02-13 17:37:41 +01:00
felix
741a7cae2c added migrations to flush again 2025-02-13 17:04:23 +01:00
Claire Lovisa
6b7bb2ec5d Remove reasoner service, replaced by new consumer logic 2025-02-06 10:05:29 +01:00
Claire Lovisa
565cf992c2 Merge branch 'master' into development 2025-02-05 14:54:28 +01:00
Claire Lovisa
d601d7f34e Add dates mapping rules for consumers
The mandatarissen and leidinggevenden consumers were missing a date
formatting mapping that is making sure that the data we display to the
user is of the same date as the one shown in the original app. This
transcription was made by the reasoner and we forgot to include it in
the mapping configuration.

I also updated the timestamp of migrations that need to run again when
I'll re-deploy to QA and DEV. It will have no impact on the upcoming
PROD deploy.
2025-02-05 10:05:39 +01:00
Claire Lovisa
94662e4e04 Merge branch 'master' into development 2025-02-04 08:42:17 +01:00
Claire Lovisa
f79724132a Merge branch 'master' into chore/bump-mandatarissen-consumer 2025-02-03 16:11:05 +01:00
Claire Lovisa
17d48100d7 Merge branch 'master' into revert-505-revert-502-chore/update-leidinggevenden-consumer 2025-02-03 16:04:25 +01:00
Claire Lovisa
cde5b49654 Merge branch 'master' into feature/bump-worship-consumer 2025-02-03 15:56:38 +01:00
wolfderechter
ef98cd512a Add migration to remove OCMW bcsd & bcsd voorzitter (#511)
* Add migration to remove bcsd

* Update changelog

* Specify graphs

* update predicates

* Target bcsd voorzitter as well

* cleanup changelog
2025-02-03 13:38:48 +01:00
mirdono
730e531387 Merge branch 'chore/cleanup-search-configuration' into development 2025-01-28 21:14:52 +01:00
mirdono
1edc4cf0a6 chore: remove separate search configuration for dev
Considering the time it takes to do a full re-index the speed benefit of the
development-specific configuration is limited. To the point that it does not
seem to outweigh the added complexity of maintaining two configurations and the
added chance of errors that brings.
2025-01-28 21:13:16 +01:00
mirdono
3a375a4581 chore: remove unused indexes for positions
The indexes for the municipality and province of a position's organisation are
not used in the app. Removing them to decrease the time required to index data.
2025-01-28 21:12:00 +01:00
mirdono
2666301048 chore: align search service configuration for dev and prod
This makes diff'ing the dev and prod configurations for the `search` service
slightly more readable.

- use same order of eager index entries with prod confiuration
- remove an extra normalizer setting in the dev config
- remove duplicate person id index
- correct property name in identifier mappings
- add missing `first_name_used` mappings
- order properties and mappings consistently across file
2025-01-28 21:11:22 +01:00
Boris De Vloed
8e311c6bab remove province and commune classifications from admin graph 2025-01-24 11:28:41 +01:00
mirdono
b296a99ac0 Merge branch 'master' into development 2025-01-23 20:05:54 +01:00
Claire Lovisa
300e088b6c Bump mandatarissen consumer to v0.1.0 2025-01-23 16:24:02 +01:00
Claire Lovisa
e844c9f824 Add reasoner rules back, we'll clean everything up afterwards 2025-01-22 20:18:47 +01:00
mirdono
e10c825f75 fix: index municipality names as keywords instead of regular text
Index municipality names as keywords instead of as plain text. This prevents
them from being split at word separators. Thereby avoiding that searches for a
municipality name, as used by the frontend's municipality filter, return
organisations whose municipality is a partial match.

For example, previously the results when searching for "Puurs" also included the
organisations located in "Sint-Amands-Puurs". The latter was tokenized into
three terms, therefore also matching plain "Puurs". By treating the municipality
name as keyword this split non longer happens.
2025-01-22 17:02:43 +01:00
Claire Lovisa
55cb772e92 Update phone number mapping
The default behaviour should clean any number that can be cleaned BUT
let the other numbers flow without any modification. The previous
behaviour I'm fixing here was to NOT let them flow if they were not in a
"cleanable" format.
2025-01-22 16:47:04 +01:00
Claire Lovisa
61b88fe602 Adjust flushing migration to delete all mandates
and not only the ones coming from Loket. There is a risk that we delete
too much data here but if that would be the case, the data is
recuperable through the backups by looking at persons and worship
positions that were in OP but not in the worship services landing zone.
2025-01-22 16:47:04 +01:00
Claire Lovisa
647e17900a Fixes on mapping rules 2025-01-22 16:47:04 +01:00
Claire Lovisa
72b4eaa68a Fix rules about names 2025-01-22 16:47:04 +01:00
Claire Lovisa
bf41ad4ad2 Make configuration more granular 2025-01-22 16:45:29 +01:00
Claire Lovisa
d3899762a9 Remove un-necessary remapping rules 2025-01-22 16:45:29 +01:00
Claire Lovisa
47c4dea630 Bump worship consumer to v0.27.0 into two consumers
The consumer needs to dispatch data to two different graphs: the worship
services graph and the privacy graph, based on triple type and/or
property. The latest version of the consumer doesn't allow it to be done
in one consumer instance, hence de split into two consumers.
2025-01-22 16:45:29 +01:00
Claire Lovisa
026ef435e1 Revert "Revert "Chore/update leidinggevenden consumer"" 2025-01-22 16:41:12 +01:00
Claire Lovisa
b358278067 Revert "Chore/update leidinggevenden consumer" 2025-01-22 16:31:44 +01:00
Claire Lovisa
eb99585a1d Merge branch 'master' into chore/update-leidinggevenden-consumer 2025-01-22 16:23:19 +01:00
Claire Lovisa
3b812946e4 Reorganize migrations and split jobs removal 2025-01-22 16:11:59 +01:00
Claire Lovisa
7834352617 Fix phone mapping 2025-01-22 15:37:39 +01:00
mirdono
3bc47a7fb0 fix: merger change event between St.-Amandus and Sint-Martinus
The worship service St.-Amandus was not included as `orginalOrganization` in the
merger change event somehow. As a result it was not listed as involved
organisation in the change event details. Furthermore, its status was not
correctly updated to "Not active".
2025-01-21 10:04:23 +01:00
Riad Abdallah
74096c96b1 Merge branch 'development' into cleanup/fully-delete-agb-stekene 2025-01-17 16:24:26 +01:00
Riad Abdallah
5ea8bfc46b Completely remove AGB Stekene data
A previous PR changed the org's status only; this PR completely removes
its data.
2025-01-17 16:00:20 +01:00
felix
1698112a9d Merge branch 'master' into chore/update-leidinggevenden-consumer 2025-01-17 15:15:46 +01:00
felix
a001f6b9e4 Remove old dispatching rules 2025-01-17 15:12:52 +01:00
felix
dba1ada5e2 Updated mapping rules 2025-01-17 14:42:54 +01:00
felix
a6571eefa5 Current consumer is VERY picky on how you write the mapping-query
See:
https://github.com/lblod/delta-consumer/blob/v0.0.27/lib/delta-sparql-mapping.js#L267

make sure you write first the graph or "triple"-pattern and filter
after that. For now.
2025-01-17 12:09:07 +01:00
felix
347844e341 update the filter so empty strings are not ingested 2025-01-17 11:19:19 +01:00
felix
19e3423202 updated migrations 2025-01-17 10:23:52 +01:00
felix
8750fddb2d added mapping rules 2025-01-17 10:23:41 +01:00