Commit Graph

1042 Commits

Author SHA1 Message Date
Claire Lovisa
e844c9f824 Add reasoner rules back, we'll clean everything up afterwards 2025-01-22 20:18:47 +01:00
mirdono
e10c825f75 fix: index municipality names as keywords instead of regular text
Index municipality names as keywords instead of as plain text. This prevents
them from being split at word separators. Thereby avoiding that searches for a
municipality name, as used by the frontend's municipality filter, return
organisations whose municipality is a partial match.

For example, previously the results when searching for "Puurs" also included the
organisations located in "Sint-Amands-Puurs". The latter was tokenized into
three terms, therefore also matching plain "Puurs". By treating the municipality
name as keyword this split non longer happens.
2025-01-22 17:02:43 +01:00
Claire Lovisa
55cb772e92 Update phone number mapping
The default behaviour should clean any number that can be cleaned BUT
let the other numbers flow without any modification. The previous
behaviour I'm fixing here was to NOT let them flow if they were not in a
"cleanable" format.
2025-01-22 16:47:04 +01:00
Claire Lovisa
61b88fe602 Adjust flushing migration to delete all mandates
and not only the ones coming from Loket. There is a risk that we delete
too much data here but if that would be the case, the data is
recuperable through the backups by looking at persons and worship
positions that were in OP but not in the worship services landing zone.
2025-01-22 16:47:04 +01:00
Claire Lovisa
647e17900a Fixes on mapping rules 2025-01-22 16:47:04 +01:00
Claire Lovisa
72b4eaa68a Fix rules about names 2025-01-22 16:47:04 +01:00
Claire Lovisa
bf41ad4ad2 Make configuration more granular 2025-01-22 16:45:29 +01:00
Claire Lovisa
d3899762a9 Remove un-necessary remapping rules 2025-01-22 16:45:29 +01:00
Claire Lovisa
47c4dea630 Bump worship consumer to v0.27.0 into two consumers
The consumer needs to dispatch data to two different graphs: the worship
services graph and the privacy graph, based on triple type and/or
property. The latest version of the consumer doesn't allow it to be done
in one consumer instance, hence de split into two consumers.
2025-01-22 16:45:29 +01:00
Claire Lovisa
026ef435e1 Revert "Revert "Chore/update leidinggevenden consumer"" 2025-01-22 16:41:12 +01:00
Claire Lovisa
b358278067 Revert "Chore/update leidinggevenden consumer" 2025-01-22 16:31:44 +01:00
Claire Lovisa
eb99585a1d Merge branch 'master' into chore/update-leidinggevenden-consumer 2025-01-22 16:23:19 +01:00
Claire Lovisa
3b812946e4 Reorganize migrations and split jobs removal 2025-01-22 16:11:59 +01:00
Claire Lovisa
7834352617 Fix phone mapping 2025-01-22 15:37:39 +01:00
mirdono
3bc47a7fb0 fix: merger change event between St.-Amandus and Sint-Martinus
The worship service St.-Amandus was not included as `orginalOrganization` in the
merger change event somehow. As a result it was not listed as involved
organisation in the change event details. Furthermore, its status was not
correctly updated to "Not active".
2025-01-21 10:04:23 +01:00
Riad Abdallah
74096c96b1 Merge branch 'development' into cleanup/fully-delete-agb-stekene 2025-01-17 16:24:26 +01:00
Riad Abdallah
5ea8bfc46b Completely remove AGB Stekene data
A previous PR changed the org's status only; this PR completely removes
its data.
2025-01-17 16:00:20 +01:00
felix
1698112a9d Merge branch 'master' into chore/update-leidinggevenden-consumer 2025-01-17 15:15:46 +01:00
felix
a001f6b9e4 Remove old dispatching rules 2025-01-17 15:12:52 +01:00
felix
dba1ada5e2 Updated mapping rules 2025-01-17 14:42:54 +01:00
felix
a6571eefa5 Current consumer is VERY picky on how you write the mapping-query
See:
https://github.com/lblod/delta-consumer/blob/v0.0.27/lib/delta-sparql-mapping.js#L267

make sure you write first the graph or "triple"-pattern and filter
after that. For now.
2025-01-17 12:09:07 +01:00
felix
347844e341 update the filter so empty strings are not ingested 2025-01-17 11:19:19 +01:00
felix
19e3423202 updated migrations 2025-01-17 10:23:52 +01:00
felix
8750fddb2d added mapping rules 2025-01-17 10:23:41 +01:00
felix
8a7eb8ede0 adding migrations 2025-01-17 09:44:08 +01:00
felix
5438af149b Merge branch 'master' into development 2025-01-16 14:39:37 +01:00
felix
90fa373254 fix performance of migration 2025-01-16 14:34:08 +01:00
felix
e0a9e77441 Merge branch 'master' into development 2025-01-16 12:13:06 +01:00
felix
038b72646c Added migration to correct leidinggeveden functionarissen OCMW
The bestuursfunctie of functionarissen both are attached to OCMW and Gemeente.
2025-01-16 11:27:03 +01:00
felix
cfd1a445de Merge branch 'master' into development 2025-01-13 17:11:47 +01:00
felix
54700d9832 Publish "Opdrachthoudende vereniging met private deelname" in ->
delta stream "public"
2025-01-13 14:56:01 +01:00
mirdono
51e41f1eb1 Merge branch 'master' into development 2025-01-10 10:59:35 +01:00
mirdono
090a69fd3f feat: allow local migrations that trigger indexing
Support for environment-local migrations that trigger indexing. This is similar
to the local migrations for the regular `migrations` service.
2025-01-09 22:32:20 +01:00
wolfez
d0835a1b30 Migration to delete betrokkene 'oudenaarde' and update financieringspercentage 2025-01-09 16:48:28 +01:00
wolfez
44e2de4f0b Create migrations for the cleanup of local involvements 2025-01-09 16:48:10 +01:00
mirdono
824201ced6 feat: merge police zones 2025
- Migrations to create the necessary merger change events that represent the
  merger of several police zones into three new ones
- Migration to update the status of the merged police zones to not active
2025-01-09 15:29:54 +01:00
mirdono
80ad432a5c fix: relate merged municipalities and province in shared graph
When new organisations were added for some merged municipalities (see PR #442)
their `org:hasSubOrganization` link with the province was inserted in to the
`<http://mu.semte.ch/graphs/administrative-unit>` graph instead of the
`<http://mu.semte.ch/graphs/shared>`.

Consequently, when logged in as a worship user and either of these
municipalities were selected in a form, the corresponding province was not
automatically filled in. This is due to the fact that worship users cannot read
from the `administrative-unit` graph.

This migration moves the appropriate `org:hasSubOrganization` triples to the
correct graph such that the behaviour for worship and non-worship users is the
same again.
2025-01-09 15:29:00 +01:00
Claire Lovisa
9122c18f1e Import 2025 NIS codes and update werkingsgebieden (#490) 2025-01-08 12:17:38 +01:00
cecemel
b60004fcf2 Merge pull request #486 from lblod/archive-agb-stekene
Archive AGB Stekene
2025-01-03 12:23:39 +01:00
felix
945faf8761 move migrations to trigger-re-index-migration
Don't forget to `drc restart migrations-triggering-indexing`
2025-01-03 12:20:15 +01:00
felix
1f7a754eb9 Remove comment migration, so we can use the mu-auth version
to migrate the file
2025-01-03 12:17:42 +01:00
cecemel
93a86372e0 Merge pull request #487 from lblod/remove-empty-uris
Remove empty URIs
2025-01-03 11:55:40 +01:00
felix
fd5844c319 Update migration to remove dangling triple for eenheid. ->
This assumes the migration hasn't run on any 'deployed' environment.
2025-01-03 11:53:24 +01:00
mirdono
dc62d6616b Merge branch 'master' into development 2024-12-20 14:56:38 +01:00
mirdono
8143aac736 chore: regenerate full addresses to reflect address changes
This migration regenerates the `locn:fullAddress` triples for addresses in a
municipality involved in a merger. In essences this migration updates the
`locn:fullAddress` triple for each address changed by the migrations in the
previous commit.

Notes
- The migration is split over two queries, one for addresses without a box
  number and one for addresses with a box number. This avoids complicating the
  query with conditional logic at the cost of code duplication in the queries.
- In the existing full address triples two different notations are used to
  separate the box and building number. OP currently separates them simply by a
  space, which is what this migration matches for. But some historical data uses
  a dash "-" to separate building and box number. Consequently, this migration
  might match more address resources than strictly updated for the municipality
  merges.
2024-12-19 16:01:47 +01:00
mirdono
dde2e42696 chore: update address municipalities for 2025 municipality mergers
This migration updates the municipality name in the addresses for all
organisations located in a municipality whose name changes due to the 2025
municipality mergers.
2024-12-19 16:01:47 +01:00
mirdono
0f1654e64c chore: move organisations in Zwijndrecht to province East Flanders
As part of the 2025 municipality mergers Zwijndrecht will merge with Beveren and
Kruibeke into Beveveren-Kruibeke-Zwijndrecht. Additionally this means that
Zwijndrecht changes province from Antwerp to East Flanders.

This migration updates the province for each organisation with an address in
Zwijndrecht to East Flanders.
2024-12-19 16:01:47 +01:00
cecemel
9ed42aa4f6 Merge pull request #489 from lblod/hotfix/add-werkingsgebieden-ocmw
Added missing werkingsgebied for OCMW.
2024-12-18 12:20:03 +01:00
felix
4e39d1eed4 Added missing werkingsgebied for OCMW.
It seems OCMW's were the only ones without werkingsgebied. And the
corresponding gemeente had this.
2024-12-18 12:03:04 +01:00
mirdono
ccc06b1970 Merge branch 'master' into development 2024-12-13 13:12:24 +01:00