Commit Graph

829 Commits

Author SHA1 Message Date
Claire Lovisa
cde5b49654 Merge branch 'master' into feature/bump-worship-consumer 2025-02-03 15:56:38 +01:00
Claire Lovisa
e844c9f824 Add reasoner rules back, we'll clean everything up afterwards 2025-01-22 20:18:47 +01:00
mirdono
e10c825f75 fix: index municipality names as keywords instead of regular text
Index municipality names as keywords instead of as plain text. This prevents
them from being split at word separators. Thereby avoiding that searches for a
municipality name, as used by the frontend's municipality filter, return
organisations whose municipality is a partial match.

For example, previously the results when searching for "Puurs" also included the
organisations located in "Sint-Amands-Puurs". The latter was tokenized into
three terms, therefore also matching plain "Puurs". By treating the municipality
name as keyword this split non longer happens.
2025-01-22 17:02:43 +01:00
Claire Lovisa
55cb772e92 Update phone number mapping
The default behaviour should clean any number that can be cleaned BUT
let the other numbers flow without any modification. The previous
behaviour I'm fixing here was to NOT let them flow if they were not in a
"cleanable" format.
2025-01-22 16:47:04 +01:00
Claire Lovisa
61b88fe602 Adjust flushing migration to delete all mandates
and not only the ones coming from Loket. There is a risk that we delete
too much data here but if that would be the case, the data is
recuperable through the backups by looking at persons and worship
positions that were in OP but not in the worship services landing zone.
2025-01-22 16:47:04 +01:00
Claire Lovisa
647e17900a Fixes on mapping rules 2025-01-22 16:47:04 +01:00
Claire Lovisa
72b4eaa68a Fix rules about names 2025-01-22 16:47:04 +01:00
Claire Lovisa
bf41ad4ad2 Make configuration more granular 2025-01-22 16:45:29 +01:00
Claire Lovisa
d3899762a9 Remove un-necessary remapping rules 2025-01-22 16:45:29 +01:00
Claire Lovisa
47c4dea630 Bump worship consumer to v0.27.0 into two consumers
The consumer needs to dispatch data to two different graphs: the worship
services graph and the privacy graph, based on triple type and/or
property. The latest version of the consumer doesn't allow it to be done
in one consumer instance, hence de split into two consumers.
2025-01-22 16:45:29 +01:00
Claire Lovisa
b358278067 Revert "Chore/update leidinggevenden consumer" 2025-01-22 16:31:44 +01:00
Claire Lovisa
eb99585a1d Merge branch 'master' into chore/update-leidinggevenden-consumer 2025-01-22 16:23:19 +01:00
Claire Lovisa
3b812946e4 Reorganize migrations and split jobs removal 2025-01-22 16:11:59 +01:00
Claire Lovisa
7834352617 Fix phone mapping 2025-01-22 15:37:39 +01:00
mirdono
3bc47a7fb0 fix: merger change event between St.-Amandus and Sint-Martinus
The worship service St.-Amandus was not included as `orginalOrganization` in the
merger change event somehow. As a result it was not listed as involved
organisation in the change event details. Furthermore, its status was not
correctly updated to "Not active".
2025-01-21 10:04:23 +01:00
felix
1698112a9d Merge branch 'master' into chore/update-leidinggevenden-consumer 2025-01-17 15:15:46 +01:00
felix
a001f6b9e4 Remove old dispatching rules 2025-01-17 15:12:52 +01:00
felix
dba1ada5e2 Updated mapping rules 2025-01-17 14:42:54 +01:00
felix
a6571eefa5 Current consumer is VERY picky on how you write the mapping-query
See:
https://github.com/lblod/delta-consumer/blob/v0.0.27/lib/delta-sparql-mapping.js#L267

make sure you write first the graph or "triple"-pattern and filter
after that. For now.
2025-01-17 12:09:07 +01:00
felix
347844e341 update the filter so empty strings are not ingested 2025-01-17 11:19:19 +01:00
felix
19e3423202 updated migrations 2025-01-17 10:23:52 +01:00
felix
8750fddb2d added mapping rules 2025-01-17 10:23:41 +01:00
felix
8a7eb8ede0 adding migrations 2025-01-17 09:44:08 +01:00
felix
90fa373254 fix performance of migration 2025-01-16 14:34:08 +01:00
felix
038b72646c Added migration to correct leidinggeveden functionarissen OCMW
The bestuursfunctie of functionarissen both are attached to OCMW and Gemeente.
2025-01-16 11:27:03 +01:00
felix
54700d9832 Publish "Opdrachthoudende vereniging met private deelname" in ->
delta stream "public"
2025-01-13 14:56:01 +01:00
wolfez
d0835a1b30 Migration to delete betrokkene 'oudenaarde' and update financieringspercentage 2025-01-09 16:48:28 +01:00
wolfez
44e2de4f0b Create migrations for the cleanup of local involvements 2025-01-09 16:48:10 +01:00
mirdono
824201ced6 feat: merge police zones 2025
- Migrations to create the necessary merger change events that represent the
  merger of several police zones into three new ones
- Migration to update the status of the merged police zones to not active
2025-01-09 15:29:54 +01:00
mirdono
80ad432a5c fix: relate merged municipalities and province in shared graph
When new organisations were added for some merged municipalities (see PR #442)
their `org:hasSubOrganization` link with the province was inserted in to the
`<http://mu.semte.ch/graphs/administrative-unit>` graph instead of the
`<http://mu.semte.ch/graphs/shared>`.

Consequently, when logged in as a worship user and either of these
municipalities were selected in a form, the corresponding province was not
automatically filled in. This is due to the fact that worship users cannot read
from the `administrative-unit` graph.

This migration moves the appropriate `org:hasSubOrganization` triples to the
correct graph such that the behaviour for worship and non-worship users is the
same again.
2025-01-09 15:29:00 +01:00
Claire Lovisa
9122c18f1e Import 2025 NIS codes and update werkingsgebieden (#490) 2025-01-08 12:17:38 +01:00
mirdono
8143aac736 chore: regenerate full addresses to reflect address changes
This migration regenerates the `locn:fullAddress` triples for addresses in a
municipality involved in a merger. In essences this migration updates the
`locn:fullAddress` triple for each address changed by the migrations in the
previous commit.

Notes
- The migration is split over two queries, one for addresses without a box
  number and one for addresses with a box number. This avoids complicating the
  query with conditional logic at the cost of code duplication in the queries.
- In the existing full address triples two different notations are used to
  separate the box and building number. OP currently separates them simply by a
  space, which is what this migration matches for. But some historical data uses
  a dash "-" to separate building and box number. Consequently, this migration
  might match more address resources than strictly updated for the municipality
  merges.
2024-12-19 16:01:47 +01:00
mirdono
dde2e42696 chore: update address municipalities for 2025 municipality mergers
This migration updates the municipality name in the addresses for all
organisations located in a municipality whose name changes due to the 2025
municipality mergers.
2024-12-19 16:01:47 +01:00
mirdono
0f1654e64c chore: move organisations in Zwijndrecht to province East Flanders
As part of the 2025 municipality mergers Zwijndrecht will merge with Beveren and
Kruibeke into Beveveren-Kruibeke-Zwijndrecht. Additionally this means that
Zwijndrecht changes province from Antwerp to East Flanders.

This migration updates the province for each organisation with an address in
Zwijndrecht to East Flanders.
2024-12-19 16:01:47 +01:00
cecemel
9ed42aa4f6 Merge pull request #489 from lblod/hotfix/add-werkingsgebieden-ocmw
Added missing werkingsgebied for OCMW.
2024-12-18 12:20:03 +01:00
felix
4e39d1eed4 Added missing werkingsgebied for OCMW.
It seems OCMW's were the only ones without werkingsgebied. And the
corresponding gemeente had this.
2024-12-18 12:03:04 +01:00
mirdono
477c37320d feat: add merger change events for 2025 municipality mergers
These migrations insert the merger change events that are needed for the 2025
municipality mergers.

The migrations executed by the `migrations` service insert the actual merger
change events for
- mergers where the resulting organisation is a new organisation (these were
  added earlier in #442);
- mergers where the resulting organisation is an already existing, active
  organisation; and
- the special case where the municipality Borsbeek is merging with the
  municipality Antwerp, thereby creating a new district Borsbeek.

The migration executed by the `migrations-triggering-indexing` service updates
the status of the necessary organisations:
- the new municipalities/OCMWs/district are set from "Being founded" (nl. "In
  oprichting") to "Active"
- the other municipalities are changed from "Active" to "Not active"
- organisations that simply remain active before and after the merger are *not*
  updated
2024-12-13 12:36:06 +01:00
mirdono
dfec837bba feat: set end date governing bodies for merged organisations
Set the end date for governing bodies for municipalities and OCMWs that are
involved in a municipality merger *and* will become inactive to 02 January 2025.

For the municipalities and OCMWs that remain active after the merger, the end
date has already been set previously.
2024-12-13 12:35:47 +01:00
mirdono
806a870744 chore: rename municipalities and OCMWs for mergers 2025
As part of the 2025 municipality mergers 3 municipalities, and their
corresponding OCMWs, keep their original URI but do change their name. More
specifically:
- Bilzen becomes Bilzen-Hoeselt
- Ham becomes Tessenderlo-Ham
- Tongeren becomes Tongeren-Borgloon
2024-12-13 12:35:24 +01:00
Boris De Vloed
8e4c395a78 Merge pull request #484 from lblod/fix/remove-test-kerk-and-betrokken-bestuur
remove wrong data in prd
2024-12-12 11:55:05 +01:00
mirdono
eb552c92c3 Fix var typo 2024-12-12 11:48:10 +01:00
Riad Abdallah
782940c270 Merge pull request #451 from lblod/remove-organizations
Add queries to remove organizations
2024-12-11 18:56:02 +01:00
felix
1b2f9d45ac Fix skos:notation ADMS:identifier language tags
It seems there were language tagged and non-languaged versions used
for the skos:notation from ADMS:identifier.
This migrations alings it, we don't want typed strings here.
See also DL-6343
2024-12-11 10:16:50 +01:00
Boris De Vloed
925289a9dc remove wrong data in prd 2024-12-05 13:35:23 +01:00
felix
2f37aaaefc Added migration to add KBO to districten. 2024-12-05 10:32:19 +01:00
Claire Lovisa
ca92809cf5 Fix classification of Voetbal in de Stad vzw (#477)
* Fix classification of an organization

* Move migration to trigger indexing on execution
2024-11-20 11:03:56 +01:00
felix
4f8babb9ae update classificatieCode representatief orgaan export 2024-11-12 13:25:57 +01:00
felix
9d5d11f922 update RO - concept to epxport 2024-11-12 11:31:11 +01:00
cecemel
1031b78ac7 Merge pull request #475 from lblod/hotfix/export-ABB-to-public-export
Added config export to export ABB
2024-11-05 11:49:52 +01:00
felix
f79d31e153 update migration 2024-11-05 11:36:41 +01:00