Commit Graph

748 Commits

Author SHA1 Message Date
Riad Abdallah
a7d6dcfb32 Move streams to consolidated background job initiator 2024-10-03 16:39:14 +02:00
Riad Abdallah
d4f9352c61 Move streams to consolidated publication graph maintainer 2024-10-03 16:38:57 +02:00
mirdono
0ba4a6f393 fix: let relevant producers export representative body classification
Each producer that export representative bodies should include the
classification corresponding triples. Otherwise receives might run into
problems.
2024-09-04 18:02:53 +02:00
Boris De Vloed
2e6dd74b72 export ro classifcation in other public producer too 2024-09-04 18:02:53 +02:00
Riad Abdallah
e755d615fc Remove properties attached to bestuursorgaan in tijd 2024-09-04 11:30:13 +02:00
Riad Abdallah
974a966576 Remove duplicate URI for IBEG 2024-09-03 16:53:40 +02:00
mirdono
78ce1f7071 feat: mandates and functions for governing bodies legislature 2025
For each of the governing bodies created by the migrations in the previous
commit, now add the corresponding mandates and functions.

Within a organisation some governing bodies share the same mandates. For
example, for municipalities the governing body "Burgemeester" and "College van
burgemeester en schepen" both refer to the SAME instance of mandates for
"Burgemeester" and "Aangewezen burgemeester".
To achieve this the some migrations contain a second `INSERT` clause in which
the other governing body that contains the necessary mandates is selected to be
able to determine the correct mandate URI. This only works on two conditions:
1. Migrations that depend on each must be executed in the correct order. For
   example, the migration inserting the mandates for "College van burgemeester
   en schepen" must be executed after that for "Burgemeester". The former will
   reuse mandates created by the latter.
2. The UUID for the shared mandates is calculated in exactly the same way in
   migrations that depend on each other.
2024-09-02 16:44:32 +02:00
mirdono
a647c7ea69 fix: add missing governing bodies for merging OCMWs
The merged OCMWs as imported in #442 were lacking some governing bodies that are
used to relation funcations to. These migration add the missing governing
bodies for these OCMWs.
2024-09-02 16:44:32 +02:00
mirdono
8c1538d45e feat: add migrations for governing bodies 2025
These migrations create the necessary time specialised governing bodies for
municipalities, OCMWs, district and provinces for the next legislature.

The migrations work by creating a new time specialisation, with an appropriate
starting date, for each abstract governing body associated with an active
organisation. For municipalities and OCMWs some instances are explicitly
filtered, these are municipalities (OCMWs) that will be merged with another one
as of 01-01-2025 and therefore will become inactive. The listed
municipalities (OCMWs) are extracted from data provided by business.
2024-09-02 16:44:32 +02:00
mirdono
296f18e41c feat: add new district Borsbeek
The municipality of Borsbeek will merge with the municipality Antwerp as of
01-01-2025. This will result in a new district Borsbeek part of municipality
Antwerp.

This migration adds that new district such that a URI is assigned to it and its
governing bodies are created. The information available at this time is limited
its (legal) name. Other core data, such as identifiers, and further information
such as site addresses will be added later by business.
2024-08-29 12:43:43 +00:00
Boris De Vloed
63979c19ab export representative organ classification 2024-08-27 16:03:12 +02:00
Laurent Deketelaere
d570e94f22 feat: Remove CLB data from the producer 2024-08-26 10:32:25 +00:00
mirdono
c9af936b43 fix: user INSERT DATA instead of INSERT where appropriate 2024-08-26 10:31:49 +00:00
mirdono
b9348a5076 fix: relate sharepoint with organisations and ensure unique prefixes
- The previous version of the migrations lacked the triple actually linking the
  new organisations with the placeholder for SharePoint identifier. This triple
  was now added.
- Ensure the timestamp prefixes are unique by adding 1 second delay in between
  generating each migration.
2024-08-26 10:31:49 +00:00
mirdono
429072dd18 feat: add new merged municipalities and OCMWs
As part of the municipality mergers for 2025, four new municipalities and their
corresponding OCMWs will have new KBO numbers. Consequently, these organizations
need to be fully manually created.

This commit adds the migrations to import the organisations for the merged
municipalities and OCMWs such that their URIs can already be shared among
applications.

The currently imported data concerns:
- core data such as (legal) name, region, status, KBO, and OVO number
- the necessary governing bodies, with as starting date 2025-01-01

The NIS-codes (and associated data) will be added in future migrations when the
NIS2025 update has been released.

Other missing data, such as addresses and contact details, will be added later
on by business.
2024-08-26 10:31:49 +00:00
mirdono
fdd83c93bb feat: migration to import actual VGC
The Vlaamse Gemeenschapscommissie is a special kind of administrative unit, with
its own specific classification code (which was added in a previous commit). The
core data, address, and contact information was provided by the business.

Note: currently the province in the address is intentionally left empty. This
data will be provided (or entered) later by business.
2024-08-26 10:31:22 +00:00
mirdono
e0d945f960 feat: add new classification code Vlaamse gemeenschapscommissie 2024-08-26 10:31:22 +00:00
Laurent Deketelaere
bc98cf12f9 chore: bump kalliope-api to 2.0.0 2024-07-19 17:10:48 +00:00
mirdono
bfb02afcdf feat: import legal and alternative names for worship services 2024-07-18 14:47:49 +00:00
mirdono
4602842e99 fix: combine merger change events
- add the missing original organisation and matching change event result to one
  merger change event
- remove the superfluous merger change event, except for its reused change event
  result
2024-07-18 13:48:35 +00:00
mirdono
07687f5e35 Merge branch 'master' into development 2024-06-21 18:06:39 +02:00
mirdono
11508cf310 fix: added migration to import the participating municipalities
The original migration to import the participants for public OCMW associations
contained a bug causing it to not match municipalities. More specifically:
- the type triple for municipalities is located in the `shared` graph;
- consequently the `FILTER EXISTS` statements to limit matches to administrative
  units could not succeed for municipalities as the queries are limited to the
  `administrative-unit` graph.

This new migration fixes this problem by changing the `FILTER EXISTS` into a
`FILTER NOT EXISTS` to exclude resourses of type `ext:KboOrganisatie`.
2024-06-21 09:40:50 +00:00
mirdono
43cf1fd323 chore: removed unneeded migration
With the addition of the migration removing relations with `ext:KboOrganisatie`
resources this migration becomes unnecessary.
2024-06-21 09:40:50 +00:00
mirdono
a6b7321cf0 fix: remove org:memberOf triples with KBO organizations as object
The migration importing related organizations for public OCMW associations was
incorrect in that it did not exclude resources of type `ext:KboOrganisatie`
being matched. This migration removes all incorrectly inserted triples.
2024-06-19 13:41:03 +00:00
mirdono
155162eb45 feat: added classification code for associations and corporations 2024-06-14 13:18:58 +00:00
mirdono
592b728611 Merge branch 'master' into development 2024-06-12 11:13:20 +02:00
mirdono
f562d711f9 fix: corrected typo in search configuration 2024-06-10 14:17:09 +02:00
Laurent Deketelaere
826a9cdf08 fix: Disable cache on /kbo-organizations/* 2024-06-07 11:39:55 +02:00
Laurent Deketelaere
e6111fffff feat: Enable cache on domaine doutes 2024-06-06 15:40:20 +02:00
Laurent Deketelaere
73492d0217 Merge branch 'master' into development 2024-06-06 10:19:51 +02:00
Laurent Deketelaere
97361f7f48 fix: Add migration to delete duplicate identifier 2024-06-05 08:38:22 +02:00
mirdono
714994bc3c fix: remove faulty contact data for some AGBs
The migrations importing the public OCMW association's contact data contained a
faulty query that matched on empty KBO numbers. As a result contact data was
incorrectly inserted to some AGBs that also do not have a KBO number. This
migration removes the incorrect data.
2024-06-03 16:07:52 +02:00
mirdono
74a0c92b31 fix: remove faulty address data for some AGBs
The migrations importing the public OCMW association's address data contained a
faulty query that matched on empty KBO numbers. As a result address data was
incorrectly inserted to some AGBs that also do not have a KBO number.

This migration removes the incorrect data, which as inserted into the
triplestore next to actual address. Furthermore, this also (re-)inserts the
correct provinces for the affected AGBs.
2024-06-03 14:55:12 +02:00
mirdono
a9e9e761c0 chore: removed faulty queries from migration
Removed incorrect queries that match on empty KBO numbers. This is to avoid the
same incorrect data being imported in case the migration is executed again at
some point.
2024-06-03 13:27:13 +02:00
mirdono
681fa0ce0a refactor: updated dispatcher to new service name 2024-06-03 07:48:41 +00:00
mirdono
b4b599d091 feat: add recently onboarded organisations to producers
* `organizations` and `organizations-public-info`
- Add the new type of registered organisations to the export configuration

* `public`
- Use a migration to add the classification codes of all recently onboarded
  classes of organisations to the `concept-scheme` used by the producer. These
  were not added during the initial onboarding:
  This includes:
  + public OCMW associations
    - Welzijnsvereniging
    - Autonome verzorgingsinstelling
  + private OCMW associations
    - Ziekenhuisvereniging
    - Vereniging of vennootschap voor sociale dienstverlening
    - Woonzorgvereniging of woonzorgvennootschap
  + PEVAs
    - PEVA gemeente
    - PEVA province
- Add the new type of registered organisations to the export configuration
2024-05-24 14:56:32 +00:00
mirdono
fd0a417ad1 fix: exclude KBO organisations as participants
The initial version of the migration to import related organisations only
matched based on KBO numbers. This risks including resources from the type
`ext:KboOrganisatie` as participants. The migration was regenerated including an
additional `FILTER` to exclude organisations of that type from matching.
2024-05-24 14:56:32 +00:00
mirdono
cd2ee5bea3 feat: added participants for private OCMW associations 2024-05-24 14:56:32 +00:00
mirdono
a94bb7f7e2 fix: regenerated migrations after business data update 2024-05-24 14:56:32 +00:00
mirdono
b9be63f193 fix: corrected the provinces in the address import 2024-05-24 14:56:32 +00:00
mirdono
4b45093572 feat: import contact details for private ocmw associations 2024-05-24 14:56:32 +00:00
mirdono
6c7e5428dc feat: import addresses for private ocmw associations 2024-05-24 14:56:32 +00:00
mirdono
29f0b3e9a1 feat: import core data for private ocmw associations 2024-05-24 14:56:32 +00:00
mirdono
a3dff637e3 fix: exclude KBO organisations as participants
The initial version of the migration to import related organisations only
matched based on KBO numbers. This risks including resources from the type
`ext:KboOrganisatie` as participants. The migration was regenerated including an
additional `FILTER` to exclude organisations of that type from matching.
2024-05-24 14:52:46 +00:00
mirdono
71b21e4716 feat: added participants for private OCMW associations 2024-05-24 14:52:46 +00:00
mirdono
d49ebea0bd fix: regenerated migrations after business data update 2024-05-24 14:52:46 +00:00
mirdono
d35b9fc3a1 fix: corrected the provinces in the address import 2024-05-24 14:52:46 +00:00
mirdono
80a503c132 feat: import contact details for private ocmw associations 2024-05-24 14:52:46 +00:00
mirdono
a0400563da feat: import addresses for private ocmw associations 2024-05-24 14:52:46 +00:00
mirdono
369a2ad483 feat: import core data for private ocmw associations 2024-05-24 14:52:46 +00:00