Commit Graph

108 Commits

Author SHA1 Message Date
mirdono
64f78722d9 feat: add memberships for new organizations
Add the migrations to create the necessary memberships for the newly added
municipalities and OCMWs. These new organizations were added as part of a hotfix
after the memberships were added to development. Consequently, the migrations
inserting these organizations are performed **after** the migrations introducing
membership data. Therefore, we need to add some additional migrations
specifically for these new organizations.
2024-10-09 09:08:01 +02:00
mirdono
2ed45e3a5e refactor: renamed job migrations to include "insert" in the filename
Added comments to make it easier to understand query executed by each job.
2024-10-09 09:08:01 +02:00
mirdono
e3ec21eb71 feat: add cleanup jobs to delete triples
When removing memberships some `org:hasSubOrganization` or `org:linkedTo`
triples may remain in the triplestore. These migrations add jobs to delete such triples.
2024-10-09 09:08:01 +02:00
mirdono
7da8ebb695 feat: add cleanup jobs to insert triples 2024-10-09 09:08:01 +02:00
mirdono
13d8154a9a fix: do not delete hasSubOrganization and linkedTo triples
Triples for the predicates `org:hasSubgOrganization` and `org:linkedTo` are
produced by OP for other apps to consume. Therefore, they should not be deleted.
2024-10-09 09:08:01 +02:00
mirdono
6cc953e4ed refactor: moved migrations to correct subfolder
These two migrations were accidentally placed in the `migrations` folder instead
of the appropriate `2024` subfolder. These migrations have already been executed
on all environments.
2024-10-04 11:00:32 +02:00
benjay10
fcf5d3fc59 Add migration to remove references to https variant
This HTTPS variant does not exist elsewhere and the linking entitities
also reference to the regular HTTP version, so these references can be
removed.
2024-09-05 16:44:10 +02:00
mirdono
15248b5e4b Merge branch 'master' into development 2024-09-04 18:20:48 +02:00
Riad Abdallah
e755d615fc Remove properties attached to bestuursorgaan in tijd 2024-09-04 11:30:13 +02:00
Riad Abdallah
974a966576 Remove duplicate URI for IBEG 2024-09-03 16:53:40 +02:00
mirdono
78ce1f7071 feat: mandates and functions for governing bodies legislature 2025
For each of the governing bodies created by the migrations in the previous
commit, now add the corresponding mandates and functions.

Within a organisation some governing bodies share the same mandates. For
example, for municipalities the governing body "Burgemeester" and "College van
burgemeester en schepen" both refer to the SAME instance of mandates for
"Burgemeester" and "Aangewezen burgemeester".
To achieve this the some migrations contain a second `INSERT` clause in which
the other governing body that contains the necessary mandates is selected to be
able to determine the correct mandate URI. This only works on two conditions:
1. Migrations that depend on each must be executed in the correct order. For
   example, the migration inserting the mandates for "College van burgemeester
   en schepen" must be executed after that for "Burgemeester". The former will
   reuse mandates created by the latter.
2. The UUID for the shared mandates is calculated in exactly the same way in
   migrations that depend on each other.
2024-09-02 16:44:32 +02:00
mirdono
a647c7ea69 fix: add missing governing bodies for merging OCMWs
The merged OCMWs as imported in #442 were lacking some governing bodies that are
used to relation funcations to. These migration add the missing governing
bodies for these OCMWs.
2024-09-02 16:44:32 +02:00
mirdono
8c1538d45e feat: add migrations for governing bodies 2025
These migrations create the necessary time specialised governing bodies for
municipalities, OCMWs, district and provinces for the next legislature.

The migrations work by creating a new time specialisation, with an appropriate
starting date, for each abstract governing body associated with an active
organisation. For municipalities and OCMWs some instances are explicitly
filtered, these are municipalities (OCMWs) that will be merged with another one
as of 01-01-2025 and therefore will become inactive. The listed
municipalities (OCMWs) are extracted from data provided by business.
2024-09-02 16:44:32 +02:00
mirdono
9291024baa feat: add new district Borsbeek
The municipality of Borsbeek will merge with the municipality Antwerp as of
01-01-2025. This will result in a new district Borsbeek part of municipality
Antwerp.

This migration adds that new district such that a URI is assigned to it and its
governing bodies are created. The information available at this time is limited
its (legal) name. Other core data, such as identifiers, and further information
such as site addresses will be added later by business.
2024-08-31 15:34:19 +02:00
mirdono
68677ead2a fix: user INSERT DATA instead of INSERT where appropriate 2024-08-31 15:34:19 +02:00
mirdono
3102f48998 fix: relate sharepoint with organisations and ensure unique prefixes
- The previous version of the migrations lacked the triple actually linking the
  new organisations with the placeholder for SharePoint identifier. This triple
  was now added.
- Ensure the timestamp prefixes are unique by adding 1 second delay in between
  generating each migration.
2024-08-31 15:34:19 +02:00
mirdono
d5da714e12 feat: add new merged municipalities and OCMWs
As part of the municipality mergers for 2025, four new municipalities and their
corresponding OCMWs will have new KBO numbers. Consequently, these organizations
need to be fully manually created.

This commit adds the migrations to import the organisations for the merged
municipalities and OCMWs such that their URIs can already be shared among
applications.

The currently imported data concerns:
- core data such as (legal) name, region, status, KBO, and OVO number
- the necessary governing bodies, with as starting date 2025-01-01

The NIS-codes (and associated data) will be added in future migrations when the
NIS2025 update has been released.

Other missing data, such as addresses and contact details, will be added later
on by business.
2024-08-31 15:34:19 +02:00
mirdono
c373a3708b feat: migration to import actual VGC
The Vlaamse Gemeenschapscommissie is a special kind of administrative unit, with
its own specific classification code (which was added in a previous commit). The
core data, address, and contact information was provided by the business.

Note: currently the province in the address is intentionally left empty. This
data will be provided (or entered) later by business.
2024-08-31 15:34:19 +02:00
mirdono
7ae1793866 feat: add new classification code Vlaamse gemeenschapscommissie 2024-08-31 15:34:19 +02:00
mirdono
296f18e41c feat: add new district Borsbeek
The municipality of Borsbeek will merge with the municipality Antwerp as of
01-01-2025. This will result in a new district Borsbeek part of municipality
Antwerp.

This migration adds that new district such that a URI is assigned to it and its
governing bodies are created. The information available at this time is limited
its (legal) name. Other core data, such as identifiers, and further information
such as site addresses will be added later by business.
2024-08-29 12:43:43 +00:00
mirdono
c9af936b43 fix: user INSERT DATA instead of INSERT where appropriate 2024-08-26 10:31:49 +00:00
mirdono
b9348a5076 fix: relate sharepoint with organisations and ensure unique prefixes
- The previous version of the migrations lacked the triple actually linking the
  new organisations with the placeholder for SharePoint identifier. This triple
  was now added.
- Ensure the timestamp prefixes are unique by adding 1 second delay in between
  generating each migration.
2024-08-26 10:31:49 +00:00
mirdono
429072dd18 feat: add new merged municipalities and OCMWs
As part of the municipality mergers for 2025, four new municipalities and their
corresponding OCMWs will have new KBO numbers. Consequently, these organizations
need to be fully manually created.

This commit adds the migrations to import the organisations for the merged
municipalities and OCMWs such that their URIs can already be shared among
applications.

The currently imported data concerns:
- core data such as (legal) name, region, status, KBO, and OVO number
- the necessary governing bodies, with as starting date 2025-01-01

The NIS-codes (and associated data) will be added in future migrations when the
NIS2025 update has been released.

Other missing data, such as addresses and contact details, will be added later
on by business.
2024-08-26 10:31:49 +00:00
mirdono
fdd83c93bb feat: migration to import actual VGC
The Vlaamse Gemeenschapscommissie is a special kind of administrative unit, with
its own specific classification code (which was added in a previous commit). The
core data, address, and contact information was provided by the business.

Note: currently the province in the address is intentionally left empty. This
data will be provided (or entered) later by business.
2024-08-26 10:31:22 +00:00
mirdono
e0d945f960 feat: add new classification code Vlaamse gemeenschapscommissie 2024-08-26 10:31:22 +00:00
mirdono
7050629e0c feat: replace is-associated-with with a membership relation 2024-07-19 17:37:24 +00:00
mirdono
4b0f0c1df2 feat: remove org:memberOf predicates 2024-07-19 17:37:24 +00:00
mirdono
9b4b9a0a6d chore: formatting and added comments 2024-07-19 17:37:24 +00:00
mirdono
7902a1acad chore: renamed membership migrations to execute them at the right time 2024-07-19 17:37:24 +00:00
mirdono
bfb02afcdf feat: import legal and alternative names for worship services 2024-07-18 14:47:49 +00:00
mirdono
07687f5e35 Merge branch 'master' into development 2024-06-21 18:06:39 +02:00
mirdono
11508cf310 fix: added migration to import the participating municipalities
The original migration to import the participants for public OCMW associations
contained a bug causing it to not match municipalities. More specifically:
- the type triple for municipalities is located in the `shared` graph;
- consequently the `FILTER EXISTS` statements to limit matches to administrative
  units could not succeed for municipalities as the queries are limited to the
  `administrative-unit` graph.

This new migration fixes this problem by changing the `FILTER EXISTS` into a
`FILTER NOT EXISTS` to exclude resourses of type `ext:KboOrganisatie`.
2024-06-21 09:40:50 +00:00
mirdono
155162eb45 feat: added classification code for associations and corporations 2024-06-14 13:18:58 +00:00
Laurent Deketelaere
73492d0217 Merge branch 'master' into development 2024-06-06 10:19:51 +02:00
Laurent Deketelaere
97361f7f48 fix: Add migration to delete duplicate identifier 2024-06-05 08:38:22 +02:00
mirdono
714994bc3c fix: remove faulty contact data for some AGBs
The migrations importing the public OCMW association's contact data contained a
faulty query that matched on empty KBO numbers. As a result contact data was
incorrectly inserted to some AGBs that also do not have a KBO number. This
migration removes the incorrect data.
2024-06-03 16:07:52 +02:00
mirdono
74a0c92b31 fix: remove faulty address data for some AGBs
The migrations importing the public OCMW association's address data contained a
faulty query that matched on empty KBO numbers. As a result address data was
incorrectly inserted to some AGBs that also do not have a KBO number.

This migration removes the incorrect data, which as inserted into the
triplestore next to actual address. Furthermore, this also (re-)inserts the
correct provinces for the affected AGBs.
2024-06-03 14:55:12 +02:00
mirdono
a9e9e761c0 chore: removed faulty queries from migration
Removed incorrect queries that match on empty KBO numbers. This is to avoid the
same incorrect data being imported in case the migration is executed again at
some point.
2024-06-03 13:27:13 +02:00
mirdono
b4b599d091 feat: add recently onboarded organisations to producers
* `organizations` and `organizations-public-info`
- Add the new type of registered organisations to the export configuration

* `public`
- Use a migration to add the classification codes of all recently onboarded
  classes of organisations to the `concept-scheme` used by the producer. These
  were not added during the initial onboarding:
  This includes:
  + public OCMW associations
    - Welzijnsvereniging
    - Autonome verzorgingsinstelling
  + private OCMW associations
    - Ziekenhuisvereniging
    - Vereniging of vennootschap voor sociale dienstverlening
    - Woonzorgvereniging of woonzorgvennootschap
  + PEVAs
    - PEVA gemeente
    - PEVA province
- Add the new type of registered organisations to the export configuration
2024-05-24 14:56:32 +00:00
mirdono
fd0a417ad1 fix: exclude KBO organisations as participants
The initial version of the migration to import related organisations only
matched based on KBO numbers. This risks including resources from the type
`ext:KboOrganisatie` as participants. The migration was regenerated including an
additional `FILTER` to exclude organisations of that type from matching.
2024-05-24 14:56:32 +00:00
mirdono
cd2ee5bea3 feat: added participants for private OCMW associations 2024-05-24 14:56:32 +00:00
mirdono
a94bb7f7e2 fix: regenerated migrations after business data update 2024-05-24 14:56:32 +00:00
mirdono
b9be63f193 fix: corrected the provinces in the address import 2024-05-24 14:56:32 +00:00
mirdono
4b45093572 feat: import contact details for private ocmw associations 2024-05-24 14:56:32 +00:00
mirdono
6c7e5428dc feat: import addresses for private ocmw associations 2024-05-24 14:56:32 +00:00
mirdono
29f0b3e9a1 feat: import core data for private ocmw associations 2024-05-24 14:56:32 +00:00
mirdono
a3dff637e3 fix: exclude KBO organisations as participants
The initial version of the migration to import related organisations only
matched based on KBO numbers. This risks including resources from the type
`ext:KboOrganisatie` as participants. The migration was regenerated including an
additional `FILTER` to exclude organisations of that type from matching.
2024-05-24 14:52:46 +00:00
mirdono
71b21e4716 feat: added participants for private OCMW associations 2024-05-24 14:52:46 +00:00
mirdono
d49ebea0bd fix: regenerated migrations after business data update 2024-05-24 14:52:46 +00:00
mirdono
d35b9fc3a1 fix: corrected the provinces in the address import 2024-05-24 14:52:46 +00:00