Commit Graph

786 Commits

Author SHA1 Message Date
mirdono
40d7c72b59 chore: remove the CLB consumer for contact data
OP will take over the editing of contact data again. This removes the CLB
consumer from OP altogether such that it cannot be accidentally be reactivated.
2024-10-16 09:55:59 +02:00
felix
95953c7988 Merge branch 'master' into development 2024-10-15 10:57:21 +02:00
cecemel
4389a743b6 Merge pull request #459 from lblod/fix/produce-bestuursfunctie
Link missing classifications to public producer concept scheme
2024-10-15 10:48:52 +02:00
Claire Lovisa
77245adbaa Link missing classifications to public producer concept scheme 2024-10-15 10:27:46 +02:00
felix
3f460ce329 Some uri's of JobOperations were off. Fixing it here. 2024-10-14 14:51:20 +02:00
felix
6397ce2923 Change the namse of the stream to be in line with previous 2024-10-14 14:50:54 +02:00
felix
7e0a668573 Restore the old public path, to not break clients 2024-10-14 14:50:14 +02:00
mirdono
64f78722d9 feat: add memberships for new organizations
Add the migrations to create the necessary memberships for the newly added
municipalities and OCMWs. These new organizations were added as part of a hotfix
after the memberships were added to development. Consequently, the migrations
inserting these organizations are performed **after** the migrations introducing
membership data. Therefore, we need to add some additional migrations
specifically for these new organizations.
2024-10-09 09:08:01 +02:00
mirdono
2ed45e3a5e refactor: renamed job migrations to include "insert" in the filename
Added comments to make it easier to understand query executed by each job.
2024-10-09 09:08:01 +02:00
mirdono
70e09cf995 chore: add DEV migration to remove invalid memberships
This migration removes a bunch of memberships which `organization` assignment is
not valid. These memberships were most likely created by (automated) testing
while the frontend did not correctly enforce the correct direction.
2024-10-09 09:08:01 +02:00
mirdono
e3ec21eb71 feat: add cleanup jobs to delete triples
When removing memberships some `org:hasSubOrganization` or `org:linkedTo`
triples may remain in the triplestore. These migrations add jobs to delete such triples.
2024-10-09 09:08:01 +02:00
mirdono
7da8ebb695 feat: add cleanup jobs to insert triples 2024-10-09 09:08:01 +02:00
mirdono
13d8154a9a fix: do not delete hasSubOrganization and linkedTo triples
Triples for the predicates `org:hasSubgOrganization` and `org:linkedTo` are
produced by OP for other apps to consume. Therefore, they should not be deleted.
2024-10-09 09:08:01 +02:00
Riad Abdallah
b6dd8b4519 Fix public info stream name 2024-10-08 13:35:35 +02:00
Riad Abdallah
797d3a8d44 Fix public info stream name 2024-10-08 13:19:00 +02:00
mirdono
6cc953e4ed refactor: moved migrations to correct subfolder
These two migrations were accidentally placed in the `migrations` folder instead
of the appropriate `2024` subfolder. These migrations have already been executed
on all environments.
2024-10-04 11:00:32 +02:00
Riad Abdallah
a98f860d3c Remove individual delta rules 2024-10-03 17:05:19 +02:00
Riad Abdallah
162a6ff654 Update dispatcher rules for the delta streams 2024-10-03 16:42:00 +02:00
Riad Abdallah
a7d6dcfb32 Move streams to consolidated background job initiator 2024-10-03 16:39:14 +02:00
Riad Abdallah
d4f9352c61 Move streams to consolidated publication graph maintainer 2024-10-03 16:38:57 +02:00
benjay10
fcf5d3fc59 Add migration to remove references to https variant
This HTTPS variant does not exist elsewhere and the linking entitities
also reference to the regular HTTP version, so these references can be
removed.
2024-09-05 16:44:10 +02:00
mirdono
15248b5e4b Merge branch 'master' into development 2024-09-04 18:20:48 +02:00
mirdono
0ba4a6f393 fix: let relevant producers export representative body classification
Each producer that export representative bodies should include the
classification corresponding triples. Otherwise receives might run into
problems.
2024-09-04 18:02:53 +02:00
Boris De Vloed
2e6dd74b72 export ro classifcation in other public producer too 2024-09-04 18:02:53 +02:00
Riad Abdallah
e755d615fc Remove properties attached to bestuursorgaan in tijd 2024-09-04 11:30:13 +02:00
Riad Abdallah
974a966576 Remove duplicate URI for IBEG 2024-09-03 16:53:40 +02:00
mirdono
78ce1f7071 feat: mandates and functions for governing bodies legislature 2025
For each of the governing bodies created by the migrations in the previous
commit, now add the corresponding mandates and functions.

Within a organisation some governing bodies share the same mandates. For
example, for municipalities the governing body "Burgemeester" and "College van
burgemeester en schepen" both refer to the SAME instance of mandates for
"Burgemeester" and "Aangewezen burgemeester".
To achieve this the some migrations contain a second `INSERT` clause in which
the other governing body that contains the necessary mandates is selected to be
able to determine the correct mandate URI. This only works on two conditions:
1. Migrations that depend on each must be executed in the correct order. For
   example, the migration inserting the mandates for "College van burgemeester
   en schepen" must be executed after that for "Burgemeester". The former will
   reuse mandates created by the latter.
2. The UUID for the shared mandates is calculated in exactly the same way in
   migrations that depend on each other.
2024-09-02 16:44:32 +02:00
mirdono
a647c7ea69 fix: add missing governing bodies for merging OCMWs
The merged OCMWs as imported in #442 were lacking some governing bodies that are
used to relation funcations to. These migration add the missing governing
bodies for these OCMWs.
2024-09-02 16:44:32 +02:00
mirdono
8c1538d45e feat: add migrations for governing bodies 2025
These migrations create the necessary time specialised governing bodies for
municipalities, OCMWs, district and provinces for the next legislature.

The migrations work by creating a new time specialisation, with an appropriate
starting date, for each abstract governing body associated with an active
organisation. For municipalities and OCMWs some instances are explicitly
filtered, these are municipalities (OCMWs) that will be merged with another one
as of 01-01-2025 and therefore will become inactive. The listed
municipalities (OCMWs) are extracted from data provided by business.
2024-09-02 16:44:32 +02:00
mirdono
9291024baa feat: add new district Borsbeek
The municipality of Borsbeek will merge with the municipality Antwerp as of
01-01-2025. This will result in a new district Borsbeek part of municipality
Antwerp.

This migration adds that new district such that a URI is assigned to it and its
governing bodies are created. The information available at this time is limited
its (legal) name. Other core data, such as identifiers, and further information
such as site addresses will be added later by business.
2024-08-31 15:34:19 +02:00
Boris De Vloed
d202be0be8 export representative organ classification 2024-08-31 15:34:19 +02:00
Laurent Deketelaere
d617154e5d feat: Remove CLB data from the producer 2024-08-31 15:34:19 +02:00
mirdono
68677ead2a fix: user INSERT DATA instead of INSERT where appropriate 2024-08-31 15:34:19 +02:00
mirdono
3102f48998 fix: relate sharepoint with organisations and ensure unique prefixes
- The previous version of the migrations lacked the triple actually linking the
  new organisations with the placeholder for SharePoint identifier. This triple
  was now added.
- Ensure the timestamp prefixes are unique by adding 1 second delay in between
  generating each migration.
2024-08-31 15:34:19 +02:00
mirdono
d5da714e12 feat: add new merged municipalities and OCMWs
As part of the municipality mergers for 2025, four new municipalities and their
corresponding OCMWs will have new KBO numbers. Consequently, these organizations
need to be fully manually created.

This commit adds the migrations to import the organisations for the merged
municipalities and OCMWs such that their URIs can already be shared among
applications.

The currently imported data concerns:
- core data such as (legal) name, region, status, KBO, and OVO number
- the necessary governing bodies, with as starting date 2025-01-01

The NIS-codes (and associated data) will be added in future migrations when the
NIS2025 update has been released.

Other missing data, such as addresses and contact details, will be added later
on by business.
2024-08-31 15:34:19 +02:00
mirdono
c373a3708b feat: migration to import actual VGC
The Vlaamse Gemeenschapscommissie is a special kind of administrative unit, with
its own specific classification code (which was added in a previous commit). The
core data, address, and contact information was provided by the business.

Note: currently the province in the address is intentionally left empty. This
data will be provided (or entered) later by business.
2024-08-31 15:34:19 +02:00
mirdono
7ae1793866 feat: add new classification code Vlaamse gemeenschapscommissie 2024-08-31 15:34:19 +02:00
mirdono
296f18e41c feat: add new district Borsbeek
The municipality of Borsbeek will merge with the municipality Antwerp as of
01-01-2025. This will result in a new district Borsbeek part of municipality
Antwerp.

This migration adds that new district such that a URI is assigned to it and its
governing bodies are created. The information available at this time is limited
its (legal) name. Other core data, such as identifiers, and further information
such as site addresses will be added later by business.
2024-08-29 12:43:43 +00:00
Boris De Vloed
63979c19ab export representative organ classification 2024-08-27 16:03:12 +02:00
Laurent Deketelaere
d570e94f22 feat: Remove CLB data from the producer 2024-08-26 10:32:25 +00:00
mirdono
c9af936b43 fix: user INSERT DATA instead of INSERT where appropriate 2024-08-26 10:31:49 +00:00
mirdono
b9348a5076 fix: relate sharepoint with organisations and ensure unique prefixes
- The previous version of the migrations lacked the triple actually linking the
  new organisations with the placeholder for SharePoint identifier. This triple
  was now added.
- Ensure the timestamp prefixes are unique by adding 1 second delay in between
  generating each migration.
2024-08-26 10:31:49 +00:00
mirdono
429072dd18 feat: add new merged municipalities and OCMWs
As part of the municipality mergers for 2025, four new municipalities and their
corresponding OCMWs will have new KBO numbers. Consequently, these organizations
need to be fully manually created.

This commit adds the migrations to import the organisations for the merged
municipalities and OCMWs such that their URIs can already be shared among
applications.

The currently imported data concerns:
- core data such as (legal) name, region, status, KBO, and OVO number
- the necessary governing bodies, with as starting date 2025-01-01

The NIS-codes (and associated data) will be added in future migrations when the
NIS2025 update has been released.

Other missing data, such as addresses and contact details, will be added later
on by business.
2024-08-26 10:31:49 +00:00
mirdono
fdd83c93bb feat: migration to import actual VGC
The Vlaamse Gemeenschapscommissie is a special kind of administrative unit, with
its own specific classification code (which was added in a previous commit). The
core data, address, and contact information was provided by the business.

Note: currently the province in the address is intentionally left empty. This
data will be provided (or entered) later by business.
2024-08-26 10:31:22 +00:00
mirdono
e0d945f960 feat: add new classification code Vlaamse gemeenschapscommissie 2024-08-26 10:31:22 +00:00
mirdono
86c8fd4b56 chore: removed deprecated relations from data model 2024-07-19 17:37:24 +00:00
mirdono
7050629e0c feat: replace is-associated-with with a membership relation 2024-07-19 17:37:24 +00:00
mirdono
4b0f0c1df2 feat: remove org:memberOf predicates 2024-07-19 17:37:24 +00:00
mirdono
9b4b9a0a6d chore: formatting and added comments 2024-07-19 17:37:24 +00:00
mirdono
7902a1acad chore: renamed membership migrations to execute them at the right time 2024-07-19 17:37:24 +00:00