Commit Graph

138 Commits

Author SHA1 Message Date
Boris De Vloed
0e02373e90 Optimize query performance - avoid thread kill 2022-03-04 15:03:18 +01:00
Nordine Bittich
dbf5fce41e bump frontend & reduce nb threads for mu search indexing 2022-03-03 09:21:40 +01:00
claire-lovisa
01a110fcdf Merge pull request #103 from lblod/refactor/kalliope-api-via-mu-auth
Remove unused config and bump kallipe-api
2022-02-28 17:37:59 +01:00
Nordine Bittich
61deab8212 List all positions for a person (ministers + mandatories) & bug fix editing issue with delta (#105) 2022-02-28 15:26:39 +01:00
Claire Lovisa
bfee6de5a9 Remove unused config and bump kallipe-api 2022-02-24 18:25:33 +01:00
Nordine Bittich
ddc679b2d7 bugfix 2022-02-11 11:34:42 +01:00
Nordine Bittich
f6b2c963f3 improve perf bestuur 2022-02-11 06:35:08 +01:00
Nordine Bittich
e52d71682e fix relationship (#99) 2022-02-08 10:22:27 +01:00
Nordine Bittich
3e14d92c29 mu search page person (#97) 2022-02-07 07:50:37 +01:00
Boris De Vloed
3bcc53b0bc add contact types (#88)
* add contact types

* move migration to 2022 directory

Co-authored-by: Nordine Bittich <nordine@bittich.be>
2022-02-02 14:59:02 +01:00
Sam Van Campenhout
99644e7925 Add a type attribute to the contact-points model (#95) 2022-02-01 15:23:01 +01:00
Sam Van Campenhout
422e92a343 Temporarily rename the change-event-result organization relationship (#94)
This relationship uses the same `org:organization` predicate that is also used for the local involvements relationship. When querying for local involvements data when an organization also has change events data,  mu-cl-resources receives the change events data instead and runs into errors. This is likely a bug in the micro service itself. Renaming the predicate is a quick workaround so we have more time to find the real solution for the problem without a broken app.
2022-01-25 20:04:18 +01:00
Nordine Bittich
7aa969c17b add new reason code 2022-01-20 10:27:55 +01:00
claire-lovisa
814a232bf8 Rename migration with wrong timestamps (#92) 2022-01-19 13:57:29 +01:00
Nordine Bittich
97fdd21d79 delete old change event data 2022-01-10 10:19:03 +01:00
Sam Van Campenhout
4dd33478d1 Use date instead of datetime were needed (#86)
If only the date is relevant we should not store it as a `datetime` since that would add timezone information which might cause the date to be displayed incorrectly in the frontend.
2022-01-06 10:34:52 +01:00
Sam Van Campenhout
32175ef883 Change event model updates (#75)
* Config changes to support the new "change event" data model

* Add mock data that matches the new change event model

This data can be inserted into the database by mounting the folder into the migrations service.

Co-authored-by: Boris De Vloed <boris.de.vloed@gmail.com>

Co-authored-by: Boris De Vloed <boris.de.vloed@gmail.com>
2022-01-06 09:25:06 +01:00
Boris De Vloed
59bdee66b1 removed unused delta rule (#81) 2021-12-14 13:55:03 +01:00
Boris De Vloed
3930b87237 add config changes 2021-12-10 09:38:15 +01:00
Boris De Vloed
cbfe243b3e fix typo in graph name 2021-12-08 16:53:39 +01:00
Boris De Vloed
834897c0c2 added typeEredienst 2021-12-08 15:24:46 +01:00
Nordine Bittich
a47c9c384d order migrations 2021-12-06 10:54:17 +01:00
Nordine Bittich
9a74e1e1ba bugfix 2021-12-03 14:21:23 +01:00
Nordine Bittich
4000c9a50f changing graph 2021-12-03 11:32:03 +01:00
Nordine Bittich
9e63016553 change graph 2021-12-03 11:24:05 +01:00
Nordine Bittich
3541a5f66b acm idm roles 2021-12-03 11:22:01 +01:00
cecemel
566ec39d9a Feature/delta producer administrative units (#67)
* Setting up file-service

- pre-requisite to download dumps
- pre-requiiste to download the json-diff files
- security considerations: the content of the files created here, is
- assumed to be public data, hence we allow it to be in the public graph

* Bumping deltanotifier and mu-auth, which need

to be able to work with mu-scop-id's

* Delta-producer have multiple background-jobs with different tasks

Hence the introduction of the jobs-controller.
Note: in a more advanced configuration, you can easily extend the
tasks related to one job.

* A pre-requisite to serve dumps, is DCAT api support

The delta-producers make a periodic dump of what is supposed to be
published. They are published according to the DCAT data-model.

Security-considerations: the DCAT producer by the delta-producer flow,
are considered to be public data, hence added to the public graph.

* Introduction of the delta-producer-dump-file-publisher

Service responsible for creating dumps for the (potentially
many) data delta flows.
Here only for the administrative-units, but this can be extended in
the future, in the config.

* Introduction of delta-producer-background-jobs-initiator

This service is responsible for triggering the background jobs related
to the delta-productoin of the administrative-units.

It trigger currently three jobs:
- INITIAL_SYNC: this is the first job to fill the publication graph.
  In theory, this is only run once per deploy
- HEALING_JOB: This is a periodic job, which checks what information
is published vs. what information should have been
published (according to a configuration). If differences are found,
because delta-messages never arrived, they are compensated here/
- DUMP_JOB: A periodic job to create a dump of the publication
graph. This is especially useful for consumers, who don't have to
replay the whole delta-diffs, but just can start from the latest sync
point.

* Introduction of delta-producer-publication-graph-maintainer

This service is the core of the logic which determines what should be
published.
The configuration is provided here, and can be elaborated refined in
the config.
It also excutes the healing logic.

* Introduction of delta-producer-json-diff-file-publisher

This simple service, listens to the updates performed on the
publication graph, and serialized these to json-files which are
compatible with current consumers

* Missing dispatcher rules for DCAT

* Various small things:

- outline, whitespaces and comments

* Update README.md

* bump delta-producer-publication-graph-maintainer

* Add organizations (KAL) - Work in progress

* added organizations graph maintainer

* removed inverses, added all bestuur types

* refactored kalliope api

Co-authored-by: Boris De Vloed <boris.de.vloed@gmail.com>
2021-12-03 11:20:32 +01:00
Nordine Bittich
3dc9b1a0b4 sparql endpoint for prod 2021-11-23 16:37:18 +01:00
Sam Van Campenhout
929dc59ee5 Remove config related to the sensitive data feature
We no longer use mu-cl-resources to manage this data so we can remove it from the configuration.
2021-11-23 16:33:40 +01:00
Sam Van Campenhout
b6e1458d8a Add a new /request-reasons endpoint (#70)
This can be used to retrieve all the possible options.
2021-11-23 15:45:42 +01:00
Nordine Bittich
8c7ba7afec migrate private data (#69)
* migrate private data

* bind subject before optional

Co-authored-by: Boris De Vloed <boris.de.vloed@gmail.com>
2021-11-23 10:36:41 +01:00
Nordine Bittich
48810caf68 fix typo 2021-11-18 14:37:55 +01:00
Nordine Bittich
fe7c0d2c0f only allow sparql endpoint to acc/dev 2021-11-18 14:32:21 +01:00
felix
97cc023be5 Added two tweaked database settings
Note: virtuoso-production.ini might currently be overkill. Could
consider not using it.
2021-11-16 16:27:42 +01:00
Boris De Vloed
8d58d87a54 only send deltas for app graph (#64) 2021-11-15 11:26:05 +01:00
Sam Van Campenhout
ad919b1f0e Merge pull request #60 from lblod/feature/crab-changes
changes for crab
2021-11-10 16:38:52 +01:00
Nordine Bittich
abc5d9256c fix dispatcher 2021-11-10 14:56:28 +01:00
Nordine Bittich
fb2fa6242f fix dispatcher 2021-11-10 14:51:56 +01:00
Nordine Bittich
ed86245a2d bugfix 2021-11-09 16:07:41 +01:00
Nordine Bittich
567740ae86 yasgui 2021-11-09 15:43:09 +01:00
Nordine Bittich
45a5dff52a fix file extension 2021-11-08 14:33:24 +01:00
Nordine Bittich
e6a167c402 ensure source crab migration will run 2021-11-05 10:40:38 +01:00
Nordine Bittich
670c1591c6 bugfix 2021-11-05 10:31:08 +01:00
Nordine Bittich
478affc609 bugfix 2021-11-05 10:29:14 +01:00
Sam Van Campenhout
60ee996e36 Remove all code related to "verbonden juridische structuren"
This functionality is no longer needed.
2021-11-03 12:59:18 +01:00
Nordine Bittich
52bc6e5d60 changes for crab 2021-11-03 10:48:12 +01:00
Aad Versteden
74fb5f31f5 Return torrii redirect on /authorization/callback 2021-10-29 14:41:15 +02:00
Aad Versteden
3227807746 Merge remote-tracking branch 'origin/feature/remove-proxy' into release/merge-for-qa 2021-10-29 14:05:17 +02:00
Aad Versteden
625fa5c8fe Consistent newlines in dispatcher.ex 2021-10-29 13:52:39 +02:00
Aad Versteden
cb7d6029c5 Merge branch 'master' into feature/remove-acmidm-account-from-public 2021-10-29 11:51:16 +02:00