Commit Graph

53 Commits

Author SHA1 Message Date
Andrea Dell'Amico 5a4d729503 Change the dataminer roles again so that the algorithms are always installed but the script that adds them is optiona. 2018-04-07 18:32:12 +02:00
Andrea Dell'Amico 1f2a02a727 dataminer: more modularity, add smartgears as dependency. 2018-04-06 17:21:38 +02:00
Andrea Dell'Amico 3cc7c27af8 Dataminer: Remove the list of installed algorithms after an upgrade to force a reinstall. 2018-04-05 16:14:37 +02:00
Andrea Dell'Amico 9ef7736f10 Cleanup some dataminer tasks. Remove the old zip installation tasks. 2018-03-23 13:40:25 +01:00
Andrea Dell'Amico 8efc0aca14 dataminer: install nscd when requested. 2017-12-15 18:08:17 +01:00
Andrea Dell'Amico 3477ccc615 dataminer: Install the web.xml file in the correct place.
dataminer: Remove the old wps_algorithms directory when moving from the old to the new algorithms setup.
2017-10-13 15:15:30 +02:00
Roberto Cirillo f1fa0bc1be add new dataminer ghost instance in preproduction environment
update dm-pool-manager service configuration and version
2017-10-11 09:24:21 +02:00
Andrea Dell'Amico b6703aa9b1 dataminer: The algorithms directory structure has been refactored. 2017-10-06 16:05:03 +02:00
Andrea Dell'Amico 5832cb0b62 dataminer: Remove the tasks that install the missing jars. They have been added to the war file. 2017-09-28 17:21:29 +02:00
Andrea Dell'Amico 59d9e8a18c dataminer: do not install the catalina config anymore. Add some java options as requested in https://support.d4science.org/issues/9797 2017-09-26 16:28:40 +02:00
Andrea Dell'Amico 7f91b5f36a dataminer: New workarounds to fix some broken behaviour. 2017-09-19 14:44:35 +02:00
Andrea Dell'Amico c0864e4e43 dataminer: Give the possibility to not install the algorithms updater cron job. 2017-09-19 14:17:37 +02:00
Andrea Dell'Amico 11f5be1a83 dataminer: add variables that permit to change the algorithms installer run frequency. Default: 1 hour.
dataminer proto: run the algorithm installer every minute.
2017-09-14 14:18:22 +02:00
Andrea Dell'Amico 22632aa634 dataminer: Fix the algorithms installer script, in some situations it created duplicated lines in the file that lists the already installed algorithms.
dataminer: Download the distribution files into /home/gcube/downloads
2017-09-14 13:41:55 +02:00
Andrea Dell'Amico e0fa10319d Dataminer: remove the dataminer war when the new one has been downloaded from maven. 2017-09-13 16:35:12 +02:00
Andrea Dell'Amico d1597d1784 dataminer: Remove the old algorithms installer when a new distribution has been downloaded from maven. 2017-09-13 16:33:16 +02:00
Andrea Dell'Amico 84fe5ff968 library/roles/smartgears/dataminer_app: Install the algorithms importer archive, using maven_artifact. 2017-09-12 17:18:00 +02:00
Andrea Dell'Amico 0908b0bbd6 Modify the algorithms updater script so that it can manage algorithms upgrades. See https://support.d4science.org/issues/9562 2017-09-04 19:39:08 +02:00
Andrea Dell'Amico c75648ffba We need to install a templated web.xml for the dataminer app. 2017-07-25 18:37:59 +02:00
Andrea Dell'Amico 9d8ae525a2 Fix the algorithms-updater script again. 2017-07-25 17:51:26 +02:00
Andrea Dell'Amico 0ea789571b Fix the dataminer algorithms updater script: it searched the lock file in the wrong place. 2017-07-25 15:59:47 +02:00
Andrea Dell'Amico 47788be177 smartgears: Install the gcube root dev key in preprod too. 2017-07-20 17:41:42 +02:00
Andrea Dell'Amico 56eaf5e783 d4science-ghn-cluster/group_vars/all/gcube_vault_keys.yml library/roles/smartgears/dataminer_app/tasks/install-gcube-key.yml library/roles/smartgears/smartgears/tasks/install-gcube-keys.yml: New gcube keys. 2017-07-20 15:25:55 +02:00
Andrea Dell'Amico 1660fb37b0 library/roles/smartgears/dataminer_app/templates/algorithms-updater.j2: Better logging. 2017-07-19 19:18:49 +02:00
Andrea Dell'Amico d3154f5d95 library/roles/smartgears/dataminer_app: Modify the cron job that updates the algorithms. Now it also runs a tool that configures new algorithms. 2017-06-22 14:39:07 +02:00
Andrea Dell'Amico 62deaafb2c library/roles/smartgears/dataminer_app/tasks/dataminer-app.yml: Install a cron job that performs a 'svn update' of the algorithms repository. 2017-05-15 13:02:13 +02:00
Andrea Dell'Amico 9c36221e11 library/roles/smartgears/dataminer_app: Install the catalina configuration to extend the classpath. 2017-05-12 19:28:09 +02:00
Andrea Dell'Amico 766a276cc2 library/roles/smartgears/dataminer_app: The war and zip versions of dataminer need to cohesist for the time being. 2017-05-12 13:24:01 +02:00
Andrea Dell'Amico 660341fd56 library/roles/smartgears/dataminer_app/tasks/dataminer-app.yml: Copy the algorithms inside the WPS WEB-INF/lib directory. It's temporary, until Lucio finds a way to dynamically load them. 2017-05-11 20:29:08 +02:00
Andrea Dell'Amico 938f661793 library/roles/smartgears/dataminer_app/tasks/dataminer-app.yml: Fix the subversion options so the task does not fail if the repository is already present. 2017-05-10 18:21:38 +02:00
Andrea Dell'Amico f2f94af17c d4science-ghn-cluster/group_vars/dataminer_devnext/dataminer_devnext.yml: Install from gcube-snapshots.
library/roles/smartgears/dataminer_app/tasks/dataminer-app.yml: Do not link the algorithms inside WEB-INF/lib: it does not work.
2017-05-10 18:21:38 +02:00
Andrea Dell'Amico a5f3856141 library/roles/smartgears/dataminer_app: Fix a wrong variable name. Remove a now unused script. 2017-05-09 14:25:56 +02:00
Andrea Dell'Amico 08220160ad library/roles/smartgears/dataminer_app: Move from the zip file to a war. Install the algorithms checking them out from the subversion repository. 2017-05-09 14:25:56 +02:00
Roberto Cirillo de940474ef ../library/roles/smartgears/dataminer_app/tasks/install-gcube-key.yml added new vo keys 2017-05-02 13:48:45 +02:00
Andrea Dell'Amico 691b10ad28 library/roles/smartgears/{dataminer_app,smartgears}: Handle the SoBigData gcube key. 2017-03-29 17:32:05 +02:00
Andrea Dell'Amico 2a16a82fd0 library/roles/smartgears/dataminer_app/tasks/install-gcube-key.yml: Remove the old keys when switching environment.
library/roles/smartgears/smartgears/templates/get-scopes.j2: Fix the creation of the container.xml file. Updates were failing because the file was not writeable.
2017-02-09 16:34:42 +01:00
Andrea Dell'Amico 1d67e721d0 library/roles/quickrank: Fix the 'become' behaviour so that it works when remote_user is not root.
library/roles/smartgears/dataminer_app/tasks/dataminer-app.yml: Fix the 'become' behaviour so that it works when remote_user is not root.
2017-02-09 12:03:52 +01:00
Andrea Dell'Amico fc790625d3 library/roles/smartgears/dataminer_app/tasks/install-gcube-key.yml: Remove the non existant fourth dev gcube key reference. 2017-01-16 18:24:52 +01:00
Andrea Dell'Amico dda9366e83 library/roles/smartgears, d4science-ghn-cluster/group_vars/all/gcube_vault_keys.yml: Add the D4Research gcube key. 2016-12-21 14:18:24 +01:00
Andrea Dell'Amico fb49a65871 library/roles/smartgears/dataminer_app/tasks/dataminer-app.yml: Set a high timeout for the download from thredds. 2016-10-11 17:42:36 +02:00
Andrea Dell'Amico cc6a29ce51 library/roles/smartgears/smartgears: directly unarchive the distribution without saving the tar file locally. 2016-10-05 17:56:44 +02:00
Andrea Dell'Amico bfd5ea4d4d library/roles/smartgears/dataminer_app: Install the gebco_08.nc file on a place external to the application files and create a symlink to it. Remove the now unused tasks that installed The wps original war file. 2016-10-05 13:31:10 +02:00
Andrea Dell'Amico a655772e51 library/roles/smartgears/dataminer_app: New way to install the software. Now we only download a zipped distribution and we change a couple of parameters inside wps_config.xml. 2016-10-05 10:37:46 +02:00
Andrea Dell'Amico f864b8648e library/roles/smartgears/dataminer_app/tasks/dataminer-app.yml: The dataminer algorithms must be copied on the right place, tomcat cannot read symlinks. 2016-09-09 13:32:16 +02:00
Andrea Dell'Amico 21df3e5cfd library/roles/smartgears/dataminer_app: Install the algorithms jars from their svn repository. See https://support.d4science.org/issues/4917 2016-09-08 14:48:30 +02:00
Andrea Dell'Amico a19949c63f library/roles/smartgears: Manage the gcube pre production keys. 2016-07-03 12:39:44 +02:00
Andrea Dell'Amico 900d414f4a library/roles/smartgears/ckan_connector: Fix the nexus URL.
library/roles/smartgears/dataminer_app: Remove some duplicate libraries, add two.
2016-06-27 15:36:37 +02:00
Andrea Dell'Amico 276e45ec15 library/roles/smartgears/dataminer_app/tasks/dataminer-app.yml: Fix the dataminer config jar destination path. 2016-06-23 12:58:50 +02:00
Andrea Dell'Amico 72af5c08fe library/roles/smartgears/dataminer_app/defaults/main.yml: Fix the dataminer configuration jar's URL. 2016-06-23 12:37:49 +02:00
Andrea Dell'Amico 874ada60eb library/roles/smartgears/smartgears/tasks/smartgears-app.yml: Fix the container.xml installation.
library/roles/smartgears/dataminer_app: More files needed.
2016-06-23 12:15:37 +02:00