Skip to content
This repository has been archived by the owner on Sep 16, 2022. It is now read-only.

February production update #746

Merged
merged 1 commit into from
Jan 28, 2021
Merged

February production update #746

merged 1 commit into from
Jan 28, 2021

Conversation

EarthModule
Copy link

February production update

* add error handling to migration 27 in case of missing syke.csv file

* split settings with django-split-settings, enable root logger, add .env support

* replace redis client with new implementation, replace yml file with settings

* integrate refdata loading as a task

* remove unnecessary 403 error on flush_records

* remove the yaml loading blocks

* replace configs with env variables

* fix some unnecessary asserts in tests

* remove unnecessary request logging logic

* update .gitignore, deps, and travis. Create .env.template

* delete settings.py

* update readme

* fix ENV_VARS instructions

* CSCFAIRADM-375: [ADD] instructions for mac and for db creation (#679)

* add watchman system monitoring, bind elasticsearch hosts to env

* disable tests testing file permissions, make elasticsearch take its host from env vars, add Docker as an option for local development setup

* Increase logging on redis and rabbitmq connections, fix rabbitmq retry behaviour to be faster

* optimize imports

* CSCFAIRADM-375: [FIX] typos in variables and ignore log directory

* CSCFAIRMETA-701: [FIX] crash on v2 dataset rpc api

- Prevents creating a new dataset version if there exists a draft

* CSCFAIRMETA-701: trigger travis

* Update-test-db-with-migrations
- Add migrations to correspond production db

* Bump django from 3.1.2 to 3.1.4

Bumps [django](https://github.com/django/django) from 3.1.2 to 3.1.4.
- [Release notes](https://github.com/django/django/releases)
- [Commits](django/django@3.1.2...3.1.4)

Signed-off-by: dependabot[bot] <[email protected]>

* Modify-JYU-catalog-logo
- Remove URL from JYU catalog logo name

* Document env vars (#720)

Co-authored-by: Toni Nurmi <[email protected]>

* add OAI env vars OAI_REPOSITORY_NAME, OAI_ETSIN_URL_TEMPLATE and OAI_ADMIN_EMAIL. Add new remote environment (#724)

Co-authored-by: Toni Nurmi <[email protected]>

* Add env var to control if rabbitmq should use vhost. Change RabbitMQ service to use VHOST only if env var allows it (#726)

Co-authored-by: Toni Nurmi <[email protected]>

* CSCFAIRMETA-799-RabbitMQ-TTV (#722)

* CSCFAIRMETA-799-RabbitMQ-TTV
- Add new connection with new vhost to TTV
- Add new exchange and routing_key for TTV
- Publish messages to 1 queue for TTV

* CSCFAIRMETA-799-RabbitMQ-TTV
- Add rabbitmq consumer for ttv

* CSCFAIRMETA-799: [FIX] simplify publish process

- Use the same virtual host for ttv and etsin
- Adding exchanges should now only need to define it in settings
- Define queues in settings
- Move rabbitmq consumers to local environment since they are not
  used in other places

Co-authored-by: Katri Tegel <[email protected]>
Co-authored-by: Tommi Pulli <[email protected]>

* CSCFAIRMETA-799-RabbitMQ-TTV-fix-settings (#728)

-Rename django_settings to settings

Co-authored-by: Katri Tegel <[email protected]>

* Add-files-to-att-dataset (#732)

Modify single dataset a0651f93-1826-4264-8fe4-df39f1ee72ac in prod
Related to changing catalog

Co-authored-by: Katri Tegel <[email protected]>

* Add ENVs to travis.yml and fixed related settings

- added SSL for elasticsearch in ENV
- rabbitmq vhost is name is not needed if it's not used
- travis environment settings are the same as in test environment

* linting and removed unnecessary setting variable

* fix flake8 problems and ones that are consequent

- api_access settings were defined too permissive for unit tests
- uncommented previously commented auth tests because of the api_access
  change
- deleted a file permission related test that tests trivial issue
  and causes a headache in the new docker local env

* add directory for logs during travis before_script

* add rabbitmq hosts to default env

* start using real redis in travis

- Ignore console logging in Travis
- test/stable deploys were removed since they aren't used anyways

* Add-files-to-att-dataset (#734)

Add dataset_version_set to datasets

Co-authored-by: Katri Tegel <[email protected]>

* Att test dataset (#736)

* Add-files-to-att-dataset
-Add test dataset that belongs to IDA-project

Co-authored-by: Katri Tegel <[email protected]>

* Cscfairmeta 847 relax draft validation (#740)

* CSCFAIRMETA-847: [ADD] needed changes in draft json schema

* CSCFAIRMETA-847: [FIX] draft datasets use dft schema

- Add extra validation to publishing method to validate against the
  given data catalog

* CSCFAIRMETA-847: [ADD|FIX] tests

* CSCFAIRMETA-890-DOI-as-pref-identifier (#741)

* CSCFAIRMETA-890-DOI-as-pref-identifier
- Add a check for DOIs from remote datasets
- Add a check that remote datasets with DOI are
validated against datacite

* CSCFAIRMETA-890-DOI-as-pref-identifier
- Modify check for which DOIs are sent for registration

Co-authored-by: Katri Tegel <[email protected]>

* CSCFAIRMETA-776: [ADD] Bulk delete (#725)

* CSCFAIRMETA-776: [ADD] Bulk delete

* CSCFAIRMETA-776-bulk-delete
-Enable deleting of drafts

Co-authored-by: genie9 <[email protected]>
Co-authored-by: Katri Tegel <[email protected]>

* CSCFAIRMETA-847: [FIX] bug where files could not be added to drafts

* Api endpoints env (#743)


Co-authored-by: Toni Nurmi <[email protected]>

* remove test comparing datetimes down to seconds as not needed (#744)

Co-authored-by: Toni Nurmi <[email protected]>

* Bump djangorestframework from 3.12.1 to 3.12.2 (#718)

Bumps [djangorestframework](https://github.com/encode/django-rest-framework) from 3.12.1 to 3.12.2.
- [Release notes](https://github.com/encode/django-rest-framework/releases)
- [Commits](encode/django-rest-framework@3.12.1...3.12.2)

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Toni Nurmi <[email protected]>

* Bump lxml from 4.6.1 to 4.6.2 (#733)

Bumps [lxml](https://github.com/lxml/lxml) from 4.6.1 to 4.6.2.
- [Release notes](https://github.com/lxml/lxml/releases)
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
- [Commits](lxml/lxml@lxml-4.6.1...lxml-4.6.2)

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Toni Nurmi <[email protected]>

* Bump pytz from 2020.1 to 2020.5 (#730)

Bumps [pytz](https://github.com/stub42/pytz) from 2020.1 to 2020.5.
- [Release notes](https://github.com/stub42/pytz/releases)
- [Commits](stub42/pytz@release_2020.1...release_2020.5)

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Toni Nurmi <[email protected]>

Co-authored-by: Toni Nurmi <[email protected]>
Co-authored-by: Tommi Pulli <[email protected]>
Co-authored-by: Tommi Pulli <[email protected]>
Co-authored-by: Katri Tegel <[email protected]>
Co-authored-by: Toni Nurmi <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Evgenia Lyjina <[email protected]>
Co-authored-by: genie9 <[email protected]>
@EarthModule EarthModule changed the title Merge Test to Stable (#737) February production update Jan 28, 2021
@EarthModule EarthModule merged commit f098d9c into master Jan 28, 2021
dependabot bot added a commit that referenced this pull request Sep 2, 2022
[FIX] Bug where files could not be added to drafts #742
[FIX] Remove test comparing datetime objects #744
[FIX] Draft validation issues #740
[ADD] Support for DOI as preferred identifier #741
[ADD] Support for bulk-delete api operations #725
[ADD] Enable V2 endpoints
dependabot bot added a commit that referenced this pull request Sep 2, 2022
[FIX] Bug where files could not be added to drafts #742
[FIX] Remove test comparing datetime objects #744
[FIX] Draft validation issues #740
[ADD] Support for DOI as preferred identifier #741
[ADD] Support for bulk-delete api operations #725
[ADD] Enable V2 endpoints
dependabot bot added a commit that referenced this pull request Sep 2, 2022
[FIX] Bug where files could not be added to drafts #742
[FIX] Remove test comparing datetime objects #744
[FIX] Draft validation issues #740
[ADD] Support for DOI as preferred identifier #741
[ADD] Support for bulk-delete api operations #725
[ADD] Enable V2 endpoints
dependabot bot added a commit that referenced this pull request Sep 2, 2022
[FIX] Bug where files could not be added to drafts #742
[FIX] Remove test comparing datetime objects #744
[FIX] Draft validation issues #740
[ADD] Support for DOI as preferred identifier #741
[ADD] Support for bulk-delete api operations #725
[ADD] Enable V2 endpoints
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants