From ebf83075f6d51f072d8a9d90d5adf406af553469 Mon Sep 17 00:00:00 2001 From: Jose Javier Merchante Date: Tue, 7 Jun 2022 14:03:02 +0200 Subject: [PATCH] Update directory for releases to include the notes Release directory from now on will be used for the release notes. We will keep the old release files in the old directory for compatibility with build_grimoirelab script. Signed-off-by: Jose Javier Merchante --- releases/NEWS | 2498 ------------------- releases/latest | 2 +- releases/{ => old}/0.2.0 | 0 releases/{ => old}/0.2.1 | 0 releases/{ => old}/0.2.10 | 0 releases/{ => old}/0.2.11 | 0 releases/{ => old}/0.2.12 | 0 releases/{ => old}/0.2.13 | 0 releases/{ => old}/0.2.14 | 0 releases/{ => old}/0.2.15 | 0 releases/{ => old}/0.2.16 | 0 releases/{ => old}/0.2.17 | 0 releases/{ => old}/0.2.18 | 0 releases/{ => old}/0.2.19 | 0 releases/{ => old}/0.2.2 | 0 releases/{ => old}/0.2.20 | 0 releases/{ => old}/0.2.21 | 0 releases/{ => old}/0.2.22 | 0 releases/{ => old}/0.2.23 | 0 releases/{ => old}/0.2.24 | 0 releases/{ => old}/0.2.25 | 0 releases/{ => old}/0.2.26 | 0 releases/{ => old}/0.2.27 | 0 releases/{ => old}/0.2.28 | 0 releases/{ => old}/0.2.29 | 0 releases/{ => old}/0.2.3 | 0 releases/{ => old}/0.2.30 | 0 releases/{ => old}/0.2.31 | 0 releases/{ => old}/0.2.32 | 0 releases/{ => old}/0.2.33 | 0 releases/{ => old}/0.2.34 | 0 releases/{ => old}/0.2.35 | 0 releases/{ => old}/0.2.36 | 0 releases/{ => old}/0.2.37 | 0 releases/{ => old}/0.2.38 | 0 releases/{ => old}/0.2.39 | 0 releases/{ => old}/0.2.4 | 0 releases/{ => old}/0.2.40 | 0 releases/{ => old}/0.2.41 | 0 releases/{ => old}/0.2.42 | 0 releases/{ => old}/0.2.43 | 0 releases/{ => old}/0.2.44 | 0 releases/{ => old}/0.2.45 | 0 releases/{ => old}/0.2.46 | 0 releases/{ => old}/0.2.47 | 0 releases/{ => old}/0.2.48 | 0 releases/{ => old}/0.2.49 | 0 releases/{ => old}/0.2.5 | 0 releases/{ => old}/0.2.50 | 0 releases/{ => old}/0.2.51 | 0 releases/{ => old}/0.2.52 | 0 releases/{ => old}/0.2.53 | 0 releases/{ => old}/0.2.54 | 0 releases/{ => old}/0.2.55 | 0 releases/{ => old}/0.2.56 | 0 releases/{ => old}/0.2.57 | 0 releases/{ => old}/0.2.58 | 0 releases/{ => old}/0.2.59 | 0 releases/{ => old}/0.2.6 | 0 releases/{ => old}/0.2.60 | 0 releases/{ => old}/0.2.61 | 0 releases/{ => old}/0.2.62 | 0 releases/{ => old}/0.2.63 | 0 releases/{ => old}/0.2.64 | 0 releases/{ => old}/0.2.65 | 0 releases/{ => old}/0.2.66 | 0 releases/{ => old}/0.2.67 | 0 releases/{ => old}/0.2.68 | 0 releases/{ => old}/0.2.69 | 0 releases/{ => old}/0.2.7 | 0 releases/{ => old}/0.2.8 | 0 releases/{ => old}/0.2.9 | 0 releases/{ => old}/0.3.0 | 0 releases/old/NEWS | 4986 ++++++++++++++++--------------------- releases/old/NEWS.old | 3058 +++++++++++++++++++++++ 75 files changed, 5272 insertions(+), 5272 deletions(-) delete mode 100644 releases/NEWS rename releases/{ => old}/0.2.0 (100%) rename releases/{ => old}/0.2.1 (100%) rename releases/{ => old}/0.2.10 (100%) rename releases/{ => old}/0.2.11 (100%) rename releases/{ => old}/0.2.12 (100%) rename releases/{ => old}/0.2.13 (100%) rename releases/{ => old}/0.2.14 (100%) rename releases/{ => old}/0.2.15 (100%) rename releases/{ => old}/0.2.16 (100%) rename releases/{ => old}/0.2.17 (100%) rename releases/{ => old}/0.2.18 (100%) rename releases/{ => old}/0.2.19 (100%) rename releases/{ => old}/0.2.2 (100%) rename releases/{ => old}/0.2.20 (100%) rename releases/{ => old}/0.2.21 (100%) rename releases/{ => old}/0.2.22 (100%) rename releases/{ => old}/0.2.23 (100%) rename releases/{ => old}/0.2.24 (100%) rename releases/{ => old}/0.2.25 (100%) rename releases/{ => old}/0.2.26 (100%) rename releases/{ => old}/0.2.27 (100%) rename releases/{ => old}/0.2.28 (100%) rename releases/{ => old}/0.2.29 (100%) rename releases/{ => old}/0.2.3 (100%) rename releases/{ => old}/0.2.30 (100%) rename releases/{ => old}/0.2.31 (100%) rename releases/{ => old}/0.2.32 (100%) rename releases/{ => old}/0.2.33 (100%) rename releases/{ => old}/0.2.34 (100%) rename releases/{ => old}/0.2.35 (100%) rename releases/{ => old}/0.2.36 (100%) rename releases/{ => old}/0.2.37 (100%) rename releases/{ => old}/0.2.38 (100%) rename releases/{ => old}/0.2.39 (100%) rename releases/{ => old}/0.2.4 (100%) rename releases/{ => old}/0.2.40 (100%) rename releases/{ => old}/0.2.41 (100%) rename releases/{ => old}/0.2.42 (100%) rename releases/{ => old}/0.2.43 (100%) rename releases/{ => old}/0.2.44 (100%) rename releases/{ => old}/0.2.45 (100%) rename releases/{ => old}/0.2.46 (100%) rename releases/{ => old}/0.2.47 (100%) rename releases/{ => old}/0.2.48 (100%) rename releases/{ => old}/0.2.49 (100%) rename releases/{ => old}/0.2.5 (100%) rename releases/{ => old}/0.2.50 (100%) rename releases/{ => old}/0.2.51 (100%) rename releases/{ => old}/0.2.52 (100%) rename releases/{ => old}/0.2.53 (100%) rename releases/{ => old}/0.2.54 (100%) rename releases/{ => old}/0.2.55 (100%) rename releases/{ => old}/0.2.56 (100%) rename releases/{ => old}/0.2.57 (100%) rename releases/{ => old}/0.2.58 (100%) rename releases/{ => old}/0.2.59 (100%) rename releases/{ => old}/0.2.6 (100%) rename releases/{ => old}/0.2.60 (100%) rename releases/{ => old}/0.2.61 (100%) rename releases/{ => old}/0.2.62 (100%) rename releases/{ => old}/0.2.63 (100%) rename releases/{ => old}/0.2.64 (100%) rename releases/{ => old}/0.2.65 (100%) rename releases/{ => old}/0.2.66 (100%) rename releases/{ => old}/0.2.67 (100%) rename releases/{ => old}/0.2.68 (100%) rename releases/{ => old}/0.2.69 (100%) rename releases/{ => old}/0.2.7 (100%) rename releases/{ => old}/0.2.8 (100%) rename releases/{ => old}/0.2.9 (100%) rename releases/{ => old}/0.3.0 (100%) create mode 100644 releases/old/NEWS.old diff --git a/releases/NEWS b/releases/NEWS deleted file mode 100644 index a2063700..00000000 --- a/releases/NEWS +++ /dev/null @@ -1,2498 +0,0 @@ -# 0.2.69 - -Released: 2022-03-18 - - -* Grimoirelab - * feat: add github event alias - * Changing `GitHub No Replay` to `GitHub No Reply` -* Cereslib - * [gha] Update tests workflow - * Remove Python 3.6 support - * [poetry] Add Poetry support -* ELK - * Support OpenSearch 1.x - * [enrich] Remove the prefix '::' of the enrollments. - * [enrich] Bugfix for hyperkitty. EnrichBackend can not get raw data. - * [poetry] Include sortinghat as extra dependency - * Remove Python 3.6 support -* Kidash - * [gha] Add workflow to automate the release process - * [gha] Add workflow to check if a changelog was included - * [gha] Update CI github action workflow - * Add flake8 and coverage as dev-dependencies - * [poetry] Add Poetry support - * Remove the support for Python 3.6 and add new versions - * [scripts] Change kidash scripts as entrypoints -* Perceval - * Add configurations of the metadata files to pyproject.toml - * [gha] Update release action using grimoirelab-github-actions -* Perceval-Mozilla - * Add configurations of the metadata files to pyproject.toml - * [gha] Update release action using grimoirelab-github-actions -* Perceval-OPNFV - * [gha] Use poetry for tests in GitHub Actions workflow - * Remove Python 3.6 support - * Support package namespaces with Poetry - * [gha] Add workflow to check if a changelog was included -* Perceval-Puppet - * [gha] Use poetry for tests in GitHub Actions workflow - * Remove Python 3.6 support - * Support package namespaces with Poetry - * [gha] Add workflow to check if a changelog was included -* Perceval-Weblate - * [gha] Use poetry for tests in GitHub Actions workflow - * Remove Python 3.6 support - * Support package namespaces with Poetry - * [gha] Add workflow to check if a changelog was included -* Sigils - * Support newer versions of Python apart from 3.7 - * [poetry] Add Poetry support - * [json] Move visualizations inside panels - * [gerrit] Replace name field to author_name in Submitters table -* SirMordred - * [gha] Use poetry for tests in GitHub Actions workflow - * [poetry] Add poetry support - * [deps] Fix dependecies in requirements - * [utils] Change sirmordred scripts as entrypoints - * Refactoring link to new tutorial page. Currently it links to a page not found and I'm pretty sure this is a better place for the reader to be sent. - * Clarify README -* Sortinghat - * Include Sortinghat command in wheel - * [gha] Update tests workflow - * Fix flake8 code style warnings - * [setup.py] Add missing commas in entry_points - * Bump numpy to 1.21.0 in requirements.txt and setup.py - * Bump numpy from 1.18.3 to 1.21.0 - * Remove Python 3.6 support - * [gha] Add workflow to check if a changelog was included - * [poetry] Add Poetry support - * [sh] Change SortingHat scripts as entrypoints - * [deps] Update Jinja version - - -# 0.2.68 - -Released: 2022-01-27 - - -* ELK - * [enrich] Fix empty value of 'author_domain' field - * [git] Add schema column for raw/calculated - * [enrich] Fix urllib3.exceptions.SSLError for 'enrich_feelings'. - * [github2] Add comments from "Approval" and "Change requests" -* Perceval - * Bump cryptography from 3.3.1 to 3.3.2 - * Bump urllib3 from 1.26.3 to 1.26.5 -* Sigils - * [github2_pull_requests] Add new fields to the index pattern - * [gitlab_issues] Add painless_time_open to the index pattern - - -# 0.2.67 - -Released: 2022-01-13 - - -* ELK - * [enrich] Fix IndexError when getting main organization -* Perceval - * [gha] Check if a changelog was included in every Pull request -* SirMordred - * [.github] Use ubuntu-18.04 instead of ubuntu-latest - * [.github] Update elasticsearch to 6.8.6 - - -# 0.2.66 - -Released: 2022-01-11 - - -* Grimoirelab - * Update events.html with MSR 2022 Hackathon details -* ELK - * [enrich] Fix refresh_identities for '*_multi_org_names' fields - * [.github] Update elasticsearch to 6.8.6 - * [enrich] Get main enrollments for *_org_name field -* Sortinghat - * [.github] Use ubuntu-18.04 instead of ubuntu-latest - * [sortinghat/utils] Fix merge_date_ranges returns an extra date - - -# 0.2.65 - -Released: 2021-11-19 - - -* ELK - * [elk] Update 'non_authored_*' fields on 'refresh_identities' - * [enriched/git] Add 'non_authored_*' commit meta fields -* Perceval - * [git] Add --no-ssl-verify parameter -* Sigils - * [git] Update index pattern to include 'non_authored_*' - * [affiliations] Authors/Contributions by Organization and Domains -* Sortinghat - * [sortinghat/utils] Fix merge_date_ranges - - -# 0.2.64 - -Released: 2021-11-05 - - -* ELK - * [setup/requirements] Upgrade requests==2.26.0 and urllib3==1.26.5 -* SirMordred - * [task_manager] Add `update_hour` in the general section - - -# 0.2.63 - -Released: 2021-10-25 - - -* Grimoirelab - * Add Mystic project - * Add TDF dashboard - * Fix typos and update screenshots - * Update events.html with hacktoberfest-21 details - * [docs] Update Built with GrimoireLab section -* ELK - * [.github] Install setuptools==57.5.0 - * [enriched/git] Add commit meta fields -* Perceval - * [docs] Add information for using perceval against private git repos - * [docs] Add perceval documentation content -* Sigils - * Fix typos in my name - * [git] Update index pattern to include commit author meta fields - * [github2] Limit visualizations to fix low performance. -* SirMordred - * [task_enrich] Support multi author fields in refresh identities - * [docs] Add information for using sirmodred against private git repos - - -# 0.2.62 - -Released: 2021-09-16 - - -* ELK - * [enriched/github2] Add demography study - * [enriched/github2] Add ghost user to calculate first attention - * [README] Update instructions for running tests -* Perceval - * [docs] Add Airtable and Bitbucket backends - * [git] Add argument base-path for the git backend - * Update README.md - * [docs] Update configurations for readthedocs - - -# 0.2.61 - -Released: 2021-09-07 - - -* ELK - * [raw/gitlab] Handle immense term for data.head_pipeline.yaml_errors - * [elk] Pass 'no_update' to pereceval - * [enriched/github2] Fix TypeError NoneType - * [mattermost] Allow parsing normal mattermost urls -* Perceval - * [github] Extend 'max_items' for all requests - * [docs] Add Gitee community backend -* SirMordred - * [config] Support inheritance in configuration - - -# 0.2.60 - -Released: 2021-08-31 - - -* ELK - * [enriched/github2] Fix KeyError 'login' - * [enriched/github2] Add 'user_login' field - - -# 0.2.59 - -Released: 2021-08-23 - - -* ELK - * [pyproject] Update packages and python to "^3.6.1" - * [enriched/githubql] Add PullRequestReview field - * [enriched/mattermost] Fix KeyError 'parent_id' - * [enriched/github2] Use user_data fields to set identities values -* Perceval - * [githubql] Add PullRequestReview event -*SirMordred - * [mordred] Add flag/arg to filter which repos run - - -# 0.2.58 - -Released: 2021-08-12 - - -* ELK - * [gitlab] Autodetect gitlab enterprise-url arg -* Perceval - * [mattermost] Support running with channel names - * [github] Handle reactions without user information - * [pyproject] Update python "^3.6.1" -* Perceval-finos - * [pyproject] Update python "^3.6.1" -* Perceval-mozilla - * [pyproject] Update python "^3.6.1" -* Perceval-opnfv - * [pyproject] Update python "^3.6.1" -* Perceval-puppet - * [pyproject] Update python "^3.6.1" -* Perceval-weblate - * [pyproject] Update python "^3.6.1" - - -# 0.2.57 - -Released: 2021-07-20 - - -* ELK - * [enriched/mattermost] Fix 'useAutomaticTimezone' TypeError - * [raw/mattermost] Fix mapping for 'data.props.meeting_id' - * [enriched/weblate] Fix KeyError for several fields - * [schema] Update Kafka KIP schema -* Kidash - * [setup] Upgrade requests to 2.26.0 -* Perceval - * Bump grimoirelab-toolkit from 0.1.12 to 0.2 - * [gha] Create release.yml - * [nntp] Avoid line too long error - * [nntp] Handle not valid date - * [mattermost] Change the key from 'data.metadata.images' to value - * [gha] Update tests workflow - * [perceval] Change perceval script as entrypoint - * [docs] Fix typos -* Perceval-finos - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Perceval-mozilla - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Perceval-opnfv - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Perceval-puppet - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Perceval-weblate - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Sortinghat - * [parsing/gitdm] Update VALID_LINE_REGEX expression - * Bump jinja2 from 2.11.1 to 2.11.3 - * [CI] Migrate from Travis CI to GitHub Actions - -# 0.2.56 - -Released: 2021-06-09 - - -* ELK - * [enriched/slack] Add stopwords in the field 'text_analyzed' - * [enriched/mattermost] Improve fields - * [enriched/github] Add demography study - * [enriched/github] Fix KeyError when getting user info - * [tests/data] Improve telegram coverage - * [README] Update bugzilla data sources description - * [schema] Fix twitter schema - * tests] Add test for metadata__updated_on field - * [tests] Add test for transactionID field - * [schema] Add twitter schema file - * [schema] Fix missing values in github event schema - * [enriched/twitter] Remove deprecated attributes from enriched item -* Kidash - * Bump urllib3 from 1.24.3 to 1.26.5 -* Perceval - * [github] Fix 404 Client Error when user is not found. - * [github] Fix user_orgs for organizations with restricted access - * [CI] Use poetry for the CI github actions workflow - * [deps] Add flake8 and coverage to dev dependencies - * Create CONTRIBUTING.md - * [poetry] Add setuptools to the build-system - * [backend] Disables stack trace if debug flag is absent -* Sigils - * [mattermost] Update panel and index pattern with new fields. - * [github_issues] Update index pattern with demography fields - * [json] Update Twitter index pattern -* SirMordred - * [README] Add demography study for github - * Allowing the config files to be specified dynamically - * [micro-mordred] Improve error messages in micro.py - * [docs] Update the mariadb docker-compose configuration - * [tests] Fix flake8 errors - -# 0.2.55 - -Released: 2021-03-15 - - -* ELK - * [stackexchange] Make author anonymization optional for stackexchange - * [enrich-stackexchange] Handle deleted user in stackoverflow - * [enriched/gitlab] Fix KeyError without `name` value -* Perceval - * [stackexchange] Include access_token as optional argument - * [stackexchange] Change the fetch order to 'asc' - - -# 0.2.54 - -Released: 2021-02-11 - -* ELK - * [raw/phabricator] Fix mapping for data.fields.custom_error_stack -* Perceval - * [slack] Use channels.history to retrieve message - - -# 0.2.53 - -Released: 2021-01-26 - -* Cereslib - * [flake8] Fix flake8 errors - -* ELK - * [enriched/github:prs] Add fields for Pull Requests-related data - * [enriched-cocom] Use hashlib instead hash() to create a uniq id - -* Kidash - * [flake8] Fix flake8 errors - -* Perceval - * [supybot] Adds support for logs without timezone information - * [githubql] Support GitHub App to fetch data - * [github] Support GitHub App to fetch data - * [perceval] Add flag `-l/--list` to show list of available backends - -* Sigils - * [github] Update index pattern with new fields - - -# 0.2.52 - -Released: 2020-11-24 - -* SortingHat - * Limit SQLAlchemy versions to <1.4 - - -# 0.2.51 - -Released: 2020-11-23 - -* ELK - * [enriched/slack] Fix enrich items without user data - * [raw/slack] Handle fields in 'data.files' - -* Perceval - * [slack] Fix fetch message from a private user - * [askbot] Add logging debug messages to Askbot - -* Sigils - * [weblate] Add organization information to overview panel - - -# 0.2.50 - -Released: 2020-10-29 - -* ELK - * [enriched/githubql] Classify merged PRs within cross-references study - * [enriched/githubql] Add MergedEvent info - * [gerrit] Add last-verified approval value field to enricher - -* Perceval - * [githubql] Fix error `Events not collected for issue...` - * [tests] Fix pipermail not working search_fields test - * [githubql] Add MergedEvent info - -* Sigils - * [github][github2] Update index patterns with new study fields - * [githubql] Update index pattern with MergedEvent fields - * [gerrit] Update index patterns with last Verified approval value - * [gerrit] Add Retention of Newcomers panel - - -# 0.2.49 - -Released: 2020-10-13 - -* ELK - * [schema] Add schema file for Weblate enriched data - * [weblate] New enricher to handle changes - * [enrich/discourse] Add credentials to collect category info - * [enriched/github] Add field issue_url for issues and pull requests - * [enriched/githubql] Update references in related indexes - -* Perceval - * Weblate backend - -* Sigils - * [weblate] Add Weblate demographics panel - * [weblate] Add Weblate overview panel and index pattern - * [github] Update index pattern with issue_url field - * Update index patterns from github-related indexes - -* SirMordred - * Add new backend weblate - - -# 0.2.48 - -Released: 2020-09-28 - -* ELK - * [enriched/git] `enrich_git_branches` skip --filter-no-collection repo - * [enriched/bugzilla] Add new field `whiteboard` -* Sigils - * [bugzilla] Update index pattern with the new field `whiteboard` - - -# 0.2.47 - -Released: 2020-09-23 - -* ELK - * [enriched/githubql] Add new study 'enrich_reference_analysis' - -* Sigils - * [gerrit] Change `timeopen` to `painless_delay` - -* SirMordred - * [githubql] Add new study "enrich_reference_analysis" - - -# 0.2.46 - -Released: 2020-09-14 - -* ELK - * [enriched/gerrit] Add new study 'enrich_demography_contribution' - * Check for author in comment raw data before assigning to user object - * [schema] Fix slack schema CSV file - * [enriched/gerrit] Add new fields `open` and `wip` - * [enriched/jira] Add `is_closed` and `status_category_key` fields - -* Perceval - * Update dulwich package version - * Add support for specifying Gerrit SSH key location - -* Sigils - * [gerrit] Update index pattern - * Update documentation about Kidash - * [docker] Add links and import instructions - * [discourse] Add links and import instructions - * [gitlab] Add links and import instructions - * [gitter] Add links and import instructions - * [maniphest] Add links and import instructions - * [mediawiki] Add links and import instructions - * [slack] Add links and import instructions - * [global] Add links and import instructions - * [affiliations] Add links and import instructions - * [code] Add links and import instructions - * [demographics] Add links and import instructions - * [gerrit] Add links and import instructions - * [lifecycle] Add links and import instructions - * [jira] Add links and import instructions - * [jenkins] Add links and import instructions - * [chaoss] Add links and import instructions - * [onion] Add links and import instructions - * [bugzilla] Add links and import instructions - * [github] Add links and import instructions - * Add new icons license information - * [git] Add links and import instructions - * [jekyll] Update theme colors - * [jira] Use `painless_delay` as the time the issue stay open - * [jira_backlog] Use `painless_delay` as the time the issue stay open - * [jira_timing] Use `painless_delay` as the time the issue stay open - -* SirMordred - * Add new study "demography_contribution" - * Update Getting Started guide with identities management section - * Fix lifecycle file name - - -# 0.2.45 - -Released: 2020-07-27 - -* GrimoireLab - * Remove 'manuscripts' from the release due there is - a broken depencency with matplotlib and numpy. - - -# 0.2.44 - -Released: 2020-07-27 - -* ELK - * [enriched/git] Study aoc support extra fields - * [enriched/mediawiki] Add `repository_labels` field - -# 0.2.43 - -Released: 2020-07-21 - -* Perceval - * [githubql] Add pull request author to ClosedEvent - * [slack] Use channels.history to retrieve message - -* ELK - * Update pyproject.toml with PyMySQL pinned dep - * [deps] Pin PyMySQL dependency - * [enriched-githubql] Add pull request submitter to closed events - * [enriched/phabricator] Fix the field `time_to_close_days` - * Fix Issue#907 - * [enriched-enrich] Set user-agent for geopy - * Fix wrong quotation - * [enriched-git] Execute update_items when local repo commits are returned - * [enriched-githubql] Add page size param to duration study - -* Hatstall - * [readme] Fix instruction to install requirements - -* Mordred - * Save new changes made in Dashboard by mounting the volume in ES - * Remove inconsistency in displaying images - * Add info about pulling in latest data - -* Sigils - * [github-closed-events] Include submitters and reporters in dashboard - * [maniphest] Change `painless_delay` instead of `timeopen_days` - * [github-label-events] Improve dashboard - * Add acknowledgments section to DevRel dashboards - -# 0.2.42 - -Released: 2020-06-20 - -* Perceval - * [slack] Handle messages without user/bot ID - -* ELK - * Add release note for rocketchat - * [enriched-slack] Handle messages without user data/bot ID - * [enriched-githubql] Add reporter data to enriched docs - * [enriched-mbox] Handle long body emails - * [enriched-githubql] Add duration analysis study - * [rocketchat] Increase test coverage and complete doc - * [rocketchat] Patch for PR #882 - * [rocketchat] Add support for RocketChat - * [grimoire_elk] Remove tzinfo for date comparison - -* Mordred - * [config] Add support for duration analysis - * [doc] Add instructions to mine rocketchat - * [docs] Update Getting-Started.md result image - -# 0.2.41 - -Released: 2020-06-13 - -* Perceval - * [backend] Add Rocket.Chat backend - * [perceval] Fix flake8 errors - * [doc] Add Slack API token generation info - * [slack] Update resource endpoints - * [launchpad] Add missing `package` parameter in launchpad - -* Sigils - * [slack] Add DevRel dashboard - * [GitHub] Add DevRel dashboard - * [discourse] Add DevRel dashboard - * [github] Add dashboard about label-related events - * [github2-pulls] Update index pattern - * [github2-pulls] Change order results metric in table vizs - * [github2-issues] Update index pattern - * [github2-issues] Change order results metric in table vizs - * [slack] Add new files metrics to index pattern - * [gerrit] Add changeset status and value to index pattern - -* ELK - * [deps] Constrain numpy version to <= 1.18.3 - * Release 0.73.0 - * Fix formatting git private repos note - * [enriched-githubql] Add label attribute to closed events - * [enriched-mediawiki] Handle filters on repo URL - * [elastic] Support for filter no-collection on multi params URLs - * [enriched-confluence] Extract username from publicName attr - * [enriched-git] Sync AOC and Git raw index - * [enriched-git] Handle anonymized repos in update_items - * [enriched-cocom] Include files in revision - * [elk] Fix flake8 errors - * [tests] Rename study indexes for tests to ease deletion - * [elk] Handle private repos in git studies - * [enriched-utils] Remove credentials for repository filter - * [raw-git] Remove credentials from origin - * [elk] Move anonymize_url to enriched/utils.py - * [enriched-cocom] Propagate commit parents to enriched index - * [utils] Remove unused function get_time_diff_days - * [enriched-mbox-study-kip] Fix calculation for inactive days - * [grimoire_elk] Replace datetime/dateutil calls with toolkit - * [utils] Remove get_git_repos - * [enriched] Remove projects.py - * [launchpad] Add support for launchpad - * [enriched-gerrit] Propagate changeset status to patchsets - * [slack] Update files metric - * [tests] Add tests for `copy_raw_fields()` method - * [Enrich] Add `copy_raw_fields()` method and refactor enrichers - * [telegram] Improve test coverage - * [Mbox] Add tests and test data for MBox KIP study. - * [test] Add missing test for perceval params - -* Mordred - * [task_panels] Upload label-related dashboard - * [docs] Update getting-started with ES/Kibiter 6.8 - * [tests] Remove panels test for kibiter 5.x - * [aliases] Remove affiliations and all_enriched aliases for github2 - * [tests] Add tests to process filter-no-collection on multi params URLs - * [task_panels] Remove support for Kibiter < 6.x - * [tests] Update requirements_test - * [sirmordred] Remove credentials from private URLs - * [task_identities] add `no-enrollment-periods-validation` - * [aliases] Fix enrich alias for gerrit - -* Sortinghat - * [deps] Constrain numpy version to <= 1.18.3 - * Update version number to 0.7.13 - * [misc/grimoirelab2sh] Add new argument to avoid periods validation - -* Graal - * [cocom] Remove first slash from file path - * [travis] Change how to install nomos - * [cocom] Include files info in docs generated - * [cocom] Include parents info in docs generated - -* Cereslib - * [enrich-enrich] Fix flake8 E741 ambiguous variable name - * [deps] Constraint numpy version to <= 1.18.3 - * version number to 0.1.13 - * [test] Add test for Git events - -* Kidash - * [kidash] Remove support for kibana <6.x - * [kidash] Improving log messages - * [kidash] Support import to Kibiter/Kibana 6.8 - - -# 0.2.40 - -Released: 2020-04-24 - -* Perceval - * [perceval] Add githubql backend - * [doc]Fixed minor typos - * [Travis] upgrade pip and setuptools - * [pagure] Add sanitize for archive - * [mattermost] Add sanitize for archive - * [github] Add sanitize for archive - * [discourse] Add sanitize for archive - * [backend] Add predefined paramaters to clients - * [pagure] Fix failing tests - * [backend] Add Gitter backend - * [gerrit] Extend `--start` param to gerrit 3.x -* Perceval-opnfv - * [travis] Upgrade setuptools and pip -* Perceval-puppet - * [travis] Upgrade setuptools and pip -* Perceval-mozilla - * [travis] Upgrade setuptools and pip -* Perceval-finos - * [travis] Upgrade setuptools and pip -* Graal - * [travis] Upgrade setuptools and pip -* Sortinghat - * [doc] Add examples of SortingHat API via Python - * [travis] Upgrade setuptools and pip - * Clarifying sortinghat intro - * Fix broken link to Perceval in README.md -* Mordred - * [mordred] Add support for github events - * [doc-git] Add parameter `run_month_days` in `enrich_git_branches` - * This commit adds config, alias, menu entry and documentaion for gitter backend. - * Fixed the typoes of docker/README.md - * [doc] Add Pagure datasource - * [tests] Remove user/password from es_enrichment section - * Remove user and password parameter from elastic section - * added section in getting started and reformatting - * added section in getting started and formatting - * [travis] Upgrade setuptools and pip - * [tests] Add requirements_tests.txt - * [docs] revamp of getting-started.md - * Fixed Broken Backlinks - * Added some sections in 'How to' of GettingStarted document - * Make anonymization optional for each backend - * fixed link for ssl error and other fixes - * fixes made as per comments - * Corrected 'Sudo' with 'sudo' - * Added how-to dump a mapping/data from an index - * added installation for docker and docker-compose, added errors and solutions in troubleshooting section - * fix typo in README.md - * Fixing typo in Sir Mordred's README.md - * [Getting-started] Update kibiter version to 6.1.4-3 - * Add "How to modify the menu" to the getting started guide - * [doc]Added section in 'How to' in Getting-Started.md - * Fixed a backlink - * [doc] Added How to section in Getting-Started - * [sirmordred] Remove duplicate call of execute_batch_tasks -* Kingarthur - * [travis] Upgrade setuptools and pip -* Manuscripts - * [travis] Upgrade setuptools and pip - * [travis] Support for python 3.5 and 3.6 -* Cereslib - * [travis] Upgrade setuptools and pip - * Fix a small typo -* Toolkit - * [travis] Upgrade setuptools and pip -* ELK - * Fix body store-and-process-github-events.yml - * [ELK] Add poetry support - * [releases] Add release note for feature #853 - * [ELK] Store and process github events - * [enrich-git] Add the param `run_month_days` to enrich_git_branches - * [enriched-git] Handle connection problems during enrich_git_branches - * This commit addds support for gitter backend. Raw and Enriched indexes have been added along with their tests and schemas. - * [pagure] Add support for Pagure - * updated the docstring for pair_programming - * [enriched-bugzillarest] Add new field `is_open` - * changed logic to delete all test indexes - * added test for pair_programming - * [travis] Upgrade setuptools and pip - * [enriched] Check first if the instance of `item` is dict - * add language field and compute all cocom study metrics per language - * added projects_map db to improve coverage - * [releases-notes] Add release note for fix #826 - * [enriched-meetup] Handle event without geolocation - * [meetup] Make users anonymization optional for meetup - * [gitlab] Make owners data anonymization optional for gitlab - * [github] Make owners data anonymization optional for github - * [git] Make author anonymization optional for git - * Make anonymization optional for each backend - * modified:final test_git.py - * [schema] Update dockerhub.csv - * [schema] Update askbot.csv - * [schema] Update mattermost.csv -* Sigils - * [bugzilla-timing] Change `painless_time_to_now` instead of `timeopen_days` - * [github] Add dashboard about closed events - * [bugzilla-backlog] Change `painless_time_to_now` instead of `timeopen_days` - * [bugzilla] Change `painless_time_to_now` instead of `timeopen_days` - * [gitter] Add gitter panels. - * Updated docker.json, replaced sirmordred repo link - - -# 0.2.39 - -Released: 2020-03-20 - -* Kidash - * [kidash/kidash] Delete dependency with `grimoirelab-panels` - * [doc] Update README -* Graal - * [graal] Update license and copyright information -* Cereslib - * [events] Add support for multiple affiliations -* Mordred - * [doc] Add PyCharm installation instructions - * added logging to file support for micro.py - * Troubleshooting fixed - * [doc] Fix askbot configuration typos - * Fix broken backlinks in supported resources - * Refracted Readme, Added navigation and contents - * Fixed README for docker-compose(without SearchGuard) with changes - * Corrected mariadb services for docker-compose.yml for without SearchGuard section - * [doc] Added Getting-Started doc - * added color logging facility in micro.py - * [micromordred] Replace actual api-token - * fixed username and pass for kibiter login - * Update README.md troubleshooting section - processes conflict with SearchGuard - * Update README.md troubleshooting section - processes conflict with SearchGuard - * Update 'Source code and docker' section of README.md to include unsecure docker-compose - * correcting spelling mistakes in Readme - * Added Empty Index Problem with Solution in troubleshooting section of Readme - * [utils] Add script to upload menu and dashboards - * Fixed phase enrichment time duration not counting days - * Added troubleshooting section in readme - * [sirmordred] Remove support for arthur - * [task_panels] Upload panels from the sigils module - * Merge branch 'add-colic' of 'https://github.com/snack0verflow/grimoirelab-sirmordred' - * [doc] Update readme with colic data and fix lexical order - * [readme] Improve doc to get a token for twitter - * [doc] Add sample cocom fields -* ELK - * [schema] Add attribute for multi org names in github_pull_requests.csv - * [schema] Add attribute for multi org names in github_issues.csv - * [schema] Add attribute for multi org names in git.csv - * [enriched-mappings] Update aoc mappings - * [enriched-study-ceres-onion] Support for multiple affiliations - * [tests] Add tests for multi_org_name fields - * [jira] Propagate multiple affiations attributes - * [gerrit] Propagate multiple affiations attributes - * [grimoire_elk] Add support for multiple affiliations - * modified: tests/test_git.py - * [raw-gerrit] Handle long text for data.patchSets.comments.message - * Update github_backlog.csv for a field missing - * [git] Include fields related with sortinghat when it is disabled - * [meetup] Include fields related with sortinghat when it is disabled - * [gitlab] Include fields related with sortinghat when it is disabled - * [github] Include fields related with sortinghat when it is disabled - * [sortinghat] Create enriched fields related to Sortinghat when it is disabled - * [enriched-gitlab] Fix repository value in issue - * [schema] Update field description - * [schema] Add project and project_1 descriptions to jenkins - * [elk] Remove support for arthur - * Update the mattermost.csv to fix a format issue - * [doc] Update readme for secure elasticsearch -* Perceval - * [groupsio] Update log message - * [perceval] Update license and copyright information - * [backend] Add Pagure backend to Perceval - * [perceval] Update license info - * [groupsio] Format from_date with utc+0 timezone - * [doc] Fix broken link in README -* Sigils - * [jenkins] Add index pattern - * Remove date formatting for grimoire_creation_date - * [all_enriched_tickets] Add date format - * [all_enriched] Add grimoire_creation_date format - * [affiliations] Add grimoire_creation_date format - * [github_issues] Update index pattern to include multi org names - * [git_areas_of_code] Update index pattern to include multi org names - * [git] Update index pattern to include multi org names - * [all_onion] Update index pattern to include multi org names - * [all_enriched_tickets] Update index pattern to include multi org names - * [all_enriched] Update index pattern to include multi org names - * [affiliations] Update index pattern to include multi org names - * Update affiliations index pattern - * [jenkins-job-categories] Add Jenkins projects pie chart - * [jenkins-nodes] Add Jenkins projects pie chart - * [jenkins-jobs] Add Jenkins projects pie chart - * [jenkins] Add Jenkins projects pie chart - * [jenkins] Update index pattern - * [twitter] Add link format to author_uuid field - * [stackoverflow] Add link format to author_uuid - * [slack] Add link format to author_uuid field - * [rss] Add link format to author_uuid field - * [redmine] Add link format to author_uuid field - * [meetup] Add link format to author_uuid field - * [mediawiki] Add link format to author_uuid field - * [mbox] Add link format to author_uuid field - * [mattermost] Add link format to author_uuid field - * [maniphest] Add link format to author_uuid field - * [kip] Add link format to author_uuid field - * [jira_resolution_date] Add format to author_uuid - * [jira] Add link format to author_uuid field - * [irc] Add link format to author_uuid field - * [gitlab-mrs] Add link format to author_uuid field - * [gitlab-issues] Add link format to author_uuid - * [github2-prs] Add link format to author_uuid - * [guthub2-issues] Add link format to author_uuid - * [git-aoc] Add link format to author_uuid field - * [gerrit] Add link format to author_uuid field - * [discourse] Add link format to author_uuid field - * [demographics] Add link format to author_uuid - * [confluence] Add link format to author_uuid field - * [bugzilla] Add link format to author_uuid field - * [askbot] Add link format to author_uuid field - * [all_onion] Add link format to author_uuid field - * [all_enriched_tickets] Add format to author_uuid - * [github-issues] Add link format to author_uuid - * [git] Add link format to author_uuid field - -# 0.2.38 - -Released: 2020-02-25 - -* Perceval - * Fixed Typos and Grammatical Errors - * [telegram] Handle edited messages - * Update doc in README - * [github] Update the docstrings - * [twitter] Support for SSL verification - * [telegram] Support for SSL verification - * [stackexchange] Support for SSL verification - * [slack] Support for SSL verification - * [rss] Support for SSL verification - * [launchpad] Support for SSL verification - * [jenkins] Support for SSL verification - * [meetup] Support for SSL verification - * [mediawiki] Support for SSL verification - * [hyperkitty] Support for SSL verification - * [googlehits] Support for SSL verification - * [gitlab] Support for SSL verification - * [dockerhub] Support for SSL verification - * [discourse] Support for SSL verification - * [confluence] Support for SSL verification - * [bugzillarest] Support for SSL verification - * [groupsio] Support for SSL verification - * [github] Support for SSL verification - * [jira] Support for SSL verification - * [mattermost] Support for SSL verification - * [phabricator] Support for SSL verification - * [pipermail] Support for SSL verification - * [mbox] Support for SSL verification - * [redmine] Support for SSL verification - * [bugzilla] Support for SSL verification - * [askbot] Support for SSL verification - * [client] Support for tunable SSL verification - * [backend] Allow to disable SSL verification - * [doc] Update groupsio documentation in README.md - * [groupsio] Fetch messages after a given date -* ELK - * [github2] Fix loading identities - * [github] Fix filter classified in GitHub and GitHub2 enrich - * add schema for backlog studie - * Add additional index to compute the chronological evolution of opened issues and average opened time issues. - * add description in git schema for commit_tags field - * add "tags" field in git enriched index to get the number of releases. - * [schema] Add scheams for docker smells and deps - * [grimoire_elk] Add connectors for docker smells and deps - * [grimoire_elk] Support for Docker smells analysis - * [grimoire_elk] Support for Docker dependencies analysis - * Update README.md - * [tests] Stop loop when finding a target study - * [tests] Move httpretty to requirements_tests - * [github2] Add support for feeling study - * [enriched-enrich] Add enrich_feelings study - * [schema] Add CSV for survival git data - * [dependencies] Add statsmodels dep to setup and requirements - * [enriched-git] Add support for survival study - * [enriched-enrich] Add survival developer study - * [doc] Add documentation to run tests and coverage - * [doc] fix mistake in README.md - * [enriched-telegram] Handle edited message - * [enriched-telegram] Handle missing username in Telegram messages - * [enriched-jira] Handle missing creator/ assignee displayName and name - * [tests] Fix tests for enrich_geolocation - * [raw-bugzillarest] Prevent indexing of clones attribute -* Hatstall - * [hatstall] Fix method editing organization domain - * Update templates location to make the application self-contained - * Update files to create the django-hatstall pip package - * [docs] Update documentation -* Mordred - * [mordred] Add support for backlog analysis study - * [doc] Add instructions to use dockersmells and dockerdeps - * [doc] fix docker-compose file - * Removed faulty parameter from utils/setup.cfg - * [aliases] Fix supybot alias `irc` instead of `supybot` - * [doc] Add instructions to execute the enrich_feelings study - * [config] Add `enrich_feelings` study - * [doc] Add instruction to execute `enrich_forecast_activity` study - * [config] Add support for `enrich_forecast_activity` study - * [sirmordred] Remove doc folder - * [config] Remove write_doc method - * [doc] Add an example of setup.cfg and projects.json for each data source - * [doc] Clarify the behavior of the 'Data Status' and 'Overview' dashboards - * [aliases.json] Remove old github2 aliases - * Add info about labels -* SortingHat - * [tests] Fix `test_not_null_source` in test_model - * [db-model] Remove CoerceToBool type - * Add requirements file -* Graal - * [coqua] Add support for Docker smells analysis - * [tests] Add travis support for Jadolint - * [codep] Add support for Docker dependencies analysis - * [analyzers] Add support for Jadolint - * [graal] Add exec_path as default parameter - * [graal] Use backend name to init default git path -* Sigils - * [docker] Add dashboard for docker smells and dependencies - * [feelings] Add dashboard for github comments, collaboration and feelings - * [org-tracking] Add org tracking dashboard - * Add organization tracking overview documentation - * [doc] Delete hidden documentation pages - * [doc] Update link for mediawiki dashboard - * [sigils] Remove images in docs/assets/images - * [doc] Add info to create a Gemfile in contributing.md - * Update Affiliations documentation - * Uodate all_enriched index pattern - * Update text of Hatstall links from Affiliations - * Fix collaboration dashboards documentation - -# 0.2.37 - -Released: 2020-01-28 - -* ELK - * [enriched-gitlab] Fix repository value in merge - * [travis] Support for python 3.7 - * [requirements] Relaxing pandas constraint - * [enriched-github2] Add support for geolocation study - * [enriched-enrich] Add geolocation study - * [enriched-github2] Remove hardcoded geolocation support - * [enrich-github] Remove dead code - * [enriched-github] Remove hardcoded geolocation support - * [dep] Add geopy dependency - * [enriched-dockerhub] Handle never updated images - * [git-enriched] Remove github commit support - * [elastic] Refactor all_properties method - * [tests] Add tests for elastic.py - * [elastic] Change logic to handle errors when creating a mapping - * [elastic] Initialize `error` variable for `safe_put_bulk` - * [elastic] Improve methods documentation - * [elastic] Rename `_check_instance` method - * [elastic] Replace dateutil call with str_to_datetime - * [elastic] Move logic to create index to new method - * [elastic] Enable loading of complex aliases - * [tests] Fix CI tests for elastic items - * (fix-ci-travisx) [elastic_items] Improve doc and test coverage - * [elk] Replace ElasticConnect, ElasticWriter exceptions with ElasticError - * [errors] Add ElasticError - * Let pandas be >= 0.22.0 - * [utils] Remove track_items script and related methods - * [elk] Remove `get_items_from_uuid` method - * [github2] Update github2 fields - * Fix possible error 2 - * Fix possible error - * Fix flake8 errors - * Add support for releasing scroll and waiting for available scroll (wait configurable amount of time) - * [enriched-colic] Handle missing commit message - * [enriched-cocom] Handle missing commit message - * [schema] Update colic schema - * [schema] Update cocom schema - * [enriched-colic] Handle credentials in origin - * [enriched-cocom] Handle credentials in origin - * [raw-github] Handle immense term for data.reviews_data.body -* Hatstall - * [docker] Download Hatstall code while the container is built -* Mordred - * [doc] Add example for github2 sections - * [travis] Support python 3.7 - * [config] Add support for geolocation study - * [sirmordred] Remove support for github commit - * [aliases] Handle complex aliases - * [doc] Add notes to enable github-comments - * [aliases] Add github2 aliases for issues and pull requests - * [task_panels] Support github-comments dashboard upload - * [config] Add support for github-comments - * [tests] Add test with archives for task_enrich - * [tests] Optimize test for task_collection - * [doc] Complete list of data sources supported - * Made gitlab issues naming consistent -* SortingHat - * [setup] Let pandas be >= 0.22.0 -* Cereslib - * [setup] Reduce constraints on dependencies -* Sigils - * [docs] Add documentation for gerrit approvals dashboard - * [gerrit-approvals] Fix typo in `Approvals by Contributor` - * [docs] Add documentation for gerrit dashboard - * [docs] Update name and image of gerrit review efficiency dashboard - * [docs] Update gerrit review efficiency - * [gerrit] Align nomenclature in Gerrit panels - * Fix schema links - * Fix broken link to github2_issues schema - * [gerrit_approvals] Add total number of approvals - * Add GitHub pull requests collaboration dashboard - * Add GitHub issues collaboration and comments dash - * Update affiliations dashboard - * [colic] Update colic panels - * [cocom] Update cocom panels - * Update Jekyll installation instructions - * Update Kidash installation to mention Python 3 - - -# 0.2.36 - -Released: 2019-01-08 - -* ELK - * [enriched] Remove support geolocation for github enriched indexes - - -# 0.2.35 - -Released: 2019-01-03 - -* ELK - * [raw-bugzillarest] Set text mapping type for thetext attribute -* Graal - * Fix lizard package dependency -* Hatstall - * [hatstall] Support check/uncheck all options in checkbox tables - * [hatstall] Add support for editing organizations and domains -* Kidash - * [setup] Remove ELK dependency - * [kidash/kidash] Remove ELK imports - * [bin/kidash] Remove ELK imports - * [bin/kidash] Remove unused imports -* SortingHat - * [database] Allow SSL connections - - -# 0.2.34 - -Released: 2019-12-19 - -* Perceval - * [jenkins] Log debug message when builds are not found - * [jira] Add info for data obtained with authenticated access - -* Sigils - * Update CONTRIBUTING.md - * [engagement panel] Fix dashboard name - * [colic] Fix dashboard name - * [cocom] Fix dashboard name - * Fix file name to use hypens instead of underscores - * [github_issues] Retitle issues open to issues - * [gitlab_issues] Retitle issues open to issues - * [about] Add mention to CHAOSS project - -* ELK - * [enrich-gitlab] Handle TypeError: 'NoneType' exception - * [utils] Add 429 error to status_force_list - * [enriched-gerrit] Handle missing user info - -* SirMordred - * [docker] Remove track_items info from readme - * [tests] Fix flake8 errors - * Add unit tests for the main methods of healthcheck.py - * Add healthcheck to Docker image with a call to the script 'utils/healthcheck.py' - * Add healthcheck script to installation setup file - * Python healthcheck script added to utils folder - * [task_panels] Include OSPO panels in community menu - -* SortingHat - * [matching-email] Remove `_filter_emails` - * [matching-email] Support blacklist when strict matching is False - * [tests] Remove hard-coded DB params - * [travis] Support for python 3.5 and 3.6 - * [tests] Set mysql `sql_mode` in travis - * [tests] Add mysql service to travis.yml - - -# 0.2.33 - -Released: 2019-11-28 - -* Sigils - * [git] Update index pattern to include hour/weekday fields - * [meetup] Update index pattern to handle group_urlname attribute - * [gerrit] Update painless_delay in index pattern - * [all_enriched] Make URLs clickable - * [demographics] Update screenshot - * [sigils] Add OSPO panel collection - - -* Perceval - * [gitlab] Raise client error if oauth is set and token is not - * [discourse] Pass credentials via headers - * [jenkins] Handle workflow multibranch job builds - * [tests] Fix variable names in github test - * [github] Handle `None` requested reviewers - * [groupsio] Add log message upon download archives failure - * [travis] Support for python 3.5 and 3.6 - * [doc] Add git and build-essential to requirements section - - -* Graal - * [tests] Increase test coverage for codep and colic - * [graal] Fix worktree creation - * [graal] Change logic to create worktree - * [tests] Add base class to handle tests on analyzers - * [tests] Add base class to handle setup of test Git repo - * [graal] Replace git cmd with /usr/bin/git - * [readme] Add SCC description to README.md - * [tests] Add tests for SCC analyzer - * [cocom] Added support of scc analyzer to Code Complexity Backend - - -* KingArthur - * [server] Add reschedule method to the REST API - * [arthur] Allow to re-schedule failed tasks - * [scheduler] Allow to reset task counters - * [scheduler] Handle TaskRegistryError - * [server] Fix docstring for `task` - * [arthur] Handle TaskRegistryError - * [tasks] Raise TaskRegistryError on task operations - * [errors] Add TaskRegistryError - * [tasks] Handle Redis errors - * [arthur] Fix typos and warnings - * [tasks] List tasks based on key prefixes - * [tasks] Convert exception to warning when updating tasks - * [tasks] Replace dangerous redis commands - * [scheduler] Support for reading tasks from redis - * [tasks] Add update operation - * [tasks] Use redis to store tasks - * [scheduler] Reschedule failed tasks into the retry queue - * [travis] Support for python 3.5 and 3.6 - * [tasks] Add JobData tuple to store jobs in the task job list - * [server] Return job_number from the metadata of the Job - * [scheduler] Save job_number in the meta field of the job enqueued - - -* Grimoire ELK - * [github2] Add schema for new version of pull index - * [github2] Add schema for new version of issue index - * [enriched-github2] New enricher to handle comments and reactions - * [enriched-git] Handle missing local git repo - * [travis.yml] Support for tests using ODFE - * [studies-aoc] Support for ODFE - * [studies-onion] Support for ODFE - * [enriched] Update bulk endpoint to support ODFE - * [enriched-enrich] Update bulk endpoint for ODFE - * [enriched-ceres_base] Add class variable for ES major version - * [elastic_items] Handle ODFE page info on pagination - * [elastic] Update bulk and mapping endpoints for ODFE - * [enriched-gerrit] Handle missing reviewer info - * [raw-elastic] Change to 'format()' in the logs - * [elk] Change to 'format()' in the logs - * [elastic_items] Change to 'format()' in the logs - * [elastic] Change to 'format()' in the logs - * [enriched-study_ceres_onion] Change to 'format()' in the logs - * [enriched-study_ceres_aoc] Change to 'format()' in the logs - * [enriched-stackexchange] Change to 'format()' in the logs - * [enriched-sortinghat_gelk] Change to 'format()' in the logs - * [enriched-remo] Change to 'format()' in the logs - * [enriched-mozillaclub] Change to 'format()' in the logs - * [enriched-meetup] Change to 'format()' in the logs - * [enriched-mediawiki] Change to 'format()' in the logs - * [enriched-mbox_study_kip] Change to 'format()' in the logs - * [enriched-mbox] Change to 'format()' in the logs - * [enriched-kitsune] Change to 'format()' in the logs - * [enriched-jira] Change to 'format()' in the logs - * [enriched-jenkins] Change to 'format()' in the logs - * [enriched-gitlab] Change to 'format()' in the logs - * [enriched-enrich] Change to 'format()' in the logs - * [enriched-ceres_base] Change to 'format()' in the logs - * [enriched-askbot] Change to 'format()' in the logs - * [enriched-git] Change to 'format()' in the logs - * [enriched-gerrit] Change to 'format()' in the logs - * [enriched-functest] Change to 'format()' in the logs - * [enriched-dockerhub] Change to 'format()' in the logs - * [enriched-discourse] Change to 'format()' in the logs - * [enriched-bugzillarest] Change to 'format()' in the logs - * [enriched-bugzilla] Change to 'format()' in the logs - * [enriched-colic] Change to 'format()' in the logs - * [enriched-cocom] Change to 'format()' in the logs - * [enriched-github] Change to 'format()' in the logs - * [enriched] Return empty item_sh when sortinghat is not set - * [enriched-meetup] Fix typo in group url name - * [dependencies] Update redis to 3.0.0 - * [enriched-bugzillarest] Handle missing user info - * [travis] Support for python 3.5 and 3.6 - * [elastic_items] Remove white spaces from repo url with labels - - -* SirMordred - * [sirmordred] Remove unused modules and change to 'format()' in the logs - * [sirmordred] Delete support to log rotation - * [doc] Remove eclipse load support for doc - * [sirmordred] Delete support to load eclipse projects - * [mordred] Decommission bot names params from setup.cfg - * [sortinghat] Fix issue when sortinghat is not in the config file - * [travis] Support for python 3.5 and 3.6 - - -* Cereslib - * [events-events] Handle empty sortinghat dict - * [README] Add travis and coveralls badges - * [setup.cfg] Ignore W605 error - * [install] Align dependencies in requirements and setup - * [setup.cfg] Ignore W504 error - * [setup] Remove scripts param - * [cereslib] Remove import from __init__.py - * [enrich] Fix flake8 errors - * [dfutils] Fix flake8 errors - * [tests] Add travis CI - - -* Toolkit - * [datetime] Handle dates with offsets outside 24h - * [travis] Support for python 3.5 and 3.6 - - -# 0.2.32 - -Released: 2019-10-28 - -* Sigils - * [docs] Update demographics.png - * [git-demographics] Change column name - * [demographics] Change column name - * [demographics] Change title `demographics_people_leaving_community` - * [git-demographics] Change title `git_demographics_people_living_community` - -* Perceval - * [github] Make fetching owners information from GitHub API optional - * [backend] Manage filtering of classified data within lists - * [github] Replace logging with logger call - * [test_backend] Provide test for find_backends - -* KingArthur - * [scheduler] Remove 'arthur' prefix and task id from job ids schema - * [setup] Update dependencies - * [jobs] Add human readable job identifier - * [arthurd] Add ignoring log-path msg when no-daemon is on - * [arthurd] Send log messages to stderr when --no-daemon is on - * [arthur] Remove 'bin/arthur' script - * [test_server] Add test of the job server endpoint - * [server] Expose jobs by job_id to the CherryPy server - * [requirements] Update package requirements - * [jobs] Replace job result object by Perceval summary - * [jobs] Refactor 'metadata' decorator - * [jobs] Generate items using BackendItemsGenerator - * [scheduler] Reschedule failed tasks with resuming - * [jobs] Remove jobs resuming support - * [tasks] Add has_resuming() method to task - * [test_worker] Add tests related to the job log storage - * [jobs] Store logs of each job in their "meta" field - -* HatStall - * Improve login form using Bootstrap style - -* Grimoire ELK - * [elastic_items] Fix message when scroll_size is 0 - * [tests] Add test for `enrich_extra_data` - * [enriched-github] Handle missing user information - * [enriched-enrich] Fix conversion projects.json to map - * [enriched-github] Removed not needed code. Added the missing sign off - * [enriched-git] Enable extra study - * [enrich] Add extra study - * [enrich] Adding new study to enable adding extra fields to a target index - * [travis] Support tests for python 3.5 and 3.6 - * [studies] Improve log messages - * [tests] Fix test enrich items discourse - * [enriched-discourse] Remove `__show_categories_tree` method - * [elk] Remove support for filter-raw-prefix - * [tests] Align tests to filter-raw-prefix removal - * [elastic-items] Remove support for `filter-raw-prefix` - * [p2o] Remove support for filter-raw-prefix - * [enriched-git] Handle empty repository errors - * [elk] Improve log messages - * [elastic_items] Change log level message - * [elastic] Compact log messages - * [raw-elastic] Improve log messages - * [enriched-utils] Change `min_enrich` value - * [tests] Increase test coverage for raw jenkins - * [tests] Increase test coverage for raw twitter - * [tests] Increase test coverage for raw supybot - * [tests] Increase test coverage for raw stackexchange - * [tests] Increase test coverage for raw nntp - * [tests] Increase test coverage for raw meetup - * [tests] Increase test coverage for raw mediawiki - * [tests] Increase test coverage for raw mbox - * [tests] Increase test coverage for raw mattermost - * [enriched-jira] Handle missing `fields` attribute - * [tests] Increase test coverage for raw github - * [tests] Increase test coverage for raw graal - * [tests] Increase test coverage for raw git - * [tests] Increase test coverage for raw functest - * [tests] Add test case for errors class - * [tests] Increase test coverage for raw dockerhub - * [tests] Increase test coverage for raw crates - * [enriched-discourse] Handle missing author information - * [raw-jenkins] Handle multiple params on repo url - * [grimoire_elk] Goodbye track_items.py - * Add minor changes to the README file. - * remove the dashboards folder - -* SirMordred - * [task_identities] Call sh affiliate after loading identities file - * [task_identities] Call sh unify after loading identites file - * [travis] Support tests for python 3.5 and 3.6 - * [tests] Add tests for enrich_extra_data study - * [doc] Improve desc projects_url - * [config] Add external study - * [studies] Improve log messages - * [task_enrich] Remove support for filter-raw-prefix - * [task] Remove support for filter-raw-prefix - * [task_manager] Conver INFO messages to DEBUG - * [task_enrich] Standardize refresh identities log messages - * [sirmordred] Improve log messages related to task projects - * [mordred] Ignore INFO messages from elasticsearch - * [task_enrich] Change `last_enrich_date` value - * [dependencies] Remove manuscripts dependency - * [doc] Remove reference to `task_report` - * [mordred] Remove `task_report` - * [task_project] Prevent random shuffling of repos - * [doc] Remove reference to `track_items` - * [mordred] Remove `track_items` support - * [doc] Update kibiter version to 6.1.4-5 - * [tests] Minor enhancements on tests - * [sirmordred] Set default sleep_for value if sortinghat is undefined - * [task_identities] Remove useless inherited code - * [task_enrich] Prevent calling sortinghat when not defined - * [task] Handle missing sortinghat params - * [doc] Refine README.md introduction - - -# 0.2.31 - -Released: 2019-10-01 - -* Grimoire ELK - * [doc] Improve README.md info - * [enriched-gitlab] Include milestone id, iid and url - * Add graal to setup.py, which is now a dependency. - * [enriched-git] Add weekday and hour info to enriched commits - -* Perceval - * [gitlab] Set extra HTTP retry status from backend - * [jenkins] Handle skipped items info in summary - * [gitlab] Handle skipped items info in summary - * [gitlab] Use generic blacklist feature - * [jenkins] Replace blacklist-reviews with blacklist-ids - * [gerrit] Replace blacklist-reviews with blacklist-ids - * [backend] Add support for blacklisting items - * [errors] Add BackendCommandArgumentParserError - * [backend] Add origin unique field - * [backend] Change signature BackendCommandArgumentParser - -* Perceval-mozilla, Perceval-puppet, Perceval-opnfv, Perceval-finos - * [backend] Change signature BackendCommandArgumentParser - -* Sigils - * [gitlab] Update index pattern for merge requests - * [gitlab] Update index pattern for issues - -* Graal - * [graal] Update metadata fields - * [backend] Change signature BackendCommandArgumentParser - -* Manuscripts - * [manuscript] Fix flake8 errors - * [setup.cfg] Ignore W605 errors - * Added first line to make these files executable. - * [manuscripts] Update license and copyright info - * [setup] Fix format type for long description of package - -* SirMordred - * [README.md] Add projects.json section - * [utils] Comment arthur params in es-collection section - * [task_collection] Add filter-no-collection to ignore the collection - * [task_identities] Log number of organizations loaded - * [task_identities] Support lazy load of SH identities files - * [task_identities] Support lazy load of SH organizations - * [task_identities] Add `get_file_hash` function - -# 0.2.30 - -Released: 2019-09-18 - -* Grimoire ELK - * [tests] Fix demography test for gerrit - * [enriched-gerrit] Handle missing user information - * [enriched-onion] Filter bots from onion study - * fix num row error that GitHub complained about - * [enriched-aoc] Include origin in AOC items -* Perceval - * [backend] Add search fields in metadata items - * [backend] Write summary of results to the backend command log - * [backend] Fix typos in backend module documentation - * [tests] Generate different 'updated_on' values for backend tests - * [backend] Organize BackendItemsGenerator parameters - * [backend] Add BackendItemsGenerator context manager - * [backend] Include summary of fetch executions - * [perceval] Add summary class -* Sigils - * [demographics] Rename demographics_leaving_developers - * [meetup] Update index pattern -* SirMordred - * [task_panels] Add contact link inside the About item of the menu - * [task_projects] Remove projects_last_diff - * [doc] Update README.md with graal-related panels attributes - * [utils] Update conf files to use graal backends - - -# 0.2.29 - -Released: 2019-09-02 - -* Grimoire ELK - * [tests] Remove reference to ocean-unique-id - * [schema] Remove ocean-unique-id - * [raw-askbot] Remove fix_item - * [tests] Add main to test_load_identities - * [jenkins] Remove ocean-unique-id frmo schema - * [Jenkins] Update CSV schema for Jenkins -* Perceval - * [groupsio] Replace HTTP basic auth with cookies based auth (hace 52 minutos) - * [slack] Pass API token via headers - - -# 0.2.28 - -Released: 2019-08-29 - -* Grimoire ELK - * [enriched-git] Remove credentials from Git URLs - * [enriched-mediawiki] Remove identity/project info in get_rich_item - * [enriched-gerrit] Add status of gerrit changeset - * [enriched-gerrit] Handle negative time to first review - * [enriched-gerrit] Add time to first review patchsets - * [enriched-gerrit] Add time to first review - * [schema] Add mattermost schema - * [mattermost-enriched] Remove commented code - * [mattermost-enrich] Add channel name and creation date - * [logger] Add logs for study and Fix CoLic query - * [colic] Add category reference implementation and corresponding tests - * [tests:study] Add tests for CoCom & CoLic study implementation - * [schema] Add CoCom and CoLic schema - * [graal:tests] Add appropriate tests for Graal integration (WIP) - * [graal] Add connector for Graal Backends and Segregate common methods - * [graal] Add CoCom & CoLic enricher along with study implementation - * [requirements.txt] Add Graal module dependency for integration - * [dependencies] Update pandas dependency to 0.22.0 - * [meetup] Store `group_created` as date - * Fix outdated link to GrimoireLab tutorial - * [schema] Add time_to_first_attention to github_issues.csv -* Graal - * [graal] Force checkout command - * [colic] Filter softlinks from analysis - * [colic] Filter dir paths from analysis - * [analyzer] Add `diff_timeout` param to cloc analyzer - * [analyzers] Suppress deprecation warning lizard.analyze_file - * [docs] Update CoLic definition under documentation adn docstrings - * [colic] Add copyright flag for extraction of copyright information - * [cloc] Fix cloc error due to mulitple word language-name - * [graal] Update license info - * [setup] Fix format type for long description of package - * [tests] Fix test_init in test_graal - * [analyzer] Fix scancode_cli results - * [docs] Update documentation and links to requirements - * [cocom] Add repository level analysis via lizard - * [analyzer] Fix results for deleted files and alter tests - * [logger] Switch `info` logger level to `debug` - * [tests] Add test for deriving `git_path` from `uri` - * [graal] Derive `git_path` from `uri` -* KingArthur - * Update to RQ 1.0 -* Perceval - * [meetup] Pass oauth2 token via headers - * [tests] Increase test coverage mattermost - * [mattermost] Add channel info - * [github] Add example to initialize backend from code - * [tests] Fix metadata_updated_on of MockedBackend - * [dependency] Unpin httpretty dependency - * [doc] Remove httpretty details from Running tests section -* Sigils - * [gerrit_timing] Add time to first review info - * [gerrit] Update index pattern - * [mattermost] Add channel visualization - * [docs] Add CoCom & CoLic documentation - * [graal] Add Code License(CoLic) panels - * [graal] Add Code Complexity(CoCom) panels -* SirMordred - * [mordred] Update redis dependency - * [doc] Add section to set up dev env with Pycharm - * [doc] Update doc getting started - * [requirements] Add Graal module to requirements.txt - * [graal] Add configuration for Graal integration in ELK - * [tests] Add gerrit and its study sections - * [doc] Improve doc about `github-repos` param in panels section - * [doc] State Elasticsearch, Kibiter, MySQL/MariaDB versions - * [tests] Clean requirements.txt - * [setup] Remove dependencies installed by other components - * [tests] Clean travis.yml - - -# 0.2.27 - -Released: 2019-07-23 - -* Grimoire ELK - * [enriched-enrich] Handle errors in demography study - * [schema] Update Jira csv - * [enriched-jira] Track creator, assignee, reporter in issues - * [enriched-jira] Handle missing identity data - * [enriched-github] Set roles to allow refresh identities -* KingArthur - * [writers] Ignore Elasticsearch certificate verification - * [scheduler] Schedule task jobs in user-defined queues - * [tasks] Add queue parameter to scheduler config - * [scheduler] Set to completed tasks with expired lifetime - * [tasks] Add task lifetime attribute - * [tests] Fix server tests with non-real repositories - * [server] Publish task information - * [tasks] Use datetime_utcnow() when creating tasks - * [jobs] Add funtion to convert job results to dicts - * [scheduler] Set infinite time-to-live for jobs and results - * [scheduler] Update task jobs list when a job is enqueued - * [tasks] Add attribute to Task to store its list of jobs - * [scheduler] Handle starting job events - * [events] Add task identifier to job event class - * [events] Add event to notify when a job starts - * [events] Remove handlers initialization in JobEventsListener - * [scheduler] Refactor event handlers - * [writers] Update dynamic templates - * Install Arthur using pip in TravisCI - * [scheduler] Rename task scheduler public methods - * [scheduler] Delegate queue selection to the task scheduler - * [scheduler] Refactor private class JobScheduler in a TaskScheduler - * [scheduler] Update tasks status during its life cycle - * [tasks] Define task life cycle - * [events] Allow job events subscription - * [events] Add basic job events - * [events] Extract job listener to create a job events listener - * [README] Fix coveralls badge - * Update for rq async parameter rename, pin rq to 0.12.0 -* Perceval - * [gitlab] Recalculate outdated list of merge requests - * [slack] Handle `num_members` for archived channels - * [jenkins] Support authenticated access using user/API token - * [client] Add `auth` param to fetch method -* Sigils - * [affiliations] Udate index pattern - * [jira] Update panels to new index structure - * Update index patterns to add analyzed fields - * [meetup] Update index pattern to fix dates -* SortingHat - * [setup] Set pandas dep version to 0.22.0 - * [sortinghat] Update copyright info - * [setup] Pin pandas dependency - - -# 0.2.26 - -Released: 2019-07-08 - -* Grimoire ELK - * [mediawiki] Fix grimoire_creation_date calculation - * removed .DS_Store - * Added check so that program does not break if aliases is None - * [raw-bugzillarest] Set text mapping type for changes attributes - * [elk] Add option to fetch from selected branches - * [elk] Return error msg from `feed_backend` - * [elastic] Use InvalidDateError in `get_last_item_field` - * [ELK] Make explicit indexing when mapping is of text type - * [enriched-redmine] Use grimoirelab-toolkit datetime functions - * [enriched-redmine] Add text mapping - * [enriched-mozillaclub] Add text mapping - * [enriched-mediawiki] Use grimoirelab-toolkit datetime functions - * [enriched-mediawiki] Add text mapping - * [enriched-jira] Add text mapping - * [enriched-gerrit] Add text mapping - * [enriched-discourse] Add text mapping - * [enriched-bugzillarest] Use grimoirelab-toolkit datetime functions - * [enriched-bugzillarest] Add text mapping - * [enriched-bugzilla] Use grimoirelab-toolkit datetime functions - * [enriched-bugzilla] Add text mapping - * [elk] Use grimoirelab-toolkit datetime functions - * [enriched-utils] Remove function `unixtime_to_datetime` - * Update description of time_open_days and time_to_close_days - * [enriched-meetup] Store created, time, updated as date - * [ELK] Update variable from KEYWORD_MAX_SIZE to KEYWORD_MAX_LENGTH - * [enriched-enrich] Decrease max keyword size -* Perceval - * [git] Add proxy support to git clone command - * [mediawiki] Skip page without `pageid` attribute - * [gitlab] Update description for --is-oauth-token - * [meetup] Enable oauth token use -* Sigils - * [twitter] Add bots filter to panel - * [stackoverflow] Add bots filter to panel - * [slack] Add bots filter to the panel - * [rss] Add bots filter to panel - * [mozilla-reps] Add bots filter to panels - * [redmine] Add bots filter to redmine panels - * [mozillaclub] Add bots filter to panel - * [meetup] Add bots filter to Meetup panels - * [mediawiki] Add bots filter to panel - * [mbox] Add bots filter to mailing lists panel - * [maniphest] Add bots filter to panels - * [chaoss-gmd] Add bots filter to panels - * [git] Add bots filter to lifecycle panel - * [jira] Add bots filter to Jira panels - * [irc] Add bots filter - * [gitlab] Add bots filter to Issues and MRs panels - * [github] Add bots filter to Issues and PRs panels - * [git] Add bots filter to Git demographics panel - * [gerrit] Add bots filter and fix backlog panel - * [discourse] Add bots filter to panel - * [demographics] Add bots filter to panel - * [confluence] Add bots filter to panel - * [bugzilla] Add bots filter to bugzilla panels - * [askbot] Add bots filter to panel - * Set the right screenshot - * [affiliations] Fix label affiliations_authors_organizations chart -* SirMordred - * [tests] Add mysql service to .travis.yml - * [tests] Update slack archive - * [task_collection] Return errors info for task collection - - -# 0.2.25 - -Released: 2019-06-23 - -* Grimoire ELK - * [raw-jira] Handle data.fields.environment in raw indexes -* Perceval - * [README] Add info to obtain a Groups.io API token - * [groupsio] Improve documentation to obtain an API token - * [groupsio] Fix description `api_token` - * [groupsio] Fix invalid value for 'limit' in subscriptions query -* Sigils - * Add how to import panel into Kibana/Kibiter - * [gerrit] Update index pattern -* SirMordred - * [task_enrich] Populate identities index only when retetion is on - - -# 0.2.24 - -Released: 2019-06-07 - -* Grimoire ELK - * [raw-bugzillarest] Handle description longer than 32766 chars - * [raw-slack] Fix illegal_argument_exception for data.blocks.elements.text - * [enriched-enrich] Reduce number of log messages on identity retrieval -* SirMordred - * Fix README.md so that the package is admitted by pypi - - -# 0.2.22 - -Released: 2019-05-31 - -* Graal - * Added to GrimoireLab release -* Grimoire ELK - * [tests] Update elasticsearch and elasticsearchdsl versions - * [dependencies] Update urllib3 and requests dependencies - * [enriched] Use RequestsHttpConnection in Elasticsearch objs - * [dependencies] Pin urllib3 and requests dependencies - * [schema] Add `repository_labels` attribute - * [enriched] Add repo labels support to enrichers - * [elk] Add repo_labels param - * [elastic_items] Extract repository labels from projects.json - * [enriched-github] Filter review comments from ghost users - * [schema] Specify where each author field come from - * [schema] Add CSV documenting Github PRs index - * [enriched-confluence] Add email data to SH identity -* Perceval - * [gitlab] Force UTF-8 encoding on response contents -* SirMordred - * [task_enrich] Add log INFO messages - * [task_enrich] Fix elasticsearch.exceptions.SSLError: ConnectionError - * [task_enrich] Add support for repository labeling - * [task_collection] Add support for repository labeling - * [task] Add support for repository labeling - * [utils] Add example of grimoirelab identities file - * [utils-micro] Add support to load identities in micro - * [micro] Fix logging configuration at module scope -* SortingHat - * [parsing:grimoirelab] Add support to parse a blacklist - * Update languages and typos in the README - - -# 0.2.21 - -Released: 2019-05-20 - -* Grimoire ELK - * [enriched-gerrit] Enable refresh identities - * [enriched-gerrit] Add ELK metadata to enriched items - * [raw-slack] Remove channel_info.previous_names attribute - * [enriched-jira] Handle enriched items from multiple jiras -* Perceval - * [slack] Handle timestamps with more than 6 decimals - * [gitlab] Add support for Gitlab Oauth tokens - * [github] Handle pull request reviewers in Enterprise API - - -# 0.2.20 - -Released: 2019-05-13 - -* Grimoire ELK - * [enriched-git] Add log info to enrich_git_branches - * [schema] Add milestone start and due dates to gitlab schemas - * [enriched-gitlab] Add milestone start and due dates - * [enriched-mediawiki] Add `grimoire_creation_date` field - * [enriched-gerrit] Handle gerrit items from multiple servers -* Kidash - * Add viz title to data source removal checks -* Perceval - * [github] Set number of issues/pull requests fetched per page - * [gitlab] Handle missing attr `last` in pagination response -* Sigils - * [gitlab-merge-requests] Update index pattern - * [gitlab-issues] Update index pattern - * [overview] Update mediawiki panels in overview - * [mediawiki] Use grimoire_creation_date in panel and search - * [overview] Use `grimoire_creation_date` in overview panel - * [github] Use grimoire_creation_date in issue panels - * [github] Use grimoire_creation_date in pull request panels - * [Redmine] Update time field - * [gitlab] Update timelion charts in efficiency panel for issues - * [gitlab] Rename index pattern for issues - * [jira] Use grimoire_creation_date -* SirMordred - * [alias] Remove gitlab alias - * [requirements] Fix elasticsearch dependency versions - * [tests] Fix assertion in test_config - * [tests] Update archives for github pulls and issues - * [aliases.json] Rename alias for gitlab issues - - -# 0.2.19 - -Released: 2019-05-06 - -* Grimoire ELK - * [schema] Update gerrit.csv - * [enriched-gerrit] Add type attribute to changeset items - * [enriched-gerrit] Rename `number` attribute to `changeset_number` - * [enriched-gerrit] Add changeset author info to enriched items - * [enrich-gerrit] Add common field to count review-related items - * [enriched-gerrit] Update attribute names (hace 3 días) - * [tests] Enhance test for gerrit enriched items - * [enriched-gerrit] Add patchset approvals as enriched items - * [enriched-gerrit] Add patchsets as enriched items - * [enriched-gerrit] Add comments as enriched items - * [enriched-git] Add study to process git branches - * [enriched-discourse] Force type of score attribute to float - * [schema] Update functest schema with `duration_from_api` attribute - * [tests] Check duration assessment for functest enriched items - * [enriched-functest] Change duration assessment - * [tests] Update tests for functest enriched items - * [enriched-functest] Handle no float duration times - * [enriched-study-ceres-aoc] Limit search size to 500 -* Perceval - * [github] Include reviews in pull request data -* Sigils - * [gerrit] Add panel with approvals - * [gerrit] Update panels to support the new index - * [functest] Update index pattern - * [Maniphest] Update time field -* SirMordred - * [menu.yml] Add gerrit approvals panel - * [tests] Include enrich_git_branches to test_studies.cfg - * [config] Add study to process git branches - - -# 0.2.18 - -Released: 2019-04-26 - -* Grimoire ELK - * [requirements.txt] Constrain elasticsearch-related dependencies - * [setup.py] Constrain elasticsearch-related dependencies -* Perceval - * [backend] Add backend-specific options for --category in helptext -* Perceval FINOS - * [finosmeetings] Update argument parser to display categories in help message - * Update Perceval requirement to 0.12.12 or later -* Perceval Mozilla - * Update Perceval requirement to 0.12.12 or later - * [backends] Include available category options in the helptext -* Perceval OPNFV - * Update Perceval requirement to 0.12.12 or later - * [setup.py] Minor update to avoid flake8 error - * [functest] Include available category options in the helptext -* Perceval Puppet - * Update Perceval requirement to 0.12.12 or later - * [setup.py] Minor update to avoid flake8 error - * [puppetforge] Include available category options in the helptext - - -# 0.2.17 - -Released: 2019-04-22 - -* Grimoire ELK - * [aoc] Update write method to upload smaller lists - * [enriched-bugzillarest] Change logic to calculate `timeopen_days` - * [enriched] Add metadata filter raw to enriched items - * [elk] Use filter raw info to assess last enrich date - * [enriched-enrich] Add `metadata_filter_raw` method - * [enriched-utils] Add filter raw text to retrive last enrich date - * [enriched-utils] Fix last enrich date calculation -* Perceval - * [doc] Update help messages for "from-date" and "to-date" params -* Sigils - * Update Jira panel documentation - * Update Jira panels to support index with comments - - -# 0.2.16 - -Released: 2019-04-11 - -* Grimoire ELK - * [raw-jira] Update raw mapping to avoid immense term errors - * [enriched-enrich] Refactor `find_item_project` method - * [elk] Set value of `projects_json_repo` during enrichment - * [elk] Set value of `projects_json_repo` during collection - * [elastic_items] Add method `set_projects_json_repo` - * [elastic] Check presence of `properties` in mappings - * [enriched-jira] Add comments to enriched index - * [elastic_items] Handle commas in filter-raw - * [enriched-gerrit] Use grimoirelab-toolkit calls - * [elk] Handle empty sh uuid attributes - * [enriched-git] Fix handling rev-list command error - * Update row with missing aggregatable value -* Perceval - * [tests] Increase test coverage of Jira backend - * [jira] Add comments in issues - * [github] Handle ghost user in pull request comment - * [doc] Update documentation for github and gitlab backends -* SirMordred - * [tests] Update jira archive - * [task_enrich] Pass projects.json repo url to ELK - * [task_collection] Pass projects.json repo url to ELK - - -# 0.2.15 - -Released: 2019-04-03 - -* Grimoire ELK - * [enrich-meetup] Avoid failures when 'rsvps' field is not available - * [enrich-git] Handle rev-list command failures - * [enriched] Fix missing ancestor title in confluence enriched items - * [elk] A * dd methods to delete identities - * [sortinghat_gelk] Add method `unique_identities` - * [sortinghat_gelk] Add method `remove_identity` - * [elk] Fix docstring in `do_studies` method - * [enriched] Add function `get_diff_current_date` to utils - * [utils] Add param mapping to `get_elastic` - * [sortinghat_gelk] Add method to remove unique identities - * [elk] Retain identities based on identities index data - * [elk] Store identities in use in dedicated index - * [elastic] Refactor method `delete_items` -* Perceval - * [meetup] Add 'rsvp', 'venue', and 'event_hosts' as classified fields - * [update] Remove unused imports -* Perceval Mozilla - * Update Perceval dependency to 0.12.8 - * [remo] Add 'filter_classified' parameter to metadata() - * [kitsune] Add 'filter_classified' parameter to metadata() -* SirMordred - * [doc] Fix missing --cfg param for micro mordred example - * [task_enrich] Support retain identities - * [config] Add method `get_active_data_sources` - * [sirmordred] Replace `retention_hours` with `retention_time` - * YAMLLoadWarning solved - - -# 0.2.14 - -Released: 2019-03-27 - -* Grimoire ELK - * [tests] Update finosmeetings test data -* Perceval FINOS - * [finosmeetings] Handle cm_type column - * [doc] Fix typo in README installation section -* Sigils - * [docs] Fix broken links in docs - * [jira] Add documentation about Jira panel - * [jira] Fix mislabeled "Submitters by Organization" pie visualization - * [github] Add repositories popularity panel - * Update demographics help markdown - - -# 0.2.13 - -Released: 2019-03-27 - -* Grimoire ELK - * [finosmeetings] Change project value to cm_title - - -# 0.2.12 - -Released: 2019-03-26 - -* Grimoire ELK - * [meetup-enriched] Prevent to access filter-classified attributes - * [elk] Handle filter-classified param - * [enriched] Set project name to cm_program for finosmeetings enrich - * [enriched] Add sortinghat identities info to finosmeetings - * [enrich] Prevent timeout when using ElasticSearch DSL - * [enriched] Fix `Too many dynamic script compilations` in git enrich - * [jira] Handle missing fields during the enrichment - * [jira] Handle multiple type values in `release` attribute during enrichment - * [stackexchange] Handle missing `answer_tags` - * [enriched] Apply retry mechanism HTTP 504 errors -* Perceval - * [tests] Increase test coverage for confluence backend - * [confluence] Fix typo in in-line comment - * [confluence] Skip contents if 'when' attribute is missing - * [meetup] Add 'group.topics' to the list of classified fields - * [backend] Allow to filter classified fields from the command line - * [backend] Add 'filter-classified' option to the backend argument parser - * [backend] Add 'filter_classified' parameter to fetch() function - * [backend] Support filtering of classified fields in Backend class - * [git] Fix `rev-list` call with `--max-count` - * [doc] Update docstring for `sleep_time` param - * [discourse] Add params `sleep_time` and ` max_retries` - * [discourse] Add tests for sleep_time and max_retries params - * [discourse] Complete raise statements in test code - * [discourse] Remove redundant parenthesis in test methods - * [github] Add support for GitHub tokens pool -* SirMordred - * [utils] Update setup.cfg and projects.json of micro-mordred - * [task_panels] Order dashboards by name - * [doc] Update documention for panels section - * [menu.yml] Add export panel to Jenkins - * [task_panels] Upload github repos panels - * [tests] Update aliases.json in tests folder - * [config] Add param to upload github-repo panels - * [aliases] Add raw and enrich aliases for github:repo -* Sortinghat - * [parsing] Fix YAMLLoadWarning for grimoirelab parser - - -# 0.2.11 - -Released: 2019-03-21 - -* Grimoire ELK - * [tests] Update finosmeetrings backend test to the new schema -* Perceval FINOS - * [finosmeetings] Rename activity and program fields -* SirMordred - * [task_projects] Prevent enrich unknown projects when declared also in other projects - - -# 0.2.10 - -Released: 2019-03-20 - -* Grimoire ELK - * [utils] Change assessment of last enrich date - - -# 0.2.9 - -Released: 2019-03-19 - -* Grimoire ELK - * [enrich-github] Add url field to enriched repository items - * [utils] Use `last_enrich_date` for incremental enrichment - * [elk] Add `last_enrich_date` to enrich_backend method - * [elastic_items] Add set_from_date method - * [schema] Add demography fields to Git -* SirMordred - * [task_enrich] Pass the last timestamp of the index before enrichment - - -# 0.2.8 - -Released: 2019-03-15 - -* Grimoire ELK - * [enrich] Change mappings to convert `date` field to keyword - * [raw] Change mappings to convert `date` field to keyword - * [ELK] Rename finos_meetings to finosmeetings - * [tests] Add tests for finosmeetings - * [enrich] Add connector for finosmeetings - * [raw] Add connector for finosmeetings - * [utils] Add connector for finosmeetings Perceval backend - * [setup] Add perceval-finos to install_requires list - * [requirements] Add perceval-finos to requirements.txt -* Perceval FINOS - * [finosmeetings] Fix docstrings and flake8 - * [finosmeetings] Change UUID calculation - * [finosmeetings] Add `date_iso_format` attribute - * [finosmeeting] Add backend to index FINOS meetings attendance - * Fix typo in FINOS name (hace 2 días) - * Initial import -* SirMordred - * [doc] Add section getting started in README.md - * [aliases] Add aliases for raw and enrich finosmeetings indexes - * [requirements] Add perceval-finos to requirements.txt - - -# 0.2.7 - -Released: 2019-03-12 - -* Grimoire ELK - * [utils] Add missing header to run scripts as Python scripts - * [enriched] Update `get_project_repository` for bugzilla enricher - * [enrich] Assign default project name to repos in unknown section - * [enriched] Remove `get_item_project` for bugzillarest enricher - * [elk] Add filter raw info to enrich backend -* SirMordred - * [tests] Add tests for `get_repos_by_backend_section` in TaskProjects - * [task_projects] Refactor `get_repos_by_backend_section` - - -# 0.2.6 - -Released: 2019-03-11 - -* Grimoire ELK - * [enrich] Add onion study to gerrit - * [p2o] Add None value for param `cfg_section_name` to p2o - * [enrich-confluence] Add ancestors data to enriched items - * [enriched] Add refresh param to update_by_query and delete_by_query - * [elk] Apply data retention policy to study indexes - * [utils] Set default value for variable analyzers - * [elastic] Add method `delete_items` - * [elk] Remove filter-raw-* for enrich backend - * [enriched] Handle hidden editors in mediawiki revisions - * [raw] Prevent mapping of data.ancestors.extensions for confluence raw items - * [elastic_items] Support for filter-raw-prefix - * [enrich] Remove raw filters when getting last enriched item - * [elk] Remove logic to create filters - * [elastic_items] Support filter on multiple attributes - * [raw] Remove `get_p2o_params_from_url` from Jira raw connector - * [raw] Remove `get_p2o_params_from_url` from Confluence raw connector - * [raw] Remove `get_p2o_params_from_url` from Bugzilla raw connector - * [raw] Remove `get_p2o_params_from_url` from Askbot raw connector - * [raw] Remove `get_p2o_params_from_url` from Gerrit raw connector - * [raw] Remove `get_p2o_params_from_url` from Git raw connector - * [tests] Add tests for `get_p2o_params_from_url` method - * [raw] Parse filters passed in the projects.json entries - * [enriched] Handle 502 and 503 errors - * [schema] Update jira.csv - * [enrich] Add updated field to Jira items - * [schema] Update gerrit.csv - * [enrich] Add last_updated and created_on to gerrit items - * [enrich] Add retry on status forcelist to ES connector - * [enrich] Update branch info in git commits - * [tests] Add tests for parsing projects.json in Jira raw connector - * [raw] Handle filter raw for jira - * [raw] Handle filter raw for confluence - * [schema] Add schema for GitHub repo data - * [enrich] Support enrichment of GitHub repo data - * [enrich] Handle Perceval errors on Git repo when updating items - * Revert "[enrich] Update Git references data in raw and enriched indexes" - * Revert "[schema] Update Git schema to include refs info" - * [schema] Update Git schema to include refs info - * [enrich] Update Git references data in raw and enriched indexes - * [utils] Move p2o description to main - * [utils] Move index_mapping description to main - * [utils] Move gh2k description to main - * [utils] Move gh2arthur description to main - * [utils] Move get_git_repos description to main - * [utils] Move gelk_mapping description to main - * [utils] Move gelk description to main - * [utils] Move e2k description to main - * [ELK] Update license info - * [tests] Update tests for mbox-related enrichers - * [schema] Update mbox csv - * [enrich] Add mbox_author_domain to mbox data -* Perceval - * [confluence] Extend Perceval Confluence backend to index ancestor pages - * [github] Add 'repository' category to fetch metadata from repositories - * [perceval] Update license info -* Sigils - * [jira] Add painless field that computes time of issues on the fly - * [github] Add delay with painless field to GH Issues panels - * [gerrit] Update gerrit panels adding delay with painless field - * [github] Add delay with painless field to GH Pull Requests panels - * Update onion panels and their documentation - * Address changes requested in #339 - * Add Jenkins Job Categories panel - * Add new version of emtech adoption without crates -* SirMordred - * [config] Allow None default value for int config param - * [task_enrich] Enable data retention policy after enrichment phase - * [task_collection] Enable data retention policy after collection phase - * [task] Delete data based on retation_hours param - * [doc] Add description for`retention_hours` param - * [config] Add param `retention_hours` - * [task_collection] Improve doc for filter-raw param - * [task] Refactor logic to process --filter-* params - * [tests] Fix tests after modification in perceval - * [task_enrich] Modify p2o filters-prefix params - * Add jenkins job categories panel to `menu.yml` - - -# 0.2.5 - -Released: 2019-02-13 - - -* Grimoire ELK - * [studies] Add origin based enrichment in AOC - * [elastic_items] Update ES query for incremental enrichment - * [utils] Handle `get_last_enrich` with raw filters - * [elastic] Handle multiple filters for last date of enriched items -* Toolkit - * [dependency] Update python-dateutil to 2.8.0 - - -# 0.2.4 - -Released: 2019-02-06 - -* Cereslib - * [enrich] Add .go as extension for the Go programming language -* Grimoire ELK - * Remove alias in use check for onion - * [elastic] Change log level message when alias is already in use - * [elk] Set filter raw in enrich connector - * [enrich] Allow to assign project to filtered repos - * [raw] Enable filter raw for Gerrit data source - * [git] Improve log messages when updating git commits data - * [elastic_items] Modify `fetch` method to collect all documents - * [git] Remove deleted commits from raw and enriched indexes - * [raw] Allow to perform update operations over a raw index - * [enrich] Allow to update enriched items -* Hatstall - * Update docs in order to add the env variables of docker deployment - * Link apache2 logs files to stderr and stdout -* KingArthur - * [worker] Remove unnecessary RQ connection management in ArthurWorker - * [tests] Repair some flake8 warnings - * [arthur] Add PUBSUB channel name specification -* Perceval - * [git] Add rev-list command to GitRepository class - * [tests] Add tests to check fetch without update - * [git] Allow fetch without update repo - * [phabricator] Move extra_status_force_list to Client class variable - * [meetup] Move extra_status_force_list to Client class variable - * [jenkins] Move extra_status_force_list to Client class variable - * [googlehits] Move extra_status_force_list to Client class variable - * [tests] Add test about retry error for GitHub - * [github] Handle upstream server connection problems -* Sigils - * Update StackOverflow index pattern and panel - * [chaoss-gmd] Fix screenshots for CHAOSS GMD collection - * [jira-backlog] Change label project to repo in Backlog visualization - * [jira-timing] Replace attribute project_name with project - * [jira-effort] Change label Project with Repository - * [jira] Replace project_name with project for jira_repositories viz - * Fix merges filter - * Updating new changes for the panel - * Update panel and documentation for PR merge duration panel - * Add documentation for pr merge duration panel - * Add pull request merge duration new panel - * Add screenshots and update front matter for sigils - * Remove word 'legacy' from Sigils title - * Add styles to doc pages - * [CHAOSS GMD] Update widgets in the panel according to the review - * [CHAOSS GMD] Add maintainer response to merge request duration - * Add help markdown widget to git demographics panel - * Add help markdown widget to demographics panel - * [doc][chaoss-gmd] Fix panel creation date - * [chaoss][doc] Add documentation for Lines of Code Changed panel - * [chaoss] Add Lines of Code Changed panel - * [doc] Fix front matter for pull requests merged -* SirMordred - * [doc] Add documentation about micro-mordred - * [config] Fix flake8 error - * [mordred] Remove global data sources param - * [doc] Add description for global_data_sources param - * [mordred] Update way of accessing global data sources - * [task_projects] Allow to accept list of global source - * [config] Make global data sources configurable from cfg - * [task_identities] Log message when orgs_file is not found on disk -* SortingHat - * [sortinghat] Fix deprecation warning for SafeConfigParser - * Fix a few grammatical errors in README.md (#181) - - -# 0.2.3 - -Released: 2019-01-10 - -* Grimoire ELK - * [elastic] Change log message level when inserting data to ES - * [sortinghat_elk] Include stacktrace in log message for unknown exception - * [elk] Include stacktrace in log message - * [tests] Delete onion index after test execution - * [elastic] Change log message level when alias already exists - * [enrich] Prevent adding DEMOGRAPHICS alias if already in use - * [enrich] Prevent adding ONION alias if already in use - * [git-enrich] Prevent adding AOC alias if already in use - * [enrich] Use the cfg section name to retrieve project name - * [elk] propagate cfg section name from mordred to ELK - * [elastic_items] Store value of the cfg section name - * Update github_issues.csv - * Update github_issues.csv - * Documentation added on github_issues.csv -* Hatstall - * Change redirections to the Django urls standard - * Redirect to the profile where the others profiles are merged - * Decrease minlength of the identities search input to 2 characters - * Show error when an uuid does not belong to a profile -* Perceval - * [github] Support `to-date` parameter in GitHub backend -* Sigils - * [affiliations] Set limit author entries due to performance issues - * [doc] Update Gerrit Efficiency panel documentation - * [efficiency] Specify Lead Time unit on Gerrit panel - * [doc] Update GitLab Efficiency panels documentation - * [doc] Update GitHub Efficiency panels documentation - * [efficiency] Specify Lead Time unit on both GitHub panels - * Add recommendations on how to create a panel - * Add info on how to use Jekyll with GitHub pages - * Update front matter - * Fix wrong links - * Update contributing guidelines - * [doc] Update screenshot for GitLab MRs Efficiency panel - * [efficiency] Add efficiency panel for GitLab merge requests - * [doc] Add documentation for GitLab merge requests efficiency panel - * [doc] Add documentation for GitLab issues efficiency panel - * [efficiency] Add efficiency panel for GitLab issues - * Fix link URL to CSV schema files in README.md - * Update sample documentation file - * [docs] Add markdown for Pull Requests Merged panel - * [chaoss] Add pull requests merged panel - * [git] Add lifecycle panel - * Add lifecycle.jpg - * Create lifecycle.md -* SirMordred - * [task] Remove credentials from URLs - * [task_panels] Add log message when kibiter is not reachable - * [task_panels] Replace urljoin with urijoin - * [task_enrich] Propagate cfg section name to ELK - * [task_panels] Add GitLab efficiency panels - * [menu] Add Git Lifecycle panel -* SortingHat - * [cmd:autoprofile] Fix expected string or bytes-like object error - - -# 0.2.2 - -Released: 2018-12-11 - -* Grimoire ELK - * [csv] Update gitlab merges schema - * [enrich-gitlab] Add time fields info -* KingArthur - * Fix package requirements - * Update requirements file due incompatible versions of RQ and Redis -* Manuscripts - * [manuscript] add chinese package - * Write notice message when the 'Process' section is empty -* Sigils - * [data-status] Add remo events and activities information -* SirMordred - * [doc] Update documentation of setup.cfg params - * [micro] Update micro setup.cfg - * [task_panels] Read menu.yaml from setup.cfg - * [config] Add menu_file param - - -# 0.2.1 - -Released: 2018-12-04 - -* Cereslib - * [tests] Update FilePath test code - * [enrich] Prepend file dir paths with slash -* Grimoire ELK - * [schemas] Fix GitLab CSVs to add missing columns - * [enrich-gitlab] Add doc for `time_to_close_days` and `time_to_merge_days` - * [enrich-gitlab] Fix `merged` attribute calculation - * [enrich-gitlab] Update calculation of `time_to_close_days` - * [elastic] Prevent add alias if already in use in ES -* Perceval - * [gitlab] Add retry on 503 HTTP error -* Sigils - * [docs] Fix page titles - * [docs] Remove theme - * [docs] Update local links - * [docs] Remove old documentation - * [docs] Add Jekyll based documentation - * Ignore Jekyll and Ruby related files - * [gitlab] Sync MRs index pattern title with SirMordred aliases - * [git] Update Git Demographics panel -* SortingHat - * [cmd:autoprofile] Avoid to set email addresses in name profile - - -# 0.2.0 - -Released: 2018-11-19 - -* Cereslib - * Fix date parsing errors using grimoirelab-toolkit -* Grimoire ELK - * [flake8] Add W503 to ignore list - * [studies] Improve log lines prefix - * (alpgarcia/master) [enrich] Use grimoirelab-toolkit methods - * [utils] Avoid enriching items over and over - * [enrich] Prevent find identities for none ids - * [schema] Update type for id in discouse.csv - * [enrich-askbot] Fix typo in enrich_items - * [schema] Update askbot csv - * [enrich-askbot] Update id attribute mapping - * [tests] Remove credentials info from log messages - * [enriched] Remove credentials info from log messages - * [ell] Remove credentials info from log messages - * [elastic_items] Remove credentials info from log messages - * [elastic] Add `anonymize_url` method - * [tests] Add tests for alias management - * [enrich-git] Use global variable for aoc alias - * [utils] Handle alias management - * [elk] Handle alias management - * [elastic] Support alias management - * [enrich] Remove logic to add aliases - * [elk] Refactor `refresh_identities` - * [enrich-github] Change mapping type of state attribute - * [enrich-gerrit] Change mapping type of status attribute - * [gitlab-raw] Fix mappings to avoid immense term exception - * [enrich-github] Fix attribute repository - * [elastic_items] Handle none page - * [raw-gitlab] Allow passing blacklisted items from projects.json - * [enrich-askbot] Refactor logic to enrich items - * [enrich-crates] Replace list with yield - * [enrich-phabricator] Replace list with yield - * [enrich-puppetforge] Replace list with yield - * [tests] Add method to check value has_identities - * [enrich-mediawiki] Remove `has_identities` method - * [schema] Update stackoverflow csv - * [enrich-stackexchange] Reorganize tags fields -* Hatstall - * Hide identities that does not have profile -* Kibiter - * Synchronized with Kibana 6.1.4 -* Perceval - * Updating instructions for querying stackexchange in README - * [gitlab] Fix `has_resuming` method -* Sigils - * [slack] Fix duplicates due to the avatar in top participants table - * [stackoverflow] Update field for question tags - * [affiliations] Add affiliations panel for kibana 6 - * [doc] Add GitHub and Gerrit efficiency docs - * [efficiency] Add panels for GitHub and Gerrit - * [mediawiki] Add Mediawiki panel doc - * [mediawiki] Add projects table in Mediawiki panel -* SirMordred - * [tests] Update setup.cfg with aliases_file param - * [task_enrich] Load aliases path from cfg param - * [task_collection] Load aliases path from cfg param - * [task] Load aliases.json file from variable path - * [config] Add aliases.json path in general cfg section - * Fix error importing old TaskPanelsAliases object - * [micro] Remove reference to TaskPanelsAliases - * [task_enrich] Remove reference of TaskPanelsAliases - * [sirmordred] Remove references to TaskPanelsAliases - * [task_panels] Remove TaskPanelsAliases task - * [sirmordred] Add aliases.json file - * [task_enrich] Extend enrich_backend method for alias management - * [task_collection] Extend feed_backend method for alias management - * [task] Read aliases from file - * [task-enrich] Refactor `refresh_identities` - * Reorder Gitlab panels putting them before Community panels - * Update metadashboard structure according to the new menu - * Unify the log debug messages printed by the threads - * Add the origin to the log messages both for data collection and enrichment - * Change logging level for Perceval and GrimoireELK and disable their logging files - * [menu] Add efficiency panels for GitHub and Gerrit -* SortingHat - * [api] Optimize how last modified identities are retrieved diff --git a/releases/latest b/releases/latest index d4981aec..5d80fb82 120000 --- a/releases/latest +++ b/releases/latest @@ -1 +1 @@ -0.2.69 \ No newline at end of file +old/0.3.0 \ No newline at end of file diff --git a/releases/0.2.0 b/releases/old/0.2.0 similarity index 100% rename from releases/0.2.0 rename to releases/old/0.2.0 diff --git a/releases/0.2.1 b/releases/old/0.2.1 similarity index 100% rename from releases/0.2.1 rename to releases/old/0.2.1 diff --git a/releases/0.2.10 b/releases/old/0.2.10 similarity index 100% rename from releases/0.2.10 rename to releases/old/0.2.10 diff --git a/releases/0.2.11 b/releases/old/0.2.11 similarity index 100% rename from releases/0.2.11 rename to releases/old/0.2.11 diff --git a/releases/0.2.12 b/releases/old/0.2.12 similarity index 100% rename from releases/0.2.12 rename to releases/old/0.2.12 diff --git a/releases/0.2.13 b/releases/old/0.2.13 similarity index 100% rename from releases/0.2.13 rename to releases/old/0.2.13 diff --git a/releases/0.2.14 b/releases/old/0.2.14 similarity index 100% rename from releases/0.2.14 rename to releases/old/0.2.14 diff --git a/releases/0.2.15 b/releases/old/0.2.15 similarity index 100% rename from releases/0.2.15 rename to releases/old/0.2.15 diff --git a/releases/0.2.16 b/releases/old/0.2.16 similarity index 100% rename from releases/0.2.16 rename to releases/old/0.2.16 diff --git a/releases/0.2.17 b/releases/old/0.2.17 similarity index 100% rename from releases/0.2.17 rename to releases/old/0.2.17 diff --git a/releases/0.2.18 b/releases/old/0.2.18 similarity index 100% rename from releases/0.2.18 rename to releases/old/0.2.18 diff --git a/releases/0.2.19 b/releases/old/0.2.19 similarity index 100% rename from releases/0.2.19 rename to releases/old/0.2.19 diff --git a/releases/0.2.2 b/releases/old/0.2.2 similarity index 100% rename from releases/0.2.2 rename to releases/old/0.2.2 diff --git a/releases/0.2.20 b/releases/old/0.2.20 similarity index 100% rename from releases/0.2.20 rename to releases/old/0.2.20 diff --git a/releases/0.2.21 b/releases/old/0.2.21 similarity index 100% rename from releases/0.2.21 rename to releases/old/0.2.21 diff --git a/releases/0.2.22 b/releases/old/0.2.22 similarity index 100% rename from releases/0.2.22 rename to releases/old/0.2.22 diff --git a/releases/0.2.23 b/releases/old/0.2.23 similarity index 100% rename from releases/0.2.23 rename to releases/old/0.2.23 diff --git a/releases/0.2.24 b/releases/old/0.2.24 similarity index 100% rename from releases/0.2.24 rename to releases/old/0.2.24 diff --git a/releases/0.2.25 b/releases/old/0.2.25 similarity index 100% rename from releases/0.2.25 rename to releases/old/0.2.25 diff --git a/releases/0.2.26 b/releases/old/0.2.26 similarity index 100% rename from releases/0.2.26 rename to releases/old/0.2.26 diff --git a/releases/0.2.27 b/releases/old/0.2.27 similarity index 100% rename from releases/0.2.27 rename to releases/old/0.2.27 diff --git a/releases/0.2.28 b/releases/old/0.2.28 similarity index 100% rename from releases/0.2.28 rename to releases/old/0.2.28 diff --git a/releases/0.2.29 b/releases/old/0.2.29 similarity index 100% rename from releases/0.2.29 rename to releases/old/0.2.29 diff --git a/releases/0.2.3 b/releases/old/0.2.3 similarity index 100% rename from releases/0.2.3 rename to releases/old/0.2.3 diff --git a/releases/0.2.30 b/releases/old/0.2.30 similarity index 100% rename from releases/0.2.30 rename to releases/old/0.2.30 diff --git a/releases/0.2.31 b/releases/old/0.2.31 similarity index 100% rename from releases/0.2.31 rename to releases/old/0.2.31 diff --git a/releases/0.2.32 b/releases/old/0.2.32 similarity index 100% rename from releases/0.2.32 rename to releases/old/0.2.32 diff --git a/releases/0.2.33 b/releases/old/0.2.33 similarity index 100% rename from releases/0.2.33 rename to releases/old/0.2.33 diff --git a/releases/0.2.34 b/releases/old/0.2.34 similarity index 100% rename from releases/0.2.34 rename to releases/old/0.2.34 diff --git a/releases/0.2.35 b/releases/old/0.2.35 similarity index 100% rename from releases/0.2.35 rename to releases/old/0.2.35 diff --git a/releases/0.2.36 b/releases/old/0.2.36 similarity index 100% rename from releases/0.2.36 rename to releases/old/0.2.36 diff --git a/releases/0.2.37 b/releases/old/0.2.37 similarity index 100% rename from releases/0.2.37 rename to releases/old/0.2.37 diff --git a/releases/0.2.38 b/releases/old/0.2.38 similarity index 100% rename from releases/0.2.38 rename to releases/old/0.2.38 diff --git a/releases/0.2.39 b/releases/old/0.2.39 similarity index 100% rename from releases/0.2.39 rename to releases/old/0.2.39 diff --git a/releases/0.2.4 b/releases/old/0.2.4 similarity index 100% rename from releases/0.2.4 rename to releases/old/0.2.4 diff --git a/releases/0.2.40 b/releases/old/0.2.40 similarity index 100% rename from releases/0.2.40 rename to releases/old/0.2.40 diff --git a/releases/0.2.41 b/releases/old/0.2.41 similarity index 100% rename from releases/0.2.41 rename to releases/old/0.2.41 diff --git a/releases/0.2.42 b/releases/old/0.2.42 similarity index 100% rename from releases/0.2.42 rename to releases/old/0.2.42 diff --git a/releases/0.2.43 b/releases/old/0.2.43 similarity index 100% rename from releases/0.2.43 rename to releases/old/0.2.43 diff --git a/releases/0.2.44 b/releases/old/0.2.44 similarity index 100% rename from releases/0.2.44 rename to releases/old/0.2.44 diff --git a/releases/0.2.45 b/releases/old/0.2.45 similarity index 100% rename from releases/0.2.45 rename to releases/old/0.2.45 diff --git a/releases/0.2.46 b/releases/old/0.2.46 similarity index 100% rename from releases/0.2.46 rename to releases/old/0.2.46 diff --git a/releases/0.2.47 b/releases/old/0.2.47 similarity index 100% rename from releases/0.2.47 rename to releases/old/0.2.47 diff --git a/releases/0.2.48 b/releases/old/0.2.48 similarity index 100% rename from releases/0.2.48 rename to releases/old/0.2.48 diff --git a/releases/0.2.49 b/releases/old/0.2.49 similarity index 100% rename from releases/0.2.49 rename to releases/old/0.2.49 diff --git a/releases/0.2.5 b/releases/old/0.2.5 similarity index 100% rename from releases/0.2.5 rename to releases/old/0.2.5 diff --git a/releases/0.2.50 b/releases/old/0.2.50 similarity index 100% rename from releases/0.2.50 rename to releases/old/0.2.50 diff --git a/releases/0.2.51 b/releases/old/0.2.51 similarity index 100% rename from releases/0.2.51 rename to releases/old/0.2.51 diff --git a/releases/0.2.52 b/releases/old/0.2.52 similarity index 100% rename from releases/0.2.52 rename to releases/old/0.2.52 diff --git a/releases/0.2.53 b/releases/old/0.2.53 similarity index 100% rename from releases/0.2.53 rename to releases/old/0.2.53 diff --git a/releases/0.2.54 b/releases/old/0.2.54 similarity index 100% rename from releases/0.2.54 rename to releases/old/0.2.54 diff --git a/releases/0.2.55 b/releases/old/0.2.55 similarity index 100% rename from releases/0.2.55 rename to releases/old/0.2.55 diff --git a/releases/0.2.56 b/releases/old/0.2.56 similarity index 100% rename from releases/0.2.56 rename to releases/old/0.2.56 diff --git a/releases/0.2.57 b/releases/old/0.2.57 similarity index 100% rename from releases/0.2.57 rename to releases/old/0.2.57 diff --git a/releases/0.2.58 b/releases/old/0.2.58 similarity index 100% rename from releases/0.2.58 rename to releases/old/0.2.58 diff --git a/releases/0.2.59 b/releases/old/0.2.59 similarity index 100% rename from releases/0.2.59 rename to releases/old/0.2.59 diff --git a/releases/0.2.6 b/releases/old/0.2.6 similarity index 100% rename from releases/0.2.6 rename to releases/old/0.2.6 diff --git a/releases/0.2.60 b/releases/old/0.2.60 similarity index 100% rename from releases/0.2.60 rename to releases/old/0.2.60 diff --git a/releases/0.2.61 b/releases/old/0.2.61 similarity index 100% rename from releases/0.2.61 rename to releases/old/0.2.61 diff --git a/releases/0.2.62 b/releases/old/0.2.62 similarity index 100% rename from releases/0.2.62 rename to releases/old/0.2.62 diff --git a/releases/0.2.63 b/releases/old/0.2.63 similarity index 100% rename from releases/0.2.63 rename to releases/old/0.2.63 diff --git a/releases/0.2.64 b/releases/old/0.2.64 similarity index 100% rename from releases/0.2.64 rename to releases/old/0.2.64 diff --git a/releases/0.2.65 b/releases/old/0.2.65 similarity index 100% rename from releases/0.2.65 rename to releases/old/0.2.65 diff --git a/releases/0.2.66 b/releases/old/0.2.66 similarity index 100% rename from releases/0.2.66 rename to releases/old/0.2.66 diff --git a/releases/0.2.67 b/releases/old/0.2.67 similarity index 100% rename from releases/0.2.67 rename to releases/old/0.2.67 diff --git a/releases/0.2.68 b/releases/old/0.2.68 similarity index 100% rename from releases/0.2.68 rename to releases/old/0.2.68 diff --git a/releases/0.2.69 b/releases/old/0.2.69 similarity index 100% rename from releases/0.2.69 rename to releases/old/0.2.69 diff --git a/releases/0.2.7 b/releases/old/0.2.7 similarity index 100% rename from releases/0.2.7 rename to releases/old/0.2.7 diff --git a/releases/0.2.8 b/releases/old/0.2.8 similarity index 100% rename from releases/0.2.8 rename to releases/old/0.2.8 diff --git a/releases/0.2.9 b/releases/old/0.2.9 similarity index 100% rename from releases/0.2.9 rename to releases/old/0.2.9 diff --git a/releases/0.3.0 b/releases/old/0.3.0 similarity index 100% rename from releases/0.3.0 rename to releases/old/0.3.0 diff --git a/releases/old/NEWS b/releases/old/NEWS index ccf8cc06..a2063700 100644 --- a/releases/old/NEWS +++ b/releases/old/NEWS @@ -1,3058 +1,2498 @@ -## 18.11-01 +# 0.2.69 -Released: 2018-11-06 +Released: 2022-03-18 -* Perceval -** [jenkins] Update message level when handling blacklisted jobs -** [gitlab] Allow to blacklist merge/issue ids -** Ignore W504 flake8 error code -** [backends] Fix flake8 errors - -* grimoirelab-elk -** [enrich-redmine] Add ELK metadata -** [enrich-mozillaclub] Add ELK metadata -** [enrich-mediawiki] Add ELK metadata -** [elastic_items] Handle pagination over none index -** [enrich] Handle insertion of empty identities -** [elk] Avoid processing None identities -** [enrich-meetup] Prevent insert enrich items with no time -** [enrich-discourse] Refactor logic to enrich items -** [ELK] Fix flake8 errors -** [utils] goodbye google-hits script -** [utils] Goodbye rest script -** [enrich-gitlab] Handle missing milestone attribute in raw items -** [elastic_items] Refactor `fetch` method -** [enrich-google_hits] Redifine has_identities method -** [enrich-functest] Redifine has_identities method -** [enrich-dockerhub] Redifine has_identities method -** [enrich-jenkins] Redifine has_identities method -** [elk] Add condition to skip loading identites -** [enrich] Add has_identities method -** [enrich-askbot] Replace list with yield -** [enrich-bugzillarest] Replace list with yield -** [enrich-confluence] Replace list with yield -** [enrich-discourse] Replace list with yield -** [enrich-gitlab] Replace list with yield -** [enrich-jira] Replace list with yield -** [enrich-kitsune] Replace list with yield -** [enrich-mattermost] Replace list with yield -** [enrich-mediawiki] Replace list with yield -** [enrich-phabricator] Replace list with yield -** [enrich-mozillaclub] Replace list with yield -** [enrich-puppetforge] Replace list with yield -** [enrich-redmine] Replace list with yield -** [enrich-remo] Replace list with yield -** [enrich-rss] Replace list with yield -** [enrich-stackexchange] Replace list with yield -** [enrich-slack] Replace list with yield -** [enrich-supybot] Replace list with yield -** [enrich-telegram] Replace list with yield -** [jenkins] Add node name cleaning based on RE -** [enrich-twitter] Replace list with yield +* Grimoirelab + * feat: add github event alias + * Changing `GitHub No Replay` to `GitHub No Reply` +* Cereslib + * [gha] Update tests workflow + * Remove Python 3.6 support + * [poetry] Add Poetry support +* ELK + * Support OpenSearch 1.x + * [enrich] Remove the prefix '::' of the enrollments. + * [enrich] Bugfix for hyperkitty. EnrichBackend can not get raw data. + * [poetry] Include sortinghat as extra dependency + * Remove Python 3.6 support +* Kidash + * [gha] Add workflow to automate the release process + * [gha] Add workflow to check if a changelog was included + * [gha] Update CI github action workflow + * Add flake8 and coverage as dev-dependencies + * [poetry] Add Poetry support + * Remove the support for Python 3.6 and add new versions + * [scripts] Change kidash scripts as entrypoints +* Perceval + * Add configurations of the metadata files to pyproject.toml + * [gha] Update release action using grimoirelab-github-actions +* Perceval-Mozilla + * Add configurations of the metadata files to pyproject.toml + * [gha] Update release action using grimoirelab-github-actions +* Perceval-OPNFV + * [gha] Use poetry for tests in GitHub Actions workflow + * Remove Python 3.6 support + * Support package namespaces with Poetry + * [gha] Add workflow to check if a changelog was included +* Perceval-Puppet + * [gha] Use poetry for tests in GitHub Actions workflow + * Remove Python 3.6 support + * Support package namespaces with Poetry + * [gha] Add workflow to check if a changelog was included +* Perceval-Weblate + * [gha] Use poetry for tests in GitHub Actions workflow + * Remove Python 3.6 support + * Support package namespaces with Poetry + * [gha] Add workflow to check if a changelog was included +* Sigils + * Support newer versions of Python apart from 3.7 + * [poetry] Add Poetry support + * [json] Move visualizations inside panels + * [gerrit] Replace name field to author_name in Submitters table * SirMordred -** Add demographics index pattern -** [menu] Add index pattern for attraction/retention -** [tests] Fix flake8 errors after upgrade -** [sirmordred] Set elasticsearch logging level to INFO -** [jira] Add index pattern for closed issues -** Add documentation for jenkins `node_regex` param -** [jenkins] Add support for node name cleaning - + * [gha] Use poetry for tests in GitHub Actions workflow + * [poetry] Add poetry support + * [deps] Fix dependecies in requirements + * [utils] Change sirmordred scripts as entrypoints + * Refactoring link to new tutorial page. Currently it links to a page not found and I'm pretty sure this is a better place for the reader to be sent. + * Clarify README +* Sortinghat + * Include Sortinghat command in wheel + * [gha] Update tests workflow + * Fix flake8 code style warnings + * [setup.py] Add missing commas in entry_points + * Bump numpy to 1.21.0 in requirements.txt and setup.py + * Bump numpy from 1.18.3 to 1.21.0 + * Remove Python 3.6 support + * [gha] Add workflow to check if a changelog was included + * [poetry] Add Poetry support + * [sh] Change SortingHat scripts as entrypoints + * [deps] Update Jinja version + + +# 0.2.68 + +Released: 2022-01-27 + + +* ELK + * [enrich] Fix empty value of 'author_domain' field + * [git] Add schema column for raw/calculated + * [enrich] Fix urllib3.exceptions.SSLError for 'enrich_feelings'. + * [github2] Add comments from "Approval" and "Change requests" +* Perceval + * Bump cryptography from 3.3.1 to 3.3.2 + * Bump urllib3 from 1.26.3 to 1.26.5 * Sigils -** [git] Update demographics panel to use new fields -** [gitlab] Fix latest items tables to size 100 -** [gitlab] Add missing fields in issues index pattern -** [jira] Add closed issues by project table - + * [github2_pull_requests] Add new fields to the index pattern + * [gitlab_issues] Add painless_time_open to the index pattern -## 18.10-03 -Released: 2018-10-21 - -* GrimoireLab -** Fixes dependencies problems found in GrimoireLab package +# 0.2.67 -## 18.10-02 +Released: 2022-01-13 -Released: 2018-10-18 +* ELK + * [enrich] Fix IndexError when getting main organization * Perceval -** [groupsio] Make api token a required param -** [groupsio] Fetch archives from group-specific domains -** Adding academic reference - -* grimoirelab-elk -** [enrich_mattermost] Fix error setting empty emails for identities -** [enrich_mattermost] Fix error setting blank names on identities -** [enrich-github] Include label lists in enriched items -** [enrich-git] Replace list with yield -** [enrich-github] Replace list with yield -** [enrich-gerrit] Replace list with yield -** [enrich-bugzilla] Replace list with yield -** [tests] Extend tests for demography study -** [enrich] Add method to include aliases in enriched index -** [enrich-gerrit] Add demography study to gerrit -** [install] Update dependencies -** [tests] Update .travis.yml -** [tests] Align tests for git demography study -** [enrich] Add generic demography study -** [enrich-git] Replace ad-hoc git demography -** [enrich-gitlab] Include labels list in enriched items -** [onion] Fix `all_onion` alias creation -** [onion] Add refresh interval -** [enrich] Check presence of input index onion -** [gitlab-enrich] Add onion study -** [schema] Add schema for gitlab issues -** [schema] Add schema for gitlab merges -** [aoc] Add a constant for out_index default value -** [tests] Extend tests data for Gitlab milestone attribute -** [enrich-gitlab] Add milestone attribute for gitlab items - + * [gha] Check if a changelog was included in every Pull request * SirMordred -** [onion] Add documentation for 'seconds' parameter -** [setup] Update dependencies -** [menu] Remove onion index pattern from Git panel -** [panels] Add demographics panel in community section -** [tests] Fix tests for task panels -** [tests] Fix tests for config -** [tests] Update mediawiki 1.28 archive -** [tests] Update .travis.yml -** [cfg] Update config files -** [doc] Update documentation with gitlab info -** [micro] Handle raw and enrich tasks exceptions -** [doc] Include doc for gitlab onion studies -** [doc] Add autorefresh_interval description -** [autorefresh] Add autorefresh identities in AOC - -* Sigils -** [data_status] Update google_hits data status entry -** [demographics] Add known limitations and issues -** [demographics] Add panel for multiple sources -** Update info about index patterns and panel ids -** [gitlab] Increase the number of issues shown in timing panels -** [gitlab] Remove invalid search object for MRs backlog -** [gitlab] Adjust "Avg. Time Open" column in Backlog Submitters table -** [gitlab] Show full list of participants in GitLab panels -** [gitlab] Add milestone visualizations to GitLab merge requests -** [gitlab] Add milestone visualizations to GitLab issues -** [onion] Add data source filter widget to panels -** [gitlab] Fix typo in visualizations - -* Kidash -** Add check for query key in bool filter fix - -## 18.10-01 + * [.github] Use ubuntu-18.04 instead of ubuntu-latest + * [.github] Update elasticsearch to 6.8.6 -Released: 2018-10-03 - -* Perceval -** [tests] Align mediawiki after API calls optimization -** [mediawiki] Optimize number of calls to API -** [tests] Use output method in assertLogs for mbox test -** [tests] Use output method in assertLogs for gitlab test -** [tests] Add test to handle mediawiki version exception -** [mediawiki] Fix error in client `get_version` method -** [gitlab] Fix typo initiazaling common MRs fields - -* grimoirelab-elk -** [enrich-stackexchange] Handle KeyError exception -** [aoc] Add support for autorfresh in sirmordred -** [demography] Catch conn exceptions when fetching author commits -** [enrich] Set identities fields to UNDEFINED for null values -* SirMordred -** [tasks_panels] Fix initialization of .kibana index in Kibana 6.x +# 0.2.66 -** Sigils -** [data_status] Fix error showing GitLab issues retrieval dates -** [twitter] Replaces Latest tweets widget at the bottom -** Update documentation about contributing to be updated with Kibiter 6.1.0 release -** Fix hidden legends in bar charts -** Fix title of organizations pie chart -** Fix badly stacked bar bug +Released: 2022-01-11 -* SortingHat -** Support UTF-8 fully in MySQL/MariaDB -* Hatstall -** Register new template filter when a name is blank but isn't None +* Grimoirelab + * Update events.html with MSR 2022 Hackathon details +* ELK + * [enrich] Fix refresh_identities for '*_multi_org_names' fields + * [.github] Update elasticsearch to 6.8.6 + * [enrich] Get main enrollments for *_org_name field +* Sortinghat + * [.github] Use ubuntu-18.04 instead of ubuntu-latest + * [sortinghat/utils] Fix merge_date_ranges returns an extra date -* Kidash -* [kidash] Enable Kibiter 6 configuration -## 18.09-03 +# 0.2.65 -Released: 2018-09-24 +Released: 2021-11-19 -* GrimoireLab -** [doc] Added file for community components. -** [docker] Clarify variable names in ansible file for building release. +* ELK + * [elk] Update 'non_authored_*' fields on 'refresh_identities' + * [enriched/git] Add 'non_authored_*' commit meta fields * Perceval -** [tests] Add tests for GitLab merge request data -** [gitlab] Add merge_request category -** [github] Fix doc in fetch method -** [args] Add new argument --json-line - -* grimoirelab-elk -** [tests] Include tests data for GitLab merge requests -** [enrich-gitlab] Add merge request enrich item -** [enrich-mediawiki] Fix unique id for enriched items -** [tests] Include tests data for GitHub pull requests -** [enrich-stackexchange] Add 'origin' and 'tag' fields to answer items -** [raw] Improve logging message in elastic - + * [git] Add --no-ssl-verify parameter * Sigils -** [overview] Minor change to make gitlab panels visible -** [data_status] Minor change to make gitlab panels visible -** [gitlab] Minor change on merge panels -** [gitlab] Minor change on issue panels -** [gitlab] Add Issues and MR info to Overview and Status panels -** [adoption] Panel for Rust adoption -** [dev] Panel for dev related sources -** [social] Panel for Social sources -** [mediawiki] Use 'edits' instead of 'editions' -** [gitlab mr] Update URL links and fix a couple of titles -** Add GitLab Merge Request panels -** [jenkins] Add panel to track nodes -** [jenkins] Add panel for tracking jobs -** [gitlab] Fix issue with URLs in the repositories table -** [gitlab] Update GitLab panels based on the review. Minor fixes. -** [gitlab] Add GitLab panels focused just on issues -** [github] Fix acc time widget in PRs backlog - -* SirMordred -** [utils] Update setup.cfg micro-mordred -** [config] Change gitlab param names -** [task_panels] Change gitlab data source names -** [tasks_panels] Disable kibiter 6 configuration -** [utils] Add gitlab entries in setup.cfg and .json -** [task_panels] Add aliases to gitlab indexes -** [utils] Update setup.cfg and .json micromordred -** [utils] Update menu.yml -** [menu.yml] Adding nodes and jobs panels -** [tests] Include strict param in mock tests task panels -** [task_panels] Handle strict mode loading panels via setup.cfg -** [config] Handle strict loading of panels -** [tests] Update number of loaded panels -** [utils] Align menu.yml micro-mordred with upstream one -** [menu.yml] Remove mattermost from menu.yml -** [tasks_panels] Handle mattermost panels via setup.cfg -** [config] Load mattermost panels by the setup.cfg -** [tasks_panels] Handle gitlab panels via setup.cfg -** [config] Load gitlab panels by the setup.cfg -** [tests] Include archives for gitlab merges and github pulls -** [task_panels] Align task panels with kidash -** [tests] Align configuration files with new changes -** [tests] Align tests with new changes in task_panels -** [doc] Update config.md -** [README.md] Update readme -** [config] Make kibiter url mandatory for panels section -** [task_panels] Set kibana settings programmatically -** [task-collection] Improve logging message + * [git] Update index pattern to include 'non_authored_*' + * [affiliations] Authors/Contributions by Organization and Domains +* Sortinghat + * [sortinghat/utils] Fix merge_date_ranges -* Hatstall -** Fix url redirection to /identities/hatstall -** Change absolute urls in href and actions to the Django right ones -* Kidash -** Revert previous commit -** [import] Create the Kibana index if not exists before importing anything +# 0.2.64 +Released: 2021-11-05 -## 18.09-02 +* ELK + * [setup/requirements] Upgrade requests==2.26.0 and urllib3==1.26.5 +* SirMordred + * [task_manager] Add `update_hour` in the general section -Released: 2018-09-07 -* Perceval -** Remove unused and not working config_file option +# 0.2.63 -* grimoirelab-elk -** [tests] Fix load identities test -** [tests] Add tests for googlehits connectors -** [utils] Add googlehits connectors -** [enrich] Add support to enrich googlehits raw data -** [raw] Add support for googlehits data +Released: 2021-10-25 -* Sigils -** [irc] Fix orgs table participants count -** [KIP] Restore search viz +* Grimoirelab + * Add Mystic project + * Add TDF dashboard + * Fix typos and update screenshots + * Update events.html with hacktoberfest-21 details + * [docs] Update Built with GrimoireLab section +* ELK + * [.github] Install setuptools==57.5.0 + * [enriched/git] Add commit meta fields +* Perceval + * [docs] Add information for using perceval against private git repos + * [docs] Add perceval documentation content +* Sigils + * Fix typos in my name + * [git] Update index pattern to include commit author meta fields + * [github2] Limit visualizations to fix low performance. * SirMordred -** [utils] Update micro-mordred menu.yml -** [task_panels] Modify alias for google hits -** [config] Remove google_hits from extra backends -** [archives] Update slack archive -** [archives] Update github archive -** [tests] Add tests for googlehits + * [task_enrich] Support multi author fields in refresh identities + * [docs] Add information for using sirmodred against private git repos -* Hatstall -** Add new index that show just an form in order to search identities -** Delete the first and last " with strip() -** Add CSRF_TRUSTED_ORIGINS as a docker env variable +# 0.2.62 -## 18.09-01 +Released: 2021-09-16 -Released: 2018-09-04 +* ELK + * [enriched/github2] Add demography study + * [enriched/github2] Add ghost user to calculate first attention + * [README] Update instructions for running tests * Perceval -** [googlehits] Modify item id generation -** [github] Increase number of items retrieved per page -** type fix on tests requirements file - -* Sirmordred -** [menu.yml] Fix typo in googlehits data source -** [task_panels] Include phabricator panels in overview and data status -** [task_panels] Enable kafka studies -** [config] Include option to visualize kafka studies -** [tests] Align tests for new panels -** [utils] Align micro-morded menu.yml with mordred one -** [task_panels] Include mbox-type panels -** [menu.yml] Include mbox-type entries -** [task_panels] Do not import panels that don't have the release field -** [task_panels] Replace google_hits backend name -** [menu.yml] Modify google hits source name -** [tests] Fix tests for task_panels -** [tests] Fix tests for task_enrich -** [tests] Fix tests for test_task -** [collection] Add support for mediawiki tag -** [utils] Add mattermost panels to menu.yml micro-mordred -** [menu] Add mattermost entry -** [menu.yaml] Remove duplicated community info in git menu -** [utils] Fix setup.cfg for micro-mordred -** [menu] Add index pattern for remo-activities -** [menu] Fix remo-activities index-patterns entry - -* grimoirelab-elk -** [enrich-meetup] Fix error printing the number of comments and RSVPs -** [tests] Update Git test data -** [tests] Update Slack test data -** [tests] Update Jira test data -** [enrich-jira] Remove unknown user data logic -** [enrich-git] Remove unknown user data logic -** Set Unknown to null user data (org, name and username) -** [elk] Modify logic to load new identities to SH -** [enrich-mbox] Replace lists with yields -** [enrich-meetup] Replace lists with yields -** [enriched] Update mediawiki project json params -** [enriched-jira] Set Unassigned to null assignee orgs and usernames -** [enrich-jira] Improve jira enricher -** [enrich-git] Handle commits with missing user info -** [tests] Enable tests from no-localhost ES + * [docs] Add Airtable and Bitbucket backends + * [git] Add argument base-path for the git backend + * Update README.md + * [docs] Update configurations for readthedocs -* Sigils -** [kip] Disable search panel -** [overview] Add mattermost widgets -** [data status] Add mattermost widgets -** [overview] Fix missing widget panels -** [data_status] Fix visualization ids -** [meetup] Fix visualization id for `meetups_main_numbers` -** [overview] Replace dockerhub viz by current ones -** [kip] Migrate panel to Kibana 6 -** [data status] Add remo activities index pattern -** [about] Update panel to include release date -** [data status] Fix dockerhub index pattern name -** [data status] Fix google hits widgets -** [overview] Fix index name for Dockerhub viz -** [overview] Update google hits widgets -** [google-hits] Panel updated to support new backend - - -## 18.08-01 - -Released: 2018-08-23 -* SortingHat -** [api] Fix lost enrollments error merging identities -** [db] Handle disconnection using pessimistic mode +# 0.2.61 -* Perceval -** [doc] Include doc to execute the googlehits backend -** [backends] Add backend for GoogleHits -** [slack] Fix flake8 error -** [slack] Include num members in channel info -** [doc] Update install from source code section in README.md -** Mozilla -** [doc] Update install from source code section in README.md -** OPNFV -** [doc] Update install from source code section in README.md -** Puppet -** [doc] Update install from source code section in README.md - -* Sirmordred -** Fix typos in menu.yaml for 6.x panels and index patterns -** [task_panels] Update index pattern files for Onion panels -** [utils] Add conf files for micro-mordred -** [utils] Add micro-mordred -** [test_task_panels] Update tests for community section menu -** [task_panels] Add community structure menu -** [config] Add time interval for autorefresh -** [panels] Remove unused panels -** Fix weird warning -** [tests] Update test_config.py -** [tests] Add example of enrich_pull_requests study in test_studies.cfg -** [config] Add `enrich_pull_requests` to the tuple of studies - -* grimoirelab-elk -** [enrich-mediawiki] Change way url is created -** [aoc] Replace message commit with first 80 chars -** [enrich-slack] Use `num_members` attribute to count channel members -** [studies] Add enrich_pull_requests study -** [aoc] Fix study to do nothing if no events +Released: 2021-09-07 -* Sigils -** Merge branch 'kibana6-migration' -** Use 'edits' instead of 'editions' for MediaWiki -** [mattermost] Add Kibana 6 panel and index pattern -** [reps activities] Add panel migrated to Kibana 6 -** [reps events] add panel fro Kibana 6 -** [about] Add about.json from master -** [dockerhub] Fix legend title for Stars and Pulls -** [dockerhub] Update evolutionary charts to use Timelion and use Deltas -** [dockerhub] Add DockerHub panel and index pattern -** [functest] Add panel for functest project -** [functest] Add testing overview panel -** [mediawiki] Use 'edits' instead of 'editions' -** [mozilla-club] Increase size of pie charts -** Add Mozilla Club panels and index patterns -** [google-hits] Add Google Hits panel and index pattern -** [twitter] Migrate panel to Kibana 6 -* Manuscripts -** [Notebooks] Update README with instructions to run the notebooks -** Add Notebooks for GMD metrics and sample visualisations -** Some (hopefully minor) changes -** [MS2/report/tests] Add basic tests for manuscripts2 reports -** [MS2/tests] Set up module level test fixtures -** [MS2/README] Update README with instructions to generate the report -** [MS2/manuscripts2] Update bin/manuscripts2 to take cmd inputs -** [MS2/latex] Separate github_issues and github_prs data for Overview -** [MS2/reports] Add functions to generate the PDF reports -** [MS2/reports] Add latex template folder from the old manuscripts -** [MS2/reports] Remove "_" from strings and update create_csv_fig_from_df -** [MS2/reports] Fix minor errors and change folder names -** [MS2/Reports] Add the project process section of the report -** [tests] Add tests for Metrics under project process in github_prs -** [MS2/metrics] Add project_process Metrics & function for github_prs -** [tests] Add tests for Metrics under project process in github_issues -** [MS2/metrics] Add project_process Metrics & function for github_issues -** [MS2/elasticsearch] Update calculate_bmi function -** [MS2/metrics] Change field for timeseries aggregations in ClosedIssues -** [MS2/reports] Add PROJECT_COMMUNITY section of the report -** [manuscripts2/metrics] Rename NAME variable to DS_NAMES In all the data source files -** [tests] Add tests for aggregations() in Authors and Organizations classes -** [MS2/metrics] Add capability to calculate project_community metrics -** [tests] Clean up code. Add tests/utils.py -** [manuscripts2/elasticsearch] Add get_list method for Query class -** [config] Add studies params -** [tests] Add tests for timeseries metrics generated in github_prs -** [github_prs] Add project_activity function -** [tests] Add tests for timeseries metrics generated in github_issues -** [github_issues] Add project_activity function -** [tests] Add tests for timeseries metrics generated in git -** [git] Add project_activity function -** [report] Add functionality to calculate PROJECT ACTIVITY section -** [tests] Rearrange the test data into specific folders -** [tests] Add tests for github_issues data source -** [manuscripts2] Add OVERVIEW section for github_issues data source -** [tests] Update test_elasticsearch.py to use test base class -** [tests] Update tests/data/git_commit.json file -** [tests] Update git_commit.json data -** [tests] Update test base class -** Rename manuscripts2/Readme.md to manuscripts2/README.md -** [tests] Add example to use the test base class -** [tests] Add test base class -** [manuscripts2] Add tests for OVERVIEW section of 'git' data source -** [manuscripts2] Add code to calculate OVERVIEW section for 'git' data source +* ELK + * [raw/gitlab] Handle immense term for data.head_pipeline.yaml_errors + * [elk] Pass 'no_update' to pereceval + * [enriched/github2] Fix TypeError NoneType + * [mattermost] Allow parsing normal mattermost urls +* Perceval + * [github] Extend 'max_items' for all requests + * [docs] Add Gitee community backend +* SirMordred + * [config] Support inheritance in configuration -* Kidash -* GrimoireLab Toolkit +# 0.2.60 -* King Arthur +Released: 2021-08-31 -* Bestiary -* Hatstall -** [docker] Update password of admin user when container restart -** Change href of Profiles item to "list" instead of "/" -** Update href in order to avoid absolute/relative problems -** Allow None country in the profile form -** [docker] Modify path of sqlite file when env variable exists -** [docker] Default admin account can be now set via docker environment variables -** [urls] Add support for using /identities as the base path for accessing Hatstall -** [docker] Remove gunicorn and use stage from Docker image -** [docker] Modify apache config to serve static files and generate the static files during deployment -** [static] Reorganize static contents for the base template in the django-hatstall project -** [urls] Remove gunicorn suport for static contents -** [docker] Add in stage the activation of ssl module in Apache -** [docker] Support https for accessing the Django Hatstall application -** [docker] Convert Django Hatstall deployment to Apache2 + mod_wsgi +* ELK + * [enriched/github2] Fix KeyError 'login' + * [enriched/github2] Add 'user_login' field -* Ceres -** Fix filter method when a column has no values +# 0.2.59 -## 18.07-11 +Released: 2021-08-23 -Released: 2018-07-25 -## Release details +* ELK + * [pyproject] Update packages and python to "^3.6.1" + * [enriched/githubql] Add PullRequestReview field + * [enriched/mattermost] Fix KeyError 'parent_id' + * [enriched/github2] Use user_data fields to set identities values +* Perceval + * [githubql] Add PullRequestReview event +*SirMordred + * [mordred] Add flag/arg to filter which repos run -* SortingHat -** [tests] Add tests for recovery mode in unify command -** [unify] Add resume method to unify command -* Perceval -** [askbot] Handle upstream internal server -** [gitlab] Sanitize requests before archiving -** [gitlab] Fix signature backend -** [travis] Change how perceval is installed -** [mbox] Fix test `test_mboxes_error` -** [github] Fix position GitHub client args -** [phabricator] Handle 429 HTTP errors -** [mbox] Increase test coverage -** [pipermail] Remove duplicated test -** [utils] Add checks to zip compressed type -** [mbox] Add checks to zip compressed type -** [doc] Include doc to execute the groups.io backend -** [backends] Add backend for groups.io -** [mbox] Allow support for zip file in MboxArchive -** [utils] Add support for zip compressed file type -** Mozilla -** [setup] Align setup to perceval one -** [travis] Change how perceval-mozilla is installed -** OPNFV -** [setup] Align setup to perceval one -** [travis] Change how perceval-opnfv is installed -** Puppet -** [setup] Align setup to perceval one -** [travis] Change how perceval-puppet is installed - -* Sirmordred -** [tests] Add tests for sirmordred -** [tests] Update test data -** [sirmordred] Load repos for a tagged backend sections -** [task_projects] Load repos for a tagged backend section -** [tests] Add archive for GitLab -** [utils] Goodbye cfg_generator -** [doc] Include example for GitLab -** [tests] Relax number of index-patterns in tests for panels -** [docs] Add coveralls badge -** [tests] Add perceval-* dependencies to requirements.txt -** [tests] Add grimoirelab-toolkit dependency to requirements.txt -** [config] Redirect autogenerated doc to README.md -** [config] Extend `write_doc` method -** [tests] Extend test for config file - -* grimoirelab-elk -** Change shebang line -** [elastic_items] Remove condition for old twitter items -** Add support for Groupsio -** [travis] Fix coverage execution -** [utils] Goodbye twitter scripts -** [README.md] Fix travis badge -** [travis] Execute coveralls after tests -** [README.md] Add coveralls badge -** Add support for GitLab +# 0.2.58 -* Sigils +Released: 2021-08-12 -* Manuscripts -** Update failing tests because of change in perceval git data -** Rename manuscripts2 branch files -** [travis] Narrow coveralls execution -** Update tests for manuscripts2 -** Update Query class: set start and end date filters directly into search object -** [tests] Fix travis.yml -** [travis] Add coveralls -** [doc] Fix badges in README.md -** Add initial infrastructure to generate the reports +* ELK + * [gitlab] Autodetect gitlab enterprise-url arg +* Perceval + * [mattermost] Support running with channel names + * [github] Handle reactions without user information + * [pyproject] Update python "^3.6.1" +* Perceval-finos + * [pyproject] Update python "^3.6.1" +* Perceval-mozilla + * [pyproject] Update python "^3.6.1" +* Perceval-opnfv + * [pyproject] Update python "^3.6.1" +* Perceval-puppet + * [pyproject] Update python "^3.6.1" +* Perceval-weblate + * [pyproject] Update python "^3.6.1" + + +# 0.2.57 + +Released: 2021-07-20 + + +* ELK + * [enriched/mattermost] Fix 'useAutomaticTimezone' TypeError + * [raw/mattermost] Fix mapping for 'data.props.meeting_id' + * [enriched/weblate] Fix KeyError for several fields + * [schema] Update Kafka KIP schema * Kidash + * [setup] Upgrade requests to 2.26.0 +* Perceval + * Bump grimoirelab-toolkit from 0.1.12 to 0.2 + * [gha] Create release.yml + * [nntp] Avoid line too long error + * [nntp] Handle not valid date + * [mattermost] Change the key from 'data.metadata.images' to value + * [gha] Update tests workflow + * [perceval] Change perceval script as entrypoint + * [docs] Fix typos +* Perceval-finos + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Perceval-mozilla + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Perceval-opnfv + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Perceval-puppet + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Perceval-weblate + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Sortinghat + * [parsing/gitdm] Update VALID_LINE_REGEX expression + * Bump jinja2 from 2.11.1 to 2.11.3 + * [CI] Migrate from Travis CI to GitHub Actions + +# 0.2.56 + +Released: 2021-06-09 + + +* ELK + * [enriched/slack] Add stopwords in the field 'text_analyzed' + * [enriched/mattermost] Improve fields + * [enriched/github] Add demography study + * [enriched/github] Fix KeyError when getting user info + * [tests/data] Improve telegram coverage + * [README] Update bugzilla data sources description + * [schema] Fix twitter schema + * tests] Add test for metadata__updated_on field + * [tests] Add test for transactionID field + * [schema] Add twitter schema file + * [schema] Fix missing values in github event schema + * [enriched/twitter] Remove deprecated attributes from enriched item +* Kidash + * Bump urllib3 from 1.24.3 to 1.26.5 +* Perceval + * [github] Fix 404 Client Error when user is not found. + * [github] Fix user_orgs for organizations with restricted access + * [CI] Use poetry for the CI github actions workflow + * [deps] Add flake8 and coverage to dev dependencies + * Create CONTRIBUTING.md + * [poetry] Add setuptools to the build-system + * [backend] Disables stack trace if debug flag is absent +* Sigils + * [mattermost] Update panel and index pattern with new fields. + * [github_issues] Update index pattern with demography fields + * [json] Update Twitter index pattern +* SirMordred + * [README] Add demography study for github + * Allowing the config files to be specified dynamically + * [micro-mordred] Improve error messages in micro.py + * [docs] Update the mariadb docker-compose configuration + * [tests] Fix flake8 errors -* GrimoireLab Toolkit - -* King Arthur +# 0.2.55 -* Bestiary +Released: 2021-03-15 -* Hatstall -* Ceres +* ELK + * [stackexchange] Make author anonymization optional for stackexchange + * [enrich-stackexchange] Handle deleted user in stackoverflow + * [enriched/gitlab] Fix KeyError without `name` value +* Perceval + * [stackexchange] Include access_token as optional argument + * [stackexchange] Change the fetch order to 'asc' -## 18.07-10 +# 0.2.54 -Released: 2018-07-17 +Released: 2021-02-11 -## Release details +* ELK + * [raw/phabricator] Fix mapping for data.fields.custom_error_stack +* Perceval + * [slack] Use channels.history to retrieve message -* grimoirelab-elk -** [studies] Use hash instead of plain text as id -** [enriched] Use metadata__update_on to index tweets +# 0.2.53 -## 18.07-09 +Released: 2021-01-26 -Released: 2018-07-15 +* Cereslib + * [flake8] Fix flake8 errors -## Release details +* ELK + * [enriched/github:prs] Add fields for Pull Requests-related data + * [enriched-cocom] Use hashlib instead hash() to create a uniq id -* Sigils -** Use kibana6-migration branch +* Kidash + * [flake8] Fix flake8 errors +* Perceval + * [supybot] Adds support for logs without timezone information + * [githubql] Support GitHub App to fetch data + * [github] Support GitHub App to fetch data + * [perceval] Add flag `-l/--list` to show list of available backends -## 18.07-08 +* Sigils + * [github] Update index pattern with new fields -Released: 2018-07-13 -## Release details +# 0.2.52 -* Sirmordred -** [menu.yaml] Add panels and index patterns for Areas of Code and Community Structure +Released: 2020-11-24 +* SortingHat + * Limit SQLAlchemy versions to <1.4 -## 18.07-07 -Released: 2018-07-12 +# 0.2.51 -## Release details +Released: 2020-11-23 -* SortingHat +* ELK + * [enriched/slack] Fix enrich items without user data + * [raw/slack] Handle fields in 'data.files' * Perceval -** Changes to work with grimoirelab_toolkit. -** Mozilla -*** Changes to work with grimoirelab_toolkit. -** OPNFV -*** Changes to work with grimoirelab_toolkit. -** Puppet -*** Changes to work with grimoirelab_toolkit. - -* Sirmordred -** [config] Add tag to backend sections - -* grimoirelab-elk -** [raw] Fix mapping Twitter -** [enriched] Add code to calculate github pull requests enriched data -** [enriched] Change toolkit import in git enricher -** [enriched] Change toolkit import in ceres_base -** [p2o] Add support for execution a list of studies -** [enrich][git][demography] Add doc and fix the incremental support + * [slack] Fix fetch message from a private user + * [askbot] Add logging debug messages to Askbot * Sigils + * [weblate] Add organization information to overview panel -* Manuscripts - -* Kidash -* GrimoireLab Toolkit -** Change module name to grimoirelab_toolkit. +# 0.2.50 -* King Arthur -** [arthur] Change toolkit import +Released: 2020-10-29 -* Bestiary +* ELK + * [enriched/githubql] Classify merged PRs within cross-references study + * [enriched/githubql] Add MergedEvent info + * [gerrit] Add last-verified approval value field to enricher -* Hatstall +* Perceval + * [githubql] Fix error `Events not collected for issue...` + * [tests] Fix pipermail not working search_fields test + * [githubql] Add MergedEvent info -* Ceres +* Sigils + * [github][github2] Update index patterns with new study fields + * [githubql] Update index pattern with MergedEvent fields + * [gerrit] Update index patterns with last Verified approval value + * [gerrit] Add Retention of Newcomers panel -## 18.07-06 -Released: 2018-07-10 +# 0.2.49 -## Release details +Released: 2020-10-13 -* SortingHat -** [travis] Include cryptography package -** [tests] Align tests to logging support -** [sortinghat] Add logging support +* ELK + * [schema] Add schema file for Weblate enriched data + * [weblate] New enricher to handle changes + * [enrich/discourse] Add credentials to collect category info + * [enriched/github] Add field issue_url for issues and pull requests + * [enriched/githubql] Update references in related indexes * Perceval -** [twitter] Change metadata_id attribute -** Mozilla -** OPNFV -** Puppet - -* Sirmordred -** [tests] Add twitter archive -** [dashboard title] Fix typo in project name extraction -** [tests] Add arthur and perceval eggs to requirements.txt -** [studies] Include raw backend to studies - -* grimoirelab-elk -** [enriched] Add support for github pull request data -** [raw] Add support for github pull request data -** [tests] Add test for kafka kip study, git studies and SSL support -** [enriched] Improve logging for studies -** [enriched] Include ocean backend in studies -** [elk] Add raw backend to studies params -** [raw] Add parser params for perceval mattermost backend -** [studies] Fix ES conns to use insecure parameter -** [enrich][mattermost] Fix project mapping support -** [enrich][slack] Fix slack project mapping to use just the channel id in the projects mapping file -** [tests] Use the projects mapping json file for testing + * Weblate backend * Sigils -** [telegram] Add Telegram panels migrated to Kibana 6 -** [apache] Add Apache panels -** Updated panels for askbot, discourse, stackoverflow, rss, bugzilla timing, redmine, maniphest, bugzilla, onion, overview, git, data status, mediawiki, jenkins, stackoverflow, confluence, slack, maniphest, github, irc, mbox, jira, bugzilla, gerrit, -* Manuscripts -** Add manuscripts2 containing new functions to calculate the metrics -** Closes #48: start date not provided use case - -* Kidash - -* GrimoireLab Toolkit + * [weblate] Add Weblate demographics panel + * [weblate] Add Weblate overview panel and index pattern + * [github] Update index pattern with issue_url field + * Update index patterns from github-related indexes -* King Arthur - -* Bestiary +* SirMordred + * Add new backend weblate -* Hatstall -** [urls] Add support for using /identities as the base path for accessing Hatstall -** [docker] Default admin account can be now set via docker environment variables -** [docker] Modify path of sqlite file when env variable exists -* Ceres +# 0.2.48 -## 18.07-05 +Released: 2020-09-28 -Released: 2018-07-04 +* ELK + * [enriched/git] `enrich_git_branches` skip --filter-no-collection repo + * [enriched/bugzilla] Add new field `whiteboard` +* Sigils + * [bugzilla] Update index pattern with the new field `whiteboard` -* Sirmordred -** Update menu.yaml to kibana 6 panel and index names -** [task_panels] Add support for loading several index patterns per data source +# 0.2.47 -## 18.07-04 +Released: 2020-09-23 -Released: 2018-07-04 +* ELK + * [enriched/githubql] Add new study 'enrich_reference_analysis' -* Kidash -** Don't sys.exit from kidash.py library (raise exceptions) +* Sigils + * [gerrit] Change `timeopen` to `painless_delay` -* Mordred -** [task_panels] Manage the error loading panels, log it and continue execution +* SirMordred + * [githubql] Add new study "enrich_reference_analysis" -## 18.07-03 +# 0.2.46 -Released: 2018-07-03 +Released: 2020-09-14 -* Sirmordred -** [task_panels] Add support for loading index patterns +* ELK + * [enriched/gerrit] Add new study 'enrich_demography_contribution' + * Check for author in comment raw data before assigning to user object + * [schema] Fix slack schema CSV file + * [enriched/gerrit] Add new fields `open` and `wip` + * [enriched/jira] Add `is_closed` and `status_category_key` fields +* Perceval + * Update dulwich package version + * Add support for specifying Gerrit SSH key location -## 18.07-02 +* Sigils + * [gerrit] Update index pattern + * Update documentation about Kidash + * [docker] Add links and import instructions + * [discourse] Add links and import instructions + * [gitlab] Add links and import instructions + * [gitter] Add links and import instructions + * [maniphest] Add links and import instructions + * [mediawiki] Add links and import instructions + * [slack] Add links and import instructions + * [global] Add links and import instructions + * [affiliations] Add links and import instructions + * [code] Add links and import instructions + * [demographics] Add links and import instructions + * [gerrit] Add links and import instructions + * [lifecycle] Add links and import instructions + * [jira] Add links and import instructions + * [jenkins] Add links and import instructions + * [chaoss] Add links and import instructions + * [onion] Add links and import instructions + * [bugzilla] Add links and import instructions + * [github] Add links and import instructions + * Add new icons license information + * [git] Add links and import instructions + * [jekyll] Update theme colors + * [jira] Use `painless_delay` as the time the issue stay open + * [jira_backlog] Use `painless_delay` as the time the issue stay open + * [jira_timing] Use `painless_delay` as the time the issue stay open -Released: 2018-07-03 +* SirMordred + * Add new study "demography_contribution" + * Update Getting Started guide with identities management section + * Fix lifecycle file name -* Kidash -** Add release date support for Index Patterns -* Sigils -** Add panels for kibiter 6.1.0 migration +# 0.2.45 +Released: 2020-07-27 -## 18.07-01 +* GrimoireLab + * Remove 'manuscripts' from the release due there is + a broken depencency with matplotlib and numpy. -Released: 2018-07-02 -* Kidash -** [tests] Add test for split-index-patterns new param -** [kidash] Add support for importing and exporting only index patterns -** Update mapping in Kibana6 if needed -** Add constant for release date field name -** Add try/except to show content of error responses -** Add release_date to panel json +# 0.2.44 +Released: 2020-07-27 -## 18.06-03 +* ELK + * [enriched/git] Study aoc support extra fields + * [enriched/mediawiki] Add `repository_labels` field -Released: 2018-06-28 +# 0.2.43 -* SortingHat -** [tests] Adapt tests to run with setup.py test -** [all] Remove support for Python 2.7 -** [db:api] Add functions for all the low level operations on SortingHat -** [api] Improve output messages for enrollment commands -** [exceptions] Rename WrappedValueError to InvalidValueError +Released: 2020-07-21 * Perceval -** [tests] Replace datetime function with equivalent toolkit one -** [meetup] Pythonicize `calculate_time_to_reset` -** [backends] Add backend for Twitter -** Mozilla -** OPNFV -** Puppet + * [githubql] Add pull request author to ClosedEvent + * [slack] Use channels.history to retrieve message + +* ELK + * Update pyproject.toml with PyMySQL pinned dep + * [deps] Pin PyMySQL dependency + * [enriched-githubql] Add pull request submitter to closed events + * [enriched/phabricator] Fix the field `time_to_close_days` + * Fix Issue#907 + * [enriched-enrich] Set user-agent for geopy + * Fix wrong quotation + * [enriched-git] Execute update_items when local repo commits are returned + * [enriched-githubql] Add page size param to duration study + +* Hatstall + * [readme] Fix instruction to install requirements * Mordred -** Change name from mordred to sirmordred - -* grimoirelab-elk -** [mattermost] Add mattermost support for gelk (raw + enrich) -** [tests] Modify tests for Twitter backend -** [utils] Modify connector information for twitter -** [twitter] Modify enrich connector -** [twitter] Modify raw connector -** [tests] Allow testing with latest grimoirelab component versions -** [enrich] Align ELK with changes in SortingHat -** [enriched][github] Add code to calculate the first reaction duration to an issue -** [enrich][redmine] Add `assigned_to` fields -** [jira] Fix mapping to avoid limit number of fields exception -** [bugzilla] Fix immense term exception for activity attribute -** [elastic] Add template to force date format -** [raw] Update mappings for jenkins to ES 5.x -** [enrich] Handle deleted user in stackoverflow -** [enriched] Add `latest_date` method to connector + * Save new changes made in Dashboard by mounting the volume in ES + * Remove inconsistency in displaying images + * Add info about pulling in latest data * Sigils -** [owlwatch] Move owlwatch to its own repo -** [GitHub] Revamp timing panels -** [GitHub ]Update PRs overview panel -** [demographics] Fix y-axis label for leaving devs -** [slack] Add projects table - -* Manuscripts -** Updated comments in esquery.py + * [github-closed-events] Include submitters and reporters in dashboard + * [maniphest] Change `painless_delay` instead of `timeopen_days` + * [github-label-events] Improve dashboard + * Add acknowledgments section to DevRel dashboards -* Kidash - -* GrimoireLab Toolkit - -* King Arthur - -* Bestiary +# 0.2.42 -* Hatstall - -* Ceres +Released: 2020-06-20 -## 18.06-02 - -Released: 2018-06-08 +* Perceval + * [slack] Handle messages without user/bot ID + +* ELK + * Add release note for rocketchat + * [enriched-slack] Handle messages without user data/bot ID + * [enriched-githubql] Add reporter data to enriched docs + * [enriched-mbox] Handle long body emails + * [enriched-githubql] Add duration analysis study + * [rocketchat] Increase test coverage and complete doc + * [rocketchat] Patch for PR #882 + * [rocketchat] Add support for RocketChat + * [grimoire_elk] Remove tzinfo for date comparison * Mordred -** [studies] Handle empty list of studies in backends + * [config] Add support for duration analysis + * [doc] Add instructions to mine rocketchat + * [docs] Update Getting-Started.md result image -## 18.06-01 +# 0.2.41 -Released: 2018-06-07 - -* SortingHat -** [parsing:sh] Make gender profile info not required +Released: 2020-06-13 * Perceval -** [backend] Include category in backend params -** [github] Add list of commits hashed included in pull requests -** [pipermail] Fix command line parameters -** OPNFV -** Puppet - -* Mordred - -* grimoirelab-elk -** [stackexchage] Fix fields for questions having an accepted answer -** [jira] Fix typo in enriched jira fields -** [studies][demography] Use author_uuid field to aggregate the authors instead of author_id -** [enrich] Modify max length for keyword fields + * [backend] Add Rocket.Chat backend + * [perceval] Fix flake8 errors + * [doc] Add Slack API token generation info + * [slack] Update resource endpoints + * [launchpad] Add missing `package` parameter in launchpad * Sigils -** [discourse] Add % of questions answered -** [stackoverflow] Fix % of questions answered -** [askbot] Add % of questions with accepted answer -** [panels] Add community structure panels & documentation -** [panels] Add accepted answers and project support -** [panels] Fixed links to issues and revamp (jira) -** [panels] Refurbish Jira panel -** [panels] Fix typo in Jira panels -** [panels] Modify answers table for consistency -** [Panels] Rearrange project and authors widgets -** [panels] Add project support to Askbot -** [panels] Add crates to Data Status + * [slack] Add DevRel dashboard + * [GitHub] Add DevRel dashboard + * [discourse] Add DevRel dashboard + * [github] Add dashboard about label-related events + * [github2-pulls] Update index pattern + * [github2-pulls] Change order results metric in table vizs + * [github2-issues] Update index pattern + * [github2-issues] Change order results metric in table vizs + * [slack] Add new files metrics to index pattern + * [gerrit] Add changeset status and value to index pattern + +* ELK + * [deps] Constrain numpy version to <= 1.18.3 + * Release 0.73.0 + * Fix formatting git private repos note + * [enriched-githubql] Add label attribute to closed events + * [enriched-mediawiki] Handle filters on repo URL + * [elastic] Support for filter no-collection on multi params URLs + * [enriched-confluence] Extract username from publicName attr + * [enriched-git] Sync AOC and Git raw index + * [enriched-git] Handle anonymized repos in update_items + * [enriched-cocom] Include files in revision + * [elk] Fix flake8 errors + * [tests] Rename study indexes for tests to ease deletion + * [elk] Handle private repos in git studies + * [enriched-utils] Remove credentials for repository filter + * [raw-git] Remove credentials from origin + * [elk] Move anonymize_url to enriched/utils.py + * [enriched-cocom] Propagate commit parents to enriched index + * [utils] Remove unused function get_time_diff_days + * [enriched-mbox-study-kip] Fix calculation for inactive days + * [grimoire_elk] Replace datetime/dateutil calls with toolkit + * [utils] Remove get_git_repos + * [enriched] Remove projects.py + * [launchpad] Add support for launchpad + * [enriched-gerrit] Propagate changeset status to patchsets + * [slack] Update files metric + * [tests] Add tests for `copy_raw_fields()` method + * [Enrich] Add `copy_raw_fields()` method and refactor enrichers + * [telegram] Improve test coverage + * [Mbox] Add tests and test data for MBox KIP study. + * [test] Add missing test for perceval params -* Manuscripts -** Updated esquery.py and created tests/test_esquery.py -** Updated esquery.py to use elasticsearch_dsl in all places +* Mordred + * [task_panels] Upload label-related dashboard + * [docs] Update getting-started with ES/Kibiter 6.8 + * [tests] Remove panels test for kibiter 5.x + * [aliases] Remove affiliations and all_enriched aliases for github2 + * [tests] Add tests to process filter-no-collection on multi params URLs + * [task_panels] Remove support for Kibiter < 6.x + * [tests] Update requirements_test + * [sirmordred] Remove credentials from private URLs + * [task_identities] add `no-enrollment-periods-validation` + * [aliases] Fix enrich alias for gerrit + +* Sortinghat + * [deps] Constrain numpy version to <= 1.18.3 + * Update version number to 0.7.13 + * [misc/grimoirelab2sh] Add new argument to avoid periods validation + +* Graal + * [cocom] Remove first slash from file path + * [travis] Change how to install nomos + * [cocom] Include files info in docs generated + * [cocom] Include parents info in docs generated -* Kidash -** [kidash] Preserve uiStateJSON dict when cleaning a dashboard from not needed data sources -** [kidash] Use #!/usr/bin/env python3 to work inside venvs correctly +* Cereslib + * [enrich-enrich] Fix flake8 E741 ambiguous variable name + * [deps] Constraint numpy version to <= 1.18.3 + * version number to 0.1.13 + * [test] Add test for Git events -* GrimoireLab Toolkit +* Kidash + * [kidash] Remove support for kibana <6.x + * [kidash] Improving log messages + * [kidash] Support import to Kibiter/Kibana 6.8 -* King Arthur -** [tests] Align tests with arthur tasks validation -** [arthur] Add validation for tasks -** [tests] Fix tests for server -** [jobs] Add category to backend arguments -** [scheduler] Fix wrong date conversion -** [server] Allow to add tasks without archiving/scheduling options -* Bestiary +# 0.2.40 -* Hatstall +Released: 2020-04-24 -* Ceres +* Perceval + * [perceval] Add githubql backend + * [doc]Fixed minor typos + * [Travis] upgrade pip and setuptools + * [pagure] Add sanitize for archive + * [mattermost] Add sanitize for archive + * [github] Add sanitize for archive + * [discourse] Add sanitize for archive + * [backend] Add predefined paramaters to clients + * [pagure] Fix failing tests + * [backend] Add Gitter backend + * [gerrit] Extend `--start` param to gerrit 3.x +* Perceval-opnfv + * [travis] Upgrade setuptools and pip +* Perceval-puppet + * [travis] Upgrade setuptools and pip +* Perceval-mozilla + * [travis] Upgrade setuptools and pip +* Perceval-finos + * [travis] Upgrade setuptools and pip +* Graal + * [travis] Upgrade setuptools and pip +* Sortinghat + * [doc] Add examples of SortingHat API via Python + * [travis] Upgrade setuptools and pip + * Clarifying sortinghat intro + * Fix broken link to Perceval in README.md +* Mordred + * [mordred] Add support for github events + * [doc-git] Add parameter `run_month_days` in `enrich_git_branches` + * This commit adds config, alias, menu entry and documentaion for gitter backend. + * Fixed the typoes of docker/README.md + * [doc] Add Pagure datasource + * [tests] Remove user/password from es_enrichment section + * Remove user and password parameter from elastic section + * added section in getting started and reformatting + * added section in getting started and formatting + * [travis] Upgrade setuptools and pip + * [tests] Add requirements_tests.txt + * [docs] revamp of getting-started.md + * Fixed Broken Backlinks + * Added some sections in 'How to' of GettingStarted document + * Make anonymization optional for each backend + * fixed link for ssl error and other fixes + * fixes made as per comments + * Corrected 'Sudo' with 'sudo' + * Added how-to dump a mapping/data from an index + * added installation for docker and docker-compose, added errors and solutions in troubleshooting section + * fix typo in README.md + * Fixing typo in Sir Mordred's README.md + * [Getting-started] Update kibiter version to 6.1.4-3 + * Add "How to modify the menu" to the getting started guide + * [doc]Added section in 'How to' in Getting-Started.md + * Fixed a backlink + * [doc] Added How to section in Getting-Started + * [sirmordred] Remove duplicate call of execute_batch_tasks +* Kingarthur + * [travis] Upgrade setuptools and pip +* Manuscripts + * [travis] Upgrade setuptools and pip + * [travis] Support for python 3.5 and 3.6 +* Cereslib + * [travis] Upgrade setuptools and pip + * Fix a small typo +* Toolkit + * [travis] Upgrade setuptools and pip +* ELK + * Fix body store-and-process-github-events.yml + * [ELK] Add poetry support + * [releases] Add release note for feature #853 + * [ELK] Store and process github events + * [enrich-git] Add the param `run_month_days` to enrich_git_branches + * [enriched-git] Handle connection problems during enrich_git_branches + * This commit addds support for gitter backend. Raw and Enriched indexes have been added along with their tests and schemas. + * [pagure] Add support for Pagure + * updated the docstring for pair_programming + * [enriched-bugzillarest] Add new field `is_open` + * changed logic to delete all test indexes + * added test for pair_programming + * [travis] Upgrade setuptools and pip + * [enriched] Check first if the instance of `item` is dict + * add language field and compute all cocom study metrics per language + * added projects_map db to improve coverage + * [releases-notes] Add release note for fix #826 + * [enriched-meetup] Handle event without geolocation + * [meetup] Make users anonymization optional for meetup + * [gitlab] Make owners data anonymization optional for gitlab + * [github] Make owners data anonymization optional for github + * [git] Make author anonymization optional for git + * Make anonymization optional for each backend + * modified:final test_git.py + * [schema] Update dockerhub.csv + * [schema] Update askbot.csv + * [schema] Update mattermost.csv +* Sigils + * [bugzilla-timing] Change `painless_time_to_now` instead of `timeopen_days` + * [github] Add dashboard about closed events + * [bugzilla-backlog] Change `painless_time_to_now` instead of `timeopen_days` + * [bugzilla] Change `painless_time_to_now` instead of `timeopen_days` + * [gitter] Add gitter panels. + * Updated docker.json, replaced sirmordred repo link -## 18.05-03 -Released: 2018-05-31 +# 0.2.39 -* SortingHat +Released: 2020-03-20 +* Kidash + * [kidash/kidash] Delete dependency with `grimoirelab-panels` + * [doc] Update README +* Graal + * [graal] Update license and copyright information +* Cereslib + * [events] Add support for multiple affiliations +* Mordred + * [doc] Add PyCharm installation instructions + * added logging to file support for micro.py + * Troubleshooting fixed + * [doc] Fix askbot configuration typos + * Fix broken backlinks in supported resources + * Refracted Readme, Added navigation and contents + * Fixed README for docker-compose(without SearchGuard) with changes + * Corrected mariadb services for docker-compose.yml for without SearchGuard section + * [doc] Added Getting-Started doc + * added color logging facility in micro.py + * [micromordred] Replace actual api-token + * fixed username and pass for kibiter login + * Update README.md troubleshooting section - processes conflict with SearchGuard + * Update README.md troubleshooting section - processes conflict with SearchGuard + * Update 'Source code and docker' section of README.md to include unsecure docker-compose + * correcting spelling mistakes in Readme + * Added Empty Index Problem with Solution in troubleshooting section of Readme + * [utils] Add script to upload menu and dashboards + * Fixed phase enrichment time duration not counting days + * Added troubleshooting section in readme + * [sirmordred] Remove support for arthur + * [task_panels] Upload panels from the sigils module + * Merge branch 'add-colic' of 'https://github.com/snack0verflow/grimoirelab-sirmordred' + * [doc] Update readme with colic data and fix lexical order + * [readme] Improve doc to get a token for twitter + * [doc] Add sample cocom fields +* ELK + * [schema] Add attribute for multi org names in github_pull_requests.csv + * [schema] Add attribute for multi org names in github_issues.csv + * [schema] Add attribute for multi org names in git.csv + * [enriched-mappings] Update aoc mappings + * [enriched-study-ceres-onion] Support for multiple affiliations + * [tests] Add tests for multi_org_name fields + * [jira] Propagate multiple affiations attributes + * [gerrit] Propagate multiple affiations attributes + * [grimoire_elk] Add support for multiple affiliations + * modified: tests/test_git.py + * [raw-gerrit] Handle long text for data.patchSets.comments.message + * Update github_backlog.csv for a field missing + * [git] Include fields related with sortinghat when it is disabled + * [meetup] Include fields related with sortinghat when it is disabled + * [gitlab] Include fields related with sortinghat when it is disabled + * [github] Include fields related with sortinghat when it is disabled + * [sortinghat] Create enriched fields related to Sortinghat when it is disabled + * [enriched-gitlab] Fix repository value in issue + * [schema] Update field description + * [schema] Add project and project_1 descriptions to jenkins + * [elk] Remove support for arthur + * Update the mattermost.csv to fix a format issue + * [doc] Update readme for secure elasticsearch * Perceval -** [tests] Increase coverage pipermail -** [pipermail] Disable SSL verification -** Mozilla -** OPNFV -** Puppet + * [groupsio] Update log message + * [perceval] Update license and copyright information + * [backend] Add Pagure backend to Perceval + * [perceval] Update license info + * [groupsio] Format from_date with utc+0 timezone + * [doc] Fix broken link in README +* Sigils + * [jenkins] Add index pattern + * Remove date formatting for grimoire_creation_date + * [all_enriched_tickets] Add date format + * [all_enriched] Add grimoire_creation_date format + * [affiliations] Add grimoire_creation_date format + * [github_issues] Update index pattern to include multi org names + * [git_areas_of_code] Update index pattern to include multi org names + * [git] Update index pattern to include multi org names + * [all_onion] Update index pattern to include multi org names + * [all_enriched_tickets] Update index pattern to include multi org names + * [all_enriched] Update index pattern to include multi org names + * [affiliations] Update index pattern to include multi org names + * Update affiliations index pattern + * [jenkins-job-categories] Add Jenkins projects pie chart + * [jenkins-nodes] Add Jenkins projects pie chart + * [jenkins-jobs] Add Jenkins projects pie chart + * [jenkins] Add Jenkins projects pie chart + * [jenkins] Update index pattern + * [twitter] Add link format to author_uuid field + * [stackoverflow] Add link format to author_uuid + * [slack] Add link format to author_uuid field + * [rss] Add link format to author_uuid field + * [redmine] Add link format to author_uuid field + * [meetup] Add link format to author_uuid field + * [mediawiki] Add link format to author_uuid field + * [mbox] Add link format to author_uuid field + * [mattermost] Add link format to author_uuid field + * [maniphest] Add link format to author_uuid field + * [kip] Add link format to author_uuid field + * [jira_resolution_date] Add format to author_uuid + * [jira] Add link format to author_uuid field + * [irc] Add link format to author_uuid field + * [gitlab-mrs] Add link format to author_uuid field + * [gitlab-issues] Add link format to author_uuid + * [github2-prs] Add link format to author_uuid + * [guthub2-issues] Add link format to author_uuid + * [git-aoc] Add link format to author_uuid field + * [gerrit] Add link format to author_uuid field + * [discourse] Add link format to author_uuid field + * [demographics] Add link format to author_uuid + * [confluence] Add link format to author_uuid field + * [bugzilla] Add link format to author_uuid field + * [askbot] Add link format to author_uuid field + * [all_onion] Add link format to author_uuid field + * [all_enriched_tickets] Add format to author_uuid + * [github-issues] Add link format to author_uuid + * [git] Add link format to author_uuid field + +# 0.2.38 + +Released: 2020-02-25 +* Perceval + * Fixed Typos and Grammatical Errors + * [telegram] Handle edited messages + * Update doc in README + * [github] Update the docstrings + * [twitter] Support for SSL verification + * [telegram] Support for SSL verification + * [stackexchange] Support for SSL verification + * [slack] Support for SSL verification + * [rss] Support for SSL verification + * [launchpad] Support for SSL verification + * [jenkins] Support for SSL verification + * [meetup] Support for SSL verification + * [mediawiki] Support for SSL verification + * [hyperkitty] Support for SSL verification + * [googlehits] Support for SSL verification + * [gitlab] Support for SSL verification + * [dockerhub] Support for SSL verification + * [discourse] Support for SSL verification + * [confluence] Support for SSL verification + * [bugzillarest] Support for SSL verification + * [groupsio] Support for SSL verification + * [github] Support for SSL verification + * [jira] Support for SSL verification + * [mattermost] Support for SSL verification + * [phabricator] Support for SSL verification + * [pipermail] Support for SSL verification + * [mbox] Support for SSL verification + * [redmine] Support for SSL verification + * [bugzilla] Support for SSL verification + * [askbot] Support for SSL verification + * [client] Support for tunable SSL verification + * [backend] Allow to disable SSL verification + * [doc] Update groupsio documentation in README.md + * [groupsio] Fetch messages after a given date +* ELK + * [github2] Fix loading identities + * [github] Fix filter classified in GitHub and GitHub2 enrich + * add schema for backlog studie + * Add additional index to compute the chronological evolution of opened issues and average opened time issues. + * add description in git schema for commit_tags field + * add "tags" field in git enriched index to get the number of releases. + * [schema] Add scheams for docker smells and deps + * [grimoire_elk] Add connectors for docker smells and deps + * [grimoire_elk] Support for Docker smells analysis + * [grimoire_elk] Support for Docker dependencies analysis + * Update README.md + * [tests] Stop loop when finding a target study + * [tests] Move httpretty to requirements_tests + * [github2] Add support for feeling study + * [enriched-enrich] Add enrich_feelings study + * [schema] Add CSV for survival git data + * [dependencies] Add statsmodels dep to setup and requirements + * [enriched-git] Add support for survival study + * [enriched-enrich] Add survival developer study + * [doc] Add documentation to run tests and coverage + * [doc] fix mistake in README.md + * [enriched-telegram] Handle edited message + * [enriched-telegram] Handle missing username in Telegram messages + * [enriched-jira] Handle missing creator/ assignee displayName and name + * [tests] Fix tests for enrich_geolocation + * [raw-bugzillarest] Prevent indexing of clones attribute +* Hatstall + * [hatstall] Fix method editing organization domain + * Update templates location to make the application self-contained + * Update files to create the django-hatstall pip package + * [docs] Update documentation * Mordred -** [studies] Allow setting up kafka_kip via cfg -** [task_projects] Add new eclipse_projects_lib.py -** [tests] Add tests for task_manager -** [config] Include sections for studies -** [tests] Align tests for studies with new functionalities -** [task_enrich] Forward study params to ELK -** [tests] Enable tests with latest versions of grimoirelab components -** [task] Improve parsing parameters for perceval - -* grimoirelab-elk -** [twitter] Set field_date for twitter enricher to created_at -** [enrich][bugzilla] Remove emails from enriched index -** [enrich][meetup] Change log from error to warning when the date are incorrect from upstream data -** [gelk-mapping] Add the script to setup.py so it is installed with the pip package -** [gelk_mapping] Generate files with the JSON mappings to be used by elasticdump to create the indexes -** [elk] Propagate study params from mordred to elk -** [enrich] Create all_onion alias if not exist -** [git] Generalize areas of code study -** [gelk_mapping.py] Script to show the mappings for a data source -** [raw] Reduce the number of fields indexed for jenkins items -** [elk] Fix enrichment of stackexchage answers - + * [mordred] Add support for backlog analysis study + * [doc] Add instructions to use dockersmells and dockerdeps + * [doc] fix docker-compose file + * Removed faulty parameter from utils/setup.cfg + * [aliases] Fix supybot alias `irc` instead of `supybot` + * [doc] Add instructions to execute the enrich_feelings study + * [config] Add `enrich_feelings` study + * [doc] Add instruction to execute `enrich_forecast_activity` study + * [config] Add support for `enrich_forecast_activity` study + * [sirmordred] Remove doc folder + * [config] Remove write_doc method + * [doc] Add an example of setup.cfg and projects.json for each data source + * [doc] Clarify the behavior of the 'Data Status' and 'Overview' dashboards + * [aliases.json] Remove old github2 aliases + * Add info about labels +* SortingHat + * [tests] Fix `test_not_null_source` in test_model + * [db-model] Remove CoerceToBool type + * Add requirements file +* Graal + * [coqua] Add support for Docker smells analysis + * [tests] Add travis support for Jadolint + * [codep] Add support for Docker dependencies analysis + * [analyzers] Add support for Jadolint + * [graal] Add exec_path as default parameter + * [graal] Use backend name to init default git path +* Sigils + * [docker] Add dashboard for docker smells and dependencies + * [feelings] Add dashboard for github comments, collaboration and feelings + * [org-tracking] Add org tracking dashboard + * Add organization tracking overview documentation + * [doc] Delete hidden documentation pages + * [doc] Update link for mediawiki dashboard + * [sigils] Remove images in docs/assets/images + * [doc] Add info to create a Gemfile in contributing.md + * Update Affiliations documentation + * Uodate all_enriched index pattern + * Update text of Hatstall links from Affiliations + * Fix collaboration dashboards documentation + +# 0.2.37 + +Released: 2020-01-28 + +* ELK + * [enriched-gitlab] Fix repository value in merge + * [travis] Support for python 3.7 + * [requirements] Relaxing pandas constraint + * [enriched-github2] Add support for geolocation study + * [enriched-enrich] Add geolocation study + * [enriched-github2] Remove hardcoded geolocation support + * [enrich-github] Remove dead code + * [enriched-github] Remove hardcoded geolocation support + * [dep] Add geopy dependency + * [enriched-dockerhub] Handle never updated images + * [git-enriched] Remove github commit support + * [elastic] Refactor all_properties method + * [tests] Add tests for elastic.py + * [elastic] Change logic to handle errors when creating a mapping + * [elastic] Initialize `error` variable for `safe_put_bulk` + * [elastic] Improve methods documentation + * [elastic] Rename `_check_instance` method + * [elastic] Replace dateutil call with str_to_datetime + * [elastic] Move logic to create index to new method + * [elastic] Enable loading of complex aliases + * [tests] Fix CI tests for elastic items + * (fix-ci-travisx) [elastic_items] Improve doc and test coverage + * [elk] Replace ElasticConnect, ElasticWriter exceptions with ElasticError + * [errors] Add ElasticError + * Let pandas be >= 0.22.0 + * [utils] Remove track_items script and related methods + * [elk] Remove `get_items_from_uuid` method + * [github2] Update github2 fields + * Fix possible error 2 + * Fix possible error + * Fix flake8 errors + * Add support for releasing scroll and waiting for available scroll (wait configurable amount of time) + * [enriched-colic] Handle missing commit message + * [enriched-cocom] Handle missing commit message + * [schema] Update colic schema + * [schema] Update cocom schema + * [enriched-colic] Handle credentials in origin + * [enriched-cocom] Handle credentials in origin + * [raw-github] Handle immense term for data.reviews_data.body +* Hatstall + * [docker] Download Hatstall code while the container is built +* Mordred + * [doc] Add example for github2 sections + * [travis] Support python 3.7 + * [config] Add support for geolocation study + * [sirmordred] Remove support for github commit + * [aliases] Handle complex aliases + * [doc] Add notes to enable github-comments + * [aliases] Add github2 aliases for issues and pull requests + * [task_panels] Support github-comments dashboard upload + * [config] Add support for github-comments + * [tests] Add test with archives for task_enrich + * [tests] Optimize test for task_collection + * [doc] Complete list of data sources supported + * Made gitlab issues naming consistent +* SortingHat + * [setup] Let pandas be >= 0.22.0 +* Cereslib + * [setup] Reduce constraints on dependencies * Sigils -** [panels] Add accepted answers to Discourse panel -** [panels] Add areas of code panel -** [confluence] Increase rows and sort by page edits -** [confluence] Use `content_url` for page links + * [docs] Add documentation for gerrit approvals dashboard + * [gerrit-approvals] Fix typo in `Approvals by Contributor` + * [docs] Add documentation for gerrit dashboard + * [docs] Update name and image of gerrit review efficiency dashboard + * [docs] Update gerrit review efficiency + * [gerrit] Align nomenclature in Gerrit panels + * Fix schema links + * Fix broken link to github2_issues schema + * [gerrit_approvals] Add total number of approvals + * Add GitHub pull requests collaboration dashboard + * Add GitHub issues collaboration and comments dash + * Update affiliations dashboard + * [colic] Update colic panels + * [cocom] Update cocom panels + * Update Jekyll installation instructions + * Update Kidash installation to mention Python 3 -* Manuscripts -** [metrics][gerrit] Use closed date field for computing the TTM (time to merge) metric -* Kidash +# 0.2.36 -* GrimoireLab Toolkit +Released: 2019-01-08 -* King Arthur -** [setup] Update Perceval version -** [jobs] Modify imports of perceval functions +* ELK + * [enriched] Remove support geolocation for github enriched indexes -* Bestiary -* Hatstall +# 0.2.35 -* Ceres +Released: 2019-01-03 +* ELK + * [raw-bugzillarest] Set text mapping type for thetext attribute +* Graal + * Fix lizard package dependency +* Hatstall + * [hatstall] Support check/uncheck all options in checkbox tables + * [hatstall] Add support for editing organizations and domains +* Kidash + * [setup] Remove ELK dependency + * [kidash/kidash] Remove ELK imports + * [bin/kidash] Remove ELK imports + * [bin/kidash] Remove unused imports +* SortingHat + * [database] Allow SSL connections -## 18.05-02 -Released: 2018-05-17 +# 0.2.34 -* SortingHat +Released: 2019-12-19 * Perceval -** [setup] Fix to let setup.py test run -** Add readthedocs badge -** [backend] Replace datetime import with grimoirelab-toolkit -** Mozilla -*** Fix support for package namespaces -** OPNFV -*** Fix support for package namespaces -** Puppet -*** Fix support for package namespaces - -* Mordred - -* grimoirelab-elk -** [enrich][twitter] Use case insesitive tags for doing the projects mapping -** [studies][demography] Add tests for the study -** [studies][demography] Use author_id field to aggregate the authors instead of Author + * [jenkins] Log debug message when builds are not found + * [jira] Add info for data obtained with authenticated access * Sigils + * Update CONTRIBUTING.md + * [engagement panel] Fix dashboard name + * [colic] Fix dashboard name + * [cocom] Fix dashboard name + * Fix file name to use hypens instead of underscores + * [github_issues] Retitle issues open to issues + * [gitlab_issues] Retitle issues open to issues + * [about] Add mention to CHAOSS project + +* ELK + * [enrich-gitlab] Handle TypeError: 'NoneType' exception + * [utils] Add 429 error to status_force_list + * [enriched-gerrit] Handle missing user info -* Manuscripts -** [docstrings] Complete docstrings for manuscripts +* SirMordred + * [docker] Remove track_items info from readme + * [tests] Fix flake8 errors + * Add unit tests for the main methods of healthcheck.py + * Add healthcheck to Docker image with a call to the script 'utils/healthcheck.py' + * Add healthcheck script to installation setup file + * Python healthcheck script added to utils folder + * [task_panels] Include OSPO panels in community menu -* Kidash +* SortingHat + * [matching-email] Remove `_filter_emails` + * [matching-email] Support blacklist when strict matching is False + * [tests] Remove hard-coded DB params + * [travis] Support for python 3.5 and 3.6 + * [tests] Set mysql `sql_mode` in travis + * [tests] Add mysql service to travis.yml -* GrimoireLab Toolkit -* King Arthur +# 0.2.33 -* Bestiary +Released: 2019-11-28 -* Hatstall +* Sigils + * [git] Update index pattern to include hour/weekday fields + * [meetup] Update index pattern to handle group_urlname attribute + * [gerrit] Update painless_delay in index pattern + * [all_enriched] Make URLs clickable + * [demographics] Update screenshot + * [sigils] Add OSPO panel collection -* Ceres +* Perceval + * [gitlab] Raise client error if oauth is set and token is not + * [discourse] Pass credentials via headers + * [jenkins] Handle workflow multibranch job builds + * [tests] Fix variable names in github test + * [github] Handle `None` requested reviewers + * [groupsio] Add log message upon download archives failure + * [travis] Support for python 3.5 and 3.6 + * [doc] Add git and build-essential to requirements section + + +* Graal + * [tests] Increase test coverage for codep and colic + * [graal] Fix worktree creation + * [graal] Change logic to create worktree + * [tests] Add base class to handle tests on analyzers + * [tests] Add base class to handle setup of test Git repo + * [graal] Replace git cmd with /usr/bin/git + * [readme] Add SCC description to README.md + * [tests] Add tests for SCC analyzer + * [cocom] Added support of scc analyzer to Code Complexity Backend + + +* KingArthur + * [server] Add reschedule method to the REST API + * [arthur] Allow to re-schedule failed tasks + * [scheduler] Allow to reset task counters + * [scheduler] Handle TaskRegistryError + * [server] Fix docstring for `task` + * [arthur] Handle TaskRegistryError + * [tasks] Raise TaskRegistryError on task operations + * [errors] Add TaskRegistryError + * [tasks] Handle Redis errors + * [arthur] Fix typos and warnings + * [tasks] List tasks based on key prefixes + * [tasks] Convert exception to warning when updating tasks + * [tasks] Replace dangerous redis commands + * [scheduler] Support for reading tasks from redis + * [tasks] Add update operation + * [tasks] Use redis to store tasks + * [scheduler] Reschedule failed tasks into the retry queue + * [travis] Support for python 3.5 and 3.6 + * [tasks] Add JobData tuple to store jobs in the task job list + * [server] Return job_number from the metadata of the Job + * [scheduler] Save job_number in the meta field of the job enqueued + + +* Grimoire ELK + * [github2] Add schema for new version of pull index + * [github2] Add schema for new version of issue index + * [enriched-github2] New enricher to handle comments and reactions + * [enriched-git] Handle missing local git repo + * [travis.yml] Support for tests using ODFE + * [studies-aoc] Support for ODFE + * [studies-onion] Support for ODFE + * [enriched] Update bulk endpoint to support ODFE + * [enriched-enrich] Update bulk endpoint for ODFE + * [enriched-ceres_base] Add class variable for ES major version + * [elastic_items] Handle ODFE page info on pagination + * [elastic] Update bulk and mapping endpoints for ODFE + * [enriched-gerrit] Handle missing reviewer info + * [raw-elastic] Change to 'format()' in the logs + * [elk] Change to 'format()' in the logs + * [elastic_items] Change to 'format()' in the logs + * [elastic] Change to 'format()' in the logs + * [enriched-study_ceres_onion] Change to 'format()' in the logs + * [enriched-study_ceres_aoc] Change to 'format()' in the logs + * [enriched-stackexchange] Change to 'format()' in the logs + * [enriched-sortinghat_gelk] Change to 'format()' in the logs + * [enriched-remo] Change to 'format()' in the logs + * [enriched-mozillaclub] Change to 'format()' in the logs + * [enriched-meetup] Change to 'format()' in the logs + * [enriched-mediawiki] Change to 'format()' in the logs + * [enriched-mbox_study_kip] Change to 'format()' in the logs + * [enriched-mbox] Change to 'format()' in the logs + * [enriched-kitsune] Change to 'format()' in the logs + * [enriched-jira] Change to 'format()' in the logs + * [enriched-jenkins] Change to 'format()' in the logs + * [enriched-gitlab] Change to 'format()' in the logs + * [enriched-enrich] Change to 'format()' in the logs + * [enriched-ceres_base] Change to 'format()' in the logs + * [enriched-askbot] Change to 'format()' in the logs + * [enriched-git] Change to 'format()' in the logs + * [enriched-gerrit] Change to 'format()' in the logs + * [enriched-functest] Change to 'format()' in the logs + * [enriched-dockerhub] Change to 'format()' in the logs + * [enriched-discourse] Change to 'format()' in the logs + * [enriched-bugzillarest] Change to 'format()' in the logs + * [enriched-bugzilla] Change to 'format()' in the logs + * [enriched-colic] Change to 'format()' in the logs + * [enriched-cocom] Change to 'format()' in the logs + * [enriched-github] Change to 'format()' in the logs + * [enriched] Return empty item_sh when sortinghat is not set + * [enriched-meetup] Fix typo in group url name + * [dependencies] Update redis to 3.0.0 + * [enriched-bugzillarest] Handle missing user info + * [travis] Support for python 3.5 and 3.6 + * [elastic_items] Remove white spaces from repo url with labels -## 18.05-01 -Released: 2018-05-10 +* SirMordred + * [sirmordred] Remove unused modules and change to 'format()' in the logs + * [sirmordred] Delete support to log rotation + * [doc] Remove eclipse load support for doc + * [sirmordred] Delete support to load eclipse projects + * [mordred] Decommission bot names params from setup.cfg + * [sortinghat] Fix issue when sortinghat is not in the config file + * [travis] Support for python 3.5 and 3.6 -* SortingHat -** [readme] Include troubleshooting section -* Perceval -** [mattermost] Add Mattermost backend -** Fix support for package namespaces -** Mozilla -** OPNFV -** Puppet +* Cereslib + * [events-events] Handle empty sortinghat dict + * [README] Add travis and coveralls badges + * [setup.cfg] Ignore W605 error + * [install] Align dependencies in requirements and setup + * [setup.cfg] Ignore W504 error + * [setup] Remove scripts param + * [cereslib] Remove import from __init__.py + * [enrich] Fix flake8 errors + * [dfutils] Fix flake8 errors + * [tests] Add travis CI -* Mordred -** [task_enrich] Ensure number of enrich tasks decreases upon failure -** [TaskManager] Fix unreachable code - -* grimoirelab-elk -** [elk] raise exception in do_studies -** [stackexchange] Add fields to csv to track accepted answers -** [discourse] Add fields to csv to track accepted answers -** [stackexchange] Add info to get the percentage of accepted answers -** [discourse] Add info to get the percentage of accepted answers -** [onion] Check author bucket to make sure it exists -** [twitter] Change date value to index tweets -** [enriched][bugzillarest] Fix comment and remove unneeded variable -** [twitter] Limit number of indexed fields -** [stackexchange] Handle deleted users -** [discourse] Add information to track accepted answers -** [stackexchange] Add information to track accepted answers -** [elastic] Remove not used global_mapping method -* Sigils +* Toolkit + * [datetime] Handle dates with offsets outside 24h + * [travis] Support for python 3.5 and 3.6 -* Manuscripts -* Kidash +# 0.2.32 -* GrimoireLab Toolkit +Released: 2019-10-28 -* King Arthur +* Sigils + * [docs] Update demographics.png + * [git-demographics] Change column name + * [demographics] Change column name + * [demographics] Change title `demographics_people_leaving_community` + * [git-demographics] Change title `git_demographics_people_living_community` -* Bestiary +* Perceval + * [github] Make fetching owners information from GitHub API optional + * [backend] Manage filtering of classified data within lists + * [github] Replace logging with logger call + * [test_backend] Provide test for find_backends + +* KingArthur + * [scheduler] Remove 'arthur' prefix and task id from job ids schema + * [setup] Update dependencies + * [jobs] Add human readable job identifier + * [arthurd] Add ignoring log-path msg when no-daemon is on + * [arthurd] Send log messages to stderr when --no-daemon is on + * [arthur] Remove 'bin/arthur' script + * [test_server] Add test of the job server endpoint + * [server] Expose jobs by job_id to the CherryPy server + * [requirements] Update package requirements + * [jobs] Replace job result object by Perceval summary + * [jobs] Refactor 'metadata' decorator + * [jobs] Generate items using BackendItemsGenerator + * [scheduler] Reschedule failed tasks with resuming + * [jobs] Remove jobs resuming support + * [tasks] Add has_resuming() method to task + * [test_worker] Add tests related to the job log storage + * [jobs] Store logs of each job in their "meta" field + +* HatStall + * Improve login form using Bootstrap style + +* Grimoire ELK + * [elastic_items] Fix message when scroll_size is 0 + * [tests] Add test for `enrich_extra_data` + * [enriched-github] Handle missing user information + * [enriched-enrich] Fix conversion projects.json to map + * [enriched-github] Removed not needed code. Added the missing sign off + * [enriched-git] Enable extra study + * [enrich] Add extra study + * [enrich] Adding new study to enable adding extra fields to a target index + * [travis] Support tests for python 3.5 and 3.6 + * [studies] Improve log messages + * [tests] Fix test enrich items discourse + * [enriched-discourse] Remove `__show_categories_tree` method + * [elk] Remove support for filter-raw-prefix + * [tests] Align tests to filter-raw-prefix removal + * [elastic-items] Remove support for `filter-raw-prefix` + * [p2o] Remove support for filter-raw-prefix + * [enriched-git] Handle empty repository errors + * [elk] Improve log messages + * [elastic_items] Change log level message + * [elastic] Compact log messages + * [raw-elastic] Improve log messages + * [enriched-utils] Change `min_enrich` value + * [tests] Increase test coverage for raw jenkins + * [tests] Increase test coverage for raw twitter + * [tests] Increase test coverage for raw supybot + * [tests] Increase test coverage for raw stackexchange + * [tests] Increase test coverage for raw nntp + * [tests] Increase test coverage for raw meetup + * [tests] Increase test coverage for raw mediawiki + * [tests] Increase test coverage for raw mbox + * [tests] Increase test coverage for raw mattermost + * [enriched-jira] Handle missing `fields` attribute + * [tests] Increase test coverage for raw github + * [tests] Increase test coverage for raw graal + * [tests] Increase test coverage for raw git + * [tests] Increase test coverage for raw functest + * [tests] Add test case for errors class + * [tests] Increase test coverage for raw dockerhub + * [tests] Increase test coverage for raw crates + * [enriched-discourse] Handle missing author information + * [raw-jenkins] Handle multiple params on repo url + * [grimoire_elk] Goodbye track_items.py + * Add minor changes to the README file. + * remove the dashboards folder -* Hatstall +* SirMordred + * [task_identities] Call sh affiliate after loading identities file + * [task_identities] Call sh unify after loading identites file + * [travis] Support tests for python 3.5 and 3.6 + * [tests] Add tests for enrich_extra_data study + * [doc] Improve desc projects_url + * [config] Add external study + * [studies] Improve log messages + * [task_enrich] Remove support for filter-raw-prefix + * [task] Remove support for filter-raw-prefix + * [task_manager] Conver INFO messages to DEBUG + * [task_enrich] Standardize refresh identities log messages + * [sirmordred] Improve log messages related to task projects + * [mordred] Ignore INFO messages from elasticsearch + * [task_enrich] Change `last_enrich_date` value + * [dependencies] Remove manuscripts dependency + * [doc] Remove reference to `task_report` + * [mordred] Remove `task_report` + * [task_project] Prevent random shuffling of repos + * [doc] Remove reference to `track_items` + * [mordred] Remove `track_items` support + * [doc] Update kibiter version to 6.1.4-5 + * [tests] Minor enhancements on tests + * [sirmordred] Set default sleep_for value if sortinghat is undefined + * [task_identities] Remove useless inherited code + * [task_enrich] Prevent calling sortinghat when not defined + * [task] Handle missing sortinghat params + * [doc] Refine README.md introduction + + +# 0.2.31 + +Released: 2019-10-01 + +* Grimoire ELK + * [doc] Improve README.md info + * [enriched-gitlab] Include milestone id, iid and url + * Add graal to setup.py, which is now a dependency. + * [enriched-git] Add weekday and hour info to enriched commits -* Ceres +* Perceval + * [gitlab] Set extra HTTP retry status from backend + * [jenkins] Handle skipped items info in summary + * [gitlab] Handle skipped items info in summary + * [gitlab] Use generic blacklist feature + * [jenkins] Replace blacklist-reviews with blacklist-ids + * [gerrit] Replace blacklist-reviews with blacklist-ids + * [backend] Add support for blacklisting items + * [errors] Add BackendCommandArgumentParserError + * [backend] Add origin unique field + * [backend] Change signature BackendCommandArgumentParser + +* Perceval-mozilla, Perceval-puppet, Perceval-opnfv, Perceval-finos + * [backend] Change signature BackendCommandArgumentParser +* Sigils + * [gitlab] Update index pattern for merge requests + * [gitlab] Update index pattern for issues -## 18.04-04 +* Graal + * [graal] Update metadata fields + * [backend] Change signature BackendCommandArgumentParser -Released: 2018-04-26 +* Manuscripts + * [manuscript] Fix flake8 errors + * [setup.cfg] Ignore W605 errors + * Added first line to make these files executable. + * [manuscripts] Update license and copyright info + * [setup] Fix format type for long description of package -* SortingHat +* SirMordred + * [README.md] Add projects.json section + * [utils] Comment arthur params in es-collection section + * [task_collection] Add filter-no-collection to ignore the collection + * [task_identities] Log number of organizations loaded + * [task_identities] Support lazy load of SH identities files + * [task_identities] Support lazy load of SH organizations + * [task_identities] Add `get_file_hash` function + +# 0.2.30 + +Released: 2019-09-18 + +* Grimoire ELK + * [tests] Fix demography test for gerrit + * [enriched-gerrit] Handle missing user information + * [enriched-onion] Filter bots from onion study + * fix num row error that GitHub complained about + * [enriched-aoc] Include origin in AOC items * Perceval -** Mozilla -** OPNFV -** Puppet -* Mordred -** [setup] Fix dependency on manuscripts -* grimoirelab-elk -** [jira] Disable dynamic mappings for data.changelog.histories -** Remove ES 2.x mappings for all data sources (alexandria is now in ES 5.1) -** [enrich] Remove emails from all enriched indexes -** [tests] Add tests using csv mappings (disabled until the results of the tests are fixed) -** [tests] Add owlwatch model to test mappings -** [phabricator] Handle long description.raw value in raw items -** [setup] Add dependency on SortingHat -* Sigils (old panels) -* Manuscripts (old reports) -** [its] Use closed_at as FIELD_DATE for closed issues metrics -** [metrics][gerrit] Use as date field closed in merged and abandoned reviews -* Kidash -* GrimoireLab Toolkit -* King Arthur -** [docker] Build various docker images -* Bestiary -* Hatstall -* Ceres + * [backend] Add search fields in metadata items + * [backend] Write summary of results to the backend command log + * [backend] Fix typos in backend module documentation + * [tests] Generate different 'updated_on' values for backend tests + * [backend] Organize BackendItemsGenerator parameters + * [backend] Add BackendItemsGenerator context manager + * [backend] Include summary of fetch executions + * [perceval] Add summary class +* Sigils + * [demographics] Rename demographics_leaving_developers + * [meetup] Update index pattern +* SirMordred + * [task_panels] Add contact link inside the About item of the menu + * [task_projects] Remove projects_last_diff + * [doc] Update README.md with graal-related panels attributes + * [utils] Update conf files to use graal backends -## 18.04-03 +# 0.2.29 -Released: 2018-04-18 +Released: 2019-09-02 +* Grimoire ELK + * [tests] Remove reference to ocean-unique-id + * [schema] Remove ocean-unique-id + * [raw-askbot] Remove fix_item + * [tests] Add main to test_load_identities + * [jenkins] Remove ocean-unique-id frmo schema + * [Jenkins] Update CSV schema for Jenkins +* Perceval + * [groupsio] Replace HTTP basic auth with cookies based auth (hace 52 minutos) + * [slack] Pass API token via headers + + +# 0.2.28 + +Released: 2019-08-29 + +* Grimoire ELK + * [enriched-git] Remove credentials from Git URLs + * [enriched-mediawiki] Remove identity/project info in get_rich_item + * [enriched-gerrit] Add status of gerrit changeset + * [enriched-gerrit] Handle negative time to first review + * [enriched-gerrit] Add time to first review patchsets + * [enriched-gerrit] Add time to first review + * [schema] Add mattermost schema + * [mattermost-enriched] Remove commented code + * [mattermost-enrich] Add channel name and creation date + * [logger] Add logs for study and Fix CoLic query + * [colic] Add category reference implementation and corresponding tests + * [tests:study] Add tests for CoCom & CoLic study implementation + * [schema] Add CoCom and CoLic schema + * [graal:tests] Add appropriate tests for Graal integration (WIP) + * [graal] Add connector for Graal Backends and Segregate common methods + * [graal] Add CoCom & CoLic enricher along with study implementation + * [requirements.txt] Add Graal module dependency for integration + * [dependencies] Update pandas dependency to 0.22.0 + * [meetup] Store `group_created` as date + * Fix outdated link to GrimoireLab tutorial + * [schema] Add time_to_first_attention to github_issues.csv +* Graal + * [graal] Force checkout command + * [colic] Filter softlinks from analysis + * [colic] Filter dir paths from analysis + * [analyzer] Add `diff_timeout` param to cloc analyzer + * [analyzers] Suppress deprecation warning lizard.analyze_file + * [docs] Update CoLic definition under documentation adn docstrings + * [colic] Add copyright flag for extraction of copyright information + * [cloc] Fix cloc error due to mulitple word language-name + * [graal] Update license info + * [setup] Fix format type for long description of package + * [tests] Fix test_init in test_graal + * [analyzer] Fix scancode_cli results + * [docs] Update documentation and links to requirements + * [cocom] Add repository level analysis via lizard + * [analyzer] Fix results for deleted files and alter tests + * [logger] Switch `info` logger level to `debug` + * [tests] Add test for deriving `git_path` from `uri` + * [graal] Derive `git_path` from `uri` +* KingArthur + * Update to RQ 1.0 +* Perceval + * [meetup] Pass oauth2 token via headers + * [tests] Increase test coverage mattermost + * [mattermost] Add channel info + * [github] Add example to initialize backend from code + * [tests] Fix metadata_updated_on of MockedBackend + * [dependency] Unpin httpretty dependency + * [doc] Remove httpretty details from Running tests section +* Sigils + * [gerrit_timing] Add time to first review info + * [gerrit] Update index pattern + * [mattermost] Add channel visualization + * [docs] Add CoCom & CoLic documentation + * [graal] Add Code License(CoLic) panels + * [graal] Add Code Complexity(CoCom) panels +* SirMordred + * [mordred] Update redis dependency + * [doc] Add section to set up dev env with Pycharm + * [doc] Update doc getting started + * [requirements] Add Graal module to requirements.txt + * [graal] Add configuration for Graal integration in ELK + * [tests] Add gerrit and its study sections + * [doc] Improve doc about `github-repos` param in panels section + * [doc] State Elasticsearch, Kibiter, MySQL/MariaDB versions + * [tests] Clean requirements.txt + * [setup] Remove dependencies installed by other components + * [tests] Clean travis.yml + + +# 0.2.27 + +Released: 2019-07-23 + +* Grimoire ELK + * [enriched-enrich] Handle errors in demography study + * [schema] Update Jira csv + * [enriched-jira] Track creator, assignee, reporter in issues + * [enriched-jira] Handle missing identity data + * [enriched-github] Set roles to allow refresh identities +* KingArthur + * [writers] Ignore Elasticsearch certificate verification + * [scheduler] Schedule task jobs in user-defined queues + * [tasks] Add queue parameter to scheduler config + * [scheduler] Set to completed tasks with expired lifetime + * [tasks] Add task lifetime attribute + * [tests] Fix server tests with non-real repositories + * [server] Publish task information + * [tasks] Use datetime_utcnow() when creating tasks + * [jobs] Add funtion to convert job results to dicts + * [scheduler] Set infinite time-to-live for jobs and results + * [scheduler] Update task jobs list when a job is enqueued + * [tasks] Add attribute to Task to store its list of jobs + * [scheduler] Handle starting job events + * [events] Add task identifier to job event class + * [events] Add event to notify when a job starts + * [events] Remove handlers initialization in JobEventsListener + * [scheduler] Refactor event handlers + * [writers] Update dynamic templates + * Install Arthur using pip in TravisCI + * [scheduler] Rename task scheduler public methods + * [scheduler] Delegate queue selection to the task scheduler + * [scheduler] Refactor private class JobScheduler in a TaskScheduler + * [scheduler] Update tasks status during its life cycle + * [tasks] Define task life cycle + * [events] Allow job events subscription + * [events] Add basic job events + * [events] Extract job listener to create a job events listener + * [README] Fix coveralls badge + * Update for rq async parameter rename, pin rq to 0.12.0 +* Perceval + * [gitlab] Recalculate outdated list of merge requests + * [slack] Handle `num_members` for archived channels + * [jenkins] Support authenticated access using user/API token + * [client] Add `auth` param to fetch method +* Sigils + * [affiliations] Udate index pattern + * [jira] Update panels to new index structure + * Update index patterns to add analyzed fields + * [meetup] Update index pattern to fix dates * SortingHat + * [setup] Set pandas dep version to 0.22.0 + * [sortinghat] Update copyright info + * [setup] Pin pandas dependency + + +# 0.2.26 + +Released: 2019-07-08 + +* Grimoire ELK + * [mediawiki] Fix grimoire_creation_date calculation + * removed .DS_Store + * Added check so that program does not break if aliases is None + * [raw-bugzillarest] Set text mapping type for changes attributes + * [elk] Add option to fetch from selected branches + * [elk] Return error msg from `feed_backend` + * [elastic] Use InvalidDateError in `get_last_item_field` + * [ELK] Make explicit indexing when mapping is of text type + * [enriched-redmine] Use grimoirelab-toolkit datetime functions + * [enriched-redmine] Add text mapping + * [enriched-mozillaclub] Add text mapping + * [enriched-mediawiki] Use grimoirelab-toolkit datetime functions + * [enriched-mediawiki] Add text mapping + * [enriched-jira] Add text mapping + * [enriched-gerrit] Add text mapping + * [enriched-discourse] Add text mapping + * [enriched-bugzillarest] Use grimoirelab-toolkit datetime functions + * [enriched-bugzillarest] Add text mapping + * [enriched-bugzilla] Use grimoirelab-toolkit datetime functions + * [enriched-bugzilla] Add text mapping + * [elk] Use grimoirelab-toolkit datetime functions + * [enriched-utils] Remove function `unixtime_to_datetime` + * Update description of time_open_days and time_to_close_days + * [enriched-meetup] Store created, time, updated as date + * [ELK] Update variable from KEYWORD_MAX_SIZE to KEYWORD_MAX_LENGTH + * [enriched-enrich] Decrease max keyword size * Perceval -** Mozilla -** OPNFV -** Puppet -* Mordred -* grimoirelab-elk -** [jenkins] Update raw mappings to deal with large comments -** [jira] Handle data.changelog.histories fields -** [tests] Update test load identites -** [elk] load identities by bulks to sortinghat -** [sortinghat_gelk] Handle possible exeception when adding identities -* Sigils (old panels) -* Manuscripts (old reports) -** [report] Show the perdiod names always as YY-Q[1-4] (16-Q4) -* Kidash -* GrimoireLab Toolkit -* King Arthur -* Bestiary -* Hatstall -** [mod_wsgi] Fix settings so Hatstall works inside Apache mod_wsgi -* Ceres - + * [git] Add proxy support to git clone command + * [mediawiki] Skip page without `pageid` attribute + * [gitlab] Update description for --is-oauth-token + * [meetup] Enable oauth token use +* Sigils + * [twitter] Add bots filter to panel + * [stackoverflow] Add bots filter to panel + * [slack] Add bots filter to the panel + * [rss] Add bots filter to panel + * [mozilla-reps] Add bots filter to panels + * [redmine] Add bots filter to redmine panels + * [mozillaclub] Add bots filter to panel + * [meetup] Add bots filter to Meetup panels + * [mediawiki] Add bots filter to panel + * [mbox] Add bots filter to mailing lists panel + * [maniphest] Add bots filter to panels + * [chaoss-gmd] Add bots filter to panels + * [git] Add bots filter to lifecycle panel + * [jira] Add bots filter to Jira panels + * [irc] Add bots filter + * [gitlab] Add bots filter to Issues and MRs panels + * [github] Add bots filter to Issues and PRs panels + * [git] Add bots filter to Git demographics panel + * [gerrit] Add bots filter and fix backlog panel + * [discourse] Add bots filter to panel + * [demographics] Add bots filter to panel + * [confluence] Add bots filter to panel + * [bugzilla] Add bots filter to bugzilla panels + * [askbot] Add bots filter to panel + * Set the right screenshot + * [affiliations] Fix label affiliations_authors_organizations chart +* SirMordred + * [tests] Add mysql service to .travis.yml + * [tests] Update slack archive + * [task_collection] Return errors info for task collection -## 18.04-02 -Released: 2018-04-14 +# 0.2.25 -* SortingHat +Released: 2019-06-23 +* Grimoire ELK + * [raw-jira] Handle data.fields.environment in raw indexes * Perceval -** [phabricator] Handle project info in core:edge transactions -** Update copyright information -** [phabricator] Include project/user information in task transactions -** [jenkins] Control detail level of Jenkins data -** [gerrit] Rename parameter 'url' to 'hostname' -** Mozilla -*** [mozillaclub] Change log level message when missing event data -** OPNFV -** Puppet + * [README] Add info to obtain a Groups.io API token + * [groupsio] Improve documentation to obtain an API token + * [groupsio] Fix description `api_token` + * [groupsio] Fix invalid value for 'limit' in subscriptions query +* Sigils + * Add how to import panel into Kibana/Kibiter + * [gerrit] Update index pattern +* SirMordred + * [task_enrich] Populate identities index only when retetion is on -* Mordred -** [task] Include projects data when creating the enrich backend for studies -** [[task_report] Fix import from report.report to manuscripts.report -** [Improve documentation about "bulk_size" and "scroll_size" -** [[tests] Update archives after sanitizing archived data - -* grimoirelab-elk -** [enrich][jira] Check that main_description field is not None before trunctating it -** [doc] Add information about alias to studies doc -** [studies] Add alias management to onion study -** [studies] Add alias management for areas of code -** [studies] Add methods to manage aliases -** [enrich] Add meta fields only if the meta field is a dict -** [tests] Add test for load identities in sortinghat -** [schema] Add Gerrit CSV aggregatable and description fields -** [phabricator] Handle dots in JSON attribute names -** [nntp] Remove X-fields in raw data -** [mbox] Remove X-fields in raw data -** [tests] Include _fix_item method in tests -** [nntp] Use mbox mappings for NNTP items -** [enrich] Handle case sensitive attributes in mbox items -** [enrich][metadata] Add project metadata fields to the enriched items -** [schema] Update git schema -** [schema] Fix `grimoire_creation_date` description -** [schema] Update areas of code schema -** [enrich] Handle long text values in mozillaclub -** [enrich] Handle different formats for failures in functest -** [travis] Add perceval-puppet dependency -** [enrich] Handle revisions without comment in mediawiki -** [tests] Update tests data for Slack -** [tests] Update test data for Jira -** [doc][studies] Improve studies doc for executing them in mordred -** [doc] Add CSV for areas of code and update doc -** [enrich] Limit size of fields.description in Jira -** [raw] Handle long description in jira fields -** [setup] Add dependency with perceval-puppet -** [raw] Filter attachment-related data of slack messages - -* Sigils (old panels) -** [panels] Update git index pattern -** [askbot] Add accepted answer info - -* Manuscripts (old reports) -** [tests] Added tests for the function replace_text_dir in report.py -** [report] Remove dependency on GREP and SED -** Update requirements for sortinghat -* Kidash +# 0.2.24 -* GrimoireLab Toolkit -** [introspect] Add function to find the properties in a class +Released: 2019-06-07 -* King Arthur -** [scheduler] Rename 'max_retries_job' to 'max_retries' -** [jobs] Replace scheduler arguments by 'max_retries' +* Grimoire ELK + * [raw-bugzillarest] Handle description longer than 32766 chars + * [raw-slack] Fix illegal_argument_exception for data.blocks.elements.text + * [enriched-enrich] Reduce number of log messages on identity retrieval +* SirMordred + * Fix README.md so that the package is admitted by pypi + + +# 0.2.22 + +Released: 2019-05-31 + +* Graal + * Added to GrimoireLab release +* Grimoire ELK + * [tests] Update elasticsearch and elasticsearchdsl versions + * [dependencies] Update urllib3 and requests dependencies + * [enriched] Use RequestsHttpConnection in Elasticsearch objs + * [dependencies] Pin urllib3 and requests dependencies + * [schema] Add `repository_labels` attribute + * [enriched] Add repo labels support to enrichers + * [elk] Add repo_labels param + * [elastic_items] Extract repository labels from projects.json + * [enriched-github] Filter review comments from ghost users + * [schema] Specify where each author field come from + * [schema] Add CSV documenting Github PRs index + * [enriched-confluence] Add email data to SH identity +* Perceval + * [gitlab] Force UTF-8 encoding on response contents +* SirMordred + * [task_enrich] Add log INFO messages + * [task_enrich] Fix elasticsearch.exceptions.SSLError: ConnectionError + * [task_enrich] Add support for repository labeling + * [task_collection] Add support for repository labeling + * [task] Add support for repository labeling + * [utils] Add example of grimoirelab identities file + * [utils-micro] Add support to load identities in micro + * [micro] Fix logging configuration at module scope +* SortingHat + * [parsing:grimoirelab] Add support to parse a blacklist + * Update languages and typos in the README -* Bestiary -* Hatstall -** [deployment] Config the Django settings for deployment in production -** [docker] Improve how gunicorn is started increasing the number of workers and the timeout -** [docker][travis] Fill the Django SECRET_KEY during deployment -** [docker] Add file based config sample for Hatstall -** [django] Remove SECRET_KEY to avoid its use in a production system -** [urls] Add urls to static contents so gunicorn can use them -** [docker] Use the CHAOSS URL to clone Hatstall -** [pip] Add all the files needed to create the django-hatstall pip package -** [hatstall app] Refactor all code to have a "hatstall" app that can be reused -** [docker] Leave alone hatstall in the docker-compose file -** [docker] Use the grimoirelab/hatstall docker image and remove link to mariadb +# 0.2.21 -* Ceres +Released: 2019-05-20 +* Grimoire ELK + * [enriched-gerrit] Enable refresh identities + * [enriched-gerrit] Add ELK metadata to enriched items + * [raw-slack] Remove channel_info.previous_names attribute + * [enriched-jira] Handle enriched items from multiple jiras +* Perceval + * [slack] Handle timestamps with more than 6 decimals + * [gitlab] Add support for Gitlab Oauth tokens + * [github] Handle pull request reviewers in Enterprise API -## 18.04-01-a -Released: 2018-04-10 +# 0.2.20 -* Mordred -** [task] Include projects data when creating the enrich backend for studies -** [task_report] Fix import from report.report to manuscripts.report -** Improve documentation about "bulk_size" and "scroll_size" -** [tests] Update archives after sanitizing archived data +Released: 2019-05-13 +* Grimoire ELK + * [enriched-git] Add log info to enrich_git_branches + * [schema] Add milestone start and due dates to gitlab schemas + * [enriched-gitlab] Add milestone start and due dates + * [enriched-mediawiki] Add `grimoire_creation_date` field + * [enriched-gerrit] Handle gerrit items from multiple servers +* Kidash + * Add viz title to data source removal checks +* Perceval + * [github] Set number of issues/pull requests fetched per page + * [gitlab] Handle missing attr `last` in pagination response +* Sigils + * [gitlab-merge-requests] Update index pattern + * [gitlab-issues] Update index pattern + * [overview] Update mediawiki panels in overview + * [mediawiki] Use grimoire_creation_date in panel and search + * [overview] Use `grimoire_creation_date` in overview panel + * [github] Use grimoire_creation_date in issue panels + * [github] Use grimoire_creation_date in pull request panels + * [Redmine] Update time field + * [gitlab] Update timelion charts in efficiency panel for issues + * [gitlab] Rename index pattern for issues + * [jira] Use grimoire_creation_date +* SirMordred + * [alias] Remove gitlab alias + * [requirements] Fix elasticsearch dependency versions + * [tests] Fix assertion in test_config + * [tests] Update archives for github pulls and issues + * [aliases.json] Rename alias for gitlab issues + + +# 0.2.19 + +Released: 2019-05-06 + +* Grimoire ELK + * [schema] Update gerrit.csv + * [enriched-gerrit] Add type attribute to changeset items + * [enriched-gerrit] Rename `number` attribute to `changeset_number` + * [enriched-gerrit] Add changeset author info to enriched items + * [enrich-gerrit] Add common field to count review-related items + * [enriched-gerrit] Update attribute names (hace 3 días) + * [tests] Enhance test for gerrit enriched items + * [enriched-gerrit] Add patchset approvals as enriched items + * [enriched-gerrit] Add patchsets as enriched items + * [enriched-gerrit] Add comments as enriched items + * [enriched-git] Add study to process git branches + * [enriched-discourse] Force type of score attribute to float + * [schema] Update functest schema with `duration_from_api` attribute + * [tests] Check duration assessment for functest enriched items + * [enriched-functest] Change duration assessment + * [tests] Update tests for functest enriched items + * [enriched-functest] Handle no float duration times + * [enriched-study-ceres-aoc] Limit search size to 500 +* Perceval + * [github] Include reviews in pull request data +* Sigils + * [gerrit] Add panel with approvals + * [gerrit] Update panels to support the new index + * [functest] Update index pattern + * [Maniphest] Update time field +* SirMordred + * [menu.yml] Add gerrit approvals panel + * [tests] Include enrich_git_branches to test_studies.cfg + * [config] Add study to process git branches -## 18.04-01 -Released: 2018-04-04 +# 0.2.18 -* SortingHat +Released: 2019-04-26 +* Grimoire ELK + * [requirements.txt] Constrain elasticsearch-related dependencies + * [setup.py] Constrain elasticsearch-related dependencies +* Perceval + * [backend] Add backend-specific options for --category in helptext +* Perceval FINOS + * [finosmeetings] Update argument parser to display categories in help message + * Update Perceval requirement to 0.12.12 or later +* Perceval Mozilla + * Update Perceval requirement to 0.12.12 or later + * [backends] Include available category options in the helptext +* Perceval OPNFV + * Update Perceval requirement to 0.12.12 or later + * [setup.py] Minor update to avoid flake8 error + * [functest] Include available category options in the helptext +* Perceval Puppet + * Update Perceval requirement to 0.12.12 or later + * [setup.py] Minor update to avoid flake8 error + * [puppetforge] Include available category options in the helptext + + +# 0.2.17 + +Released: 2019-04-22 + +* Grimoire ELK + * [aoc] Update write method to upload smaller lists + * [enriched-bugzillarest] Change logic to calculate `timeopen_days` + * [enriched] Add metadata filter raw to enriched items + * [elk] Use filter raw info to assess last enrich date + * [enriched-enrich] Add `metadata_filter_raw` method + * [enriched-utils] Add filter raw text to retrive last enrich date + * [enriched-utils] Fix last enrich date calculation +* Perceval + * [doc] Update help messages for "from-date" and "to-date" params +* Sigils + * Update Jira panel documentation + * Update Jira panels to support index with comments + + +# 0.2.16 + +Released: 2019-04-11 + +* Grimoire ELK + * [raw-jira] Update raw mapping to avoid immense term errors + * [enriched-enrich] Refactor `find_item_project` method + * [elk] Set value of `projects_json_repo` during enrichment + * [elk] Set value of `projects_json_repo` during collection + * [elastic_items] Add method `set_projects_json_repo` + * [elastic] Check presence of `properties` in mappings + * [enriched-jira] Add comments to enriched index + * [elastic_items] Handle commas in filter-raw + * [enriched-gerrit] Use grimoirelab-toolkit calls + * [elk] Handle empty sh uuid attributes + * [enriched-git] Fix handling rev-list command error + * Update row with missing aggregatable value * Perceval -** Fix the error "Not a gzipped file (b'00')" -** [client] Sanitize url, payload and headers when archiving data -** [all backends Remove credentials when archiving data -** [jira] Avoid init HTTP session when fetching data from archive -** [tests] Fix fetch_from_archive test -** Mozilla -** OPNFV -** Puppet + * [tests] Increase test coverage of Jira backend + * [jira] Add comments in issues + * [github] Handle ghost user in pull request comment + * [doc] Update documentation for github and gitlab backends +* SirMordred + * [tests] Update jira archive + * [task_enrich] Pass projects.json repo url to ELK + * [task_collection] Pass projects.json repo url to ELK + + +# 0.2.15 + +Released: 2019-04-03 + +* Grimoire ELK + * [enrich-meetup] Avoid failures when 'rsvps' field is not available + * [enrich-git] Handle rev-list command failures + * [enriched] Fix missing ancestor title in confluence enriched items + * [elk] A * dd methods to delete identities + * [sortinghat_gelk] Add method `unique_identities` + * [sortinghat_gelk] Add method `remove_identity` + * [elk] Fix docstring in `do_studies` method + * [enriched] Add function `get_diff_current_date` to utils + * [utils] Add param mapping to `get_elastic` + * [sortinghat_gelk] Add method to remove unique identities + * [elk] Retain identities based on identities index data + * [elk] Store identities in use in dedicated index + * [elastic] Refactor method `delete_items` +* Perceval + * [meetup] Add 'rsvp', 'venue', and 'event_hosts' as classified fields + * [update] Remove unused imports +* Perceval Mozilla + * Update Perceval dependency to 0.12.8 + * [remo] Add 'filter_classified' parameter to metadata() + * [kitsune] Add 'filter_classified' parameter to metadata() +* SirMordred + * [doc] Fix missing --cfg param for micro mordred example + * [task_enrich] Support retain identities + * [config] Add method `get_active_data_sources` + * [sirmordred] Replace `retention_hours` with `retention_time` + * YAMLLoadWarning solved -* Mordred -** [panels] Add hyperkitty panel (the same than mbox) -** [task_collection] Support that the name of a backend section could include a suffix -** [task_panels] Filter with data sources active only multi data source visualizations -** [tests] Add archive for testing remo - -* grimoirelab-elk -** [utils] Add PuppetForge support once perceval pip package is available -** [raw] Update mappings to filter body information in confluence items -** [enrich] Limit size of summary and main_description in bugzillarest -** [enrich] Limit size of value attribute summary in bugzilla -** [raw] Change discourse mapping for data.post_stream.posts.cooked -** [enrich] Fix mapping for attribute question_title in discourse -** [enrich] Handle missing accepted_answer_id attribute -** Added support for co-author -** Fix flake8 issues -** [schema] Update askbot.csv -** [studies] Add timeout to ES connections -** [tests] Remove old test data - -* Sigils (old panels) - -* Manuscripts (old reports) -** Remove recursive copying of report directory -** Add user defined logo option -* Kidash +# 0.2.14 -* GrimoireLab Toolkit -** [tests] Increase test coverage -** [datetime] Handle wrong timezone offset +Released: 2019-03-27 -* King Arthur -** Fix Travis CI badge -** Update required version of Perceval -** Rename GrimoireLab references to CHAOSS -** [jobs] Fix 'from_date' and 'offset' reset error +* Grimoire ELK + * [tests] Update finosmeetings test data +* Perceval FINOS + * [finosmeetings] Handle cm_type column + * [doc] Fix typo in README installation section +* Sigils + * [docs] Fix broken links in docs + * [jira] Add documentation about Jira panel + * [jira] Fix mislabeled "Submitters by Organization" pie visualization + * [github] Add repositories popularity panel + * Update demographics help markdown -* Bestiary -* Hatstall -** [conf] Configure Hatstall using the setup file if exists first and then the web form +# 0.2.13 -* Ceres +Released: 2019-03-27 +* Grimoire ELK + * [finosmeetings] Change project value to cm_title -## 18.03-05 -Released: 2018-03-27 +# 0.2.12 -* SortingHat +Released: 2019-03-26 +* Grimoire ELK + * [meetup-enriched] Prevent to access filter-classified attributes + * [elk] Handle filter-classified param + * [enriched] Set project name to cm_program for finosmeetings enrich + * [enriched] Add sortinghat identities info to finosmeetings + * [enrich] Prevent timeout when using ElasticSearch DSL + * [enriched] Fix `Too many dynamic script compilations` in git enrich + * [jira] Handle missing fields during the enrichment + * [jira] Handle multiple type values in `release` attribute during enrichment + * [stackexchange] Handle missing `answer_tags` + * [enriched] Apply retry mechanism HTTP 504 errors * Perceval -** Handle negative sleep time for rate limit reset: meetup, gitlab, github, client -** [git] Add --to-date to git backend to pull data upto a given time -** [github] Add pull request data -** [pipermail] Increase test coverage -** Mozilla -** [remo] Add params to fetch events from older to newer -** OPNFV -** Puppet + * [tests] Increase test coverage for confluence backend + * [confluence] Fix typo in in-line comment + * [confluence] Skip contents if 'when' attribute is missing + * [meetup] Add 'group.topics' to the list of classified fields + * [backend] Allow to filter classified fields from the command line + * [backend] Add 'filter-classified' option to the backend argument parser + * [backend] Add 'filter_classified' parameter to fetch() function + * [backend] Support filtering of classified fields in Backend class + * [git] Fix `rev-list` call with `--max-count` + * [doc] Update docstring for `sleep_time` param + * [discourse] Add params `sleep_time` and ` max_retries` + * [discourse] Add tests for sleep_time and max_retries params + * [discourse] Complete raise statements in test code + * [discourse] Remove redundant parenthesis in test methods + * [github] Add support for GitHub tokens pool +* SirMordred + * [utils] Update setup.cfg and projects.json of micro-mordred + * [task_panels] Order dashboards by name + * [doc] Update documention for panels section + * [menu.yml] Add export panel to Jenkins + * [task_panels] Upload github repos panels + * [tests] Update aliases.json in tests folder + * [config] Add param to upload github-repo panels + * [aliases] Add raw and enrich aliases for github:repo +* Sortinghat + * [parsing] Fix YAMLLoadWarning for grimoirelab parser + + +# 0.2.11 + +Released: 2019-03-21 + +* Grimoire ELK + * [tests] Update finosmeetrings backend test to the new schema +* Perceval FINOS + * [finosmeetings] Rename activity and program fields +* SirMordred + * [task_projects] Prevent enrich unknown projects when declared also in other projects -* Mordred -** [task_panels] Don't use anymore the kibiter version from general config in mordred -** [config] Fix howto import the version from mordred -** [doc] Add first version of the mordred params documented generated automatically -** [config] Add description to all params and remove the params not used anymore -** [doc] Initial version of setup automatic doc generation -** Update import sections to follow grimoire-elk changes -** Fix flake8 errors -** [task_identities] Fix the call to get gender data (hotfix commit) - -* grimoirelab-elk (old GrimoireELK) -** [utils] Remove puppetforge support until there is a pip package and it is supported in grimoirelab_build script -** [elk] Fix mapping path for areas of code index -** [elk] Add onion study to GitHub -** [enriched] Handle wrong time offset in Git enrichment -** [p2o] Use directly the params definition from utils.py -** [enrich] Add doc for enrich_items method and remove not needed code -** [enrich][phabricator] Add enrich metadata to enriched items -** [puppetforge] Implement the enrich spec for PuppetForge -** [enrich] Add `answer_status` field to askbot -** [raw] Fix typos in ES 2.2 mappings for gerrit -** [enrich] Fix limit comment message in gerrit, git -** [enriched] Set not accepted answer flag to askbot unanswered question -** [all] Replace arthur with with elk in import sections -** [all] Replace elk with enriched in import sections -** [all] Replace ocean with raw in import sections -** [arthur] Rename the file name arthur.py to elk.py -** [ocean/elk] Change packages names: This code renames the packages ocean and elk to raw and enriched -** [ocean][hyperkitty] Create specific HyperKittyOcean class -** [utils] Support that the name of a connector could include a suffix -** [elk] Fix params parsing for arthur tasks -** Move CSVs schema definition from Sigils to GrimoireELK -** [Askbot] Add fields to askbot.csv to track accepted answers -** [doc] Add documentation for Areas of Code study -** [elk] Include mappings to discourse backend -** [ocean] Add ES 2.x mappings for askbot backend -** [elk] Create areas of code output index if needed -** [doc] Add documentation on Onion study -** [elk] Add onion study - -* Sigils (old panels) -* [csv] Remove CSVs moved to grimoirelab-elk - -* Manuscripts (old reports) -* Kidash -** [kidash] Update elk import +# 0.2.10 -* GrimoireLab Toolkit +Released: 2019-03-20 -* King Arthur +* Grimoire ELK + * [utils] Change assessment of last enrich date -* Bestiary -* Hatstall +# 0.2.9 -* Ceres -** [examples] Update elk import -** [events] Update elk import +Released: 2019-03-19 +* Grimoire ELK + * [enrich-github] Add url field to enriched repository items + * [utils] Use `last_enrich_date` for incremental enrichment + * [elk] Add `last_enrich_date` to enrich_backend method + * [elastic_items] Add set_from_date method + * [schema] Add demography fields to Git +* SirMordred + * [task_enrich] Pass the last timestamp of the index before enrichment + + +# 0.2.8 + +Released: 2019-03-15 + +* Grimoire ELK + * [enrich] Change mappings to convert `date` field to keyword + * [raw] Change mappings to convert `date` field to keyword + * [ELK] Rename finos_meetings to finosmeetings + * [tests] Add tests for finosmeetings + * [enrich] Add connector for finosmeetings + * [raw] Add connector for finosmeetings + * [utils] Add connector for finosmeetings Perceval backend + * [setup] Add perceval-finos to install_requires list + * [requirements] Add perceval-finos to requirements.txt +* Perceval FINOS + * [finosmeetings] Fix docstrings and flake8 + * [finosmeetings] Change UUID calculation + * [finosmeetings] Add `date_iso_format` attribute + * [finosmeeting] Add backend to index FINOS meetings attendance + * Fix typo in FINOS name (hace 2 días) + * Initial import +* SirMordred + * [doc] Add section getting started in README.md + * [aliases] Add aliases for raw and enrich finosmeetings indexes + * [requirements] Add perceval-finos to requirements.txt -## 18.03-04 -Released: 2018-03-21 +# 0.2.7 -* SortingHat +Released: 2019-03-12 +* Grimoire ELK + * [utils] Add missing header to run scripts as Python scripts + * [enriched] Update `get_project_repository` for bugzilla enricher + * [enrich] Assign default project name to repos in unknown section + * [enriched] Remove `get_item_project` for bugzillarest enricher + * [elk] Add filter raw info to enrich backend +* SirMordred + * [tests] Add tests for `get_repos_by_backend_section` in TaskProjects + * [task_projects] Refactor `get_repos_by_backend_section` + + +# 0.2.6 + +Released: 2019-03-11 + +* Grimoire ELK + * [enrich] Add onion study to gerrit + * [p2o] Add None value for param `cfg_section_name` to p2o + * [enrich-confluence] Add ancestors data to enriched items + * [enriched] Add refresh param to update_by_query and delete_by_query + * [elk] Apply data retention policy to study indexes + * [utils] Set default value for variable analyzers + * [elastic] Add method `delete_items` + * [elk] Remove filter-raw-* for enrich backend + * [enriched] Handle hidden editors in mediawiki revisions + * [raw] Prevent mapping of data.ancestors.extensions for confluence raw items + * [elastic_items] Support for filter-raw-prefix + * [enrich] Remove raw filters when getting last enriched item + * [elk] Remove logic to create filters + * [elastic_items] Support filter on multiple attributes + * [raw] Remove `get_p2o_params_from_url` from Jira raw connector + * [raw] Remove `get_p2o_params_from_url` from Confluence raw connector + * [raw] Remove `get_p2o_params_from_url` from Bugzilla raw connector + * [raw] Remove `get_p2o_params_from_url` from Askbot raw connector + * [raw] Remove `get_p2o_params_from_url` from Gerrit raw connector + * [raw] Remove `get_p2o_params_from_url` from Git raw connector + * [tests] Add tests for `get_p2o_params_from_url` method + * [raw] Parse filters passed in the projects.json entries + * [enriched] Handle 502 and 503 errors + * [schema] Update jira.csv + * [enrich] Add updated field to Jira items + * [schema] Update gerrit.csv + * [enrich] Add last_updated and created_on to gerrit items + * [enrich] Add retry on status forcelist to ES connector + * [enrich] Update branch info in git commits + * [tests] Add tests for parsing projects.json in Jira raw connector + * [raw] Handle filter raw for jira + * [raw] Handle filter raw for confluence + * [schema] Add schema for GitHub repo data + * [enrich] Support enrichment of GitHub repo data + * [enrich] Handle Perceval errors on Git repo when updating items + * Revert "[enrich] Update Git references data in raw and enriched indexes" + * Revert "[schema] Update Git schema to include refs info" + * [schema] Update Git schema to include refs info + * [enrich] Update Git references data in raw and enriched indexes + * [utils] Move p2o description to main + * [utils] Move index_mapping description to main + * [utils] Move gh2k description to main + * [utils] Move gh2arthur description to main + * [utils] Move get_git_repos description to main + * [utils] Move gelk_mapping description to main + * [utils] Move gelk description to main + * [utils] Move e2k description to main + * [ELK] Update license info + * [tests] Update tests for mbox-related enrichers + * [schema] Update mbox csv + * [enrich] Add mbox_author_domain to mbox data * Perceval -** [pipermail] Handle inaccessible archive URLs -** Mozilla -** OPNFV -** Puppet + * [confluence] Extend Perceval Confluence backend to index ancestor pages + * [github] Add 'repository' category to fetch metadata from repositories + * [perceval] Update license info +* Sigils + * [jira] Add painless field that computes time of issues on the fly + * [github] Add delay with painless field to GH Issues panels + * [gerrit] Update gerrit panels adding delay with painless field + * [github] Add delay with painless field to GH Pull Requests panels + * Update onion panels and their documentation + * Address changes requested in #339 + * Add Jenkins Job Categories panel + * Add new version of emtech adoption without crates +* SirMordred + * [config] Allow None default value for int config param + * [task_enrich] Enable data retention policy after enrichment phase + * [task_collection] Enable data retention policy after collection phase + * [task] Delete data based on retation_hours param + * [doc] Add description for`retention_hours` param + * [config] Add param `retention_hours` + * [task_collection] Improve doc for filter-raw param + * [task] Refactor logic to process --filter-* params + * [tests] Fix tests after modification in perceval + * [task_enrich] Modify p2o filters-prefix params + * Add jenkins job categories panel to `menu.yml` -* Mordred -** [task_enrich] Replace bulk_upload_sync with bulk_upload -** [mordred] Remove param studies en enrich section which does not exists anymore -* GrimoireELK -** [ocean] Fix mappings with jenkins to avoid regression errors -** [enrich][mbox] Return an empty SH identity if the identity provided is None +# 0.2.5 -* Sigils (old panels) +Released: 2019-02-13 -* Manuscripts (old reports) -** Default name of manuscripts added -** Added -v argument to show version of manuscripts -* Kidash +* Grimoire ELK + * [studies] Add origin based enrichment in AOC + * [elastic_items] Update ES query for incremental enrichment + * [utils] Handle `get_last_enrich` with raw filters + * [elastic] Handle multiple filters for last date of enriched items +* Toolkit + * [dependency] Update python-dateutil to 2.8.0 -* GrimoireLab Toolkit -* King Arthur +# 0.2.4 -* Bestiary +Released: 2019-02-06 +* Cereslib + * [enrich] Add .go as extension for the Go programming language +* Grimoire ELK + * Remove alias in use check for onion + * [elastic] Change log level message when alias is already in use + * [elk] Set filter raw in enrich connector + * [enrich] Allow to assign project to filtered repos + * [raw] Enable filter raw for Gerrit data source + * [git] Improve log messages when updating git commits data + * [elastic_items] Modify `fetch` method to collect all documents + * [git] Remove deleted commits from raw and enriched indexes + * [raw] Allow to perform update operations over a raw index + * [enrich] Allow to update enriched items * Hatstall -** Add paginated table in proifle page with 3 columns instead of 2 -** Add more info of uidentity when click on 'view' in profile page -** Change behaviour of the columns when open/close columns -** Add button in the card info of unique identity to merge it -** Fix table size joining columns - -* Ceres + * Update docs in order to add the env variables of docker deployment + * Link apache2 logs files to stderr and stdout +* KingArthur + * [worker] Remove unnecessary RQ connection management in ArthurWorker + * [tests] Repair some flake8 warnings + * [arthur] Add PUBSUB channel name specification +* Perceval + * [git] Add rev-list command to GitRepository class + * [tests] Add tests to check fetch without update + * [git] Allow fetch without update repo + * [phabricator] Move extra_status_force_list to Client class variable + * [meetup] Move extra_status_force_list to Client class variable + * [jenkins] Move extra_status_force_list to Client class variable + * [googlehits] Move extra_status_force_list to Client class variable + * [tests] Add test about retry error for GitHub + * [github] Handle upstream server connection problems +* Sigils + * Update StackOverflow index pattern and panel + * [chaoss-gmd] Fix screenshots for CHAOSS GMD collection + * [jira-backlog] Change label project to repo in Backlog visualization + * [jira-timing] Replace attribute project_name with project + * [jira-effort] Change label Project with Repository + * [jira] Replace project_name with project for jira_repositories viz + * Fix merges filter + * Updating new changes for the panel + * Update panel and documentation for PR merge duration panel + * Add documentation for pr merge duration panel + * Add pull request merge duration new panel + * Add screenshots and update front matter for sigils + * Remove word 'legacy' from Sigils title + * Add styles to doc pages + * [CHAOSS GMD] Update widgets in the panel according to the review + * [CHAOSS GMD] Add maintainer response to merge request duration + * Add help markdown widget to git demographics panel + * Add help markdown widget to demographics panel + * [doc][chaoss-gmd] Fix panel creation date + * [chaoss][doc] Add documentation for Lines of Code Changed panel + * [chaoss] Add Lines of Code Changed panel + * [doc] Fix front matter for pull requests merged +* SirMordred + * [doc] Add documentation about micro-mordred + * [config] Fix flake8 error + * [mordred] Remove global data sources param + * [doc] Add description for global_data_sources param + * [mordred] Update way of accessing global data sources + * [task_projects] Allow to accept list of global source + * [config] Make global data sources configurable from cfg + * [task_identities] Log message when orgs_file is not found on disk +* SortingHat + * [sortinghat] Fix deprecation warning for SafeConfigParser + * Fix a few grammatical errors in README.md (#181) + + +# 0.2.3 + +Released: 2019-01-10 + +* Grimoire ELK + * [elastic] Change log message level when inserting data to ES + * [sortinghat_elk] Include stacktrace in log message for unknown exception + * [elk] Include stacktrace in log message + * [tests] Delete onion index after test execution + * [elastic] Change log message level when alias already exists + * [enrich] Prevent adding DEMOGRAPHICS alias if already in use + * [enrich] Prevent adding ONION alias if already in use + * [git-enrich] Prevent adding AOC alias if already in use + * [enrich] Use the cfg section name to retrieve project name + * [elk] propagate cfg section name from mordred to ELK + * [elastic_items] Store value of the cfg section name + * Update github_issues.csv + * Update github_issues.csv + * Documentation added on github_issues.csv +* Hatstall + * Change redirections to the Django urls standard + * Redirect to the profile where the others profiles are merged + * Decrease minlength of the identities search input to 2 characters + * Show error when an uuid does not belong to a profile +* Perceval + * [github] Support `to-date` parameter in GitHub backend +* Sigils + * [affiliations] Set limit author entries due to performance issues + * [doc] Update Gerrit Efficiency panel documentation + * [efficiency] Specify Lead Time unit on Gerrit panel + * [doc] Update GitLab Efficiency panels documentation + * [doc] Update GitHub Efficiency panels documentation + * [efficiency] Specify Lead Time unit on both GitHub panels + * Add recommendations on how to create a panel + * Add info on how to use Jekyll with GitHub pages + * Update front matter + * Fix wrong links + * Update contributing guidelines + * [doc] Update screenshot for GitLab MRs Efficiency panel + * [efficiency] Add efficiency panel for GitLab merge requests + * [doc] Add documentation for GitLab merge requests efficiency panel + * [doc] Add documentation for GitLab issues efficiency panel + * [efficiency] Add efficiency panel for GitLab issues + * Fix link URL to CSV schema files in README.md + * Update sample documentation file + * [docs] Add markdown for Pull Requests Merged panel + * [chaoss] Add pull requests merged panel + * [git] Add lifecycle panel + * Add lifecycle.jpg + * Create lifecycle.md +* SirMordred + * [task] Remove credentials from URLs + * [task_panels] Add log message when kibiter is not reachable + * [task_panels] Replace urljoin with urijoin + * [task_enrich] Propagate cfg section name to ELK + * [task_panels] Add GitLab efficiency panels + * [menu] Add Git Lifecycle panel +* SortingHat + * [cmd:autoprofile] Fix expected string or bytes-like object error -## 18.03-03 -Released: 2018-03-20 +# 0.2.2 -* Mordred -** [mordred] Remove param studies en enrich section which does not exists anymore +Released: 2018-12-11 +* Grimoire ELK + * [csv] Update gitlab merges schema + * [enrich-gitlab] Add time fields info +* KingArthur + * Fix package requirements + * Update requirements file due incompatible versions of RQ and Redis +* Manuscripts + * [manuscript] add chinese package + * Write notice message when the 'Process' section is empty +* Sigils + * [data-status] Add remo events and activities information +* SirMordred + * [doc] Update documentation of setup.cfg params + * [micro] Update micro setup.cfg + * [task_panels] Read menu.yaml from setup.cfg + * [config] Add menu_file param -## 18.03-02 -Released: 2018-03-20 +# 0.2.1 -* SortingHat -** [cmd:autogender] Check well-formed names only and Retry and skip connection errors +Released: 2018-12-04 +* Cereslib + * [tests] Update FilePath test code + * [enrich] Prepend file dir paths with slash +* Grimoire ELK + * [schemas] Fix GitLab CSVs to add missing columns + * [enrich-gitlab] Add doc for `time_to_close_days` and `time_to_merge_days` + * [enrich-gitlab] Fix `merged` attribute calculation + * [enrich-gitlab] Update calculation of `time_to_close_days` + * [elastic] Prevent add alias if already in use in ES * Perceval -** [backend] Remove empty category from parsed arguments -** Mozilla -*** Add tests requirements pip file -*** Add support to run tests using setup.py file - -** OPNFV -*** Add tests requirements pip file -*** Add support to run tests using setup.py file -** Puppet -*** Add tests requirements pip file -*** Add support to run tests using setup.py file - -* Mordred -** [task_projects][eclipse] Add support for extracting the github repositories -** [clean] Remove legacy testing grimoire_elk symlink -** [task_identities] Add gender support -** [task_panels] Add as data source stackoverflow if stackexchange is included -** [tests] Fix tests including the gender fields in SH identities files - -* GrimoireELK -** [elk] Fix check condition ES version for rss, meetup, nntp -** [elk] Limit size of attributes for several data sources to avoid keyword max length issues -** [elk] Fix mappings ES 5.1.x for all backends -** [ocean] Prevent Slack attachment info to be indexed -** [ocean/elasttic] Replace bulk_upload_sync with bulk_upload -** [elastic] Delete bulk_upload_sync method -** [askbot] Refine information to track accepted answers -** [tests] Modify test data for askbot -** [elk] Enrich item to track accepted answers -** [ocean] Add mappings for Askbot ocean -** [enrich][bugzillarest] Change " " with "+" in product and component names to follow Mozilla projects mapping -** [elk] Add gender info from SortingHat -** [ocean][conf] Remove legacy conf index not used anymore -** [utils] Remove not used scripts o2s.py and ocean.py -** [utils] Remove symlink grimoire_elk to avoid hacks in modules import -** [utils] Remove not needed old symlink - -* Sigils (old panels) -** [Askbot] Add fields to askbot.csv to track accepted answers -** [schema] Update Meetup schema to deal with aggregatable fields in Kibana -** [panels] Fix Gerrit panel to use author name field -** Added schema for time_to_commit - -* Manuscripts (old reports) -** Select by user for custom indices for each data -** Create default indices if no custom index is provided -** Change the default name for the enriched git index from 'git_enrich' to 'git' - -* Kidash - -* GrimoireLab Toolkit + * [gitlab] Add retry on 503 HTTP error +* Sigils + * [docs] Fix page titles + * [docs] Remove theme + * [docs] Update local links + * [docs] Remove old documentation + * [docs] Add Jekyll based documentation + * Ignore Jekyll and Ruby related files + * [gitlab] Sync MRs index pattern title with SirMordred aliases + * [git] Update Git Demographics panel +* SortingHat + * [cmd:autoprofile] Avoid to set email addresses in name profile -* King Arthur -* Bestiary -** Add new features: edit and remove ecosystems and projects -** Add information messages to web UI related to important actions -** Change position of ecosystem-related buttons +# 0.2.0 -* Hatstall -** Add custom pagination in order to retrieve the data paginated -** Add search box that searchs directly to the sh database -** Fix last_modified field show in unique identities -** Add 'show' custom in order to get length of the table paginated -** Change button show entries for 'onchange' event in the select +Released: 2018-11-19 * Cereslib -** [events] Add Git author domain from email - - -## 18.03-01-a - -Released: 2018-03-14 - -* GrimoireELK -** [ocean] Add ES 2.x mappings for all ocean backends -** [git] Add a new time_to_commit field to enriched index - -## 18.03-01 - -Released: 2018-03-13 - -* SortingHat -** [model] Fix wrong __repr__ in Profile -** [api] Add search_unique_identities_slice() function -** [cmd:autogender] Fix typo in help output -** Release 0.6.0 -** Rename GrimoireLab references to CHAOSS -** [sortinghat] Add autogender command -** [api] Add function for searching profiles -** [tests] Fix non-deterministic tests -** Add --version command line option -** [tests] Fix so that tests pass when db not in localhost -** [init] Remove annoying error -** [setup] Update pandas -** [gitdm2sh] Set option to ignore invalid email addresses - -* Perceval -** [all backends] Set category when calling fetch and fetch_from_archive -** [meetup][gitlab] Ignore sleep for rate when reading from archive -** [tests] Modify backends tests when fetching from archive -** [tests] Add mock http answers to tests launchpad -** [gerrit] Add tests for gerrit backend -** [mediawiki] Sort request payload parameters for versions >= 1.27 -** [mediawiki][phabricator] Force sort request payload parameters -** [tests][askbot] Format html content file -** [all backends] Add default parameters when init the Client -** [slack] Move parameter latest to the archived args -** [all backends] Add valid categories -** [all backends] Align fetch signature to the backend generic one -** [all backends] Add archive support -** Update CI config to run tests using Python 3.5 and 3.6 -** Update coverage call to remove 'omit' parameter -** [askbot] Add data about accepted answers -** [mbox] Define 'tmp_path' variable before copying mboxes -** [backend] Ignore errors produced while fetching from archives -** [backend] Fix 'Namespace' object has no attribute 'fetch_archive' -** Rename GrimoireLab references to CHAOSS -** [backend] Remove metadata() decorator -** [cache] Remove cache mode -** [backends] Replace cache by archive mode -** Add tests requirements pip-file -** Fix tests to support their execution in two different modes -** Add support to run tests using setup.py file -** [gmane] Remove Gmane backend -** [jenkins] Update perceval sample in README -** [backend] Use the archive manager within BackendCommand -** [backend] Add shortcut functions to fetch items -** [backend] Add 'archived-since' to the argument parser -** [backend] Add 'category' to the general arguments parser -** [backend] Define archive arguments for the argument parser -** [archive] Add class to manage a set of archives -** [archive] Replace 'item_category' by 'category' -** [errors] Add class for raising archive manager exceptions -** [pipermail, bugzilla] Avoid warning by BeautifulSoup -** [perceval] Add GitLab backend -** [all backends] Apply archive to backend -** [client] Replace type() with isinstance() -** [backend] Change method signature of _test_fetch_from_archive -** [backend] Fix backend name in fetch method -** [backend] Add fetch, fetch_from_archive and fetch_items -** [nntp] Fix KeyError 'Date' in metadata_updated_on field -** [backend] Integrate archive with generic backend -** [client] Integrate archive with generic HTTP client -** [archive] Add Archive class -** [tests] Add tests for NotImplemented method errors in backend -** [http-client] Fix rate limit reset log message -** [git] Parse additional pattern for moved files -** [all backends] Modify variable name default_sleep_time -** [client] Modify variable name default_sleep_time - -** Perceval Mozilla -*** [tests] Modify tests when fetching from archive -*** Set category when calling fetch and fetch_from_archive -*** Add valid categories -*** Align fetch signature to the backend generic one -*** Update Perceval dependency version -*** Rename GrimoireLab references to CHAOSS -*** Apply archive to all backends -*** [crates] Fix None sleep_time when using CratesCmd -*** Import perceval modules using relative paths -*** [setup] Update minimum version of perceval required -*** [crates] Change HttpClient method call - -** Perceval OPNFV -*** [functest] Set category when calling fetch and fetch_from_archive -*** [tests] Modify functest tests when fetching from archive -*** [functest] Add valid categories -*** [functest] Align fetch signature to the backend generic one -*** Update Perceval dependency version -*** Rename GrimoireLab references to CHAOSS -*** [FuncTest] Apply archive to FuncTest backend - -** Perceval Puppet -*** [puppetforge] Set category when calling fetch and fetch_from_archive -*** [tests] Modify puppetforge tests when fetching from archive -*** [puppetforge] Add valid categories -*** [puppetforge] Align fetch signature to the backend generic one -*** Update Perceval dependency version -*** Rename GrimoireLab references to CHAOSS -*** [puppetforge] Apply archive to PuppetForge backend - -* Mordred -** [tests] Add tests for the studies configuration per backend -** [task_enrich] Configure and execute studies per backend after enrichment -** [config] Remove 'studies' param from enrich section -** [tests] Add archive for all backends -** [tests] Add tests to fetch data from archives -** [mordred] Updates to use the new location for elastic module in grimoire_elk -** [task_panels] Fix support for Kibana 6 when uploading menus -** [tasks] Make use of grimoire-elk connections -** [task_enrich] Use new param pair_programming to activate this enrich feature - -* GrimoireELK -** [studies] Add support for git_author_domain field -** [setup] Fixed conflict with urllib3 version -** [elk] Fix access to mappings directory -** [utils] Use the 1st interpreter on $PATH -** [tests] Break done tests for all backends -** [elk] Fix enrich_items method -** Update elastic import to the new module path in grimoire_elk.elastic -** [elastic] Refactor elastic class -** [travis] Update travis to add new dependencies -** [elk] Add areas of code study -** [elk] Add basic structure for cereslib studies -** [elk] Refactor sortinghat module name -** [enrich][git] Fix incremental demography update for already existing authors -** [archive] Allow handling perceval archive -** [ocean] Fix mappings to index data in several data sources -** [tests] Refactor tests for backends/connectors -** [remo] Rename filenames of ocean and elk remo connectors -** [ocean] Remove ES 2.x mappings to index git data -** [ocean] Modify Pipermail input data for test -** [ocean] Add Launchpad backend -** [ocean] Add PuppetForge backend -** [ocean] Add GitLab backend -** [tests] Update tests data -** [elk] Update enrich_items method of several data sources for new tests -** [elk] Handle NNTP uppercase Date field -** [ocean] Add warning when json items are not inserted to ES -** [enrich] Track storage exceptions when uploading enriched data to ES -** [travis] Add delay to make ES start - -* Sigils (old Panels) -** Update documentation on process related panels - -* Manuscripts (old reports) -** added Content-Type information in function: get_metrics_data - -* Kidash -** [kidash] Update elastic import from grimoire_elk -** [import] Don't modify the height of visualizatons in dashboards from Kibana >= 6 - -* GrimoireLab Toolkit -** Add support to run tests using setup.py file -** Update coverage call to remove 'omit' parameter -** Rename GrimoireLab references to CHAOSS -** Update CI config to run tests using Python 3.5 and 3.6 - -* King Arthur (old Arthur): -** Add support to run tests using setup.py file -** Fix tests to support their execution in two different modes -** Modify tests requirements pip-file and Travis config. file -** Update documentation with a section for the arthurd config. file -** [worker] Add documentation to perform_job method -** [arthurd] Replace cache support with archive support -** [server] Enable server to handle archives -** [jobs] Enable jobs to handle archives -** [tasks] Enable tasks to deal with archive -** [scheduler] Enable scheduler to deal with archive tasks -** [arthur] Enable Arthur to fetch data from archives - -## elasticgirl.30.4 - -Released: 2018-02-12 - -* GrimoireELK -** [enrich][crates] Return always a correct SH identity - - -## elasticgirl.30.3 - -Released: 2018-02-11 - -* GrimoireELK -** [enrich][git] Add a new param pair_programming to activate this enrich feature -* Mordred -** [task_enrich] Use new param pair_programming to activate this enrich feature - - -## elasticgirl.30.2 - -Released: 2018-02-08 - -* GrimoireELK -** [enrich][jira] Include release field in enriched index -** [enrich][git] Add git_uuid field which is unique id in pair programming - - -## elasticgirl.30.1 - -Released: 2018-02-01 - -* GrimoireELK -** [enrich][git][demography] Fix the demography study logic so it works in incremental mode always -** [enrich][slack] Don't convert boolean fields to int in SortingHat fields -** [elastic] Track exceptions when uploading data to ES -** [enrich][git] Add a new field git_author_domain with the email domain for the Author of the commit - -* Kidash -** [import] Don't modify the height of visualizatons in dashboards from Kibana >= 6 - -## elasticgirl.30 - -Released: 2018-01-31 - -* SortingHat -** [load] Avoid some messages when not in verbose mode -** [init] Add option for reusing database - -* Perceval: frozen in 0.9.10 until Archive cache refactoring is complete -** Mozilla: frozen in 0.1.5 to be compatible with perceval 0.9.10 -** OPNFV -** Puppet - -* Mordred -** [panels] Kibiter now supports that the title for the dashboard is in a JSON inside .kibiter index. New method for uploading it. -** setup and configure RotatingFileHandler for file logging -** [mordred] Check if Bestiary projects can be read before executing mordred -** [task_panels] Add params with kibana url and version to create the .kibana -** [mordred] Retry connection with Elasticsearch and Kibiter to wait for their starting time -** [task_identities] Execute unify just after the load of identities in the same task -** [task_panels] Add mbox as data source to be shown if pipermail exists -** [autorefresh] Refactor autorefresh code thanks to the last_update field in Sortinghat -** [task_panels] Force the creation of .kibana index in Kibiter6 -** [docker] Don't download the menu.yaml file if it has not changed from our local copy - -* GrimoireELK -** [enrich][phabricator] Fix enricher when an item has an array with None as first item of projects -** [enrich] Add missing headers in PUT queries to support ES6 -** [ocean][pipermail] Define the url and dirpath params needed by arthur when using pipermail -** [elastic_items] Remove log error when there are no items or the items index does not exists yet -** [utils] Retry by default total times = connect error times -** [ocean/confluence] Filter out body.storage.value from index -** [enriched] Ensure that we have a method for refreshing whole indexes - -* Panels -** [overview] Include for studies vis a "_studies_" in the id and title - -* Manuscripts (old reports) - -* Kidash -** [kidash] Remove by default from dashboards the study related visualizations -** [visualization] Include the style needed in Kibiana6 to show metrics vis correctly -** [dashboard] Fix the bool filters for the dashboard -** [layout] Increase 1 height the panels of height 1 for kibana6 - -* GrimoireLab Toolkit -** [introspect] Ignore * and ** parameters in method signatures - -* Arthur - - -## elasticgirl.29.4 - -Released: 2018-01-29 - -* GrimoireELK -** [utils] Retry by default total times = connect error times - -* Mordred -** [arthur] Catch exception when the arthur items dict changes during its measure - - -## elasticgirl.29.3 - -Released: 2018-01-29 - -* Mordred -** [task_panels] Add mbox as data source to be shown if pipermail exists -** [task_identities] Execute unify just after the load of identities in the same task -** [mordred] Retry connection with Elasticsearch and Kibiter to wait for their starting time - -* Kidash -** [layout] Increase 1 height the panels of height 1 for kibana6 -** [dashboard] Fix the bool filters for the dashboard -** [visualization] Include the style needed in Kibiana6 to show metrics vis correctly - - -## elasticgirl.29.2 - -Released: 2018-01-25 - -* Mordred -** [autorefresh] Refactor autorefresh code thanks to the last_update field in Sortinghat - -* GrimoireELK -** [elastic_items] Remove log error when there are no items or the items index does not exists yet - - -## elasticgirl.29.1 - -Released: 2018-01-24 - -* Mordred -** [task_panels] Force the creation of .kibana index in Kibiter6 - -* GrimoireELK -** [ocean][pipermail] Define the url and dirpath params needed by arthur when using pipermail -** [enrich] Add missing headers in PUT queries to support ES6 - - -## elasticgirl.29.0 - -Released: 2018-01-23 - -* SortingHat -** [model][tests] Define an order for domains and adapt tests to MariaDB -** [tests] Change configuration to a config file - -* Perceval: frozen in 0.9.10 until Archive transition from cache is complete -** Mozilla: frozen in 0.1.5 to be compatible with perceval 0.9.10 -** OPNFV -*** [functest] Apply generic HTTP client to FuncTest -** Puppet -*** [puppetforge] Apply generic HTTP client to PuppetForge - -* Mordred -** [task_panlels] Support for Kibiter/Kibana 6.x -** [task_projects] Add a new param projects_url to download the projects data from a URL -** [task_identities] Use the last datetime for autorefresh to find the changes in SortingHat -** [task_identities] Don't load identities if autorefresh is pending -** [docker] Update docker mordred image to use a install based on pip packages -** [unified_releases] Remove 'unified_releases' directory which is now in GrimoireLab -** [task] Fix composition perceval params - -* GrimoireELK -** [ocean][confluence] Avoid creating the mapping of data.extensions.position which mutates -** [git] Add Elasticsearch 6.x support for study in git -** [kidash] Remove kidash (moved to a new repo as chaoss/grimoirelab-kidash) -** [elasticsearch] Support Elasticsearch 6 - -* Panels - -* Manuscripts (old reports) -** [setup] Modifications due to change in name (manuscripts) - -* Kidash -** [kidash] Unbundle kidash completely from GrimoireELK -** [kidash] Fix error getting the title of an index pattern -** [setup] Change to the new chaoss organization in GitHub - -* GrimoireLab Toolkit -** [datetime] Add timezone data to datetime_utcnow() - -* Arthur -** [tests] Add tests for add, remove, tasks paths of arthur server - - -## elasticgirl.28.3 - -Released: 2018-01-21 - -* GrimoireELK -** [kidash] Remove kidash (moved to a new repo as chaoss/grimoirelab-kidash) -** [elasticsearch] Support Elasticsearch 6 - - -## elasticgirl.28.2 - -Released: 2018-01-18 - -* Mordred -** [task] Fix composition perceval params -** [docker] Update docker mordred image to use a install based on pip packages -** [task_identities] Don't load identities if autorefresh is pending -** [task_identities] Use the new API SH call search_last_modified_identities to refresh identities -** [task_projects] Add a new param projects_url to download the projects data from a URL - - -## elasticgirl.28.1 - -Released: 2018-01-09 - -* Mordred -** [docker] Add symlink to kidash so mordred finds it - - -## elasticgirl.28 - -Released: 2018-01-09 - -* SortingHat - -* Perceval -** [git] Send in fetch-pack local heads refs only -** [meetup] Handle processing deleted groups -** [git] Fix cloned directory of local repository -** Mozilla -*** Apply generic HTTP client to all backends -** OPNFV: no changes -** Puppet: no changes - -* Mordred -** [panels] Use the new kidash module, instead of grimoire-kidash -** [task_collection][arthur] Limit the total number of items collected from redis -** [task_collection][arthur] Set to 200MB the max memory for the arthur python dict -** [task_collection][arthur] Limit the max size of the python memory with raw items from redis -** [tasks_panels] Add support for data sources when uploading panels -** [docker] Use the new grimoirelab github repository location to download the releases - -* GrimoireELK -** [kidash] Unbundle kidash completely -** [Jira] Extract timing for a sprint -** [Jira] Move enrichement of fields property to a classmethod -** [setup] Add kingarthur as a dependency - -* Panels - -* Reports - -* GrimoireLab Toolkit - -* Arthur -** Add support for configuration file -** [writers] Update writer to support ElasticSearch >= 5.x -** Update requirements - - -## elasticgirl.27.1 - -Released: 2017-12-28 -Warning: Change in SortingHat database. You need to either create -a new database from scratch, or convert your old SortingHat database. -See details in the main README.md in the SortingHat git repository -(section "Compatibility between versions)"). - -* SortingHat -** Release 0.5.0 -** [api] Add function to search last modified identities -** [api] Update 'last_modified' attribute when needed -** [model] Add 'last_modified' attribute to unique identities and identities -** [grimoirelab2sh] Add '--no-email-validation' option -** parsing:grimoirelab] Set option to ignore invalid email addresses - - -## elasticgirl.27 - -Released: 2017-12-28 -Warning: skip_initial_load no longer supported in Mordred. - -* SortingHat (stalled to pre 0.5.0 due to change in db schema) - -* Perceval -** [meetup] Remove 'draft' status due to a bug in Meetup API -** [git] Request in fetch-pack the outdated refs only -** [git] Fix error discovering refs in repos which don't have any -** [git] Ignore error codes when executing a command -** Mozilla: no changes -** OPNFV: no changes -** Puppet: no changes - -* Mordred -** [task_collection] Configure bulk and scroll size in arthur collection -** [tasks_project] Load projects in the initial tasks in mordred -** [task_collection] Create task in arthur only the first time -** [task_identities] Add support for '--no-email-validation' option in grimoirelab2sh - -* GrimoireELK -** [ocean][git] Map data.message to string so it is not a keyword because it is large field (>32K) in some cases -** [panels] Change the API so dashboards can be listed, imported and exported with a JSON in memory -** [enrich][meetup] Fix to support empty events during comments extraction -** [enrich][jira] Check that labels are defined in issue['fields'] before using it - -* Panels -** [Panels] Fix Twitter username field in tables -** [Panels] Add projects and orgs support for Meetup - -* Reports - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.26.2 - -Released: 2017-12-22 - -* GrimoireELK -** [enrich][meetup] Fix to support empty events during comments extraction - - -## elasticgirl.26.1 - -Released: 2017-12-21 - -* SortingHat -** [grimoirelab2sh] Add '--no-email-validation' option - -* Mordred -** [task_identities] Add support for '--no-email-validation' option in grimoirelab2sh - - -## elasticgirl.26 - -Released: 2017-12-20 - -* SortingHat - -* Perceval -** Mozilla: no changes -** OPNFV: no changes -** Puppet: no changes - -* Mordred -** [docker] Add link to arthur library so it can be used in mordred -** [task_identities] Don't load identities if autorefresh is pending -** [docker] arthur is not used with Elasticsearch anymore -** [task_collection][arthur] Compute the memory usage in intervals - -* GrimoireELK -** [mappings] If a mapping can not be created just log the issue -** [autorefresh] Group the number of identities to be refreshed -** [utils] Support enrich all items for all groups in a raw meetup index -** [enrich][meetup] Fix to support empty events during ersvp extraction - -* Panels -** [Panels] Add projects to IRC panel -** [Panels] Remove old unused panel directories -** [Panels] Add project support to Twitter panel - -* Reports - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.25.1 - -Released: 2017-12-19 - -* Mordred -** [mordred] Fix symbolic links to grimoire_elk and report changed by error - -## elasticgirl.25 - -Released: 2017-12-18 - -* SortingHat -** [db] Fix tables created with invalid collation -** [model] Coerce boolean type -** [travis] Update before_install package versions -** [setup] Upgrade dependencies -** [cmd:export] Remove trailing whitespaces in JSON files - -* Perceval -** [backend] Fix 'find_backends' to get all backend descendants -** [launchpad] Handle 404 HTTP error -** Update generic http-client parameters for phabricator, meetup, jenkins, github -** [client] Fix init headers and status codes -** [docker] Add build-essential/gcc for dulwich -** [meetup] Adapt tests to assess the sleep for rate -** [github] Adapt tests to assess the sleep for rate -** [client] Add function to calculate the time to reset for tokens -** Apply generic HTTP client to all backends -** [http-client] Add parameter "verify" to fetch method -** Mozilla: no changes -** OPNFV: no changes -** Puppet: no changes - -* Mordred -** Add Arthur support to mordred -** [mordred] Simplify how mordred is started -** [doc] Basic description of mordred -** [tests] Remove load_orgs testing because it fails in Travis -** [requirements] Reuse the deps in setup.py in requirements.txt -** [travis] Add travis support and execute all testing for PRs -** Fix all PEP-8 issues - -* GrimoireELK -** Arr arthur support -** [ocean] Simplify feed logic when getting the items from perceval cache or arthur redis -** Add travis support with test execution. Improvements in the tests. -** Fix PEP-8 issues -** [gelk] Remove ocean-unique-id unique identifier and use always the uuid from perceval. -** [enrich][sortinghat] Add identity domain using the profile information -** [enrich][phabricator] Check in p is defined before using it -** [enrich][meetup] Don't create comments and rsvps events for empty meetup items -** [kidash] Export the index patterns in searches -** [enrich][bugzillarest] Add comments field with the number of comments - -* Panels -** [tests] Remove from test checking the ocean-unique-id field -** Add Crates CSV schema definition -** Bugzilla panels updated for bugzillarest compatibility - -* Reports -** [metrics][issue] Remove Closers metric and Fix BMI implementation -** [github_issues] Removed Closers metric which is not implemented -** [tests] Fix pep8 issues in the tests -** [travis] Install deps using the requirements.txt file in Travis -** [tests] Activate the execution of the tests during CI -** [tests] Initial version of the tests -** Modify code to be PEP8 compliant -** [travis] Add initial travis file - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.24 - -Released: 2017-11-30 - -* SortingHat -** [parsing:grimoirelab] Remove `Unknown` enrollments while parsing - -* Perceval -** [client] Add generic HTTP client -** [jenkins] Fix HTTP error handling -** [gerrit] Fix no route to host error -** [github] Init rate limit info (requests left and reset time) - -* Mordred - -* GrimoireELK -** [travis] First version for CI with Travis, including pep8 and integration tests -** Fixed all PEP-8 issues -** [p2o] Remove code not needed detected during pep8 cleaning -** [tests][crates] Add testing for crates data source -** [enrich][functest] Implement get_field_author and return None -** [enrich][twitter] Check that twitter is in projects map before using it -** [enrich][bugzillarest] Change fields to use the same names than in bugzilla -** [enrich][bugzilla] Remove project_name field to avoid confussions with dashboard projects -** [ocean][phabricator] Fix to float the subpriority field -** [enrich] Check if an identity exists before trying to get her profile -** [index_mapping] Support sort-after scrolling. Use sync uploading of bulk data -** [index_mapping] Add an option so the elasticsearch for read and write could be different -** [elastic] Log the items already uploaded with the bulk API -** [elastic] Fix how the number of duplicates/lost items is tracked in bulk operations -** [elastic] Pack the items in bulk sync before uploading -** [elastic] Raise exception if there is a problem putting the data in Elasticsearch -** [ocean][crates] Remove all params to be passed to the perceval backend -** [enrich][crates] Remove project support from crates (not needed) - -* Panels - -* Reports - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.23.2 - -Released: 2017-11-28 - -* SortingHat - -* Perceval - -* Perceval-OPNFV - -* Perceval-Mozilla - -* Mordred - -* GrimoireELK -** Updated version which fixes: Enrich bugzilla rest 4611 #136 - -* Panels - -* Reports - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.23.1 - -Released: 2017-11-26 - -* SortingHat - -* Perceval - -* Perceval-OPNFV - -* Perceval-Mozilla -** Updated version - -* Mordred - -* GrimoireELK - -* Panels - -* Reports - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.23 - -Released: 2017-11-23 - -* SortingHat -** Add no-strict-matching option -** [setup] Add code for setup.py test to work - -* Perceval -** [git] Fix invalid URL when TCPGitClient is initialized - -* Mordred -** [task_identities] Add reset_on_load param to activate the reset of identities on load -** [task_identities] Add new option strict-mapping to sortinghat config -** [threads] Get the two thread locks needed for enrich and identities in the same order - -* GrimoireELK -** [enrich][meetup] Support that `time` field does not exists in meetup raw item -** [docker] Add docker compose for Elastic 6 version using Bitergia images -** [elastic] Create new method global_mapping to get the mapping added always -** [index_mapping] Remove debug code line which makes mappings to be always None -** [panels] Fix library to work with Elasticsearch6 -** [panels] Add support for listing/importing/exporting panels in ES6 -** [kidash] Add option to clean all items not included in data sources provided - -* Panels -** Add initial version of contribution guidelines -** [owlwatch] Fix path of test data files -** [owlwatch] Add init to test dir to fix test runner -** [owlwatch] Add CSV support -** [owlwatch] Add documentation for CSV comparisons - -* Reports -** [jira] Add jira data source to reports -** [stackexchange] Add new data source stackexchange to reports - -* GrimoireLab Toolkit -** [datetime] Fix to handle dates with invalid time offset - -* Arthur - - -## elasticgirl.22 - -Released: 2017-11-14 - -* SortingHat - -* Perceval -** [git] Change 'mirror' to 'bare' repositories -** [git] Limit the number of 'have' commits sent by fetch-pack -** [git] Fix error fetching latest items from empty repositories - -* Mordred -** [docker] Use the new URL for downloading releases specification - -* GrimoireELK -** [utils] Add index_mapping.py script -** [enrich] Fix log message about the size in MB of the bulk packet sent to ES - -* Panels -** Fix header row in CSV files -** [setup] Add panels/__init__.py -** Several improvements in testing - -* Reports - -* GrimoireLab Toolkit - -* Arthur -** [setup] Set cheerypy version to cherrypy>=8.1 <=11.0.0 -** [setup] Improve generation of package and running tests - -## elasticgirl.21 - -Released: 2017-11-13 - -* SortingHat - -* Perceval -** [meetup] Fix too many requests error -** [jenkins] Fix connection timed out exception -** [git] Fix fetch-pack for HTTPs connections -** [git] Work with bared repositories only -** [crates.io] Add crates backend - -* Mordred -** [task_identities] Fix downloading of identities file from GitHub -** [task_enrich] Wait 5 seconds before executing the studies (demography fix) -** [panels] Fix all panels issues -** [exceptions] Print RuntimeError in an appropriate way -** [menu] Add Functest panel to menu.yaml - -* GrimoireELK -** [enrich] Use _version.py to get GELK version -** Add badges for pypi packages -** [enrich][jira] Support that reporter does not exists in jira raw data -** [kidash] Add support for using panels in the panels module -** [jira] Add story points to enriched index, when they are available -** [setup] Improve setup.py - -* Panels -** [pkg] Add files for first Python package - -* Reports - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.20 - -Released: 2017-11-02 - -* SortingHat - -* Perceval - -* Mordred -** [task_identities] Don't use the orgs file when converting from yaml identities to JSON identities -** [mordred] Clean the threads shared queues once the execution is finished - -* GrimoireELK -** [enrich] Refactor (simplify and improve) the logic to get the SH fields from an identity - -* Panels - -* Reports -** [report] Use command line param title if provided instead of mordred short name - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.19.1 - -Released: 2017-10-26 - -* SortingHat - -* Perceval - -* Mordred - -* GrimoireELK - -* Panels - -* Reports -** Updated version - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.19 - -Released: 2017-10-26 - -* SortingHat -** [matching] Substitute sort for sort_values (pandas in unify) -** [cmd:unify] Change unicode to str - -* Perceval -** [tests] General reorganization -** [askbot] Handle TooManyRedirects error when question title is empty -** [github] Enable fetch reactions without token - -* Mordred -** [task_identities] Include for identities refresh also uuid in which other uuids are merged. -** [task_manager] Add sync logic between threads so the load of identities and the merge of identities tasks are not done during enrichment tasks execution. -** [task_identities] Add support for loading identities in GrimoireLab yaml format from files stored in GitLab and locally. -** [task_identities] Add support for not executing unify and affiliate. -** [task_manager] Execute the tasks and then wait for the interval. - -* GrimoireELK -** [enrich] Get Kibiter version during enrichment process. - -* Panels -** Migrate Reps Events panel to Kibana 5 -** Migrate reps activities panel to Kibana 5 -** Use shaded circle markers in maps -** Migrate Reps Events panel to Kibana 5 -** Migrate Functest panels to Kibana 5 -** Migrate Apache panel to Kibana 5 -** Migrate Functest panels to Kibana 5 -** Migrate MozillaClub panel to Kibana5 -** Migrate Google Hits panel to Kibana 5 -** Migrate Jira Effort Panel to Kibana 5 - -* Reports - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.18.1 - -Released: 2017-10-20 - -* SortingHat - -* Perceval -** Updated version - -* Mordred -** First pip package: updated version - -* GrimoireELK -** Updated version - -* Panels - -* Reports -** First pip package: updated version - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.18 - -Released: 2017-10-20 - -* SortingHat - -* Perceval -** [github] Fix abuse rate limit error (#173) -** [phabricator] Fix restricted access to projects data -** [mbox] Fix UnicodeDecodeError when parsing email addresses (#176) -** [launchpad] Add instructions to README.md and bin/perceval -** [launchpad] Add Launchpad backend - -* Mordred -** Add identification for threads -** [task_panels] Fix mapping problem with ElasticSearch/Kibana 5.6 -** [task_identities] Set TaskInitSortingHat as a global task not related to a data source -** [task_panel][aliases] Add functest aliases -** [tasks] Readd support to execute one time all tasks and exit. -** [task_panels] Add missing aliases: apache, google-hits, remo-events -** Adapt to produce a pipy package (remove VIzGrimoireUtils dependency) - -* GrimoireELK -** [enrich][functest] Fixes all issues and delivered to the customer -** [enrich] Several fixes in different backends to sync with panels - -* Panels -** [owlwatch] Added tool for testing enriched indexes and panels definitions. - Used now in grimoirelab release cycle. -** Migrate Redmine panels to Kibana5 -** Migrate GitHub Backlog to Kibana 5 -** Migrate mediawiki panel to Kibana5 - -* Reports -** Add support for building pip packages. -** Add LaTeX templates to the package. - -* VIzGrimoireUtils -** Not used any more - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.17 - -Released: 2017-10-06 - -* SortingHat -** Install misc scripts like grimoire2sh -** [cmd:load] Add option to clear ids relationships and enrollments -** [cmd:load] Update profile information when loading identities -** [parsing:grimoirelab] Fix style errors in the parser - -* Perceval -** [github] Reduce requests to collect reactions on issues and comments and fix formatting issues -** [git] Redefine default storing repositories path - -* Mordred - -* GrimoireELK -** [docker][kibana] Add docker compose file for Kibana 5.6.0 with X-Pack disabled -** [docker] Don't use a specific elastic config file by default. Use the one - included in the docker image (Elasticsearch). Fix permissions sample file. -** [enrich] Add support for enriching all items from a github raw index with different repositories. -** [requests] Increase the connection retry time from 10 min to 2.5d in HTTP connections -** [enrich][discourse] Fix discourse case in which there is no categories tree -** [enrich][slack] Support that message['attachments'] could be None - -* Panels T3411 -** Add CSV files as the data model schema -** Migrate Discourse to Kibana 5 - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.16 - -Released: 2017-09-25 - -* SortingHat - -* Perceval -** [github] Fix GitHub Enterprise support -** [git] Run Git commands setting HOME environment variable -** [github] Include reaction information for issues -** [github] Fetch multiple assignees from issues -** [github] Fetch GitHub issue comments -** [discourse] Do not process topics without posts in them - -* Mordred -** Add support for DockerHub (#29) - -* GrimoireELK -** [enrich][github] Support that the user data dict is empty -** [utils] Support https insecure when getting the kibiter version -** [enrich][confluence] Use the space field for project grouping in wiki pages -** [enrich][discourse] Support that a discourse site does not use subcategories -** [enrich][phabricator] Check that item['fields']['ownerData'] is not None before using it -** [enrich][functest] Check that func_test['details'] is not None before using it -** [ocean] Add support in perceval fetch call to the param latest_items -** [enrich][studies] Fix how the date is computed for the last execution of a study. Implemented for the demography study -** [enrich][mediawiki] Add to url field "view" between wiki origin and the page title - -* Panels -** Add Kafka Improvement Proposals panel - -* Reports -** [offset] Include the offset in the start and end dates. -** [projects] Add a new flag --projects to generate the projects data or not. -** [offset] Fix quarter report name when using the offset param. -** [LaTeX] Add report date frame to the summary - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.15 - -Released: 2017-08-08 - -* SortingHat - -* Perceval -** [slack] Fix precision problems in 'oldest' parameter -** Add badge for pypi version - -* Mordred -** [task_collection] Print the full stack trace when there is an exception collecting the data -** [task_projects] Add discourse to the data sources that are always downloaded globally -** [menu] Add Maniphest panels to menu -** [menu] Fix name of Bugzilla panels -** Change schedule to upload panels + menu in the initial phase -** Fix wrong URL when trying to set up defaul time frame and index pattern -** Update menu according to latest 5.1.1 GrimoireLab panels - -* GrimoireELK -** Fix string to integer concatenation error. -** [enrich][discourse] Support that some categories ids don't appear in categories names list -** [enrich][discourse] The category_id must be a string in the projects mapping -** [mbox][kip] Return None if the subject is None when trying to extract the KIP from the subject -** [enrich][confluence] Add confluence space field to the enriched index -** [enrich][askbot] Support that the author_askbot_user_name does not exist. - -* Panels -** Migrate affiliations panel to Kibana 5 -** Add Overview, Data Status and Last Month Contributors panels -** Add GitHub Backlog panel -** Add About panel with some help about the general use of Kibana -** Update About section -** Remove "highlightAll":true string to downgrade panels to 5.1.1 -** Add maniphest panels for 5.1.1 -** Add Mediawiki panel for 5.1.1 - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.14 - -Released: 2017-08-04 - -* SortingHat - -* Perceval - -* Mordred -** Use branch master and the json directory for panels loading. Fix panels names. -** [identities] Create the SortingHat database in mordred initial step - -* GrimoireELK -** Support projects in all data sources -** Fix mappings for stackexchange and twitter for ES5 aggregatable strings fields -** Fix tests adding dockerhub and functest data sources -** [enrich][phabricator] Use directly the list of tags instead of a comma separated string with the tags. - -* Panels -** Migrate discourse, twitter, confluence, RSS, stackooverflow, git, Jenkins, gerrit, bugzilla, mailing list, jira, aaskbot, dockerhub, irc, slack, meetup, github panels to Kibana 5 - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit -** Avoid problems for building the package when no pandoc is installed. - -* Arthur - -## elasticgirl.13 - -Released: 2017-07-20 - -* SortingHat: Updated to the last version. **Don't use it without upgrading the SH database following the procedure below** - -mysqldump --no-create-info db > db.sql -mysqladmin drop db -sortinghat init db -mysql db < db.sql - -** Release 0.4.0 -** [cmd:unify] Print which unique identities were merged -** [api] Add source filter to search_unique_identities() - -* Perceval -** Release 0.9.0 - -* Mordred -** Improve in mordred and enrichment logs about autorefresh -** [docker] Use in default mordred docker image the stage that starts arthur env - -* GrimoireELK -** [enrich][askbot] Fix identities extraction for "bot" like answered_by. -** [ocean][functest] Avoid mapping the field details which changes now between a dict, a list and a string. -** [enrich][mbox] Update the eclipse archives location so the project of a mailing lists can be found in projects.json -** [enrich][git] Use grimoire_creation_date as the date field for git. -** [enrich][meetup] Catch eitem['time_date'] exception when the timedate in the item is wrong. -** Add files needed for building clean pip packages. -** Move kidash to a new directory. -** [enrich][meetup] Catch eitem['time_date'] exception when the timedate in the item is wrong. -** [dashboards] Add KIP draft panel (Kafka Improvement Process) -** [gelk] Get Kibiter version and share it as a global variable of grimoire_elk.utils. -** [enrich][supybot] Add grimoire_creation_date and is_supybot_message standard fields -** [gelk] Remove urljoin to combine the base URL with the kibana config path because it removes the /data path. -** [enrich][askbot] Add author_url field to questions, answers and comments. -** [enrich][askbot][meetup] Copy list of items directly to enriched index. Kibana supports aggregating them directly. -** [enrich][slack] Use fielddata=True for text_analyzed in Kibiter 5. Fix also the enrichment of user_data when it does not include some fields -** [enrich][dockerhub] Implement the enrichment process according to panels team specification. -** [enrich][dockerhub] Enrich events and also create a image enriched item with the data from the last event. -** Avoid adding '//' to URL to be used with Elasticsearch API REST because the API REST petition will fail if '//' are in the URL path. - -* Panels - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -* Arthur: First time arthur is included - -## elasticgirl.12 - -Released: 2017-07-13 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** [slack] Fix error processing comment messages -** [OPNFV] [functest] Fix 'pagination' key not found error - -* Mordred -** Upload Sortinghat identities to a GitHub repository -** [task_track] Get upstream files contribs from all git repositories for OPNFV following the pattern: https://git.opnfv.org//plain/UPSTREAM -** [mordred] Remove the general load of identities used during the initial step. - -* GrimoireELK -** [track_items] Check that upstream contributors file exists. - -* Panels -** Added Confluence panel - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -## elasticgirl.11 - -Released: 2017-07-06 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** New git backend which syncs a repository using low-level commands - -* Mordred -** [docker] Add certificate for some mailing lists -** [autorefresh] Autorefresh will be done after enrichment if there are new data in Sorting Hat identities database. -** [task_panels] Move aliases logic to a new task TaskPanelsAliases so it can be called isolated from the loading of panels. -** [mordred] Use the new task TaskPanelsAliases to create the aliases during enrichment so the aliases are created once the enriched indexes are available. -** [task_identites] Extract Sortinghat unique identities modified in unify and affiliate commands. -** [identities] Add support for getting the uuids that have changed during Sortinghat unify and affiliate and refreshing them during next enrichment execution for all data sources. - -* GrimoireELK -** [enrich][functest] Add support for enriching FuncTest data source coming from OPNFV -** Change TZ so that it comes from author_date -** [enrich][sortinghat] Suppport the autorefresh of identities using a list of ids or uuids in an enriched index -** [enrich] Use always metadata__timestamp for detecting thew new items that must be enriched in incremental mode. Also do it for demography study. -** [panels] Add new method exists_dashboard to check if a dashboard already exists. -** [enrich][meetup] Use time_date as the grimoire_creation_date -** Merge branch 'master' into kafka-kip -** [enrich][mbox] Extract only the needed lines from the boyd of the message to avoid having huge body messages in the enriched index. -** [enrich][slack] Support that from_['real_name'] does no always exists -** [enrich][confluence] Add grimoire_creation_date -** [ocean] Avoid getting the mapping for some raw fields with problems in askbot, bugzilla, bugzillarest, jira and redmine - -* Panels - -* Reports -** [report] Improve log messages - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - - -## elasticgirl.10 - -Released: 2017-06-09 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** [perceval] Add Docker Hub backend - -* Mordred -** [doc] Update the mordred docker sample doc with last features and config params added to mordred. -** [task_identities] Don't try to load empty identities files -** [task_panels] Add support for defining the time frame and default index in an empty Kibiter. - -* GrimoireELK -** [enrich][git][demography] Fill author_min_date also if its value is None no matter it exists -** [enrich][github] Use grimoire_creation_date for getting the affiliation of authors - -* Panels -** Fixed issue with bold texts - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - - - -## elasticgirl.9 - -Released: 2017-05-24 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** Release 0.8.0 -** Remove deprecated functions from utils module. This functions are now part of GrimoireLab toolkit package. -** [backends] Use GrimoireLab toolkit. Datetime handling and introspection has been delegate to GrimoireLab toolkit. - -* Mordred -** [task_identities] Support filter raw in TaskIdentitiesCollection when we have one repository. - -* GrimoireELK -** [enrich][discourse] Add categories support to the enriched posts -** [errors][network] Retry in networking errors for connections and reads using the requests.packages.urllib3.util.retry.Retry -** [enrich][slack] Don't try to find the email in the user profile when it is not available. -** [enrich][stackexchange] Use arrays for tags in enriched index -** [docker] Add compose and elasticsearch config for kibiter 5.4.0 and ElasticSearch 5.4.0 - -* Panels - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -## elasticgirl.8 - -Released: 2017-05-17 - -Note: In this release we can not include perceval 0.8 because perceval-mozilla and perceval-puppet are not updated. - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** [bugzilla] Set User-Agent header on Bugzilla clients -** [askbot] Support old URLs schema - -* Mordred -** [task] Fix error configuring unaffiliated_group during enrichment in identities refresh -** [task_identities] Add support for downloading identities file from remote locations -** [task_identities] Don't load orgs if load_orgs is false -** [task_collection][task_enrich] Add support for config the bulk_size and scroll_size params - -* GrimoireELK -** Add the size of the JSON document to be indexed to the logs -** [ocean] Avoid showing the commits when analyzing git repositories in debug mode. It is too verbose in large repositories. -** [p2o][gelk] Add support for changing the number of items in ES bulk operations and ES scrolling searches. - -* Panels -** Add Lag info and performance KPIs -** Add Lag Solving Issues help -** Add section for the last 7 days of activity -** Add timeframe 7 days selection -** Update summary links in frequently asked metrics -** Add documentation about newcomers in the community as use case -** Add Frequent Asked Metrics section - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit -** [uris] Add module for handling URIs -** [datetime] Add module for managing datatime objects -** [introspect] Add module for handling instrospection -** Release 0.1.0 - -## elasticgirl.7 - -Released: 2017-05-04 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval - -* Mordred -** [task_identities] Execute affiliate, autoprofile and unify in subprocesses to avoid memory issues. -** [config] Add additional data sources that are loaded globally: confluece, jenkins, jira -** [task_collection] Do not use project field in data collection. (github project and project_1 issue) - -* GrimoireELK -** [enrich][sortinghat] Improve logs when error appears during SH activity in arthur.py. -** [enrich][meetup] Add a new field time_date with the date in which the event is planned -** [enrich][jira] Add projects support to JIRA. - -* Panels - -* Reports - -* VIzGrimoireUtils - - -## elasticgirl.6 - -Released: 2017-04-28 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval - -* Mordred -** Add the new TaskProjects task which manages the projects data for a dashboard -** Implement mordred projects creation and update from Eclipse projects -** Recover the project enrichment support for bugzilla and gerrit -** Add VIzGrimoireUtils dependency for Eclipse projects parsing - -* GrimoireELK -** [enrich] Show enrich exception call trace in logs -** [enrich][twitter] Don't try to configure perceval backend in non perceval data sources -** [enrich][logs] Show datasource in loading identities logs -** [enrich][twitter] Fix identities extraction in twitter -** [enrich][askbot] Fix SortingHat identities find in answers and comments. -** [enrich][git][p2p] Activate pair programming if origin url includes https://github.com/cloudfoundry-incubator -** [enrich][meetup] Define venue_geolocation field as a geolocation type value in the mapping. - -* Panels -** Add missing search widgets -** Update overview to include mediawiki - -* Reports -** [report] Get the active data sources in the mordred config file -** [report] Fix community section, GitHub metrics in overview, template string replacing in subdirs and quarter name. - -* VIzGrimoireUtils: added to the relase as mordred dependency -** [eclipse_projects] Break down eclipse_projects.py script in a library to be used for managing eclipse projects info and the script which uses it. The library is compatible with python2 and python3. - -## elasticgirl.5.1 - -Released: 2017-04-21 - -* SortingHat - -* Perceval - -* Mordred -** [config] Add new method get_data_sources to get the active data sources in a mordred config file. - -* GrimoireELK -** Fixes related to the change from iterator to generator of ocean API affecting askbot, discourse, mbox and meetup and track_items in elasticgirl.4 -** Fixes in pair programming logic - -* Panels - -* Reports -** Create a unified template and supporting code for generating the reports - -## elasticgirl.4 - -Released: 2017-04-10 - -* SortingHat -** [utils] Fix encoding error generting UUIDs in Python 3 -** [mailmap2sh] Add tool to convert mailmap files to a Sorting Hat JSON - -* Perceval -** [supybot] Include filepath data on ParseError exception -** [gerrit] Add option to disable SSH host keys checks -** [confluence] Add content URL to each item - -* Mordred -** [config] Add type checking for all config params -** Several improvements in tests so all of them work now -** Added track_items task -** Add report task -** [mordred] Add a new option -p to execute the a list of phases different from config file. - -* GrimoireELK -** [enrich][mediawiki] Fix extraction of identities from mediawiki reviews -** [enrich][confluence] Add the new field content_url to the enrich index -** [enrich][askbot] Add filter-raw support for askbot -** [ocean] Use a generator to access the items in ocean. -** [enrich] Get enriched items using the same logic than getting items from ocean -** [enrich][git] Fix demography study so it works with pair programming -** [ocean][meetup] Add the group meetup as tag so the raw index can store several groups in the same index -** [enrich][slack] Add missing field text_analyzed - -* Panels -** Add metrics.md file to the general README - -* Reports - - -## elasticgirl.3 - -Released: 2017-03-30 - + * Fix date parsing errors using grimoirelab-toolkit +* Grimoire ELK + * [flake8] Add W503 to ignore list + * [studies] Improve log lines prefix + * (alpgarcia/master) [enrich] Use grimoirelab-toolkit methods + * [utils] Avoid enriching items over and over + * [enrich] Prevent find identities for none ids + * [schema] Update type for id in discouse.csv + * [enrich-askbot] Fix typo in enrich_items + * [schema] Update askbot csv + * [enrich-askbot] Update id attribute mapping + * [tests] Remove credentials info from log messages + * [enriched] Remove credentials info from log messages + * [ell] Remove credentials info from log messages + * [elastic_items] Remove credentials info from log messages + * [elastic] Add `anonymize_url` method + * [tests] Add tests for alias management + * [enrich-git] Use global variable for aoc alias + * [utils] Handle alias management + * [elk] Handle alias management + * [elastic] Support alias management + * [enrich] Remove logic to add aliases + * [elk] Refactor `refresh_identities` + * [enrich-github] Change mapping type of state attribute + * [enrich-gerrit] Change mapping type of status attribute + * [gitlab-raw] Fix mappings to avoid immense term exception + * [enrich-github] Fix attribute repository + * [elastic_items] Handle none page + * [raw-gitlab] Allow passing blacklisted items from projects.json + * [enrich-askbot] Refactor logic to enrich items + * [enrich-crates] Replace list with yield + * [enrich-phabricator] Replace list with yield + * [enrich-puppetforge] Replace list with yield + * [tests] Add method to check value has_identities + * [enrich-mediawiki] Remove `has_identities` method + * [schema] Update stackoverflow csv + * [enrich-stackexchange] Reorganize tags fields +* Hatstall + * Hide identities that does not have profile +* Kibiter + * Synchronized with Kibana 6.1.4 * Perceval -** Add agent header so rss from wordpress could be retrieved - -* Mordred -** Clean docker image and add support for reports (prettyplotlib and elasticsearch_dsl) -** Fixes in config params -** Check that there are tasks to execute in update mode before executing them to avoid infinite loop in update -** Add new Task to track items upstream, including config and task implemetation. -** Add new Task to generate reports including config and task implemetation. -** Add unaffiliated_group to configure the name of the unaffiliated org name - -* GrimoireELK -** [enrich][demography] Fix author_min_date when executing in incremental mode -** [track_items] Add library and sample script using it -** Add Slack support - -* Panels -** Update mailing lists file name - -* Reports -** First version integrated - - -## elasticgirl.2 - -Released: 2017-03-23 - + * Updating instructions for querying stackexchange in README + * [gitlab] Fix `has_resuming` method +* Sigils + * [slack] Fix duplicates due to the avatar in top participants table + * [stackoverflow] Update field for question tags + * [affiliations] Add affiliations panel for kibana 6 + * [doc] Add GitHub and Gerrit efficiency docs + * [efficiency] Add panels for GitHub and Gerrit + * [mediawiki] Add Mediawiki panel doc + * [mediawiki] Add projects table in Mediawiki panel +* SirMordred + * [tests] Update setup.cfg with aliases_file param + * [task_enrich] Load aliases path from cfg param + * [task_collection] Load aliases path from cfg param + * [task] Load aliases.json file from variable path + * [config] Add aliases.json path in general cfg section + * Fix error importing old TaskPanelsAliases object + * [micro] Remove reference to TaskPanelsAliases + * [task_enrich] Remove reference of TaskPanelsAliases + * [sirmordred] Remove references to TaskPanelsAliases + * [task_panels] Remove TaskPanelsAliases task + * [sirmordred] Add aliases.json file + * [task_enrich] Extend enrich_backend method for alias management + * [task_collection] Extend feed_backend method for alias management + * [task] Read aliases from file + * [task-enrich] Refactor `refresh_identities` + * Reorder Gitlab panels putting them before Community panels + * Update metadashboard structure according to the new menu + * Unify the log debug messages printed by the threads + * Add the origin to the log messages both for data collection and enrichment + * Change logging level for Perceval and GrimoireELK and disable their logging files + * [menu] Add efficiency panels for GitHub and Gerrit * SortingHat -** Release 0.3.0: https://github.com/grimoirelab/sortinghat/releases/tag/0.3.0 - -* Perceval -** Release 0.7.0: https://github.com/grimoirelab/perceval/releases/tag/0.7.0 - -* Mordred -** Support several entries in menu.yaml for the same data source, fixed menu creation and add one level menus for Overview, Data Status, About -** Improved config management: check config, create config and overall params management -** Added new aliases to remo indexes to fix data freshness issue -** Improvements in logs to find errors in threads -** The initial load step could be skipped using the skip_initial_load config param - -* GrimoireELK -** [enrich][git] Add effort pair programming metrics -** [enrich][phabricator] Add missing fields assigned_to and timeopen_days (T2305 ) -** [ocean][twitter] Order raw items using @timestamp during enrichment (T2367) -** [enrich][hyperkitty] Support -** [enrich][jenkins] Add "main" as built_on when built_on field is empty (thanks @lcanas and @jgb) -** [track_items] Upload first complete version with gerrit contributions support - -* Panels -** doc fixes and typo fixes - -## elasticgirl.1 - -Released: 2017-03-09 - -* Perceval -** Automatic checking of code style using flake8 using Travis. Fixed codying style in all perceval. -** Slack backend improvements -** Logs improvements in gerrit -** [backend] Escape invalid chars when UUIDs are generated - -* GrimoireELK -** Logging now includes the correct modules. Several logging fixes. -** [ocean] Fix mappings for gerrit and mbox to avoid immense term issue. -** [ocean][jenkins] Add support for jenkins-rename-file param in mordred - -* Mordred -** Add support for jenkins-rename-file param in mordred -** Add g++ to docker image to compile pandas -** [tests] Add more tests, including a test for testing the full stack and check the number of items generated - -* Panels -** Add first version of general panel description - -## dagger - -Released: 2017-02-23 - -** Support for nntp, puppetforge and hyperkitty (perceval + gelk). slack supported in perceval. -** Support for --filters-raw-prefix (gelk) -** Support remo and remo:activities as data sources in mordred (pending merge branch in mordred) -** Twitter enrichment does not support from_date parameter (gelk) - -## catwoman - -Released: 2017-02-02 - -## batgirl - -Released: 2016-12-23 - -## atom_girl - -Released: 2016-12-14 + * [api] Optimize how last modified identities are retrieved diff --git a/releases/old/NEWS.old b/releases/old/NEWS.old new file mode 100644 index 00000000..ccf8cc06 --- /dev/null +++ b/releases/old/NEWS.old @@ -0,0 +1,3058 @@ +## 18.11-01 + +Released: 2018-11-06 + +* Perceval +** [jenkins] Update message level when handling blacklisted jobs +** [gitlab] Allow to blacklist merge/issue ids +** Ignore W504 flake8 error code +** [backends] Fix flake8 errors + +* grimoirelab-elk +** [enrich-redmine] Add ELK metadata +** [enrich-mozillaclub] Add ELK metadata +** [enrich-mediawiki] Add ELK metadata +** [elastic_items] Handle pagination over none index +** [enrich] Handle insertion of empty identities +** [elk] Avoid processing None identities +** [enrich-meetup] Prevent insert enrich items with no time +** [enrich-discourse] Refactor logic to enrich items +** [ELK] Fix flake8 errors +** [utils] goodbye google-hits script +** [utils] Goodbye rest script +** [enrich-gitlab] Handle missing milestone attribute in raw items +** [elastic_items] Refactor `fetch` method +** [enrich-google_hits] Redifine has_identities method +** [enrich-functest] Redifine has_identities method +** [enrich-dockerhub] Redifine has_identities method +** [enrich-jenkins] Redifine has_identities method +** [elk] Add condition to skip loading identites +** [enrich] Add has_identities method +** [enrich-askbot] Replace list with yield +** [enrich-bugzillarest] Replace list with yield +** [enrich-confluence] Replace list with yield +** [enrich-discourse] Replace list with yield +** [enrich-gitlab] Replace list with yield +** [enrich-jira] Replace list with yield +** [enrich-kitsune] Replace list with yield +** [enrich-mattermost] Replace list with yield +** [enrich-mediawiki] Replace list with yield +** [enrich-phabricator] Replace list with yield +** [enrich-mozillaclub] Replace list with yield +** [enrich-puppetforge] Replace list with yield +** [enrich-redmine] Replace list with yield +** [enrich-remo] Replace list with yield +** [enrich-rss] Replace list with yield +** [enrich-stackexchange] Replace list with yield +** [enrich-slack] Replace list with yield +** [enrich-supybot] Replace list with yield +** [enrich-telegram] Replace list with yield +** [jenkins] Add node name cleaning based on RE +** [enrich-twitter] Replace list with yield + +* SirMordred +** Add demographics index pattern +** [menu] Add index pattern for attraction/retention +** [tests] Fix flake8 errors after upgrade +** [sirmordred] Set elasticsearch logging level to INFO +** [jira] Add index pattern for closed issues +** Add documentation for jenkins `node_regex` param +** [jenkins] Add support for node name cleaning + +* Sigils +** [git] Update demographics panel to use new fields +** [gitlab] Fix latest items tables to size 100 +** [gitlab] Add missing fields in issues index pattern +** [jira] Add closed issues by project table + + +## 18.10-03 + +Released: 2018-10-21 + +* GrimoireLab +** Fixes dependencies problems found in GrimoireLab package + +## 18.10-02 + +Released: 2018-10-18 + +* Perceval +** [groupsio] Make api token a required param +** [groupsio] Fetch archives from group-specific domains +** Adding academic reference + +* grimoirelab-elk +** [enrich_mattermost] Fix error setting empty emails for identities +** [enrich_mattermost] Fix error setting blank names on identities +** [enrich-github] Include label lists in enriched items +** [enrich-git] Replace list with yield +** [enrich-github] Replace list with yield +** [enrich-gerrit] Replace list with yield +** [enrich-bugzilla] Replace list with yield +** [tests] Extend tests for demography study +** [enrich] Add method to include aliases in enriched index +** [enrich-gerrit] Add demography study to gerrit +** [install] Update dependencies +** [tests] Update .travis.yml +** [tests] Align tests for git demography study +** [enrich] Add generic demography study +** [enrich-git] Replace ad-hoc git demography +** [enrich-gitlab] Include labels list in enriched items +** [onion] Fix `all_onion` alias creation +** [onion] Add refresh interval +** [enrich] Check presence of input index onion +** [gitlab-enrich] Add onion study +** [schema] Add schema for gitlab issues +** [schema] Add schema for gitlab merges +** [aoc] Add a constant for out_index default value +** [tests] Extend tests data for Gitlab milestone attribute +** [enrich-gitlab] Add milestone attribute for gitlab items + +* SirMordred +** [onion] Add documentation for 'seconds' parameter +** [setup] Update dependencies +** [menu] Remove onion index pattern from Git panel +** [panels] Add demographics panel in community section +** [tests] Fix tests for task panels +** [tests] Fix tests for config +** [tests] Update mediawiki 1.28 archive +** [tests] Update .travis.yml +** [cfg] Update config files +** [doc] Update documentation with gitlab info +** [micro] Handle raw and enrich tasks exceptions +** [doc] Include doc for gitlab onion studies +** [doc] Add autorefresh_interval description +** [autorefresh] Add autorefresh identities in AOC + +* Sigils +** [data_status] Update google_hits data status entry +** [demographics] Add known limitations and issues +** [demographics] Add panel for multiple sources +** Update info about index patterns and panel ids +** [gitlab] Increase the number of issues shown in timing panels +** [gitlab] Remove invalid search object for MRs backlog +** [gitlab] Adjust "Avg. Time Open" column in Backlog Submitters table +** [gitlab] Show full list of participants in GitLab panels +** [gitlab] Add milestone visualizations to GitLab merge requests +** [gitlab] Add milestone visualizations to GitLab issues +** [onion] Add data source filter widget to panels +** [gitlab] Fix typo in visualizations + +* Kidash +** Add check for query key in bool filter fix + +## 18.10-01 + +Released: 2018-10-03 + +* Perceval +** [tests] Align mediawiki after API calls optimization +** [mediawiki] Optimize number of calls to API +** [tests] Use output method in assertLogs for mbox test +** [tests] Use output method in assertLogs for gitlab test +** [tests] Add test to handle mediawiki version exception +** [mediawiki] Fix error in client `get_version` method +** [gitlab] Fix typo initiazaling common MRs fields + +* grimoirelab-elk +** [enrich-stackexchange] Handle KeyError exception +** [aoc] Add support for autorfresh in sirmordred +** [demography] Catch conn exceptions when fetching author commits +** [enrich] Set identities fields to UNDEFINED for null values + +* SirMordred +** [tasks_panels] Fix initialization of .kibana index in Kibana 6.x + +** Sigils +** [data_status] Fix error showing GitLab issues retrieval dates +** [twitter] Replaces Latest tweets widget at the bottom +** Update documentation about contributing to be updated with Kibiter 6.1.0 release +** Fix hidden legends in bar charts +** Fix title of organizations pie chart +** Fix badly stacked bar bug + +* SortingHat +** Support UTF-8 fully in MySQL/MariaDB + +* Hatstall +** Register new template filter when a name is blank but isn't None + +* Kidash +* [kidash] Enable Kibiter 6 configuration + +## 18.09-03 + +Released: 2018-09-24 + +* GrimoireLab +** [doc] Added file for community components. +** [docker] Clarify variable names in ansible file for building release. + +* Perceval +** [tests] Add tests for GitLab merge request data +** [gitlab] Add merge_request category +** [github] Fix doc in fetch method +** [args] Add new argument --json-line + +* grimoirelab-elk +** [tests] Include tests data for GitLab merge requests +** [enrich-gitlab] Add merge request enrich item +** [enrich-mediawiki] Fix unique id for enriched items +** [tests] Include tests data for GitHub pull requests +** [enrich-stackexchange] Add 'origin' and 'tag' fields to answer items +** [raw] Improve logging message in elastic + +* Sigils +** [overview] Minor change to make gitlab panels visible +** [data_status] Minor change to make gitlab panels visible +** [gitlab] Minor change on merge panels +** [gitlab] Minor change on issue panels +** [gitlab] Add Issues and MR info to Overview and Status panels +** [adoption] Panel for Rust adoption +** [dev] Panel for dev related sources +** [social] Panel for Social sources +** [mediawiki] Use 'edits' instead of 'editions' +** [gitlab mr] Update URL links and fix a couple of titles +** Add GitLab Merge Request panels +** [jenkins] Add panel to track nodes +** [jenkins] Add panel for tracking jobs +** [gitlab] Fix issue with URLs in the repositories table +** [gitlab] Update GitLab panels based on the review. Minor fixes. +** [gitlab] Add GitLab panels focused just on issues +** [github] Fix acc time widget in PRs backlog + +* SirMordred +** [utils] Update setup.cfg micro-mordred +** [config] Change gitlab param names +** [task_panels] Change gitlab data source names +** [tasks_panels] Disable kibiter 6 configuration +** [utils] Add gitlab entries in setup.cfg and .json +** [task_panels] Add aliases to gitlab indexes +** [utils] Update setup.cfg and .json micromordred +** [utils] Update menu.yml +** [menu.yml] Adding nodes and jobs panels +** [tests] Include strict param in mock tests task panels +** [task_panels] Handle strict mode loading panels via setup.cfg +** [config] Handle strict loading of panels +** [tests] Update number of loaded panels +** [utils] Align menu.yml micro-mordred with upstream one +** [menu.yml] Remove mattermost from menu.yml +** [tasks_panels] Handle mattermost panels via setup.cfg +** [config] Load mattermost panels by the setup.cfg +** [tasks_panels] Handle gitlab panels via setup.cfg +** [config] Load gitlab panels by the setup.cfg +** [tests] Include archives for gitlab merges and github pulls +** [task_panels] Align task panels with kidash +** [tests] Align configuration files with new changes +** [tests] Align tests with new changes in task_panels +** [doc] Update config.md +** [README.md] Update readme +** [config] Make kibiter url mandatory for panels section +** [task_panels] Set kibana settings programmatically +** [task-collection] Improve logging message + +* Hatstall +** Fix url redirection to /identities/hatstall +** Change absolute urls in href and actions to the Django right ones + +* Kidash +** Revert previous commit +** [import] Create the Kibana index if not exists before importing anything + + + +## 18.09-02 + +Released: 2018-09-07 + +* Perceval +** Remove unused and not working config_file option + +* grimoirelab-elk +** [tests] Fix load identities test +** [tests] Add tests for googlehits connectors +** [utils] Add googlehits connectors +** [enrich] Add support to enrich googlehits raw data +** [raw] Add support for googlehits data + +* Sigils +** [irc] Fix orgs table participants count +** [KIP] Restore search viz + +* SirMordred +** [utils] Update micro-mordred menu.yml +** [task_panels] Modify alias for google hits +** [config] Remove google_hits from extra backends +** [archives] Update slack archive +** [archives] Update github archive +** [tests] Add tests for googlehits + +* Hatstall +** Add new index that show just an form in order to search identities +** Delete the first and last " with strip() +** Add CSRF_TRUSTED_ORIGINS as a docker env variable + + +## 18.09-01 + +Released: 2018-09-04 + +* Perceval +** [googlehits] Modify item id generation +** [github] Increase number of items retrieved per page +** type fix on tests requirements file + +* Sirmordred +** [menu.yml] Fix typo in googlehits data source +** [task_panels] Include phabricator panels in overview and data status +** [task_panels] Enable kafka studies +** [config] Include option to visualize kafka studies +** [tests] Align tests for new panels +** [utils] Align micro-morded menu.yml with mordred one +** [task_panels] Include mbox-type panels +** [menu.yml] Include mbox-type entries +** [task_panels] Do not import panels that don't have the release field +** [task_panels] Replace google_hits backend name +** [menu.yml] Modify google hits source name +** [tests] Fix tests for task_panels +** [tests] Fix tests for task_enrich +** [tests] Fix tests for test_task +** [collection] Add support for mediawiki tag +** [utils] Add mattermost panels to menu.yml micro-mordred +** [menu] Add mattermost entry +** [menu.yaml] Remove duplicated community info in git menu +** [utils] Fix setup.cfg for micro-mordred +** [menu] Add index pattern for remo-activities +** [menu] Fix remo-activities index-patterns entry + +* grimoirelab-elk +** [enrich-meetup] Fix error printing the number of comments and RSVPs +** [tests] Update Git test data +** [tests] Update Slack test data +** [tests] Update Jira test data +** [enrich-jira] Remove unknown user data logic +** [enrich-git] Remove unknown user data logic +** Set Unknown to null user data (org, name and username) +** [elk] Modify logic to load new identities to SH +** [enrich-mbox] Replace lists with yields +** [enrich-meetup] Replace lists with yields +** [enriched] Update mediawiki project json params +** [enriched-jira] Set Unassigned to null assignee orgs and usernames +** [enrich-jira] Improve jira enricher +** [enrich-git] Handle commits with missing user info +** [tests] Enable tests from no-localhost ES + +* Sigils +** [kip] Disable search panel +** [overview] Add mattermost widgets +** [data status] Add mattermost widgets +** [overview] Fix missing widget panels +** [data_status] Fix visualization ids +** [meetup] Fix visualization id for `meetups_main_numbers` +** [overview] Replace dockerhub viz by current ones +** [kip] Migrate panel to Kibana 6 +** [data status] Add remo activities index pattern +** [about] Update panel to include release date +** [data status] Fix dockerhub index pattern name +** [data status] Fix google hits widgets +** [overview] Fix index name for Dockerhub viz +** [overview] Update google hits widgets +** [google-hits] Panel updated to support new backend + + +## 18.08-01 + +Released: 2018-08-23 + +* SortingHat +** [api] Fix lost enrollments error merging identities +** [db] Handle disconnection using pessimistic mode + +* Perceval +** [doc] Include doc to execute the googlehits backend +** [backends] Add backend for GoogleHits +** [slack] Fix flake8 error +** [slack] Include num members in channel info +** [doc] Update install from source code section in README.md +** Mozilla +** [doc] Update install from source code section in README.md +** OPNFV +** [doc] Update install from source code section in README.md +** Puppet +** [doc] Update install from source code section in README.md + +* Sirmordred +** Fix typos in menu.yaml for 6.x panels and index patterns +** [task_panels] Update index pattern files for Onion panels +** [utils] Add conf files for micro-mordred +** [utils] Add micro-mordred +** [test_task_panels] Update tests for community section menu +** [task_panels] Add community structure menu +** [config] Add time interval for autorefresh +** [panels] Remove unused panels +** Fix weird warning +** [tests] Update test_config.py +** [tests] Add example of enrich_pull_requests study in test_studies.cfg +** [config] Add `enrich_pull_requests` to the tuple of studies + +* grimoirelab-elk +** [enrich-mediawiki] Change way url is created +** [aoc] Replace message commit with first 80 chars +** [enrich-slack] Use `num_members` attribute to count channel members +** [studies] Add enrich_pull_requests study +** [aoc] Fix study to do nothing if no events + +* Sigils +** Merge branch 'kibana6-migration' +** Use 'edits' instead of 'editions' for MediaWiki +** [mattermost] Add Kibana 6 panel and index pattern +** [reps activities] Add panel migrated to Kibana 6 +** [reps events] add panel fro Kibana 6 +** [about] Add about.json from master +** [dockerhub] Fix legend title for Stars and Pulls +** [dockerhub] Update evolutionary charts to use Timelion and use Deltas +** [dockerhub] Add DockerHub panel and index pattern +** [functest] Add panel for functest project +** [functest] Add testing overview panel +** [mediawiki] Use 'edits' instead of 'editions' +** [mozilla-club] Increase size of pie charts +** Add Mozilla Club panels and index patterns +** [google-hits] Add Google Hits panel and index pattern +** [twitter] Migrate panel to Kibana 6 + +* Manuscripts +** [Notebooks] Update README with instructions to run the notebooks +** Add Notebooks for GMD metrics and sample visualisations +** Some (hopefully minor) changes +** [MS2/report/tests] Add basic tests for manuscripts2 reports +** [MS2/tests] Set up module level test fixtures +** [MS2/README] Update README with instructions to generate the report +** [MS2/manuscripts2] Update bin/manuscripts2 to take cmd inputs +** [MS2/latex] Separate github_issues and github_prs data for Overview +** [MS2/reports] Add functions to generate the PDF reports +** [MS2/reports] Add latex template folder from the old manuscripts +** [MS2/reports] Remove "_" from strings and update create_csv_fig_from_df +** [MS2/reports] Fix minor errors and change folder names +** [MS2/Reports] Add the project process section of the report +** [tests] Add tests for Metrics under project process in github_prs +** [MS2/metrics] Add project_process Metrics & function for github_prs +** [tests] Add tests for Metrics under project process in github_issues +** [MS2/metrics] Add project_process Metrics & function for github_issues +** [MS2/elasticsearch] Update calculate_bmi function +** [MS2/metrics] Change field for timeseries aggregations in ClosedIssues +** [MS2/reports] Add PROJECT_COMMUNITY section of the report +** [manuscripts2/metrics] Rename NAME variable to DS_NAMES In all the data source files +** [tests] Add tests for aggregations() in Authors and Organizations classes +** [MS2/metrics] Add capability to calculate project_community metrics +** [tests] Clean up code. Add tests/utils.py +** [manuscripts2/elasticsearch] Add get_list method for Query class +** [config] Add studies params +** [tests] Add tests for timeseries metrics generated in github_prs +** [github_prs] Add project_activity function +** [tests] Add tests for timeseries metrics generated in github_issues +** [github_issues] Add project_activity function +** [tests] Add tests for timeseries metrics generated in git +** [git] Add project_activity function +** [report] Add functionality to calculate PROJECT ACTIVITY section +** [tests] Rearrange the test data into specific folders +** [tests] Add tests for github_issues data source +** [manuscripts2] Add OVERVIEW section for github_issues data source +** [tests] Update test_elasticsearch.py to use test base class +** [tests] Update tests/data/git_commit.json file +** [tests] Update git_commit.json data +** [tests] Update test base class +** Rename manuscripts2/Readme.md to manuscripts2/README.md +** [tests] Add example to use the test base class +** [tests] Add test base class +** [manuscripts2] Add tests for OVERVIEW section of 'git' data source +** [manuscripts2] Add code to calculate OVERVIEW section for 'git' data source + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall +** [docker] Update password of admin user when container restart +** Change href of Profiles item to "list" instead of "/" +** Update href in order to avoid absolute/relative problems +** Allow None country in the profile form +** [docker] Modify path of sqlite file when env variable exists +** [docker] Default admin account can be now set via docker environment variables +** [urls] Add support for using /identities as the base path for accessing Hatstall +** [docker] Remove gunicorn and use stage from Docker image +** [docker] Modify apache config to serve static files and generate the static files during deployment +** [static] Reorganize static contents for the base template in the django-hatstall project +** [urls] Remove gunicorn suport for static contents +** [docker] Add in stage the activation of ssl module in Apache +** [docker] Support https for accessing the Django Hatstall application +** [docker] Convert Django Hatstall deployment to Apache2 + mod_wsgi + +* Ceres +** Fix filter method when a column has no values + + +## 18.07-11 + +Released: 2018-07-25 + +## Release details + +* SortingHat +** [tests] Add tests for recovery mode in unify command +** [unify] Add resume method to unify command + +* Perceval +** [askbot] Handle upstream internal server +** [gitlab] Sanitize requests before archiving +** [gitlab] Fix signature backend +** [travis] Change how perceval is installed +** [mbox] Fix test `test_mboxes_error` +** [github] Fix position GitHub client args +** [phabricator] Handle 429 HTTP errors +** [mbox] Increase test coverage +** [pipermail] Remove duplicated test +** [utils] Add checks to zip compressed type +** [mbox] Add checks to zip compressed type +** [doc] Include doc to execute the groups.io backend +** [backends] Add backend for groups.io +** [mbox] Allow support for zip file in MboxArchive +** [utils] Add support for zip compressed file type +** Mozilla +** [setup] Align setup to perceval one +** [travis] Change how perceval-mozilla is installed +** OPNFV +** [setup] Align setup to perceval one +** [travis] Change how perceval-opnfv is installed +** Puppet +** [setup] Align setup to perceval one +** [travis] Change how perceval-puppet is installed + +* Sirmordred +** [tests] Add tests for sirmordred +** [tests] Update test data +** [sirmordred] Load repos for a tagged backend sections +** [task_projects] Load repos for a tagged backend section +** [tests] Add archive for GitLab +** [utils] Goodbye cfg_generator +** [doc] Include example for GitLab +** [tests] Relax number of index-patterns in tests for panels +** [docs] Add coveralls badge +** [tests] Add perceval-* dependencies to requirements.txt +** [tests] Add grimoirelab-toolkit dependency to requirements.txt +** [config] Redirect autogenerated doc to README.md +** [config] Extend `write_doc` method +** [tests] Extend test for config file + +* grimoirelab-elk +** Change shebang line +** [elastic_items] Remove condition for old twitter items +** Add support for Groupsio +** [travis] Fix coverage execution +** [utils] Goodbye twitter scripts +** [README.md] Fix travis badge +** [travis] Execute coveralls after tests +** [README.md] Add coveralls badge +** Add support for GitLab + +* Sigils + +* Manuscripts +** Update failing tests because of change in perceval git data +** Rename manuscripts2 branch files +** [travis] Narrow coveralls execution +** Update tests for manuscripts2 +** Update Query class: set start and end date filters directly into search object +** [tests] Fix travis.yml +** [travis] Add coveralls +** [doc] Fix badges in README.md +** Add initial infrastructure to generate the reports + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres + + +## 18.07-10 + +Released: 2018-07-17 + +## Release details + +* grimoirelab-elk +** [studies] Use hash instead of plain text as id +** [enriched] Use metadata__update_on to index tweets + + +## 18.07-09 + +Released: 2018-07-15 + +## Release details + +* Sigils +** Use kibana6-migration branch + + +## 18.07-08 + +Released: 2018-07-13 + +## Release details + +* Sirmordred +** [menu.yaml] Add panels and index patterns for Areas of Code and Community Structure + + +## 18.07-07 + +Released: 2018-07-12 + +## Release details + +* SortingHat + +* Perceval +** Changes to work with grimoirelab_toolkit. +** Mozilla +*** Changes to work with grimoirelab_toolkit. +** OPNFV +*** Changes to work with grimoirelab_toolkit. +** Puppet +*** Changes to work with grimoirelab_toolkit. + +* Sirmordred +** [config] Add tag to backend sections + +* grimoirelab-elk +** [raw] Fix mapping Twitter +** [enriched] Add code to calculate github pull requests enriched data +** [enriched] Change toolkit import in git enricher +** [enriched] Change toolkit import in ceres_base +** [p2o] Add support for execution a list of studies +** [enrich][git][demography] Add doc and fix the incremental support + +* Sigils + +* Manuscripts + +* Kidash + +* GrimoireLab Toolkit +** Change module name to grimoirelab_toolkit. + +* King Arthur +** [arthur] Change toolkit import + +* Bestiary + +* Hatstall + +* Ceres + +## 18.07-06 + +Released: 2018-07-10 + +## Release details + +* SortingHat +** [travis] Include cryptography package +** [tests] Align tests to logging support +** [sortinghat] Add logging support + +* Perceval +** [twitter] Change metadata_id attribute +** Mozilla +** OPNFV +** Puppet + +* Sirmordred +** [tests] Add twitter archive +** [dashboard title] Fix typo in project name extraction +** [tests] Add arthur and perceval eggs to requirements.txt +** [studies] Include raw backend to studies + +* grimoirelab-elk +** [enriched] Add support for github pull request data +** [raw] Add support for github pull request data +** [tests] Add test for kafka kip study, git studies and SSL support +** [enriched] Improve logging for studies +** [enriched] Include ocean backend in studies +** [elk] Add raw backend to studies params +** [raw] Add parser params for perceval mattermost backend +** [studies] Fix ES conns to use insecure parameter +** [enrich][mattermost] Fix project mapping support +** [enrich][slack] Fix slack project mapping to use just the channel id in the projects mapping file +** [tests] Use the projects mapping json file for testing + +* Sigils +** [telegram] Add Telegram panels migrated to Kibana 6 +** [apache] Add Apache panels +** Updated panels for askbot, discourse, stackoverflow, rss, bugzilla timing, redmine, maniphest, bugzilla, onion, overview, git, data status, mediawiki, jenkins, stackoverflow, confluence, slack, maniphest, github, irc, mbox, jira, bugzilla, gerrit, +* Manuscripts +** Add manuscripts2 containing new functions to calculate the metrics +** Closes #48: start date not provided use case + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall +** [urls] Add support for using /identities as the base path for accessing Hatstall +** [docker] Default admin account can be now set via docker environment variables +** [docker] Modify path of sqlite file when env variable exists + +* Ceres + +## 18.07-05 + +Released: 2018-07-04 + +* Sirmordred +** Update menu.yaml to kibana 6 panel and index names +** [task_panels] Add support for loading several index patterns per data source + + +## 18.07-04 + +Released: 2018-07-04 + +* Kidash +** Don't sys.exit from kidash.py library (raise exceptions) + +* Mordred +** [task_panels] Manage the error loading panels, log it and continue execution + + +## 18.07-03 + +Released: 2018-07-03 + +* Sirmordred +** [task_panels] Add support for loading index patterns + + +## 18.07-02 + +Released: 2018-07-03 + +* Kidash +** Add release date support for Index Patterns + +* Sigils +** Add panels for kibiter 6.1.0 migration + + +## 18.07-01 + +Released: 2018-07-02 + +* Kidash +** [tests] Add test for split-index-patterns new param +** [kidash] Add support for importing and exporting only index patterns +** Update mapping in Kibana6 if needed +** Add constant for release date field name +** Add try/except to show content of error responses +** Add release_date to panel json + + +## 18.06-03 + +Released: 2018-06-28 + +* SortingHat +** [tests] Adapt tests to run with setup.py test +** [all] Remove support for Python 2.7 +** [db:api] Add functions for all the low level operations on SortingHat +** [api] Improve output messages for enrollment commands +** [exceptions] Rename WrappedValueError to InvalidValueError + +* Perceval +** [tests] Replace datetime function with equivalent toolkit one +** [meetup] Pythonicize `calculate_time_to_reset` +** [backends] Add backend for Twitter +** Mozilla +** OPNFV +** Puppet + +* Mordred +** Change name from mordred to sirmordred + +* grimoirelab-elk +** [mattermost] Add mattermost support for gelk (raw + enrich) +** [tests] Modify tests for Twitter backend +** [utils] Modify connector information for twitter +** [twitter] Modify enrich connector +** [twitter] Modify raw connector +** [tests] Allow testing with latest grimoirelab component versions +** [enrich] Align ELK with changes in SortingHat +** [enriched][github] Add code to calculate the first reaction duration to an issue +** [enrich][redmine] Add `assigned_to` fields +** [jira] Fix mapping to avoid limit number of fields exception +** [bugzilla] Fix immense term exception for activity attribute +** [elastic] Add template to force date format +** [raw] Update mappings for jenkins to ES 5.x +** [enrich] Handle deleted user in stackoverflow +** [enriched] Add `latest_date` method to connector + +* Sigils +** [owlwatch] Move owlwatch to its own repo +** [GitHub] Revamp timing panels +** [GitHub ]Update PRs overview panel +** [demographics] Fix y-axis label for leaving devs +** [slack] Add projects table + +* Manuscripts +** Updated comments in esquery.py + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres + +## 18.06-02 + +Released: 2018-06-08 + +* Mordred +** [studies] Handle empty list of studies in backends + +## 18.06-01 + +Released: 2018-06-07 + +* SortingHat +** [parsing:sh] Make gender profile info not required + +* Perceval +** [backend] Include category in backend params +** [github] Add list of commits hashed included in pull requests +** [pipermail] Fix command line parameters +** OPNFV +** Puppet + +* Mordred + +* grimoirelab-elk +** [stackexchage] Fix fields for questions having an accepted answer +** [jira] Fix typo in enriched jira fields +** [studies][demography] Use author_uuid field to aggregate the authors instead of author_id +** [enrich] Modify max length for keyword fields + +* Sigils +** [discourse] Add % of questions answered +** [stackoverflow] Fix % of questions answered +** [askbot] Add % of questions with accepted answer +** [panels] Add community structure panels & documentation +** [panels] Add accepted answers and project support +** [panels] Fixed links to issues and revamp (jira) +** [panels] Refurbish Jira panel +** [panels] Fix typo in Jira panels +** [panels] Modify answers table for consistency +** [Panels] Rearrange project and authors widgets +** [panels] Add project support to Askbot +** [panels] Add crates to Data Status + +* Manuscripts +** Updated esquery.py and created tests/test_esquery.py +** Updated esquery.py to use elasticsearch_dsl in all places + +* Kidash +** [kidash] Preserve uiStateJSON dict when cleaning a dashboard from not needed data sources +** [kidash] Use #!/usr/bin/env python3 to work inside venvs correctly + +* GrimoireLab Toolkit + +* King Arthur +** [tests] Align tests with arthur tasks validation +** [arthur] Add validation for tasks +** [tests] Fix tests for server +** [jobs] Add category to backend arguments +** [scheduler] Fix wrong date conversion +** [server] Allow to add tasks without archiving/scheduling options + +* Bestiary + +* Hatstall + +* Ceres + +## 18.05-03 + +Released: 2018-05-31 + +* SortingHat + +* Perceval +** [tests] Increase coverage pipermail +** [pipermail] Disable SSL verification +** Mozilla +** OPNFV +** Puppet + +* Mordred +** [studies] Allow setting up kafka_kip via cfg +** [task_projects] Add new eclipse_projects_lib.py +** [tests] Add tests for task_manager +** [config] Include sections for studies +** [tests] Align tests for studies with new functionalities +** [task_enrich] Forward study params to ELK +** [tests] Enable tests with latest versions of grimoirelab components +** [task] Improve parsing parameters for perceval + +* grimoirelab-elk +** [twitter] Set field_date for twitter enricher to created_at +** [enrich][bugzilla] Remove emails from enriched index +** [enrich][meetup] Change log from error to warning when the date are incorrect from upstream data +** [gelk-mapping] Add the script to setup.py so it is installed with the pip package +** [gelk_mapping] Generate files with the JSON mappings to be used by elasticdump to create the indexes +** [elk] Propagate study params from mordred to elk +** [enrich] Create all_onion alias if not exist +** [git] Generalize areas of code study +** [gelk_mapping.py] Script to show the mappings for a data source +** [raw] Reduce the number of fields indexed for jenkins items +** [elk] Fix enrichment of stackexchage answers + +* Sigils +** [panels] Add accepted answers to Discourse panel +** [panels] Add areas of code panel +** [confluence] Increase rows and sort by page edits +** [confluence] Use `content_url` for page links + +* Manuscripts +** [metrics][gerrit] Use closed date field for computing the TTM (time to merge) metric + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur +** [setup] Update Perceval version +** [jobs] Modify imports of perceval functions + +* Bestiary + +* Hatstall + +* Ceres + + +## 18.05-02 + +Released: 2018-05-17 + +* SortingHat + +* Perceval +** [setup] Fix to let setup.py test run +** Add readthedocs badge +** [backend] Replace datetime import with grimoirelab-toolkit +** Mozilla +*** Fix support for package namespaces +** OPNFV +*** Fix support for package namespaces +** Puppet +*** Fix support for package namespaces + +* Mordred + +* grimoirelab-elk +** [enrich][twitter] Use case insesitive tags for doing the projects mapping +** [studies][demography] Add tests for the study +** [studies][demography] Use author_id field to aggregate the authors instead of Author + +* Sigils + +* Manuscripts +** [docstrings] Complete docstrings for manuscripts + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres + + +## 18.05-01 + +Released: 2018-05-10 + +* SortingHat +** [readme] Include troubleshooting section + +* Perceval +** [mattermost] Add Mattermost backend +** Fix support for package namespaces +** Mozilla +** OPNFV +** Puppet + +* Mordred +** [task_enrich] Ensure number of enrich tasks decreases upon failure +** [TaskManager] Fix unreachable code + +* grimoirelab-elk +** [elk] raise exception in do_studies +** [stackexchange] Add fields to csv to track accepted answers +** [discourse] Add fields to csv to track accepted answers +** [stackexchange] Add info to get the percentage of accepted answers +** [discourse] Add info to get the percentage of accepted answers +** [onion] Check author bucket to make sure it exists +** [twitter] Change date value to index tweets +** [enriched][bugzillarest] Fix comment and remove unneeded variable +** [twitter] Limit number of indexed fields +** [stackexchange] Handle deleted users +** [discourse] Add information to track accepted answers +** [stackexchange] Add information to track accepted answers +** [elastic] Remove not used global_mapping method + +* Sigils + +* Manuscripts + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres + + +## 18.04-04 + +Released: 2018-04-26 + +* SortingHat +* Perceval +** Mozilla +** OPNFV +** Puppet +* Mordred +** [setup] Fix dependency on manuscripts +* grimoirelab-elk +** [jira] Disable dynamic mappings for data.changelog.histories +** Remove ES 2.x mappings for all data sources (alexandria is now in ES 5.1) +** [enrich] Remove emails from all enriched indexes +** [tests] Add tests using csv mappings (disabled until the results of the tests are fixed) +** [tests] Add owlwatch model to test mappings +** [phabricator] Handle long description.raw value in raw items +** [setup] Add dependency on SortingHat +* Sigils (old panels) +* Manuscripts (old reports) +** [its] Use closed_at as FIELD_DATE for closed issues metrics +** [metrics][gerrit] Use as date field closed in merged and abandoned reviews +* Kidash +* GrimoireLab Toolkit +* King Arthur +** [docker] Build various docker images +* Bestiary +* Hatstall +* Ceres + + +## 18.04-03 + +Released: 2018-04-18 + +* SortingHat +* Perceval +** Mozilla +** OPNFV +** Puppet +* Mordred +* grimoirelab-elk +** [jenkins] Update raw mappings to deal with large comments +** [jira] Handle data.changelog.histories fields +** [tests] Update test load identites +** [elk] load identities by bulks to sortinghat +** [sortinghat_gelk] Handle possible exeception when adding identities +* Sigils (old panels) +* Manuscripts (old reports) +** [report] Show the perdiod names always as YY-Q[1-4] (16-Q4) +* Kidash +* GrimoireLab Toolkit +* King Arthur +* Bestiary +* Hatstall +** [mod_wsgi] Fix settings so Hatstall works inside Apache mod_wsgi +* Ceres + + +## 18.04-02 + +Released: 2018-04-14 + +* SortingHat + +* Perceval +** [phabricator] Handle project info in core:edge transactions +** Update copyright information +** [phabricator] Include project/user information in task transactions +** [jenkins] Control detail level of Jenkins data +** [gerrit] Rename parameter 'url' to 'hostname' +** Mozilla +*** [mozillaclub] Change log level message when missing event data +** OPNFV +** Puppet + +* Mordred +** [task] Include projects data when creating the enrich backend for studies +** [[task_report] Fix import from report.report to manuscripts.report +** [Improve documentation about "bulk_size" and "scroll_size" +** [[tests] Update archives after sanitizing archived data + +* grimoirelab-elk +** [enrich][jira] Check that main_description field is not None before trunctating it +** [doc] Add information about alias to studies doc +** [studies] Add alias management to onion study +** [studies] Add alias management for areas of code +** [studies] Add methods to manage aliases +** [enrich] Add meta fields only if the meta field is a dict +** [tests] Add test for load identities in sortinghat +** [schema] Add Gerrit CSV aggregatable and description fields +** [phabricator] Handle dots in JSON attribute names +** [nntp] Remove X-fields in raw data +** [mbox] Remove X-fields in raw data +** [tests] Include _fix_item method in tests +** [nntp] Use mbox mappings for NNTP items +** [enrich] Handle case sensitive attributes in mbox items +** [enrich][metadata] Add project metadata fields to the enriched items +** [schema] Update git schema +** [schema] Fix `grimoire_creation_date` description +** [schema] Update areas of code schema +** [enrich] Handle long text values in mozillaclub +** [enrich] Handle different formats for failures in functest +** [travis] Add perceval-puppet dependency +** [enrich] Handle revisions without comment in mediawiki +** [tests] Update tests data for Slack +** [tests] Update test data for Jira +** [doc][studies] Improve studies doc for executing them in mordred +** [doc] Add CSV for areas of code and update doc +** [enrich] Limit size of fields.description in Jira +** [raw] Handle long description in jira fields +** [setup] Add dependency with perceval-puppet +** [raw] Filter attachment-related data of slack messages + +* Sigils (old panels) +** [panels] Update git index pattern +** [askbot] Add accepted answer info + +* Manuscripts (old reports) +** [tests] Added tests for the function replace_text_dir in report.py +** [report] Remove dependency on GREP and SED +** Update requirements for sortinghat + +* Kidash + +* GrimoireLab Toolkit +** [introspect] Add function to find the properties in a class + +* King Arthur +** [scheduler] Rename 'max_retries_job' to 'max_retries' +** [jobs] Replace scheduler arguments by 'max_retries' + +* Bestiary + +* Hatstall +** [deployment] Config the Django settings for deployment in production +** [docker] Improve how gunicorn is started increasing the number of workers and the timeout +** [docker][travis] Fill the Django SECRET_KEY during deployment +** [docker] Add file based config sample for Hatstall +** [django] Remove SECRET_KEY to avoid its use in a production system +** [urls] Add urls to static contents so gunicorn can use them +** [docker] Use the CHAOSS URL to clone Hatstall +** [pip] Add all the files needed to create the django-hatstall pip package +** [hatstall app] Refactor all code to have a "hatstall" app that can be reused +** [docker] Leave alone hatstall in the docker-compose file +** [docker] Use the grimoirelab/hatstall docker image and remove link to mariadb + +* Ceres + + +## 18.04-01-a + +Released: 2018-04-10 + +* Mordred +** [task] Include projects data when creating the enrich backend for studies +** [task_report] Fix import from report.report to manuscripts.report +** Improve documentation about "bulk_size" and "scroll_size" +** [tests] Update archives after sanitizing archived data + + +## 18.04-01 + +Released: 2018-04-04 + +* SortingHat + +* Perceval +** Fix the error "Not a gzipped file (b'00')" +** [client] Sanitize url, payload and headers when archiving data +** [all backends Remove credentials when archiving data +** [jira] Avoid init HTTP session when fetching data from archive +** [tests] Fix fetch_from_archive test +** Mozilla +** OPNFV +** Puppet + +* Mordred +** [panels] Add hyperkitty panel (the same than mbox) +** [task_collection] Support that the name of a backend section could include a suffix +** [task_panels] Filter with data sources active only multi data source visualizations +** [tests] Add archive for testing remo + +* grimoirelab-elk +** [utils] Add PuppetForge support once perceval pip package is available +** [raw] Update mappings to filter body information in confluence items +** [enrich] Limit size of summary and main_description in bugzillarest +** [enrich] Limit size of value attribute summary in bugzilla +** [raw] Change discourse mapping for data.post_stream.posts.cooked +** [enrich] Fix mapping for attribute question_title in discourse +** [enrich] Handle missing accepted_answer_id attribute +** Added support for co-author +** Fix flake8 issues +** [schema] Update askbot.csv +** [studies] Add timeout to ES connections +** [tests] Remove old test data + +* Sigils (old panels) + +* Manuscripts (old reports) +** Remove recursive copying of report directory +** Add user defined logo option + +* Kidash + +* GrimoireLab Toolkit +** [tests] Increase test coverage +** [datetime] Handle wrong timezone offset + +* King Arthur +** Fix Travis CI badge +** Update required version of Perceval +** Rename GrimoireLab references to CHAOSS +** [jobs] Fix 'from_date' and 'offset' reset error + +* Bestiary + +* Hatstall +** [conf] Configure Hatstall using the setup file if exists first and then the web form + +* Ceres + + +## 18.03-05 + +Released: 2018-03-27 + +* SortingHat + +* Perceval +** Handle negative sleep time for rate limit reset: meetup, gitlab, github, client +** [git] Add --to-date to git backend to pull data upto a given time +** [github] Add pull request data +** [pipermail] Increase test coverage +** Mozilla +** [remo] Add params to fetch events from older to newer +** OPNFV +** Puppet + +* Mordred +** [task_panels] Don't use anymore the kibiter version from general config in mordred +** [config] Fix howto import the version from mordred +** [doc] Add first version of the mordred params documented generated automatically +** [config] Add description to all params and remove the params not used anymore +** [doc] Initial version of setup automatic doc generation +** Update import sections to follow grimoire-elk changes +** Fix flake8 errors +** [task_identities] Fix the call to get gender data (hotfix commit) + +* grimoirelab-elk (old GrimoireELK) +** [utils] Remove puppetforge support until there is a pip package and it is supported in grimoirelab_build script +** [elk] Fix mapping path for areas of code index +** [elk] Add onion study to GitHub +** [enriched] Handle wrong time offset in Git enrichment +** [p2o] Use directly the params definition from utils.py +** [enrich] Add doc for enrich_items method and remove not needed code +** [enrich][phabricator] Add enrich metadata to enriched items +** [puppetforge] Implement the enrich spec for PuppetForge +** [enrich] Add `answer_status` field to askbot +** [raw] Fix typos in ES 2.2 mappings for gerrit +** [enrich] Fix limit comment message in gerrit, git +** [enriched] Set not accepted answer flag to askbot unanswered question +** [all] Replace arthur with with elk in import sections +** [all] Replace elk with enriched in import sections +** [all] Replace ocean with raw in import sections +** [arthur] Rename the file name arthur.py to elk.py +** [ocean/elk] Change packages names: This code renames the packages ocean and elk to raw and enriched +** [ocean][hyperkitty] Create specific HyperKittyOcean class +** [utils] Support that the name of a connector could include a suffix +** [elk] Fix params parsing for arthur tasks +** Move CSVs schema definition from Sigils to GrimoireELK +** [Askbot] Add fields to askbot.csv to track accepted answers +** [doc] Add documentation for Areas of Code study +** [elk] Include mappings to discourse backend +** [ocean] Add ES 2.x mappings for askbot backend +** [elk] Create areas of code output index if needed +** [doc] Add documentation on Onion study +** [elk] Add onion study + +* Sigils (old panels) +* [csv] Remove CSVs moved to grimoirelab-elk + +* Manuscripts (old reports) + +* Kidash +** [kidash] Update elk import + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres +** [examples] Update elk import +** [events] Update elk import + + +## 18.03-04 + +Released: 2018-03-21 + +* SortingHat + +* Perceval +** [pipermail] Handle inaccessible archive URLs +** Mozilla +** OPNFV +** Puppet + +* Mordred +** [task_enrich] Replace bulk_upload_sync with bulk_upload +** [mordred] Remove param studies en enrich section which does not exists anymore + +* GrimoireELK +** [ocean] Fix mappings with jenkins to avoid regression errors +** [enrich][mbox] Return an empty SH identity if the identity provided is None + +* Sigils (old panels) + +* Manuscripts (old reports) +** Default name of manuscripts added +** Added -v argument to show version of manuscripts + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall +** Add paginated table in proifle page with 3 columns instead of 2 +** Add more info of uidentity when click on 'view' in profile page +** Change behaviour of the columns when open/close columns +** Add button in the card info of unique identity to merge it +** Fix table size joining columns + +* Ceres + +## 18.03-03 + +Released: 2018-03-20 + +* Mordred +** [mordred] Remove param studies en enrich section which does not exists anymore + + +## 18.03-02 + +Released: 2018-03-20 + +* SortingHat +** [cmd:autogender] Check well-formed names only and Retry and skip connection errors + +* Perceval +** [backend] Remove empty category from parsed arguments +** Mozilla +*** Add tests requirements pip file +*** Add support to run tests using setup.py file + +** OPNFV +*** Add tests requirements pip file +*** Add support to run tests using setup.py file +** Puppet +*** Add tests requirements pip file +*** Add support to run tests using setup.py file + +* Mordred +** [task_projects][eclipse] Add support for extracting the github repositories +** [clean] Remove legacy testing grimoire_elk symlink +** [task_identities] Add gender support +** [task_panels] Add as data source stackoverflow if stackexchange is included +** [tests] Fix tests including the gender fields in SH identities files + +* GrimoireELK +** [elk] Fix check condition ES version for rss, meetup, nntp +** [elk] Limit size of attributes for several data sources to avoid keyword max length issues +** [elk] Fix mappings ES 5.1.x for all backends +** [ocean] Prevent Slack attachment info to be indexed +** [ocean/elasttic] Replace bulk_upload_sync with bulk_upload +** [elastic] Delete bulk_upload_sync method +** [askbot] Refine information to track accepted answers +** [tests] Modify test data for askbot +** [elk] Enrich item to track accepted answers +** [ocean] Add mappings for Askbot ocean +** [enrich][bugzillarest] Change " " with "+" in product and component names to follow Mozilla projects mapping +** [elk] Add gender info from SortingHat +** [ocean][conf] Remove legacy conf index not used anymore +** [utils] Remove not used scripts o2s.py and ocean.py +** [utils] Remove symlink grimoire_elk to avoid hacks in modules import +** [utils] Remove not needed old symlink + +* Sigils (old panels) +** [Askbot] Add fields to askbot.csv to track accepted answers +** [schema] Update Meetup schema to deal with aggregatable fields in Kibana +** [panels] Fix Gerrit panel to use author name field +** Added schema for time_to_commit + +* Manuscripts (old reports) +** Select by user for custom indices for each data +** Create default indices if no custom index is provided +** Change the default name for the enriched git index from 'git_enrich' to 'git' + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary +** Add new features: edit and remove ecosystems and projects +** Add information messages to web UI related to important actions +** Change position of ecosystem-related buttons + +* Hatstall +** Add custom pagination in order to retrieve the data paginated +** Add search box that searchs directly to the sh database +** Fix last_modified field show in unique identities +** Add 'show' custom in order to get length of the table paginated +** Change button show entries for 'onchange' event in the select + +* Cereslib +** [events] Add Git author domain from email + + +## 18.03-01-a + +Released: 2018-03-14 + +* GrimoireELK +** [ocean] Add ES 2.x mappings for all ocean backends +** [git] Add a new time_to_commit field to enriched index + +## 18.03-01 + +Released: 2018-03-13 + +* SortingHat +** [model] Fix wrong __repr__ in Profile +** [api] Add search_unique_identities_slice() function +** [cmd:autogender] Fix typo in help output +** Release 0.6.0 +** Rename GrimoireLab references to CHAOSS +** [sortinghat] Add autogender command +** [api] Add function for searching profiles +** [tests] Fix non-deterministic tests +** Add --version command line option +** [tests] Fix so that tests pass when db not in localhost +** [init] Remove annoying error +** [setup] Update pandas +** [gitdm2sh] Set option to ignore invalid email addresses + +* Perceval +** [all backends] Set category when calling fetch and fetch_from_archive +** [meetup][gitlab] Ignore sleep for rate when reading from archive +** [tests] Modify backends tests when fetching from archive +** [tests] Add mock http answers to tests launchpad +** [gerrit] Add tests for gerrit backend +** [mediawiki] Sort request payload parameters for versions >= 1.27 +** [mediawiki][phabricator] Force sort request payload parameters +** [tests][askbot] Format html content file +** [all backends] Add default parameters when init the Client +** [slack] Move parameter latest to the archived args +** [all backends] Add valid categories +** [all backends] Align fetch signature to the backend generic one +** [all backends] Add archive support +** Update CI config to run tests using Python 3.5 and 3.6 +** Update coverage call to remove 'omit' parameter +** [askbot] Add data about accepted answers +** [mbox] Define 'tmp_path' variable before copying mboxes +** [backend] Ignore errors produced while fetching from archives +** [backend] Fix 'Namespace' object has no attribute 'fetch_archive' +** Rename GrimoireLab references to CHAOSS +** [backend] Remove metadata() decorator +** [cache] Remove cache mode +** [backends] Replace cache by archive mode +** Add tests requirements pip-file +** Fix tests to support their execution in two different modes +** Add support to run tests using setup.py file +** [gmane] Remove Gmane backend +** [jenkins] Update perceval sample in README +** [backend] Use the archive manager within BackendCommand +** [backend] Add shortcut functions to fetch items +** [backend] Add 'archived-since' to the argument parser +** [backend] Add 'category' to the general arguments parser +** [backend] Define archive arguments for the argument parser +** [archive] Add class to manage a set of archives +** [archive] Replace 'item_category' by 'category' +** [errors] Add class for raising archive manager exceptions +** [pipermail, bugzilla] Avoid warning by BeautifulSoup +** [perceval] Add GitLab backend +** [all backends] Apply archive to backend +** [client] Replace type() with isinstance() +** [backend] Change method signature of _test_fetch_from_archive +** [backend] Fix backend name in fetch method +** [backend] Add fetch, fetch_from_archive and fetch_items +** [nntp] Fix KeyError 'Date' in metadata_updated_on field +** [backend] Integrate archive with generic backend +** [client] Integrate archive with generic HTTP client +** [archive] Add Archive class +** [tests] Add tests for NotImplemented method errors in backend +** [http-client] Fix rate limit reset log message +** [git] Parse additional pattern for moved files +** [all backends] Modify variable name default_sleep_time +** [client] Modify variable name default_sleep_time + +** Perceval Mozilla +*** [tests] Modify tests when fetching from archive +*** Set category when calling fetch and fetch_from_archive +*** Add valid categories +*** Align fetch signature to the backend generic one +*** Update Perceval dependency version +*** Rename GrimoireLab references to CHAOSS +*** Apply archive to all backends +*** [crates] Fix None sleep_time when using CratesCmd +*** Import perceval modules using relative paths +*** [setup] Update minimum version of perceval required +*** [crates] Change HttpClient method call + +** Perceval OPNFV +*** [functest] Set category when calling fetch and fetch_from_archive +*** [tests] Modify functest tests when fetching from archive +*** [functest] Add valid categories +*** [functest] Align fetch signature to the backend generic one +*** Update Perceval dependency version +*** Rename GrimoireLab references to CHAOSS +*** [FuncTest] Apply archive to FuncTest backend + +** Perceval Puppet +*** [puppetforge] Set category when calling fetch and fetch_from_archive +*** [tests] Modify puppetforge tests when fetching from archive +*** [puppetforge] Add valid categories +*** [puppetforge] Align fetch signature to the backend generic one +*** Update Perceval dependency version +*** Rename GrimoireLab references to CHAOSS +*** [puppetforge] Apply archive to PuppetForge backend + +* Mordred +** [tests] Add tests for the studies configuration per backend +** [task_enrich] Configure and execute studies per backend after enrichment +** [config] Remove 'studies' param from enrich section +** [tests] Add archive for all backends +** [tests] Add tests to fetch data from archives +** [mordred] Updates to use the new location for elastic module in grimoire_elk +** [task_panels] Fix support for Kibana 6 when uploading menus +** [tasks] Make use of grimoire-elk connections +** [task_enrich] Use new param pair_programming to activate this enrich feature + +* GrimoireELK +** [studies] Add support for git_author_domain field +** [setup] Fixed conflict with urllib3 version +** [elk] Fix access to mappings directory +** [utils] Use the 1st interpreter on $PATH +** [tests] Break done tests for all backends +** [elk] Fix enrich_items method +** Update elastic import to the new module path in grimoire_elk.elastic +** [elastic] Refactor elastic class +** [travis] Update travis to add new dependencies +** [elk] Add areas of code study +** [elk] Add basic structure for cereslib studies +** [elk] Refactor sortinghat module name +** [enrich][git] Fix incremental demography update for already existing authors +** [archive] Allow handling perceval archive +** [ocean] Fix mappings to index data in several data sources +** [tests] Refactor tests for backends/connectors +** [remo] Rename filenames of ocean and elk remo connectors +** [ocean] Remove ES 2.x mappings to index git data +** [ocean] Modify Pipermail input data for test +** [ocean] Add Launchpad backend +** [ocean] Add PuppetForge backend +** [ocean] Add GitLab backend +** [tests] Update tests data +** [elk] Update enrich_items method of several data sources for new tests +** [elk] Handle NNTP uppercase Date field +** [ocean] Add warning when json items are not inserted to ES +** [enrich] Track storage exceptions when uploading enriched data to ES +** [travis] Add delay to make ES start + +* Sigils (old Panels) +** Update documentation on process related panels + +* Manuscripts (old reports) +** added Content-Type information in function: get_metrics_data + +* Kidash +** [kidash] Update elastic import from grimoire_elk +** [import] Don't modify the height of visualizatons in dashboards from Kibana >= 6 + +* GrimoireLab Toolkit +** Add support to run tests using setup.py file +** Update coverage call to remove 'omit' parameter +** Rename GrimoireLab references to CHAOSS +** Update CI config to run tests using Python 3.5 and 3.6 + +* King Arthur (old Arthur): +** Add support to run tests using setup.py file +** Fix tests to support their execution in two different modes +** Modify tests requirements pip-file and Travis config. file +** Update documentation with a section for the arthurd config. file +** [worker] Add documentation to perform_job method +** [arthurd] Replace cache support with archive support +** [server] Enable server to handle archives +** [jobs] Enable jobs to handle archives +** [tasks] Enable tasks to deal with archive +** [scheduler] Enable scheduler to deal with archive tasks +** [arthur] Enable Arthur to fetch data from archives + +## elasticgirl.30.4 + +Released: 2018-02-12 + +* GrimoireELK +** [enrich][crates] Return always a correct SH identity + + +## elasticgirl.30.3 + +Released: 2018-02-11 + +* GrimoireELK +** [enrich][git] Add a new param pair_programming to activate this enrich feature +* Mordred +** [task_enrich] Use new param pair_programming to activate this enrich feature + + +## elasticgirl.30.2 + +Released: 2018-02-08 + +* GrimoireELK +** [enrich][jira] Include release field in enriched index +** [enrich][git] Add git_uuid field which is unique id in pair programming + + +## elasticgirl.30.1 + +Released: 2018-02-01 + +* GrimoireELK +** [enrich][git][demography] Fix the demography study logic so it works in incremental mode always +** [enrich][slack] Don't convert boolean fields to int in SortingHat fields +** [elastic] Track exceptions when uploading data to ES +** [enrich][git] Add a new field git_author_domain with the email domain for the Author of the commit + +* Kidash +** [import] Don't modify the height of visualizatons in dashboards from Kibana >= 6 + +## elasticgirl.30 + +Released: 2018-01-31 + +* SortingHat +** [load] Avoid some messages when not in verbose mode +** [init] Add option for reusing database + +* Perceval: frozen in 0.9.10 until Archive cache refactoring is complete +** Mozilla: frozen in 0.1.5 to be compatible with perceval 0.9.10 +** OPNFV +** Puppet + +* Mordred +** [panels] Kibiter now supports that the title for the dashboard is in a JSON inside .kibiter index. New method for uploading it. +** setup and configure RotatingFileHandler for file logging +** [mordred] Check if Bestiary projects can be read before executing mordred +** [task_panels] Add params with kibana url and version to create the .kibana +** [mordred] Retry connection with Elasticsearch and Kibiter to wait for their starting time +** [task_identities] Execute unify just after the load of identities in the same task +** [task_panels] Add mbox as data source to be shown if pipermail exists +** [autorefresh] Refactor autorefresh code thanks to the last_update field in Sortinghat +** [task_panels] Force the creation of .kibana index in Kibiter6 +** [docker] Don't download the menu.yaml file if it has not changed from our local copy + +* GrimoireELK +** [enrich][phabricator] Fix enricher when an item has an array with None as first item of projects +** [enrich] Add missing headers in PUT queries to support ES6 +** [ocean][pipermail] Define the url and dirpath params needed by arthur when using pipermail +** [elastic_items] Remove log error when there are no items or the items index does not exists yet +** [utils] Retry by default total times = connect error times +** [ocean/confluence] Filter out body.storage.value from index +** [enriched] Ensure that we have a method for refreshing whole indexes + +* Panels +** [overview] Include for studies vis a "_studies_" in the id and title + +* Manuscripts (old reports) + +* Kidash +** [kidash] Remove by default from dashboards the study related visualizations +** [visualization] Include the style needed in Kibiana6 to show metrics vis correctly +** [dashboard] Fix the bool filters for the dashboard +** [layout] Increase 1 height the panels of height 1 for kibana6 + +* GrimoireLab Toolkit +** [introspect] Ignore * and ** parameters in method signatures + +* Arthur + + +## elasticgirl.29.4 + +Released: 2018-01-29 + +* GrimoireELK +** [utils] Retry by default total times = connect error times + +* Mordred +** [arthur] Catch exception when the arthur items dict changes during its measure + + +## elasticgirl.29.3 + +Released: 2018-01-29 + +* Mordred +** [task_panels] Add mbox as data source to be shown if pipermail exists +** [task_identities] Execute unify just after the load of identities in the same task +** [mordred] Retry connection with Elasticsearch and Kibiter to wait for their starting time + +* Kidash +** [layout] Increase 1 height the panels of height 1 for kibana6 +** [dashboard] Fix the bool filters for the dashboard +** [visualization] Include the style needed in Kibiana6 to show metrics vis correctly + + +## elasticgirl.29.2 + +Released: 2018-01-25 + +* Mordred +** [autorefresh] Refactor autorefresh code thanks to the last_update field in Sortinghat + +* GrimoireELK +** [elastic_items] Remove log error when there are no items or the items index does not exists yet + + +## elasticgirl.29.1 + +Released: 2018-01-24 + +* Mordred +** [task_panels] Force the creation of .kibana index in Kibiter6 + +* GrimoireELK +** [ocean][pipermail] Define the url and dirpath params needed by arthur when using pipermail +** [enrich] Add missing headers in PUT queries to support ES6 + + +## elasticgirl.29.0 + +Released: 2018-01-23 + +* SortingHat +** [model][tests] Define an order for domains and adapt tests to MariaDB +** [tests] Change configuration to a config file + +* Perceval: frozen in 0.9.10 until Archive transition from cache is complete +** Mozilla: frozen in 0.1.5 to be compatible with perceval 0.9.10 +** OPNFV +*** [functest] Apply generic HTTP client to FuncTest +** Puppet +*** [puppetforge] Apply generic HTTP client to PuppetForge + +* Mordred +** [task_panlels] Support for Kibiter/Kibana 6.x +** [task_projects] Add a new param projects_url to download the projects data from a URL +** [task_identities] Use the last datetime for autorefresh to find the changes in SortingHat +** [task_identities] Don't load identities if autorefresh is pending +** [docker] Update docker mordred image to use a install based on pip packages +** [unified_releases] Remove 'unified_releases' directory which is now in GrimoireLab +** [task] Fix composition perceval params + +* GrimoireELK +** [ocean][confluence] Avoid creating the mapping of data.extensions.position which mutates +** [git] Add Elasticsearch 6.x support for study in git +** [kidash] Remove kidash (moved to a new repo as chaoss/grimoirelab-kidash) +** [elasticsearch] Support Elasticsearch 6 + +* Panels + +* Manuscripts (old reports) +** [setup] Modifications due to change in name (manuscripts) + +* Kidash +** [kidash] Unbundle kidash completely from GrimoireELK +** [kidash] Fix error getting the title of an index pattern +** [setup] Change to the new chaoss organization in GitHub + +* GrimoireLab Toolkit +** [datetime] Add timezone data to datetime_utcnow() + +* Arthur +** [tests] Add tests for add, remove, tasks paths of arthur server + + +## elasticgirl.28.3 + +Released: 2018-01-21 + +* GrimoireELK +** [kidash] Remove kidash (moved to a new repo as chaoss/grimoirelab-kidash) +** [elasticsearch] Support Elasticsearch 6 + + +## elasticgirl.28.2 + +Released: 2018-01-18 + +* Mordred +** [task] Fix composition perceval params +** [docker] Update docker mordred image to use a install based on pip packages +** [task_identities] Don't load identities if autorefresh is pending +** [task_identities] Use the new API SH call search_last_modified_identities to refresh identities +** [task_projects] Add a new param projects_url to download the projects data from a URL + + +## elasticgirl.28.1 + +Released: 2018-01-09 + +* Mordred +** [docker] Add symlink to kidash so mordred finds it + + +## elasticgirl.28 + +Released: 2018-01-09 + +* SortingHat + +* Perceval +** [git] Send in fetch-pack local heads refs only +** [meetup] Handle processing deleted groups +** [git] Fix cloned directory of local repository +** Mozilla +*** Apply generic HTTP client to all backends +** OPNFV: no changes +** Puppet: no changes + +* Mordred +** [panels] Use the new kidash module, instead of grimoire-kidash +** [task_collection][arthur] Limit the total number of items collected from redis +** [task_collection][arthur] Set to 200MB the max memory for the arthur python dict +** [task_collection][arthur] Limit the max size of the python memory with raw items from redis +** [tasks_panels] Add support for data sources when uploading panels +** [docker] Use the new grimoirelab github repository location to download the releases + +* GrimoireELK +** [kidash] Unbundle kidash completely +** [Jira] Extract timing for a sprint +** [Jira] Move enrichement of fields property to a classmethod +** [setup] Add kingarthur as a dependency + +* Panels + +* Reports + +* GrimoireLab Toolkit + +* Arthur +** Add support for configuration file +** [writers] Update writer to support ElasticSearch >= 5.x +** Update requirements + + +## elasticgirl.27.1 + +Released: 2017-12-28 +Warning: Change in SortingHat database. You need to either create +a new database from scratch, or convert your old SortingHat database. +See details in the main README.md in the SortingHat git repository +(section "Compatibility between versions)"). + +* SortingHat +** Release 0.5.0 +** [api] Add function to search last modified identities +** [api] Update 'last_modified' attribute when needed +** [model] Add 'last_modified' attribute to unique identities and identities +** [grimoirelab2sh] Add '--no-email-validation' option +** parsing:grimoirelab] Set option to ignore invalid email addresses + + +## elasticgirl.27 + +Released: 2017-12-28 +Warning: skip_initial_load no longer supported in Mordred. + +* SortingHat (stalled to pre 0.5.0 due to change in db schema) + +* Perceval +** [meetup] Remove 'draft' status due to a bug in Meetup API +** [git] Request in fetch-pack the outdated refs only +** [git] Fix error discovering refs in repos which don't have any +** [git] Ignore error codes when executing a command +** Mozilla: no changes +** OPNFV: no changes +** Puppet: no changes + +* Mordred +** [task_collection] Configure bulk and scroll size in arthur collection +** [tasks_project] Load projects in the initial tasks in mordred +** [task_collection] Create task in arthur only the first time +** [task_identities] Add support for '--no-email-validation' option in grimoirelab2sh + +* GrimoireELK +** [ocean][git] Map data.message to string so it is not a keyword because it is large field (>32K) in some cases +** [panels] Change the API so dashboards can be listed, imported and exported with a JSON in memory +** [enrich][meetup] Fix to support empty events during comments extraction +** [enrich][jira] Check that labels are defined in issue['fields'] before using it + +* Panels +** [Panels] Fix Twitter username field in tables +** [Panels] Add projects and orgs support for Meetup + +* Reports + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.26.2 + +Released: 2017-12-22 + +* GrimoireELK +** [enrich][meetup] Fix to support empty events during comments extraction + + +## elasticgirl.26.1 + +Released: 2017-12-21 + +* SortingHat +** [grimoirelab2sh] Add '--no-email-validation' option + +* Mordred +** [task_identities] Add support for '--no-email-validation' option in grimoirelab2sh + + +## elasticgirl.26 + +Released: 2017-12-20 + +* SortingHat + +* Perceval +** Mozilla: no changes +** OPNFV: no changes +** Puppet: no changes + +* Mordred +** [docker] Add link to arthur library so it can be used in mordred +** [task_identities] Don't load identities if autorefresh is pending +** [docker] arthur is not used with Elasticsearch anymore +** [task_collection][arthur] Compute the memory usage in intervals + +* GrimoireELK +** [mappings] If a mapping can not be created just log the issue +** [autorefresh] Group the number of identities to be refreshed +** [utils] Support enrich all items for all groups in a raw meetup index +** [enrich][meetup] Fix to support empty events during ersvp extraction + +* Panels +** [Panels] Add projects to IRC panel +** [Panels] Remove old unused panel directories +** [Panels] Add project support to Twitter panel + +* Reports + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.25.1 + +Released: 2017-12-19 + +* Mordred +** [mordred] Fix symbolic links to grimoire_elk and report changed by error + +## elasticgirl.25 + +Released: 2017-12-18 + +* SortingHat +** [db] Fix tables created with invalid collation +** [model] Coerce boolean type +** [travis] Update before_install package versions +** [setup] Upgrade dependencies +** [cmd:export] Remove trailing whitespaces in JSON files + +* Perceval +** [backend] Fix 'find_backends' to get all backend descendants +** [launchpad] Handle 404 HTTP error +** Update generic http-client parameters for phabricator, meetup, jenkins, github +** [client] Fix init headers and status codes +** [docker] Add build-essential/gcc for dulwich +** [meetup] Adapt tests to assess the sleep for rate +** [github] Adapt tests to assess the sleep for rate +** [client] Add function to calculate the time to reset for tokens +** Apply generic HTTP client to all backends +** [http-client] Add parameter "verify" to fetch method +** Mozilla: no changes +** OPNFV: no changes +** Puppet: no changes + +* Mordred +** Add Arthur support to mordred +** [mordred] Simplify how mordred is started +** [doc] Basic description of mordred +** [tests] Remove load_orgs testing because it fails in Travis +** [requirements] Reuse the deps in setup.py in requirements.txt +** [travis] Add travis support and execute all testing for PRs +** Fix all PEP-8 issues + +* GrimoireELK +** Arr arthur support +** [ocean] Simplify feed logic when getting the items from perceval cache or arthur redis +** Add travis support with test execution. Improvements in the tests. +** Fix PEP-8 issues +** [gelk] Remove ocean-unique-id unique identifier and use always the uuid from perceval. +** [enrich][sortinghat] Add identity domain using the profile information +** [enrich][phabricator] Check in p is defined before using it +** [enrich][meetup] Don't create comments and rsvps events for empty meetup items +** [kidash] Export the index patterns in searches +** [enrich][bugzillarest] Add comments field with the number of comments + +* Panels +** [tests] Remove from test checking the ocean-unique-id field +** Add Crates CSV schema definition +** Bugzilla panels updated for bugzillarest compatibility + +* Reports +** [metrics][issue] Remove Closers metric and Fix BMI implementation +** [github_issues] Removed Closers metric which is not implemented +** [tests] Fix pep8 issues in the tests +** [travis] Install deps using the requirements.txt file in Travis +** [tests] Activate the execution of the tests during CI +** [tests] Initial version of the tests +** Modify code to be PEP8 compliant +** [travis] Add initial travis file + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.24 + +Released: 2017-11-30 + +* SortingHat +** [parsing:grimoirelab] Remove `Unknown` enrollments while parsing + +* Perceval +** [client] Add generic HTTP client +** [jenkins] Fix HTTP error handling +** [gerrit] Fix no route to host error +** [github] Init rate limit info (requests left and reset time) + +* Mordred + +* GrimoireELK +** [travis] First version for CI with Travis, including pep8 and integration tests +** Fixed all PEP-8 issues +** [p2o] Remove code not needed detected during pep8 cleaning +** [tests][crates] Add testing for crates data source +** [enrich][functest] Implement get_field_author and return None +** [enrich][twitter] Check that twitter is in projects map before using it +** [enrich][bugzillarest] Change fields to use the same names than in bugzilla +** [enrich][bugzilla] Remove project_name field to avoid confussions with dashboard projects +** [ocean][phabricator] Fix to float the subpriority field +** [enrich] Check if an identity exists before trying to get her profile +** [index_mapping] Support sort-after scrolling. Use sync uploading of bulk data +** [index_mapping] Add an option so the elasticsearch for read and write could be different +** [elastic] Log the items already uploaded with the bulk API +** [elastic] Fix how the number of duplicates/lost items is tracked in bulk operations +** [elastic] Pack the items in bulk sync before uploading +** [elastic] Raise exception if there is a problem putting the data in Elasticsearch +** [ocean][crates] Remove all params to be passed to the perceval backend +** [enrich][crates] Remove project support from crates (not needed) + +* Panels + +* Reports + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.23.2 + +Released: 2017-11-28 + +* SortingHat + +* Perceval + +* Perceval-OPNFV + +* Perceval-Mozilla + +* Mordred + +* GrimoireELK +** Updated version which fixes: Enrich bugzilla rest 4611 #136 + +* Panels + +* Reports + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.23.1 + +Released: 2017-11-26 + +* SortingHat + +* Perceval + +* Perceval-OPNFV + +* Perceval-Mozilla +** Updated version + +* Mordred + +* GrimoireELK + +* Panels + +* Reports + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.23 + +Released: 2017-11-23 + +* SortingHat +** Add no-strict-matching option +** [setup] Add code for setup.py test to work + +* Perceval +** [git] Fix invalid URL when TCPGitClient is initialized + +* Mordred +** [task_identities] Add reset_on_load param to activate the reset of identities on load +** [task_identities] Add new option strict-mapping to sortinghat config +** [threads] Get the two thread locks needed for enrich and identities in the same order + +* GrimoireELK +** [enrich][meetup] Support that `time` field does not exists in meetup raw item +** [docker] Add docker compose for Elastic 6 version using Bitergia images +** [elastic] Create new method global_mapping to get the mapping added always +** [index_mapping] Remove debug code line which makes mappings to be always None +** [panels] Fix library to work with Elasticsearch6 +** [panels] Add support for listing/importing/exporting panels in ES6 +** [kidash] Add option to clean all items not included in data sources provided + +* Panels +** Add initial version of contribution guidelines +** [owlwatch] Fix path of test data files +** [owlwatch] Add init to test dir to fix test runner +** [owlwatch] Add CSV support +** [owlwatch] Add documentation for CSV comparisons + +* Reports +** [jira] Add jira data source to reports +** [stackexchange] Add new data source stackexchange to reports + +* GrimoireLab Toolkit +** [datetime] Fix to handle dates with invalid time offset + +* Arthur + + +## elasticgirl.22 + +Released: 2017-11-14 + +* SortingHat + +* Perceval +** [git] Change 'mirror' to 'bare' repositories +** [git] Limit the number of 'have' commits sent by fetch-pack +** [git] Fix error fetching latest items from empty repositories + +* Mordred +** [docker] Use the new URL for downloading releases specification + +* GrimoireELK +** [utils] Add index_mapping.py script +** [enrich] Fix log message about the size in MB of the bulk packet sent to ES + +* Panels +** Fix header row in CSV files +** [setup] Add panels/__init__.py +** Several improvements in testing + +* Reports + +* GrimoireLab Toolkit + +* Arthur +** [setup] Set cheerypy version to cherrypy>=8.1 <=11.0.0 +** [setup] Improve generation of package and running tests + +## elasticgirl.21 + +Released: 2017-11-13 + +* SortingHat + +* Perceval +** [meetup] Fix too many requests error +** [jenkins] Fix connection timed out exception +** [git] Fix fetch-pack for HTTPs connections +** [git] Work with bared repositories only +** [crates.io] Add crates backend + +* Mordred +** [task_identities] Fix downloading of identities file from GitHub +** [task_enrich] Wait 5 seconds before executing the studies (demography fix) +** [panels] Fix all panels issues +** [exceptions] Print RuntimeError in an appropriate way +** [menu] Add Functest panel to menu.yaml + +* GrimoireELK +** [enrich] Use _version.py to get GELK version +** Add badges for pypi packages +** [enrich][jira] Support that reporter does not exists in jira raw data +** [kidash] Add support for using panels in the panels module +** [jira] Add story points to enriched index, when they are available +** [setup] Improve setup.py + +* Panels +** [pkg] Add files for first Python package + +* Reports + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.20 + +Released: 2017-11-02 + +* SortingHat + +* Perceval + +* Mordred +** [task_identities] Don't use the orgs file when converting from yaml identities to JSON identities +** [mordred] Clean the threads shared queues once the execution is finished + +* GrimoireELK +** [enrich] Refactor (simplify and improve) the logic to get the SH fields from an identity + +* Panels + +* Reports +** [report] Use command line param title if provided instead of mordred short name + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.19.1 + +Released: 2017-10-26 + +* SortingHat + +* Perceval + +* Mordred + +* GrimoireELK + +* Panels + +* Reports +** Updated version + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.19 + +Released: 2017-10-26 + +* SortingHat +** [matching] Substitute sort for sort_values (pandas in unify) +** [cmd:unify] Change unicode to str + +* Perceval +** [tests] General reorganization +** [askbot] Handle TooManyRedirects error when question title is empty +** [github] Enable fetch reactions without token + +* Mordred +** [task_identities] Include for identities refresh also uuid in which other uuids are merged. +** [task_manager] Add sync logic between threads so the load of identities and the merge of identities tasks are not done during enrichment tasks execution. +** [task_identities] Add support for loading identities in GrimoireLab yaml format from files stored in GitLab and locally. +** [task_identities] Add support for not executing unify and affiliate. +** [task_manager] Execute the tasks and then wait for the interval. + +* GrimoireELK +** [enrich] Get Kibiter version during enrichment process. + +* Panels +** Migrate Reps Events panel to Kibana 5 +** Migrate reps activities panel to Kibana 5 +** Use shaded circle markers in maps +** Migrate Reps Events panel to Kibana 5 +** Migrate Functest panels to Kibana 5 +** Migrate Apache panel to Kibana 5 +** Migrate Functest panels to Kibana 5 +** Migrate MozillaClub panel to Kibana5 +** Migrate Google Hits panel to Kibana 5 +** Migrate Jira Effort Panel to Kibana 5 + +* Reports + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.18.1 + +Released: 2017-10-20 + +* SortingHat + +* Perceval +** Updated version + +* Mordred +** First pip package: updated version + +* GrimoireELK +** Updated version + +* Panels + +* Reports +** First pip package: updated version + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.18 + +Released: 2017-10-20 + +* SortingHat + +* Perceval +** [github] Fix abuse rate limit error (#173) +** [phabricator] Fix restricted access to projects data +** [mbox] Fix UnicodeDecodeError when parsing email addresses (#176) +** [launchpad] Add instructions to README.md and bin/perceval +** [launchpad] Add Launchpad backend + +* Mordred +** Add identification for threads +** [task_panels] Fix mapping problem with ElasticSearch/Kibana 5.6 +** [task_identities] Set TaskInitSortingHat as a global task not related to a data source +** [task_panel][aliases] Add functest aliases +** [tasks] Readd support to execute one time all tasks and exit. +** [task_panels] Add missing aliases: apache, google-hits, remo-events +** Adapt to produce a pipy package (remove VIzGrimoireUtils dependency) + +* GrimoireELK +** [enrich][functest] Fixes all issues and delivered to the customer +** [enrich] Several fixes in different backends to sync with panels + +* Panels +** [owlwatch] Added tool for testing enriched indexes and panels definitions. + Used now in grimoirelab release cycle. +** Migrate Redmine panels to Kibana5 +** Migrate GitHub Backlog to Kibana 5 +** Migrate mediawiki panel to Kibana5 + +* Reports +** Add support for building pip packages. +** Add LaTeX templates to the package. + +* VIzGrimoireUtils +** Not used any more + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.17 + +Released: 2017-10-06 + +* SortingHat +** Install misc scripts like grimoire2sh +** [cmd:load] Add option to clear ids relationships and enrollments +** [cmd:load] Update profile information when loading identities +** [parsing:grimoirelab] Fix style errors in the parser + +* Perceval +** [github] Reduce requests to collect reactions on issues and comments and fix formatting issues +** [git] Redefine default storing repositories path + +* Mordred + +* GrimoireELK +** [docker][kibana] Add docker compose file for Kibana 5.6.0 with X-Pack disabled +** [docker] Don't use a specific elastic config file by default. Use the one + included in the docker image (Elasticsearch). Fix permissions sample file. +** [enrich] Add support for enriching all items from a github raw index with different repositories. +** [requests] Increase the connection retry time from 10 min to 2.5d in HTTP connections +** [enrich][discourse] Fix discourse case in which there is no categories tree +** [enrich][slack] Support that message['attachments'] could be None + +* Panels T3411 +** Add CSV files as the data model schema +** Migrate Discourse to Kibana 5 + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.16 + +Released: 2017-09-25 + +* SortingHat + +* Perceval +** [github] Fix GitHub Enterprise support +** [git] Run Git commands setting HOME environment variable +** [github] Include reaction information for issues +** [github] Fetch multiple assignees from issues +** [github] Fetch GitHub issue comments +** [discourse] Do not process topics without posts in them + +* Mordred +** Add support for DockerHub (#29) + +* GrimoireELK +** [enrich][github] Support that the user data dict is empty +** [utils] Support https insecure when getting the kibiter version +** [enrich][confluence] Use the space field for project grouping in wiki pages +** [enrich][discourse] Support that a discourse site does not use subcategories +** [enrich][phabricator] Check that item['fields']['ownerData'] is not None before using it +** [enrich][functest] Check that func_test['details'] is not None before using it +** [ocean] Add support in perceval fetch call to the param latest_items +** [enrich][studies] Fix how the date is computed for the last execution of a study. Implemented for the demography study +** [enrich][mediawiki] Add to url field "view" between wiki origin and the page title + +* Panels +** Add Kafka Improvement Proposals panel + +* Reports +** [offset] Include the offset in the start and end dates. +** [projects] Add a new flag --projects to generate the projects data or not. +** [offset] Fix quarter report name when using the offset param. +** [LaTeX] Add report date frame to the summary + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.15 + +Released: 2017-08-08 + +* SortingHat + +* Perceval +** [slack] Fix precision problems in 'oldest' parameter +** Add badge for pypi version + +* Mordred +** [task_collection] Print the full stack trace when there is an exception collecting the data +** [task_projects] Add discourse to the data sources that are always downloaded globally +** [menu] Add Maniphest panels to menu +** [menu] Fix name of Bugzilla panels +** Change schedule to upload panels + menu in the initial phase +** Fix wrong URL when trying to set up defaul time frame and index pattern +** Update menu according to latest 5.1.1 GrimoireLab panels + +* GrimoireELK +** Fix string to integer concatenation error. +** [enrich][discourse] Support that some categories ids don't appear in categories names list +** [enrich][discourse] The category_id must be a string in the projects mapping +** [mbox][kip] Return None if the subject is None when trying to extract the KIP from the subject +** [enrich][confluence] Add confluence space field to the enriched index +** [enrich][askbot] Support that the author_askbot_user_name does not exist. + +* Panels +** Migrate affiliations panel to Kibana 5 +** Add Overview, Data Status and Last Month Contributors panels +** Add GitHub Backlog panel +** Add About panel with some help about the general use of Kibana +** Update About section +** Remove "highlightAll":true string to downgrade panels to 5.1.1 +** Add maniphest panels for 5.1.1 +** Add Mediawiki panel for 5.1.1 + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.14 + +Released: 2017-08-04 + +* SortingHat + +* Perceval + +* Mordred +** Use branch master and the json directory for panels loading. Fix panels names. +** [identities] Create the SortingHat database in mordred initial step + +* GrimoireELK +** Support projects in all data sources +** Fix mappings for stackexchange and twitter for ES5 aggregatable strings fields +** Fix tests adding dockerhub and functest data sources +** [enrich][phabricator] Use directly the list of tags instead of a comma separated string with the tags. + +* Panels +** Migrate discourse, twitter, confluence, RSS, stackooverflow, git, Jenkins, gerrit, bugzilla, mailing list, jira, aaskbot, dockerhub, irc, slack, meetup, github panels to Kibana 5 + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit +** Avoid problems for building the package when no pandoc is installed. + +* Arthur + +## elasticgirl.13 + +Released: 2017-07-20 + +* SortingHat: Updated to the last version. **Don't use it without upgrading the SH database following the procedure below** + +mysqldump --no-create-info db > db.sql +mysqladmin drop db +sortinghat init db +mysql db < db.sql + +** Release 0.4.0 +** [cmd:unify] Print which unique identities were merged +** [api] Add source filter to search_unique_identities() + +* Perceval +** Release 0.9.0 + +* Mordred +** Improve in mordred and enrichment logs about autorefresh +** [docker] Use in default mordred docker image the stage that starts arthur env + +* GrimoireELK +** [enrich][askbot] Fix identities extraction for "bot" like answered_by. +** [ocean][functest] Avoid mapping the field details which changes now between a dict, a list and a string. +** [enrich][mbox] Update the eclipse archives location so the project of a mailing lists can be found in projects.json +** [enrich][git] Use grimoire_creation_date as the date field for git. +** [enrich][meetup] Catch eitem['time_date'] exception when the timedate in the item is wrong. +** Add files needed for building clean pip packages. +** Move kidash to a new directory. +** [enrich][meetup] Catch eitem['time_date'] exception when the timedate in the item is wrong. +** [dashboards] Add KIP draft panel (Kafka Improvement Process) +** [gelk] Get Kibiter version and share it as a global variable of grimoire_elk.utils. +** [enrich][supybot] Add grimoire_creation_date and is_supybot_message standard fields +** [gelk] Remove urljoin to combine the base URL with the kibana config path because it removes the /data path. +** [enrich][askbot] Add author_url field to questions, answers and comments. +** [enrich][askbot][meetup] Copy list of items directly to enriched index. Kibana supports aggregating them directly. +** [enrich][slack] Use fielddata=True for text_analyzed in Kibiter 5. Fix also the enrichment of user_data when it does not include some fields +** [enrich][dockerhub] Implement the enrichment process according to panels team specification. +** [enrich][dockerhub] Enrich events and also create a image enriched item with the data from the last event. +** Avoid adding '//' to URL to be used with Elasticsearch API REST because the API REST petition will fail if '//' are in the URL path. + +* Panels + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +* Arthur: First time arthur is included + +## elasticgirl.12 + +Released: 2017-07-13 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** [slack] Fix error processing comment messages +** [OPNFV] [functest] Fix 'pagination' key not found error + +* Mordred +** Upload Sortinghat identities to a GitHub repository +** [task_track] Get upstream files contribs from all git repositories for OPNFV following the pattern: https://git.opnfv.org//plain/UPSTREAM +** [mordred] Remove the general load of identities used during the initial step. + +* GrimoireELK +** [track_items] Check that upstream contributors file exists. + +* Panels +** Added Confluence panel + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +## elasticgirl.11 + +Released: 2017-07-06 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** New git backend which syncs a repository using low-level commands + +* Mordred +** [docker] Add certificate for some mailing lists +** [autorefresh] Autorefresh will be done after enrichment if there are new data in Sorting Hat identities database. +** [task_panels] Move aliases logic to a new task TaskPanelsAliases so it can be called isolated from the loading of panels. +** [mordred] Use the new task TaskPanelsAliases to create the aliases during enrichment so the aliases are created once the enriched indexes are available. +** [task_identites] Extract Sortinghat unique identities modified in unify and affiliate commands. +** [identities] Add support for getting the uuids that have changed during Sortinghat unify and affiliate and refreshing them during next enrichment execution for all data sources. + +* GrimoireELK +** [enrich][functest] Add support for enriching FuncTest data source coming from OPNFV +** Change TZ so that it comes from author_date +** [enrich][sortinghat] Suppport the autorefresh of identities using a list of ids or uuids in an enriched index +** [enrich] Use always metadata__timestamp for detecting thew new items that must be enriched in incremental mode. Also do it for demography study. +** [panels] Add new method exists_dashboard to check if a dashboard already exists. +** [enrich][meetup] Use time_date as the grimoire_creation_date +** Merge branch 'master' into kafka-kip +** [enrich][mbox] Extract only the needed lines from the boyd of the message to avoid having huge body messages in the enriched index. +** [enrich][slack] Support that from_['real_name'] does no always exists +** [enrich][confluence] Add grimoire_creation_date +** [ocean] Avoid getting the mapping for some raw fields with problems in askbot, bugzilla, bugzillarest, jira and redmine + +* Panels + +* Reports +** [report] Improve log messages + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + + +## elasticgirl.10 + +Released: 2017-06-09 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** [perceval] Add Docker Hub backend + +* Mordred +** [doc] Update the mordred docker sample doc with last features and config params added to mordred. +** [task_identities] Don't try to load empty identities files +** [task_panels] Add support for defining the time frame and default index in an empty Kibiter. + +* GrimoireELK +** [enrich][git][demography] Fill author_min_date also if its value is None no matter it exists +** [enrich][github] Use grimoire_creation_date for getting the affiliation of authors + +* Panels +** Fixed issue with bold texts + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + + + +## elasticgirl.9 + +Released: 2017-05-24 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** Release 0.8.0 +** Remove deprecated functions from utils module. This functions are now part of GrimoireLab toolkit package. +** [backends] Use GrimoireLab toolkit. Datetime handling and introspection has been delegate to GrimoireLab toolkit. + +* Mordred +** [task_identities] Support filter raw in TaskIdentitiesCollection when we have one repository. + +* GrimoireELK +** [enrich][discourse] Add categories support to the enriched posts +** [errors][network] Retry in networking errors for connections and reads using the requests.packages.urllib3.util.retry.Retry +** [enrich][slack] Don't try to find the email in the user profile when it is not available. +** [enrich][stackexchange] Use arrays for tags in enriched index +** [docker] Add compose and elasticsearch config for kibiter 5.4.0 and ElasticSearch 5.4.0 + +* Panels + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +## elasticgirl.8 + +Released: 2017-05-17 + +Note: In this release we can not include perceval 0.8 because perceval-mozilla and perceval-puppet are not updated. + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** [bugzilla] Set User-Agent header on Bugzilla clients +** [askbot] Support old URLs schema + +* Mordred +** [task] Fix error configuring unaffiliated_group during enrichment in identities refresh +** [task_identities] Add support for downloading identities file from remote locations +** [task_identities] Don't load orgs if load_orgs is false +** [task_collection][task_enrich] Add support for config the bulk_size and scroll_size params + +* GrimoireELK +** Add the size of the JSON document to be indexed to the logs +** [ocean] Avoid showing the commits when analyzing git repositories in debug mode. It is too verbose in large repositories. +** [p2o][gelk] Add support for changing the number of items in ES bulk operations and ES scrolling searches. + +* Panels +** Add Lag info and performance KPIs +** Add Lag Solving Issues help +** Add section for the last 7 days of activity +** Add timeframe 7 days selection +** Update summary links in frequently asked metrics +** Add documentation about newcomers in the community as use case +** Add Frequent Asked Metrics section + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit +** [uris] Add module for handling URIs +** [datetime] Add module for managing datatime objects +** [introspect] Add module for handling instrospection +** Release 0.1.0 + +## elasticgirl.7 + +Released: 2017-05-04 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval + +* Mordred +** [task_identities] Execute affiliate, autoprofile and unify in subprocesses to avoid memory issues. +** [config] Add additional data sources that are loaded globally: confluece, jenkins, jira +** [task_collection] Do not use project field in data collection. (github project and project_1 issue) + +* GrimoireELK +** [enrich][sortinghat] Improve logs when error appears during SH activity in arthur.py. +** [enrich][meetup] Add a new field time_date with the date in which the event is planned +** [enrich][jira] Add projects support to JIRA. + +* Panels + +* Reports + +* VIzGrimoireUtils + + +## elasticgirl.6 + +Released: 2017-04-28 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval + +* Mordred +** Add the new TaskProjects task which manages the projects data for a dashboard +** Implement mordred projects creation and update from Eclipse projects +** Recover the project enrichment support for bugzilla and gerrit +** Add VIzGrimoireUtils dependency for Eclipse projects parsing + +* GrimoireELK +** [enrich] Show enrich exception call trace in logs +** [enrich][twitter] Don't try to configure perceval backend in non perceval data sources +** [enrich][logs] Show datasource in loading identities logs +** [enrich][twitter] Fix identities extraction in twitter +** [enrich][askbot] Fix SortingHat identities find in answers and comments. +** [enrich][git][p2p] Activate pair programming if origin url includes https://github.com/cloudfoundry-incubator +** [enrich][meetup] Define venue_geolocation field as a geolocation type value in the mapping. + +* Panels +** Add missing search widgets +** Update overview to include mediawiki + +* Reports +** [report] Get the active data sources in the mordred config file +** [report] Fix community section, GitHub metrics in overview, template string replacing in subdirs and quarter name. + +* VIzGrimoireUtils: added to the relase as mordred dependency +** [eclipse_projects] Break down eclipse_projects.py script in a library to be used for managing eclipse projects info and the script which uses it. The library is compatible with python2 and python3. + +## elasticgirl.5.1 + +Released: 2017-04-21 + +* SortingHat + +* Perceval + +* Mordred +** [config] Add new method get_data_sources to get the active data sources in a mordred config file. + +* GrimoireELK +** Fixes related to the change from iterator to generator of ocean API affecting askbot, discourse, mbox and meetup and track_items in elasticgirl.4 +** Fixes in pair programming logic + +* Panels + +* Reports +** Create a unified template and supporting code for generating the reports + +## elasticgirl.4 + +Released: 2017-04-10 + +* SortingHat +** [utils] Fix encoding error generting UUIDs in Python 3 +** [mailmap2sh] Add tool to convert mailmap files to a Sorting Hat JSON + +* Perceval +** [supybot] Include filepath data on ParseError exception +** [gerrit] Add option to disable SSH host keys checks +** [confluence] Add content URL to each item + +* Mordred +** [config] Add type checking for all config params +** Several improvements in tests so all of them work now +** Added track_items task +** Add report task +** [mordred] Add a new option -p to execute the a list of phases different from config file. + +* GrimoireELK +** [enrich][mediawiki] Fix extraction of identities from mediawiki reviews +** [enrich][confluence] Add the new field content_url to the enrich index +** [enrich][askbot] Add filter-raw support for askbot +** [ocean] Use a generator to access the items in ocean. +** [enrich] Get enriched items using the same logic than getting items from ocean +** [enrich][git] Fix demography study so it works with pair programming +** [ocean][meetup] Add the group meetup as tag so the raw index can store several groups in the same index +** [enrich][slack] Add missing field text_analyzed + +* Panels +** Add metrics.md file to the general README + +* Reports + + +## elasticgirl.3 + +Released: 2017-03-30 + +* Perceval +** Add agent header so rss from wordpress could be retrieved + +* Mordred +** Clean docker image and add support for reports (prettyplotlib and elasticsearch_dsl) +** Fixes in config params +** Check that there are tasks to execute in update mode before executing them to avoid infinite loop in update +** Add new Task to track items upstream, including config and task implemetation. +** Add new Task to generate reports including config and task implemetation. +** Add unaffiliated_group to configure the name of the unaffiliated org name + +* GrimoireELK +** [enrich][demography] Fix author_min_date when executing in incremental mode +** [track_items] Add library and sample script using it +** Add Slack support + +* Panels +** Update mailing lists file name + +* Reports +** First version integrated + + +## elasticgirl.2 + +Released: 2017-03-23 + +* SortingHat +** Release 0.3.0: https://github.com/grimoirelab/sortinghat/releases/tag/0.3.0 + +* Perceval +** Release 0.7.0: https://github.com/grimoirelab/perceval/releases/tag/0.7.0 + +* Mordred +** Support several entries in menu.yaml for the same data source, fixed menu creation and add one level menus for Overview, Data Status, About +** Improved config management: check config, create config and overall params management +** Added new aliases to remo indexes to fix data freshness issue +** Improvements in logs to find errors in threads +** The initial load step could be skipped using the skip_initial_load config param + +* GrimoireELK +** [enrich][git] Add effort pair programming metrics +** [enrich][phabricator] Add missing fields assigned_to and timeopen_days (T2305 ) +** [ocean][twitter] Order raw items using @timestamp during enrichment (T2367) +** [enrich][hyperkitty] Support +** [enrich][jenkins] Add "main" as built_on when built_on field is empty (thanks @lcanas and @jgb) +** [track_items] Upload first complete version with gerrit contributions support + +* Panels +** doc fixes and typo fixes + +## elasticgirl.1 + +Released: 2017-03-09 + +* Perceval +** Automatic checking of code style using flake8 using Travis. Fixed codying style in all perceval. +** Slack backend improvements +** Logs improvements in gerrit +** [backend] Escape invalid chars when UUIDs are generated + +* GrimoireELK +** Logging now includes the correct modules. Several logging fixes. +** [ocean] Fix mappings for gerrit and mbox to avoid immense term issue. +** [ocean][jenkins] Add support for jenkins-rename-file param in mordred + +* Mordred +** Add support for jenkins-rename-file param in mordred +** Add g++ to docker image to compile pandas +** [tests] Add more tests, including a test for testing the full stack and check the number of items generated + +* Panels +** Add first version of general panel description + +## dagger + +Released: 2017-02-23 + +** Support for nntp, puppetforge and hyperkitty (perceval + gelk). slack supported in perceval. +** Support for --filters-raw-prefix (gelk) +** Support remo and remo:activities as data sources in mordred (pending merge branch in mordred) +** Twitter enrichment does not support from_date parameter (gelk) + +## catwoman + +Released: 2017-02-02 + +## batgirl + +Released: 2016-12-23 + +## atom_girl + +Released: 2016-12-14