diff --git a/releases/NEWS b/releases/NEWS deleted file mode 100644 index a2063700..00000000 --- a/releases/NEWS +++ /dev/null @@ -1,2498 +0,0 @@ -# 0.2.69 - -Released: 2022-03-18 - - -* Grimoirelab - * feat: add github event alias - * Changing `GitHub No Replay` to `GitHub No Reply` -* Cereslib - * [gha] Update tests workflow - * Remove Python 3.6 support - * [poetry] Add Poetry support -* ELK - * Support OpenSearch 1.x - * [enrich] Remove the prefix '::' of the enrollments. - * [enrich] Bugfix for hyperkitty. EnrichBackend can not get raw data. - * [poetry] Include sortinghat as extra dependency - * Remove Python 3.6 support -* Kidash - * [gha] Add workflow to automate the release process - * [gha] Add workflow to check if a changelog was included - * [gha] Update CI github action workflow - * Add flake8 and coverage as dev-dependencies - * [poetry] Add Poetry support - * Remove the support for Python 3.6 and add new versions - * [scripts] Change kidash scripts as entrypoints -* Perceval - * Add configurations of the metadata files to pyproject.toml - * [gha] Update release action using grimoirelab-github-actions -* Perceval-Mozilla - * Add configurations of the metadata files to pyproject.toml - * [gha] Update release action using grimoirelab-github-actions -* Perceval-OPNFV - * [gha] Use poetry for tests in GitHub Actions workflow - * Remove Python 3.6 support - * Support package namespaces with Poetry - * [gha] Add workflow to check if a changelog was included -* Perceval-Puppet - * [gha] Use poetry for tests in GitHub Actions workflow - * Remove Python 3.6 support - * Support package namespaces with Poetry - * [gha] Add workflow to check if a changelog was included -* Perceval-Weblate - * [gha] Use poetry for tests in GitHub Actions workflow - * Remove Python 3.6 support - * Support package namespaces with Poetry - * [gha] Add workflow to check if a changelog was included -* Sigils - * Support newer versions of Python apart from 3.7 - * [poetry] Add Poetry support - * [json] Move visualizations inside panels - * [gerrit] Replace name field to author_name in Submitters table -* SirMordred - * [gha] Use poetry for tests in GitHub Actions workflow - * [poetry] Add poetry support - * [deps] Fix dependecies in requirements - * [utils] Change sirmordred scripts as entrypoints - * Refactoring link to new tutorial page. Currently it links to a page not found and I'm pretty sure this is a better place for the reader to be sent. - * Clarify README -* Sortinghat - * Include Sortinghat command in wheel - * [gha] Update tests workflow - * Fix flake8 code style warnings - * [setup.py] Add missing commas in entry_points - * Bump numpy to 1.21.0 in requirements.txt and setup.py - * Bump numpy from 1.18.3 to 1.21.0 - * Remove Python 3.6 support - * [gha] Add workflow to check if a changelog was included - * [poetry] Add Poetry support - * [sh] Change SortingHat scripts as entrypoints - * [deps] Update Jinja version - - -# 0.2.68 - -Released: 2022-01-27 - - -* ELK - * [enrich] Fix empty value of 'author_domain' field - * [git] Add schema column for raw/calculated - * [enrich] Fix urllib3.exceptions.SSLError for 'enrich_feelings'. - * [github2] Add comments from "Approval" and "Change requests" -* Perceval - * Bump cryptography from 3.3.1 to 3.3.2 - * Bump urllib3 from 1.26.3 to 1.26.5 -* Sigils - * [github2_pull_requests] Add new fields to the index pattern - * [gitlab_issues] Add painless_time_open to the index pattern - - -# 0.2.67 - -Released: 2022-01-13 - - -* ELK - * [enrich] Fix IndexError when getting main organization -* Perceval - * [gha] Check if a changelog was included in every Pull request -* SirMordred - * [.github] Use ubuntu-18.04 instead of ubuntu-latest - * [.github] Update elasticsearch to 6.8.6 - - -# 0.2.66 - -Released: 2022-01-11 - - -* Grimoirelab - * Update events.html with MSR 2022 Hackathon details -* ELK - * [enrich] Fix refresh_identities for '*_multi_org_names' fields - * [.github] Update elasticsearch to 6.8.6 - * [enrich] Get main enrollments for *_org_name field -* Sortinghat - * [.github] Use ubuntu-18.04 instead of ubuntu-latest - * [sortinghat/utils] Fix merge_date_ranges returns an extra date - - -# 0.2.65 - -Released: 2021-11-19 - - -* ELK - * [elk] Update 'non_authored_*' fields on 'refresh_identities' - * [enriched/git] Add 'non_authored_*' commit meta fields -* Perceval - * [git] Add --no-ssl-verify parameter -* Sigils - * [git] Update index pattern to include 'non_authored_*' - * [affiliations] Authors/Contributions by Organization and Domains -* Sortinghat - * [sortinghat/utils] Fix merge_date_ranges - - -# 0.2.64 - -Released: 2021-11-05 - - -* ELK - * [setup/requirements] Upgrade requests==2.26.0 and urllib3==1.26.5 -* SirMordred - * [task_manager] Add `update_hour` in the general section - - -# 0.2.63 - -Released: 2021-10-25 - - -* Grimoirelab - * Add Mystic project - * Add TDF dashboard - * Fix typos and update screenshots - * Update events.html with hacktoberfest-21 details - * [docs] Update Built with GrimoireLab section -* ELK - * [.github] Install setuptools==57.5.0 - * [enriched/git] Add commit meta fields -* Perceval - * [docs] Add information for using perceval against private git repos - * [docs] Add perceval documentation content -* Sigils - * Fix typos in my name - * [git] Update index pattern to include commit author meta fields - * [github2] Limit visualizations to fix low performance. -* SirMordred - * [task_enrich] Support multi author fields in refresh identities - * [docs] Add information for using sirmodred against private git repos - - -# 0.2.62 - -Released: 2021-09-16 - - -* ELK - * [enriched/github2] Add demography study - * [enriched/github2] Add ghost user to calculate first attention - * [README] Update instructions for running tests -* Perceval - * [docs] Add Airtable and Bitbucket backends - * [git] Add argument base-path for the git backend - * Update README.md - * [docs] Update configurations for readthedocs - - -# 0.2.61 - -Released: 2021-09-07 - - -* ELK - * [raw/gitlab] Handle immense term for data.head_pipeline.yaml_errors - * [elk] Pass 'no_update' to pereceval - * [enriched/github2] Fix TypeError NoneType - * [mattermost] Allow parsing normal mattermost urls -* Perceval - * [github] Extend 'max_items' for all requests - * [docs] Add Gitee community backend -* SirMordred - * [config] Support inheritance in configuration - - -# 0.2.60 - -Released: 2021-08-31 - - -* ELK - * [enriched/github2] Fix KeyError 'login' - * [enriched/github2] Add 'user_login' field - - -# 0.2.59 - -Released: 2021-08-23 - - -* ELK - * [pyproject] Update packages and python to "^3.6.1" - * [enriched/githubql] Add PullRequestReview field - * [enriched/mattermost] Fix KeyError 'parent_id' - * [enriched/github2] Use user_data fields to set identities values -* Perceval - * [githubql] Add PullRequestReview event -*SirMordred - * [mordred] Add flag/arg to filter which repos run - - -# 0.2.58 - -Released: 2021-08-12 - - -* ELK - * [gitlab] Autodetect gitlab enterprise-url arg -* Perceval - * [mattermost] Support running with channel names - * [github] Handle reactions without user information - * [pyproject] Update python "^3.6.1" -* Perceval-finos - * [pyproject] Update python "^3.6.1" -* Perceval-mozilla - * [pyproject] Update python "^3.6.1" -* Perceval-opnfv - * [pyproject] Update python "^3.6.1" -* Perceval-puppet - * [pyproject] Update python "^3.6.1" -* Perceval-weblate - * [pyproject] Update python "^3.6.1" - - -# 0.2.57 - -Released: 2021-07-20 - - -* ELK - * [enriched/mattermost] Fix 'useAutomaticTimezone' TypeError - * [raw/mattermost] Fix mapping for 'data.props.meeting_id' - * [enriched/weblate] Fix KeyError for several fields - * [schema] Update Kafka KIP schema -* Kidash - * [setup] Upgrade requests to 2.26.0 -* Perceval - * Bump grimoirelab-toolkit from 0.1.12 to 0.2 - * [gha] Create release.yml - * [nntp] Avoid line too long error - * [nntp] Handle not valid date - * [mattermost] Change the key from 'data.metadata.images' to value - * [gha] Update tests workflow - * [perceval] Change perceval script as entrypoint - * [docs] Fix typos -* Perceval-finos - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Perceval-mozilla - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Perceval-opnfv - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Perceval-puppet - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Perceval-weblate - * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 - * [perceval-finos] Add poetry support - * [travis] Support for python 3.6, 3.7 and 3.8 -* Sortinghat - * [parsing/gitdm] Update VALID_LINE_REGEX expression - * Bump jinja2 from 2.11.1 to 2.11.3 - * [CI] Migrate from Travis CI to GitHub Actions - -# 0.2.56 - -Released: 2021-06-09 - - -* ELK - * [enriched/slack] Add stopwords in the field 'text_analyzed' - * [enriched/mattermost] Improve fields - * [enriched/github] Add demography study - * [enriched/github] Fix KeyError when getting user info - * [tests/data] Improve telegram coverage - * [README] Update bugzilla data sources description - * [schema] Fix twitter schema - * tests] Add test for metadata__updated_on field - * [tests] Add test for transactionID field - * [schema] Add twitter schema file - * [schema] Fix missing values in github event schema - * [enriched/twitter] Remove deprecated attributes from enriched item -* Kidash - * Bump urllib3 from 1.24.3 to 1.26.5 -* Perceval - * [github] Fix 404 Client Error when user is not found. - * [github] Fix user_orgs for organizations with restricted access - * [CI] Use poetry for the CI github actions workflow - * [deps] Add flake8 and coverage to dev dependencies - * Create CONTRIBUTING.md - * [poetry] Add setuptools to the build-system - * [backend] Disables stack trace if debug flag is absent -* Sigils - * [mattermost] Update panel and index pattern with new fields. - * [github_issues] Update index pattern with demography fields - * [json] Update Twitter index pattern -* SirMordred - * [README] Add demography study for github - * Allowing the config files to be specified dynamically - * [micro-mordred] Improve error messages in micro.py - * [docs] Update the mariadb docker-compose configuration - * [tests] Fix flake8 errors - -# 0.2.55 - -Released: 2021-03-15 - - -* ELK - * [stackexchange] Make author anonymization optional for stackexchange - * [enrich-stackexchange] Handle deleted user in stackoverflow - * [enriched/gitlab] Fix KeyError without `name` value -* Perceval - * [stackexchange] Include access_token as optional argument - * [stackexchange] Change the fetch order to 'asc' - - -# 0.2.54 - -Released: 2021-02-11 - -* ELK - * [raw/phabricator] Fix mapping for data.fields.custom_error_stack -* Perceval - * [slack] Use channels.history to retrieve message - - -# 0.2.53 - -Released: 2021-01-26 - -* Cereslib - * [flake8] Fix flake8 errors - -* ELK - * [enriched/github:prs] Add fields for Pull Requests-related data - * [enriched-cocom] Use hashlib instead hash() to create a uniq id - -* Kidash - * [flake8] Fix flake8 errors - -* Perceval - * [supybot] Adds support for logs without timezone information - * [githubql] Support GitHub App to fetch data - * [github] Support GitHub App to fetch data - * [perceval] Add flag `-l/--list` to show list of available backends - -* Sigils - * [github] Update index pattern with new fields - - -# 0.2.52 - -Released: 2020-11-24 - -* SortingHat - * Limit SQLAlchemy versions to <1.4 - - -# 0.2.51 - -Released: 2020-11-23 - -* ELK - * [enriched/slack] Fix enrich items without user data - * [raw/slack] Handle fields in 'data.files' - -* Perceval - * [slack] Fix fetch message from a private user - * [askbot] Add logging debug messages to Askbot - -* Sigils - * [weblate] Add organization information to overview panel - - -# 0.2.50 - -Released: 2020-10-29 - -* ELK - * [enriched/githubql] Classify merged PRs within cross-references study - * [enriched/githubql] Add MergedEvent info - * [gerrit] Add last-verified approval value field to enricher - -* Perceval - * [githubql] Fix error `Events not collected for issue...` - * [tests] Fix pipermail not working search_fields test - * [githubql] Add MergedEvent info - -* Sigils - * [github][github2] Update index patterns with new study fields - * [githubql] Update index pattern with MergedEvent fields - * [gerrit] Update index patterns with last Verified approval value - * [gerrit] Add Retention of Newcomers panel - - -# 0.2.49 - -Released: 2020-10-13 - -* ELK - * [schema] Add schema file for Weblate enriched data - * [weblate] New enricher to handle changes - * [enrich/discourse] Add credentials to collect category info - * [enriched/github] Add field issue_url for issues and pull requests - * [enriched/githubql] Update references in related indexes - -* Perceval - * Weblate backend - -* Sigils - * [weblate] Add Weblate demographics panel - * [weblate] Add Weblate overview panel and index pattern - * [github] Update index pattern with issue_url field - * Update index patterns from github-related indexes - -* SirMordred - * Add new backend weblate - - -# 0.2.48 - -Released: 2020-09-28 - -* ELK - * [enriched/git] `enrich_git_branches` skip --filter-no-collection repo - * [enriched/bugzilla] Add new field `whiteboard` -* Sigils - * [bugzilla] Update index pattern with the new field `whiteboard` - - -# 0.2.47 - -Released: 2020-09-23 - -* ELK - * [enriched/githubql] Add new study 'enrich_reference_analysis' - -* Sigils - * [gerrit] Change `timeopen` to `painless_delay` - -* SirMordred - * [githubql] Add new study "enrich_reference_analysis" - - -# 0.2.46 - -Released: 2020-09-14 - -* ELK - * [enriched/gerrit] Add new study 'enrich_demography_contribution' - * Check for author in comment raw data before assigning to user object - * [schema] Fix slack schema CSV file - * [enriched/gerrit] Add new fields `open` and `wip` - * [enriched/jira] Add `is_closed` and `status_category_key` fields - -* Perceval - * Update dulwich package version - * Add support for specifying Gerrit SSH key location - -* Sigils - * [gerrit] Update index pattern - * Update documentation about Kidash - * [docker] Add links and import instructions - * [discourse] Add links and import instructions - * [gitlab] Add links and import instructions - * [gitter] Add links and import instructions - * [maniphest] Add links and import instructions - * [mediawiki] Add links and import instructions - * [slack] Add links and import instructions - * [global] Add links and import instructions - * [affiliations] Add links and import instructions - * [code] Add links and import instructions - * [demographics] Add links and import instructions - * [gerrit] Add links and import instructions - * [lifecycle] Add links and import instructions - * [jira] Add links and import instructions - * [jenkins] Add links and import instructions - * [chaoss] Add links and import instructions - * [onion] Add links and import instructions - * [bugzilla] Add links and import instructions - * [github] Add links and import instructions - * Add new icons license information - * [git] Add links and import instructions - * [jekyll] Update theme colors - * [jira] Use `painless_delay` as the time the issue stay open - * [jira_backlog] Use `painless_delay` as the time the issue stay open - * [jira_timing] Use `painless_delay` as the time the issue stay open - -* SirMordred - * Add new study "demography_contribution" - * Update Getting Started guide with identities management section - * Fix lifecycle file name - - -# 0.2.45 - -Released: 2020-07-27 - -* GrimoireLab - * Remove 'manuscripts' from the release due there is - a broken depencency with matplotlib and numpy. - - -# 0.2.44 - -Released: 2020-07-27 - -* ELK - * [enriched/git] Study aoc support extra fields - * [enriched/mediawiki] Add `repository_labels` field - -# 0.2.43 - -Released: 2020-07-21 - -* Perceval - * [githubql] Add pull request author to ClosedEvent - * [slack] Use channels.history to retrieve message - -* ELK - * Update pyproject.toml with PyMySQL pinned dep - * [deps] Pin PyMySQL dependency - * [enriched-githubql] Add pull request submitter to closed events - * [enriched/phabricator] Fix the field `time_to_close_days` - * Fix Issue#907 - * [enriched-enrich] Set user-agent for geopy - * Fix wrong quotation - * [enriched-git] Execute update_items when local repo commits are returned - * [enriched-githubql] Add page size param to duration study - -* Hatstall - * [readme] Fix instruction to install requirements - -* Mordred - * Save new changes made in Dashboard by mounting the volume in ES - * Remove inconsistency in displaying images - * Add info about pulling in latest data - -* Sigils - * [github-closed-events] Include submitters and reporters in dashboard - * [maniphest] Change `painless_delay` instead of `timeopen_days` - * [github-label-events] Improve dashboard - * Add acknowledgments section to DevRel dashboards - -# 0.2.42 - -Released: 2020-06-20 - -* Perceval - * [slack] Handle messages without user/bot ID - -* ELK - * Add release note for rocketchat - * [enriched-slack] Handle messages without user data/bot ID - * [enriched-githubql] Add reporter data to enriched docs - * [enriched-mbox] Handle long body emails - * [enriched-githubql] Add duration analysis study - * [rocketchat] Increase test coverage and complete doc - * [rocketchat] Patch for PR #882 - * [rocketchat] Add support for RocketChat - * [grimoire_elk] Remove tzinfo for date comparison - -* Mordred - * [config] Add support for duration analysis - * [doc] Add instructions to mine rocketchat - * [docs] Update Getting-Started.md result image - -# 0.2.41 - -Released: 2020-06-13 - -* Perceval - * [backend] Add Rocket.Chat backend - * [perceval] Fix flake8 errors - * [doc] Add Slack API token generation info - * [slack] Update resource endpoints - * [launchpad] Add missing `package` parameter in launchpad - -* Sigils - * [slack] Add DevRel dashboard - * [GitHub] Add DevRel dashboard - * [discourse] Add DevRel dashboard - * [github] Add dashboard about label-related events - * [github2-pulls] Update index pattern - * [github2-pulls] Change order results metric in table vizs - * [github2-issues] Update index pattern - * [github2-issues] Change order results metric in table vizs - * [slack] Add new files metrics to index pattern - * [gerrit] Add changeset status and value to index pattern - -* ELK - * [deps] Constrain numpy version to <= 1.18.3 - * Release 0.73.0 - * Fix formatting git private repos note - * [enriched-githubql] Add label attribute to closed events - * [enriched-mediawiki] Handle filters on repo URL - * [elastic] Support for filter no-collection on multi params URLs - * [enriched-confluence] Extract username from publicName attr - * [enriched-git] Sync AOC and Git raw index - * [enriched-git] Handle anonymized repos in update_items - * [enriched-cocom] Include files in revision - * [elk] Fix flake8 errors - * [tests] Rename study indexes for tests to ease deletion - * [elk] Handle private repos in git studies - * [enriched-utils] Remove credentials for repository filter - * [raw-git] Remove credentials from origin - * [elk] Move anonymize_url to enriched/utils.py - * [enriched-cocom] Propagate commit parents to enriched index - * [utils] Remove unused function get_time_diff_days - * [enriched-mbox-study-kip] Fix calculation for inactive days - * [grimoire_elk] Replace datetime/dateutil calls with toolkit - * [utils] Remove get_git_repos - * [enriched] Remove projects.py - * [launchpad] Add support for launchpad - * [enriched-gerrit] Propagate changeset status to patchsets - * [slack] Update files metric - * [tests] Add tests for `copy_raw_fields()` method - * [Enrich] Add `copy_raw_fields()` method and refactor enrichers - * [telegram] Improve test coverage - * [Mbox] Add tests and test data for MBox KIP study. - * [test] Add missing test for perceval params - -* Mordred - * [task_panels] Upload label-related dashboard - * [docs] Update getting-started with ES/Kibiter 6.8 - * [tests] Remove panels test for kibiter 5.x - * [aliases] Remove affiliations and all_enriched aliases for github2 - * [tests] Add tests to process filter-no-collection on multi params URLs - * [task_panels] Remove support for Kibiter < 6.x - * [tests] Update requirements_test - * [sirmordred] Remove credentials from private URLs - * [task_identities] add `no-enrollment-periods-validation` - * [aliases] Fix enrich alias for gerrit - -* Sortinghat - * [deps] Constrain numpy version to <= 1.18.3 - * Update version number to 0.7.13 - * [misc/grimoirelab2sh] Add new argument to avoid periods validation - -* Graal - * [cocom] Remove first slash from file path - * [travis] Change how to install nomos - * [cocom] Include files info in docs generated - * [cocom] Include parents info in docs generated - -* Cereslib - * [enrich-enrich] Fix flake8 E741 ambiguous variable name - * [deps] Constraint numpy version to <= 1.18.3 - * version number to 0.1.13 - * [test] Add test for Git events - -* Kidash - * [kidash] Remove support for kibana <6.x - * [kidash] Improving log messages - * [kidash] Support import to Kibiter/Kibana 6.8 - - -# 0.2.40 - -Released: 2020-04-24 - -* Perceval - * [perceval] Add githubql backend - * [doc]Fixed minor typos - * [Travis] upgrade pip and setuptools - * [pagure] Add sanitize for archive - * [mattermost] Add sanitize for archive - * [github] Add sanitize for archive - * [discourse] Add sanitize for archive - * [backend] Add predefined paramaters to clients - * [pagure] Fix failing tests - * [backend] Add Gitter backend - * [gerrit] Extend `--start` param to gerrit 3.x -* Perceval-opnfv - * [travis] Upgrade setuptools and pip -* Perceval-puppet - * [travis] Upgrade setuptools and pip -* Perceval-mozilla - * [travis] Upgrade setuptools and pip -* Perceval-finos - * [travis] Upgrade setuptools and pip -* Graal - * [travis] Upgrade setuptools and pip -* Sortinghat - * [doc] Add examples of SortingHat API via Python - * [travis] Upgrade setuptools and pip - * Clarifying sortinghat intro - * Fix broken link to Perceval in README.md -* Mordred - * [mordred] Add support for github events - * [doc-git] Add parameter `run_month_days` in `enrich_git_branches` - * This commit adds config, alias, menu entry and documentaion for gitter backend. - * Fixed the typoes of docker/README.md - * [doc] Add Pagure datasource - * [tests] Remove user/password from es_enrichment section - * Remove user and password parameter from elastic section - * added section in getting started and reformatting - * added section in getting started and formatting - * [travis] Upgrade setuptools and pip - * [tests] Add requirements_tests.txt - * [docs] revamp of getting-started.md - * Fixed Broken Backlinks - * Added some sections in 'How to' of GettingStarted document - * Make anonymization optional for each backend - * fixed link for ssl error and other fixes - * fixes made as per comments - * Corrected 'Sudo' with 'sudo' - * Added how-to dump a mapping/data from an index - * added installation for docker and docker-compose, added errors and solutions in troubleshooting section - * fix typo in README.md - * Fixing typo in Sir Mordred's README.md - * [Getting-started] Update kibiter version to 6.1.4-3 - * Add "How to modify the menu" to the getting started guide - * [doc]Added section in 'How to' in Getting-Started.md - * Fixed a backlink - * [doc] Added How to section in Getting-Started - * [sirmordred] Remove duplicate call of execute_batch_tasks -* Kingarthur - * [travis] Upgrade setuptools and pip -* Manuscripts - * [travis] Upgrade setuptools and pip - * [travis] Support for python 3.5 and 3.6 -* Cereslib - * [travis] Upgrade setuptools and pip - * Fix a small typo -* Toolkit - * [travis] Upgrade setuptools and pip -* ELK - * Fix body store-and-process-github-events.yml - * [ELK] Add poetry support - * [releases] Add release note for feature #853 - * [ELK] Store and process github events - * [enrich-git] Add the param `run_month_days` to enrich_git_branches - * [enriched-git] Handle connection problems during enrich_git_branches - * This commit addds support for gitter backend. Raw and Enriched indexes have been added along with their tests and schemas. - * [pagure] Add support for Pagure - * updated the docstring for pair_programming - * [enriched-bugzillarest] Add new field `is_open` - * changed logic to delete all test indexes - * added test for pair_programming - * [travis] Upgrade setuptools and pip - * [enriched] Check first if the instance of `item` is dict - * add language field and compute all cocom study metrics per language - * added projects_map db to improve coverage - * [releases-notes] Add release note for fix #826 - * [enriched-meetup] Handle event without geolocation - * [meetup] Make users anonymization optional for meetup - * [gitlab] Make owners data anonymization optional for gitlab - * [github] Make owners data anonymization optional for github - * [git] Make author anonymization optional for git - * Make anonymization optional for each backend - * modified:final test_git.py - * [schema] Update dockerhub.csv - * [schema] Update askbot.csv - * [schema] Update mattermost.csv -* Sigils - * [bugzilla-timing] Change `painless_time_to_now` instead of `timeopen_days` - * [github] Add dashboard about closed events - * [bugzilla-backlog] Change `painless_time_to_now` instead of `timeopen_days` - * [bugzilla] Change `painless_time_to_now` instead of `timeopen_days` - * [gitter] Add gitter panels. - * Updated docker.json, replaced sirmordred repo link - - -# 0.2.39 - -Released: 2020-03-20 - -* Kidash - * [kidash/kidash] Delete dependency with `grimoirelab-panels` - * [doc] Update README -* Graal - * [graal] Update license and copyright information -* Cereslib - * [events] Add support for multiple affiliations -* Mordred - * [doc] Add PyCharm installation instructions - * added logging to file support for micro.py - * Troubleshooting fixed - * [doc] Fix askbot configuration typos - * Fix broken backlinks in supported resources - * Refracted Readme, Added navigation and contents - * Fixed README for docker-compose(without SearchGuard) with changes - * Corrected mariadb services for docker-compose.yml for without SearchGuard section - * [doc] Added Getting-Started doc - * added color logging facility in micro.py - * [micromordred] Replace actual api-token - * fixed username and pass for kibiter login - * Update README.md troubleshooting section - processes conflict with SearchGuard - * Update README.md troubleshooting section - processes conflict with SearchGuard - * Update 'Source code and docker' section of README.md to include unsecure docker-compose - * correcting spelling mistakes in Readme - * Added Empty Index Problem with Solution in troubleshooting section of Readme - * [utils] Add script to upload menu and dashboards - * Fixed phase enrichment time duration not counting days - * Added troubleshooting section in readme - * [sirmordred] Remove support for arthur - * [task_panels] Upload panels from the sigils module - * Merge branch 'add-colic' of 'https://github.com/snack0verflow/grimoirelab-sirmordred' - * [doc] Update readme with colic data and fix lexical order - * [readme] Improve doc to get a token for twitter - * [doc] Add sample cocom fields -* ELK - * [schema] Add attribute for multi org names in github_pull_requests.csv - * [schema] Add attribute for multi org names in github_issues.csv - * [schema] Add attribute for multi org names in git.csv - * [enriched-mappings] Update aoc mappings - * [enriched-study-ceres-onion] Support for multiple affiliations - * [tests] Add tests for multi_org_name fields - * [jira] Propagate multiple affiations attributes - * [gerrit] Propagate multiple affiations attributes - * [grimoire_elk] Add support for multiple affiliations - * modified: tests/test_git.py - * [raw-gerrit] Handle long text for data.patchSets.comments.message - * Update github_backlog.csv for a field missing - * [git] Include fields related with sortinghat when it is disabled - * [meetup] Include fields related with sortinghat when it is disabled - * [gitlab] Include fields related with sortinghat when it is disabled - * [github] Include fields related with sortinghat when it is disabled - * [sortinghat] Create enriched fields related to Sortinghat when it is disabled - * [enriched-gitlab] Fix repository value in issue - * [schema] Update field description - * [schema] Add project and project_1 descriptions to jenkins - * [elk] Remove support for arthur - * Update the mattermost.csv to fix a format issue - * [doc] Update readme for secure elasticsearch -* Perceval - * [groupsio] Update log message - * [perceval] Update license and copyright information - * [backend] Add Pagure backend to Perceval - * [perceval] Update license info - * [groupsio] Format from_date with utc+0 timezone - * [doc] Fix broken link in README -* Sigils - * [jenkins] Add index pattern - * Remove date formatting for grimoire_creation_date - * [all_enriched_tickets] Add date format - * [all_enriched] Add grimoire_creation_date format - * [affiliations] Add grimoire_creation_date format - * [github_issues] Update index pattern to include multi org names - * [git_areas_of_code] Update index pattern to include multi org names - * [git] Update index pattern to include multi org names - * [all_onion] Update index pattern to include multi org names - * [all_enriched_tickets] Update index pattern to include multi org names - * [all_enriched] Update index pattern to include multi org names - * [affiliations] Update index pattern to include multi org names - * Update affiliations index pattern - * [jenkins-job-categories] Add Jenkins projects pie chart - * [jenkins-nodes] Add Jenkins projects pie chart - * [jenkins-jobs] Add Jenkins projects pie chart - * [jenkins] Add Jenkins projects pie chart - * [jenkins] Update index pattern - * [twitter] Add link format to author_uuid field - * [stackoverflow] Add link format to author_uuid - * [slack] Add link format to author_uuid field - * [rss] Add link format to author_uuid field - * [redmine] Add link format to author_uuid field - * [meetup] Add link format to author_uuid field - * [mediawiki] Add link format to author_uuid field - * [mbox] Add link format to author_uuid field - * [mattermost] Add link format to author_uuid field - * [maniphest] Add link format to author_uuid field - * [kip] Add link format to author_uuid field - * [jira_resolution_date] Add format to author_uuid - * [jira] Add link format to author_uuid field - * [irc] Add link format to author_uuid field - * [gitlab-mrs] Add link format to author_uuid field - * [gitlab-issues] Add link format to author_uuid - * [github2-prs] Add link format to author_uuid - * [guthub2-issues] Add link format to author_uuid - * [git-aoc] Add link format to author_uuid field - * [gerrit] Add link format to author_uuid field - * [discourse] Add link format to author_uuid field - * [demographics] Add link format to author_uuid - * [confluence] Add link format to author_uuid field - * [bugzilla] Add link format to author_uuid field - * [askbot] Add link format to author_uuid field - * [all_onion] Add link format to author_uuid field - * [all_enriched_tickets] Add format to author_uuid - * [github-issues] Add link format to author_uuid - * [git] Add link format to author_uuid field - -# 0.2.38 - -Released: 2020-02-25 - -* Perceval - * Fixed Typos and Grammatical Errors - * [telegram] Handle edited messages - * Update doc in README - * [github] Update the docstrings - * [twitter] Support for SSL verification - * [telegram] Support for SSL verification - * [stackexchange] Support for SSL verification - * [slack] Support for SSL verification - * [rss] Support for SSL verification - * [launchpad] Support for SSL verification - * [jenkins] Support for SSL verification - * [meetup] Support for SSL verification - * [mediawiki] Support for SSL verification - * [hyperkitty] Support for SSL verification - * [googlehits] Support for SSL verification - * [gitlab] Support for SSL verification - * [dockerhub] Support for SSL verification - * [discourse] Support for SSL verification - * [confluence] Support for SSL verification - * [bugzillarest] Support for SSL verification - * [groupsio] Support for SSL verification - * [github] Support for SSL verification - * [jira] Support for SSL verification - * [mattermost] Support for SSL verification - * [phabricator] Support for SSL verification - * [pipermail] Support for SSL verification - * [mbox] Support for SSL verification - * [redmine] Support for SSL verification - * [bugzilla] Support for SSL verification - * [askbot] Support for SSL verification - * [client] Support for tunable SSL verification - * [backend] Allow to disable SSL verification - * [doc] Update groupsio documentation in README.md - * [groupsio] Fetch messages after a given date -* ELK - * [github2] Fix loading identities - * [github] Fix filter classified in GitHub and GitHub2 enrich - * add schema for backlog studie - * Add additional index to compute the chronological evolution of opened issues and average opened time issues. - * add description in git schema for commit_tags field - * add "tags" field in git enriched index to get the number of releases. - * [schema] Add scheams for docker smells and deps - * [grimoire_elk] Add connectors for docker smells and deps - * [grimoire_elk] Support for Docker smells analysis - * [grimoire_elk] Support for Docker dependencies analysis - * Update README.md - * [tests] Stop loop when finding a target study - * [tests] Move httpretty to requirements_tests - * [github2] Add support for feeling study - * [enriched-enrich] Add enrich_feelings study - * [schema] Add CSV for survival git data - * [dependencies] Add statsmodels dep to setup and requirements - * [enriched-git] Add support for survival study - * [enriched-enrich] Add survival developer study - * [doc] Add documentation to run tests and coverage - * [doc] fix mistake in README.md - * [enriched-telegram] Handle edited message - * [enriched-telegram] Handle missing username in Telegram messages - * [enriched-jira] Handle missing creator/ assignee displayName and name - * [tests] Fix tests for enrich_geolocation - * [raw-bugzillarest] Prevent indexing of clones attribute -* Hatstall - * [hatstall] Fix method editing organization domain - * Update templates location to make the application self-contained - * Update files to create the django-hatstall pip package - * [docs] Update documentation -* Mordred - * [mordred] Add support for backlog analysis study - * [doc] Add instructions to use dockersmells and dockerdeps - * [doc] fix docker-compose file - * Removed faulty parameter from utils/setup.cfg - * [aliases] Fix supybot alias `irc` instead of `supybot` - * [doc] Add instructions to execute the enrich_feelings study - * [config] Add `enrich_feelings` study - * [doc] Add instruction to execute `enrich_forecast_activity` study - * [config] Add support for `enrich_forecast_activity` study - * [sirmordred] Remove doc folder - * [config] Remove write_doc method - * [doc] Add an example of setup.cfg and projects.json for each data source - * [doc] Clarify the behavior of the 'Data Status' and 'Overview' dashboards - * [aliases.json] Remove old github2 aliases - * Add info about labels -* SortingHat - * [tests] Fix `test_not_null_source` in test_model - * [db-model] Remove CoerceToBool type - * Add requirements file -* Graal - * [coqua] Add support for Docker smells analysis - * [tests] Add travis support for Jadolint - * [codep] Add support for Docker dependencies analysis - * [analyzers] Add support for Jadolint - * [graal] Add exec_path as default parameter - * [graal] Use backend name to init default git path -* Sigils - * [docker] Add dashboard for docker smells and dependencies - * [feelings] Add dashboard for github comments, collaboration and feelings - * [org-tracking] Add org tracking dashboard - * Add organization tracking overview documentation - * [doc] Delete hidden documentation pages - * [doc] Update link for mediawiki dashboard - * [sigils] Remove images in docs/assets/images - * [doc] Add info to create a Gemfile in contributing.md - * Update Affiliations documentation - * Uodate all_enriched index pattern - * Update text of Hatstall links from Affiliations - * Fix collaboration dashboards documentation - -# 0.2.37 - -Released: 2020-01-28 - -* ELK - * [enriched-gitlab] Fix repository value in merge - * [travis] Support for python 3.7 - * [requirements] Relaxing pandas constraint - * [enriched-github2] Add support for geolocation study - * [enriched-enrich] Add geolocation study - * [enriched-github2] Remove hardcoded geolocation support - * [enrich-github] Remove dead code - * [enriched-github] Remove hardcoded geolocation support - * [dep] Add geopy dependency - * [enriched-dockerhub] Handle never updated images - * [git-enriched] Remove github commit support - * [elastic] Refactor all_properties method - * [tests] Add tests for elastic.py - * [elastic] Change logic to handle errors when creating a mapping - * [elastic] Initialize `error` variable for `safe_put_bulk` - * [elastic] Improve methods documentation - * [elastic] Rename `_check_instance` method - * [elastic] Replace dateutil call with str_to_datetime - * [elastic] Move logic to create index to new method - * [elastic] Enable loading of complex aliases - * [tests] Fix CI tests for elastic items - * (fix-ci-travisx) [elastic_items] Improve doc and test coverage - * [elk] Replace ElasticConnect, ElasticWriter exceptions with ElasticError - * [errors] Add ElasticError - * Let pandas be >= 0.22.0 - * [utils] Remove track_items script and related methods - * [elk] Remove `get_items_from_uuid` method - * [github2] Update github2 fields - * Fix possible error 2 - * Fix possible error - * Fix flake8 errors - * Add support for releasing scroll and waiting for available scroll (wait configurable amount of time) - * [enriched-colic] Handle missing commit message - * [enriched-cocom] Handle missing commit message - * [schema] Update colic schema - * [schema] Update cocom schema - * [enriched-colic] Handle credentials in origin - * [enriched-cocom] Handle credentials in origin - * [raw-github] Handle immense term for data.reviews_data.body -* Hatstall - * [docker] Download Hatstall code while the container is built -* Mordred - * [doc] Add example for github2 sections - * [travis] Support python 3.7 - * [config] Add support for geolocation study - * [sirmordred] Remove support for github commit - * [aliases] Handle complex aliases - * [doc] Add notes to enable github-comments - * [aliases] Add github2 aliases for issues and pull requests - * [task_panels] Support github-comments dashboard upload - * [config] Add support for github-comments - * [tests] Add test with archives for task_enrich - * [tests] Optimize test for task_collection - * [doc] Complete list of data sources supported - * Made gitlab issues naming consistent -* SortingHat - * [setup] Let pandas be >= 0.22.0 -* Cereslib - * [setup] Reduce constraints on dependencies -* Sigils - * [docs] Add documentation for gerrit approvals dashboard - * [gerrit-approvals] Fix typo in `Approvals by Contributor` - * [docs] Add documentation for gerrit dashboard - * [docs] Update name and image of gerrit review efficiency dashboard - * [docs] Update gerrit review efficiency - * [gerrit] Align nomenclature in Gerrit panels - * Fix schema links - * Fix broken link to github2_issues schema - * [gerrit_approvals] Add total number of approvals - * Add GitHub pull requests collaboration dashboard - * Add GitHub issues collaboration and comments dash - * Update affiliations dashboard - * [colic] Update colic panels - * [cocom] Update cocom panels - * Update Jekyll installation instructions - * Update Kidash installation to mention Python 3 - - -# 0.2.36 - -Released: 2019-01-08 - -* ELK - * [enriched] Remove support geolocation for github enriched indexes - - -# 0.2.35 - -Released: 2019-01-03 - -* ELK - * [raw-bugzillarest] Set text mapping type for thetext attribute -* Graal - * Fix lizard package dependency -* Hatstall - * [hatstall] Support check/uncheck all options in checkbox tables - * [hatstall] Add support for editing organizations and domains -* Kidash - * [setup] Remove ELK dependency - * [kidash/kidash] Remove ELK imports - * [bin/kidash] Remove ELK imports - * [bin/kidash] Remove unused imports -* SortingHat - * [database] Allow SSL connections - - -# 0.2.34 - -Released: 2019-12-19 - -* Perceval - * [jenkins] Log debug message when builds are not found - * [jira] Add info for data obtained with authenticated access - -* Sigils - * Update CONTRIBUTING.md - * [engagement panel] Fix dashboard name - * [colic] Fix dashboard name - * [cocom] Fix dashboard name - * Fix file name to use hypens instead of underscores - * [github_issues] Retitle issues open to issues - * [gitlab_issues] Retitle issues open to issues - * [about] Add mention to CHAOSS project - -* ELK - * [enrich-gitlab] Handle TypeError: 'NoneType' exception - * [utils] Add 429 error to status_force_list - * [enriched-gerrit] Handle missing user info - -* SirMordred - * [docker] Remove track_items info from readme - * [tests] Fix flake8 errors - * Add unit tests for the main methods of healthcheck.py - * Add healthcheck to Docker image with a call to the script 'utils/healthcheck.py' - * Add healthcheck script to installation setup file - * Python healthcheck script added to utils folder - * [task_panels] Include OSPO panels in community menu - -* SortingHat - * [matching-email] Remove `_filter_emails` - * [matching-email] Support blacklist when strict matching is False - * [tests] Remove hard-coded DB params - * [travis] Support for python 3.5 and 3.6 - * [tests] Set mysql `sql_mode` in travis - * [tests] Add mysql service to travis.yml - - -# 0.2.33 - -Released: 2019-11-28 - -* Sigils - * [git] Update index pattern to include hour/weekday fields - * [meetup] Update index pattern to handle group_urlname attribute - * [gerrit] Update painless_delay in index pattern - * [all_enriched] Make URLs clickable - * [demographics] Update screenshot - * [sigils] Add OSPO panel collection - - -* Perceval - * [gitlab] Raise client error if oauth is set and token is not - * [discourse] Pass credentials via headers - * [jenkins] Handle workflow multibranch job builds - * [tests] Fix variable names in github test - * [github] Handle `None` requested reviewers - * [groupsio] Add log message upon download archives failure - * [travis] Support for python 3.5 and 3.6 - * [doc] Add git and build-essential to requirements section - - -* Graal - * [tests] Increase test coverage for codep and colic - * [graal] Fix worktree creation - * [graal] Change logic to create worktree - * [tests] Add base class to handle tests on analyzers - * [tests] Add base class to handle setup of test Git repo - * [graal] Replace git cmd with /usr/bin/git - * [readme] Add SCC description to README.md - * [tests] Add tests for SCC analyzer - * [cocom] Added support of scc analyzer to Code Complexity Backend - - -* KingArthur - * [server] Add reschedule method to the REST API - * [arthur] Allow to re-schedule failed tasks - * [scheduler] Allow to reset task counters - * [scheduler] Handle TaskRegistryError - * [server] Fix docstring for `task` - * [arthur] Handle TaskRegistryError - * [tasks] Raise TaskRegistryError on task operations - * [errors] Add TaskRegistryError - * [tasks] Handle Redis errors - * [arthur] Fix typos and warnings - * [tasks] List tasks based on key prefixes - * [tasks] Convert exception to warning when updating tasks - * [tasks] Replace dangerous redis commands - * [scheduler] Support for reading tasks from redis - * [tasks] Add update operation - * [tasks] Use redis to store tasks - * [scheduler] Reschedule failed tasks into the retry queue - * [travis] Support for python 3.5 and 3.6 - * [tasks] Add JobData tuple to store jobs in the task job list - * [server] Return job_number from the metadata of the Job - * [scheduler] Save job_number in the meta field of the job enqueued - - -* Grimoire ELK - * [github2] Add schema for new version of pull index - * [github2] Add schema for new version of issue index - * [enriched-github2] New enricher to handle comments and reactions - * [enriched-git] Handle missing local git repo - * [travis.yml] Support for tests using ODFE - * [studies-aoc] Support for ODFE - * [studies-onion] Support for ODFE - * [enriched] Update bulk endpoint to support ODFE - * [enriched-enrich] Update bulk endpoint for ODFE - * [enriched-ceres_base] Add class variable for ES major version - * [elastic_items] Handle ODFE page info on pagination - * [elastic] Update bulk and mapping endpoints for ODFE - * [enriched-gerrit] Handle missing reviewer info - * [raw-elastic] Change to 'format()' in the logs - * [elk] Change to 'format()' in the logs - * [elastic_items] Change to 'format()' in the logs - * [elastic] Change to 'format()' in the logs - * [enriched-study_ceres_onion] Change to 'format()' in the logs - * [enriched-study_ceres_aoc] Change to 'format()' in the logs - * [enriched-stackexchange] Change to 'format()' in the logs - * [enriched-sortinghat_gelk] Change to 'format()' in the logs - * [enriched-remo] Change to 'format()' in the logs - * [enriched-mozillaclub] Change to 'format()' in the logs - * [enriched-meetup] Change to 'format()' in the logs - * [enriched-mediawiki] Change to 'format()' in the logs - * [enriched-mbox_study_kip] Change to 'format()' in the logs - * [enriched-mbox] Change to 'format()' in the logs - * [enriched-kitsune] Change to 'format()' in the logs - * [enriched-jira] Change to 'format()' in the logs - * [enriched-jenkins] Change to 'format()' in the logs - * [enriched-gitlab] Change to 'format()' in the logs - * [enriched-enrich] Change to 'format()' in the logs - * [enriched-ceres_base] Change to 'format()' in the logs - * [enriched-askbot] Change to 'format()' in the logs - * [enriched-git] Change to 'format()' in the logs - * [enriched-gerrit] Change to 'format()' in the logs - * [enriched-functest] Change to 'format()' in the logs - * [enriched-dockerhub] Change to 'format()' in the logs - * [enriched-discourse] Change to 'format()' in the logs - * [enriched-bugzillarest] Change to 'format()' in the logs - * [enriched-bugzilla] Change to 'format()' in the logs - * [enriched-colic] Change to 'format()' in the logs - * [enriched-cocom] Change to 'format()' in the logs - * [enriched-github] Change to 'format()' in the logs - * [enriched] Return empty item_sh when sortinghat is not set - * [enriched-meetup] Fix typo in group url name - * [dependencies] Update redis to 3.0.0 - * [enriched-bugzillarest] Handle missing user info - * [travis] Support for python 3.5 and 3.6 - * [elastic_items] Remove white spaces from repo url with labels - - -* SirMordred - * [sirmordred] Remove unused modules and change to 'format()' in the logs - * [sirmordred] Delete support to log rotation - * [doc] Remove eclipse load support for doc - * [sirmordred] Delete support to load eclipse projects - * [mordred] Decommission bot names params from setup.cfg - * [sortinghat] Fix issue when sortinghat is not in the config file - * [travis] Support for python 3.5 and 3.6 - - -* Cereslib - * [events-events] Handle empty sortinghat dict - * [README] Add travis and coveralls badges - * [setup.cfg] Ignore W605 error - * [install] Align dependencies in requirements and setup - * [setup.cfg] Ignore W504 error - * [setup] Remove scripts param - * [cereslib] Remove import from __init__.py - * [enrich] Fix flake8 errors - * [dfutils] Fix flake8 errors - * [tests] Add travis CI - - -* Toolkit - * [datetime] Handle dates with offsets outside 24h - * [travis] Support for python 3.5 and 3.6 - - -# 0.2.32 - -Released: 2019-10-28 - -* Sigils - * [docs] Update demographics.png - * [git-demographics] Change column name - * [demographics] Change column name - * [demographics] Change title `demographics_people_leaving_community` - * [git-demographics] Change title `git_demographics_people_living_community` - -* Perceval - * [github] Make fetching owners information from GitHub API optional - * [backend] Manage filtering of classified data within lists - * [github] Replace logging with logger call - * [test_backend] Provide test for find_backends - -* KingArthur - * [scheduler] Remove 'arthur' prefix and task id from job ids schema - * [setup] Update dependencies - * [jobs] Add human readable job identifier - * [arthurd] Add ignoring log-path msg when no-daemon is on - * [arthurd] Send log messages to stderr when --no-daemon is on - * [arthur] Remove 'bin/arthur' script - * [test_server] Add test of the job server endpoint - * [server] Expose jobs by job_id to the CherryPy server - * [requirements] Update package requirements - * [jobs] Replace job result object by Perceval summary - * [jobs] Refactor 'metadata' decorator - * [jobs] Generate items using BackendItemsGenerator - * [scheduler] Reschedule failed tasks with resuming - * [jobs] Remove jobs resuming support - * [tasks] Add has_resuming() method to task - * [test_worker] Add tests related to the job log storage - * [jobs] Store logs of each job in their "meta" field - -* HatStall - * Improve login form using Bootstrap style - -* Grimoire ELK - * [elastic_items] Fix message when scroll_size is 0 - * [tests] Add test for `enrich_extra_data` - * [enriched-github] Handle missing user information - * [enriched-enrich] Fix conversion projects.json to map - * [enriched-github] Removed not needed code. Added the missing sign off - * [enriched-git] Enable extra study - * [enrich] Add extra study - * [enrich] Adding new study to enable adding extra fields to a target index - * [travis] Support tests for python 3.5 and 3.6 - * [studies] Improve log messages - * [tests] Fix test enrich items discourse - * [enriched-discourse] Remove `__show_categories_tree` method - * [elk] Remove support for filter-raw-prefix - * [tests] Align tests to filter-raw-prefix removal - * [elastic-items] Remove support for `filter-raw-prefix` - * [p2o] Remove support for filter-raw-prefix - * [enriched-git] Handle empty repository errors - * [elk] Improve log messages - * [elastic_items] Change log level message - * [elastic] Compact log messages - * [raw-elastic] Improve log messages - * [enriched-utils] Change `min_enrich` value - * [tests] Increase test coverage for raw jenkins - * [tests] Increase test coverage for raw twitter - * [tests] Increase test coverage for raw supybot - * [tests] Increase test coverage for raw stackexchange - * [tests] Increase test coverage for raw nntp - * [tests] Increase test coverage for raw meetup - * [tests] Increase test coverage for raw mediawiki - * [tests] Increase test coverage for raw mbox - * [tests] Increase test coverage for raw mattermost - * [enriched-jira] Handle missing `fields` attribute - * [tests] Increase test coverage for raw github - * [tests] Increase test coverage for raw graal - * [tests] Increase test coverage for raw git - * [tests] Increase test coverage for raw functest - * [tests] Add test case for errors class - * [tests] Increase test coverage for raw dockerhub - * [tests] Increase test coverage for raw crates - * [enriched-discourse] Handle missing author information - * [raw-jenkins] Handle multiple params on repo url - * [grimoire_elk] Goodbye track_items.py - * Add minor changes to the README file. - * remove the dashboards folder - -* SirMordred - * [task_identities] Call sh affiliate after loading identities file - * [task_identities] Call sh unify after loading identites file - * [travis] Support tests for python 3.5 and 3.6 - * [tests] Add tests for enrich_extra_data study - * [doc] Improve desc projects_url - * [config] Add external study - * [studies] Improve log messages - * [task_enrich] Remove support for filter-raw-prefix - * [task] Remove support for filter-raw-prefix - * [task_manager] Conver INFO messages to DEBUG - * [task_enrich] Standardize refresh identities log messages - * [sirmordred] Improve log messages related to task projects - * [mordred] Ignore INFO messages from elasticsearch - * [task_enrich] Change `last_enrich_date` value - * [dependencies] Remove manuscripts dependency - * [doc] Remove reference to `task_report` - * [mordred] Remove `task_report` - * [task_project] Prevent random shuffling of repos - * [doc] Remove reference to `track_items` - * [mordred] Remove `track_items` support - * [doc] Update kibiter version to 6.1.4-5 - * [tests] Minor enhancements on tests - * [sirmordred] Set default sleep_for value if sortinghat is undefined - * [task_identities] Remove useless inherited code - * [task_enrich] Prevent calling sortinghat when not defined - * [task] Handle missing sortinghat params - * [doc] Refine README.md introduction - - -# 0.2.31 - -Released: 2019-10-01 - -* Grimoire ELK - * [doc] Improve README.md info - * [enriched-gitlab] Include milestone id, iid and url - * Add graal to setup.py, which is now a dependency. - * [enriched-git] Add weekday and hour info to enriched commits - -* Perceval - * [gitlab] Set extra HTTP retry status from backend - * [jenkins] Handle skipped items info in summary - * [gitlab] Handle skipped items info in summary - * [gitlab] Use generic blacklist feature - * [jenkins] Replace blacklist-reviews with blacklist-ids - * [gerrit] Replace blacklist-reviews with blacklist-ids - * [backend] Add support for blacklisting items - * [errors] Add BackendCommandArgumentParserError - * [backend] Add origin unique field - * [backend] Change signature BackendCommandArgumentParser - -* Perceval-mozilla, Perceval-puppet, Perceval-opnfv, Perceval-finos - * [backend] Change signature BackendCommandArgumentParser - -* Sigils - * [gitlab] Update index pattern for merge requests - * [gitlab] Update index pattern for issues - -* Graal - * [graal] Update metadata fields - * [backend] Change signature BackendCommandArgumentParser - -* Manuscripts - * [manuscript] Fix flake8 errors - * [setup.cfg] Ignore W605 errors - * Added first line to make these files executable. - * [manuscripts] Update license and copyright info - * [setup] Fix format type for long description of package - -* SirMordred - * [README.md] Add projects.json section - * [utils] Comment arthur params in es-collection section - * [task_collection] Add filter-no-collection to ignore the collection - * [task_identities] Log number of organizations loaded - * [task_identities] Support lazy load of SH identities files - * [task_identities] Support lazy load of SH organizations - * [task_identities] Add `get_file_hash` function - -# 0.2.30 - -Released: 2019-09-18 - -* Grimoire ELK - * [tests] Fix demography test for gerrit - * [enriched-gerrit] Handle missing user information - * [enriched-onion] Filter bots from onion study - * fix num row error that GitHub complained about - * [enriched-aoc] Include origin in AOC items -* Perceval - * [backend] Add search fields in metadata items - * [backend] Write summary of results to the backend command log - * [backend] Fix typos in backend module documentation - * [tests] Generate different 'updated_on' values for backend tests - * [backend] Organize BackendItemsGenerator parameters - * [backend] Add BackendItemsGenerator context manager - * [backend] Include summary of fetch executions - * [perceval] Add summary class -* Sigils - * [demographics] Rename demographics_leaving_developers - * [meetup] Update index pattern -* SirMordred - * [task_panels] Add contact link inside the About item of the menu - * [task_projects] Remove projects_last_diff - * [doc] Update README.md with graal-related panels attributes - * [utils] Update conf files to use graal backends - - -# 0.2.29 - -Released: 2019-09-02 - -* Grimoire ELK - * [tests] Remove reference to ocean-unique-id - * [schema] Remove ocean-unique-id - * [raw-askbot] Remove fix_item - * [tests] Add main to test_load_identities - * [jenkins] Remove ocean-unique-id frmo schema - * [Jenkins] Update CSV schema for Jenkins -* Perceval - * [groupsio] Replace HTTP basic auth with cookies based auth (hace 52 minutos) - * [slack] Pass API token via headers - - -# 0.2.28 - -Released: 2019-08-29 - -* Grimoire ELK - * [enriched-git] Remove credentials from Git URLs - * [enriched-mediawiki] Remove identity/project info in get_rich_item - * [enriched-gerrit] Add status of gerrit changeset - * [enriched-gerrit] Handle negative time to first review - * [enriched-gerrit] Add time to first review patchsets - * [enriched-gerrit] Add time to first review - * [schema] Add mattermost schema - * [mattermost-enriched] Remove commented code - * [mattermost-enrich] Add channel name and creation date - * [logger] Add logs for study and Fix CoLic query - * [colic] Add category reference implementation and corresponding tests - * [tests:study] Add tests for CoCom & CoLic study implementation - * [schema] Add CoCom and CoLic schema - * [graal:tests] Add appropriate tests for Graal integration (WIP) - * [graal] Add connector for Graal Backends and Segregate common methods - * [graal] Add CoCom & CoLic enricher along with study implementation - * [requirements.txt] Add Graal module dependency for integration - * [dependencies] Update pandas dependency to 0.22.0 - * [meetup] Store `group_created` as date - * Fix outdated link to GrimoireLab tutorial - * [schema] Add time_to_first_attention to github_issues.csv -* Graal - * [graal] Force checkout command - * [colic] Filter softlinks from analysis - * [colic] Filter dir paths from analysis - * [analyzer] Add `diff_timeout` param to cloc analyzer - * [analyzers] Suppress deprecation warning lizard.analyze_file - * [docs] Update CoLic definition under documentation adn docstrings - * [colic] Add copyright flag for extraction of copyright information - * [cloc] Fix cloc error due to mulitple word language-name - * [graal] Update license info - * [setup] Fix format type for long description of package - * [tests] Fix test_init in test_graal - * [analyzer] Fix scancode_cli results - * [docs] Update documentation and links to requirements - * [cocom] Add repository level analysis via lizard - * [analyzer] Fix results for deleted files and alter tests - * [logger] Switch `info` logger level to `debug` - * [tests] Add test for deriving `git_path` from `uri` - * [graal] Derive `git_path` from `uri` -* KingArthur - * Update to RQ 1.0 -* Perceval - * [meetup] Pass oauth2 token via headers - * [tests] Increase test coverage mattermost - * [mattermost] Add channel info - * [github] Add example to initialize backend from code - * [tests] Fix metadata_updated_on of MockedBackend - * [dependency] Unpin httpretty dependency - * [doc] Remove httpretty details from Running tests section -* Sigils - * [gerrit_timing] Add time to first review info - * [gerrit] Update index pattern - * [mattermost] Add channel visualization - * [docs] Add CoCom & CoLic documentation - * [graal] Add Code License(CoLic) panels - * [graal] Add Code Complexity(CoCom) panels -* SirMordred - * [mordred] Update redis dependency - * [doc] Add section to set up dev env with Pycharm - * [doc] Update doc getting started - * [requirements] Add Graal module to requirements.txt - * [graal] Add configuration for Graal integration in ELK - * [tests] Add gerrit and its study sections - * [doc] Improve doc about `github-repos` param in panels section - * [doc] State Elasticsearch, Kibiter, MySQL/MariaDB versions - * [tests] Clean requirements.txt - * [setup] Remove dependencies installed by other components - * [tests] Clean travis.yml - - -# 0.2.27 - -Released: 2019-07-23 - -* Grimoire ELK - * [enriched-enrich] Handle errors in demography study - * [schema] Update Jira csv - * [enriched-jira] Track creator, assignee, reporter in issues - * [enriched-jira] Handle missing identity data - * [enriched-github] Set roles to allow refresh identities -* KingArthur - * [writers] Ignore Elasticsearch certificate verification - * [scheduler] Schedule task jobs in user-defined queues - * [tasks] Add queue parameter to scheduler config - * [scheduler] Set to completed tasks with expired lifetime - * [tasks] Add task lifetime attribute - * [tests] Fix server tests with non-real repositories - * [server] Publish task information - * [tasks] Use datetime_utcnow() when creating tasks - * [jobs] Add funtion to convert job results to dicts - * [scheduler] Set infinite time-to-live for jobs and results - * [scheduler] Update task jobs list when a job is enqueued - * [tasks] Add attribute to Task to store its list of jobs - * [scheduler] Handle starting job events - * [events] Add task identifier to job event class - * [events] Add event to notify when a job starts - * [events] Remove handlers initialization in JobEventsListener - * [scheduler] Refactor event handlers - * [writers] Update dynamic templates - * Install Arthur using pip in TravisCI - * [scheduler] Rename task scheduler public methods - * [scheduler] Delegate queue selection to the task scheduler - * [scheduler] Refactor private class JobScheduler in a TaskScheduler - * [scheduler] Update tasks status during its life cycle - * [tasks] Define task life cycle - * [events] Allow job events subscription - * [events] Add basic job events - * [events] Extract job listener to create a job events listener - * [README] Fix coveralls badge - * Update for rq async parameter rename, pin rq to 0.12.0 -* Perceval - * [gitlab] Recalculate outdated list of merge requests - * [slack] Handle `num_members` for archived channels - * [jenkins] Support authenticated access using user/API token - * [client] Add `auth` param to fetch method -* Sigils - * [affiliations] Udate index pattern - * [jira] Update panels to new index structure - * Update index patterns to add analyzed fields - * [meetup] Update index pattern to fix dates -* SortingHat - * [setup] Set pandas dep version to 0.22.0 - * [sortinghat] Update copyright info - * [setup] Pin pandas dependency - - -# 0.2.26 - -Released: 2019-07-08 - -* Grimoire ELK - * [mediawiki] Fix grimoire_creation_date calculation - * removed .DS_Store - * Added check so that program does not break if aliases is None - * [raw-bugzillarest] Set text mapping type for changes attributes - * [elk] Add option to fetch from selected branches - * [elk] Return error msg from `feed_backend` - * [elastic] Use InvalidDateError in `get_last_item_field` - * [ELK] Make explicit indexing when mapping is of text type - * [enriched-redmine] Use grimoirelab-toolkit datetime functions - * [enriched-redmine] Add text mapping - * [enriched-mozillaclub] Add text mapping - * [enriched-mediawiki] Use grimoirelab-toolkit datetime functions - * [enriched-mediawiki] Add text mapping - * [enriched-jira] Add text mapping - * [enriched-gerrit] Add text mapping - * [enriched-discourse] Add text mapping - * [enriched-bugzillarest] Use grimoirelab-toolkit datetime functions - * [enriched-bugzillarest] Add text mapping - * [enriched-bugzilla] Use grimoirelab-toolkit datetime functions - * [enriched-bugzilla] Add text mapping - * [elk] Use grimoirelab-toolkit datetime functions - * [enriched-utils] Remove function `unixtime_to_datetime` - * Update description of time_open_days and time_to_close_days - * [enriched-meetup] Store created, time, updated as date - * [ELK] Update variable from KEYWORD_MAX_SIZE to KEYWORD_MAX_LENGTH - * [enriched-enrich] Decrease max keyword size -* Perceval - * [git] Add proxy support to git clone command - * [mediawiki] Skip page without `pageid` attribute - * [gitlab] Update description for --is-oauth-token - * [meetup] Enable oauth token use -* Sigils - * [twitter] Add bots filter to panel - * [stackoverflow] Add bots filter to panel - * [slack] Add bots filter to the panel - * [rss] Add bots filter to panel - * [mozilla-reps] Add bots filter to panels - * [redmine] Add bots filter to redmine panels - * [mozillaclub] Add bots filter to panel - * [meetup] Add bots filter to Meetup panels - * [mediawiki] Add bots filter to panel - * [mbox] Add bots filter to mailing lists panel - * [maniphest] Add bots filter to panels - * [chaoss-gmd] Add bots filter to panels - * [git] Add bots filter to lifecycle panel - * [jira] Add bots filter to Jira panels - * [irc] Add bots filter - * [gitlab] Add bots filter to Issues and MRs panels - * [github] Add bots filter to Issues and PRs panels - * [git] Add bots filter to Git demographics panel - * [gerrit] Add bots filter and fix backlog panel - * [discourse] Add bots filter to panel - * [demographics] Add bots filter to panel - * [confluence] Add bots filter to panel - * [bugzilla] Add bots filter to bugzilla panels - * [askbot] Add bots filter to panel - * Set the right screenshot - * [affiliations] Fix label affiliations_authors_organizations chart -* SirMordred - * [tests] Add mysql service to .travis.yml - * [tests] Update slack archive - * [task_collection] Return errors info for task collection - - -# 0.2.25 - -Released: 2019-06-23 - -* Grimoire ELK - * [raw-jira] Handle data.fields.environment in raw indexes -* Perceval - * [README] Add info to obtain a Groups.io API token - * [groupsio] Improve documentation to obtain an API token - * [groupsio] Fix description `api_token` - * [groupsio] Fix invalid value for 'limit' in subscriptions query -* Sigils - * Add how to import panel into Kibana/Kibiter - * [gerrit] Update index pattern -* SirMordred - * [task_enrich] Populate identities index only when retetion is on - - -# 0.2.24 - -Released: 2019-06-07 - -* Grimoire ELK - * [raw-bugzillarest] Handle description longer than 32766 chars - * [raw-slack] Fix illegal_argument_exception for data.blocks.elements.text - * [enriched-enrich] Reduce number of log messages on identity retrieval -* SirMordred - * Fix README.md so that the package is admitted by pypi - - -# 0.2.22 - -Released: 2019-05-31 - -* Graal - * Added to GrimoireLab release -* Grimoire ELK - * [tests] Update elasticsearch and elasticsearchdsl versions - * [dependencies] Update urllib3 and requests dependencies - * [enriched] Use RequestsHttpConnection in Elasticsearch objs - * [dependencies] Pin urllib3 and requests dependencies - * [schema] Add `repository_labels` attribute - * [enriched] Add repo labels support to enrichers - * [elk] Add repo_labels param - * [elastic_items] Extract repository labels from projects.json - * [enriched-github] Filter review comments from ghost users - * [schema] Specify where each author field come from - * [schema] Add CSV documenting Github PRs index - * [enriched-confluence] Add email data to SH identity -* Perceval - * [gitlab] Force UTF-8 encoding on response contents -* SirMordred - * [task_enrich] Add log INFO messages - * [task_enrich] Fix elasticsearch.exceptions.SSLError: ConnectionError - * [task_enrich] Add support for repository labeling - * [task_collection] Add support for repository labeling - * [task] Add support for repository labeling - * [utils] Add example of grimoirelab identities file - * [utils-micro] Add support to load identities in micro - * [micro] Fix logging configuration at module scope -* SortingHat - * [parsing:grimoirelab] Add support to parse a blacklist - * Update languages and typos in the README - - -# 0.2.21 - -Released: 2019-05-20 - -* Grimoire ELK - * [enriched-gerrit] Enable refresh identities - * [enriched-gerrit] Add ELK metadata to enriched items - * [raw-slack] Remove channel_info.previous_names attribute - * [enriched-jira] Handle enriched items from multiple jiras -* Perceval - * [slack] Handle timestamps with more than 6 decimals - * [gitlab] Add support for Gitlab Oauth tokens - * [github] Handle pull request reviewers in Enterprise API - - -# 0.2.20 - -Released: 2019-05-13 - -* Grimoire ELK - * [enriched-git] Add log info to enrich_git_branches - * [schema] Add milestone start and due dates to gitlab schemas - * [enriched-gitlab] Add milestone start and due dates - * [enriched-mediawiki] Add `grimoire_creation_date` field - * [enriched-gerrit] Handle gerrit items from multiple servers -* Kidash - * Add viz title to data source removal checks -* Perceval - * [github] Set number of issues/pull requests fetched per page - * [gitlab] Handle missing attr `last` in pagination response -* Sigils - * [gitlab-merge-requests] Update index pattern - * [gitlab-issues] Update index pattern - * [overview] Update mediawiki panels in overview - * [mediawiki] Use grimoire_creation_date in panel and search - * [overview] Use `grimoire_creation_date` in overview panel - * [github] Use grimoire_creation_date in issue panels - * [github] Use grimoire_creation_date in pull request panels - * [Redmine] Update time field - * [gitlab] Update timelion charts in efficiency panel for issues - * [gitlab] Rename index pattern for issues - * [jira] Use grimoire_creation_date -* SirMordred - * [alias] Remove gitlab alias - * [requirements] Fix elasticsearch dependency versions - * [tests] Fix assertion in test_config - * [tests] Update archives for github pulls and issues - * [aliases.json] Rename alias for gitlab issues - - -# 0.2.19 - -Released: 2019-05-06 - -* Grimoire ELK - * [schema] Update gerrit.csv - * [enriched-gerrit] Add type attribute to changeset items - * [enriched-gerrit] Rename `number` attribute to `changeset_number` - * [enriched-gerrit] Add changeset author info to enriched items - * [enrich-gerrit] Add common field to count review-related items - * [enriched-gerrit] Update attribute names (hace 3 días) - * [tests] Enhance test for gerrit enriched items - * [enriched-gerrit] Add patchset approvals as enriched items - * [enriched-gerrit] Add patchsets as enriched items - * [enriched-gerrit] Add comments as enriched items - * [enriched-git] Add study to process git branches - * [enriched-discourse] Force type of score attribute to float - * [schema] Update functest schema with `duration_from_api` attribute - * [tests] Check duration assessment for functest enriched items - * [enriched-functest] Change duration assessment - * [tests] Update tests for functest enriched items - * [enriched-functest] Handle no float duration times - * [enriched-study-ceres-aoc] Limit search size to 500 -* Perceval - * [github] Include reviews in pull request data -* Sigils - * [gerrit] Add panel with approvals - * [gerrit] Update panels to support the new index - * [functest] Update index pattern - * [Maniphest] Update time field -* SirMordred - * [menu.yml] Add gerrit approvals panel - * [tests] Include enrich_git_branches to test_studies.cfg - * [config] Add study to process git branches - - -# 0.2.18 - -Released: 2019-04-26 - -* Grimoire ELK - * [requirements.txt] Constrain elasticsearch-related dependencies - * [setup.py] Constrain elasticsearch-related dependencies -* Perceval - * [backend] Add backend-specific options for --category in helptext -* Perceval FINOS - * [finosmeetings] Update argument parser to display categories in help message - * Update Perceval requirement to 0.12.12 or later -* Perceval Mozilla - * Update Perceval requirement to 0.12.12 or later - * [backends] Include available category options in the helptext -* Perceval OPNFV - * Update Perceval requirement to 0.12.12 or later - * [setup.py] Minor update to avoid flake8 error - * [functest] Include available category options in the helptext -* Perceval Puppet - * Update Perceval requirement to 0.12.12 or later - * [setup.py] Minor update to avoid flake8 error - * [puppetforge] Include available category options in the helptext - - -# 0.2.17 - -Released: 2019-04-22 - -* Grimoire ELK - * [aoc] Update write method to upload smaller lists - * [enriched-bugzillarest] Change logic to calculate `timeopen_days` - * [enriched] Add metadata filter raw to enriched items - * [elk] Use filter raw info to assess last enrich date - * [enriched-enrich] Add `metadata_filter_raw` method - * [enriched-utils] Add filter raw text to retrive last enrich date - * [enriched-utils] Fix last enrich date calculation -* Perceval - * [doc] Update help messages for "from-date" and "to-date" params -* Sigils - * Update Jira panel documentation - * Update Jira panels to support index with comments - - -# 0.2.16 - -Released: 2019-04-11 - -* Grimoire ELK - * [raw-jira] Update raw mapping to avoid immense term errors - * [enriched-enrich] Refactor `find_item_project` method - * [elk] Set value of `projects_json_repo` during enrichment - * [elk] Set value of `projects_json_repo` during collection - * [elastic_items] Add method `set_projects_json_repo` - * [elastic] Check presence of `properties` in mappings - * [enriched-jira] Add comments to enriched index - * [elastic_items] Handle commas in filter-raw - * [enriched-gerrit] Use grimoirelab-toolkit calls - * [elk] Handle empty sh uuid attributes - * [enriched-git] Fix handling rev-list command error - * Update row with missing aggregatable value -* Perceval - * [tests] Increase test coverage of Jira backend - * [jira] Add comments in issues - * [github] Handle ghost user in pull request comment - * [doc] Update documentation for github and gitlab backends -* SirMordred - * [tests] Update jira archive - * [task_enrich] Pass projects.json repo url to ELK - * [task_collection] Pass projects.json repo url to ELK - - -# 0.2.15 - -Released: 2019-04-03 - -* Grimoire ELK - * [enrich-meetup] Avoid failures when 'rsvps' field is not available - * [enrich-git] Handle rev-list command failures - * [enriched] Fix missing ancestor title in confluence enriched items - * [elk] A * dd methods to delete identities - * [sortinghat_gelk] Add method `unique_identities` - * [sortinghat_gelk] Add method `remove_identity` - * [elk] Fix docstring in `do_studies` method - * [enriched] Add function `get_diff_current_date` to utils - * [utils] Add param mapping to `get_elastic` - * [sortinghat_gelk] Add method to remove unique identities - * [elk] Retain identities based on identities index data - * [elk] Store identities in use in dedicated index - * [elastic] Refactor method `delete_items` -* Perceval - * [meetup] Add 'rsvp', 'venue', and 'event_hosts' as classified fields - * [update] Remove unused imports -* Perceval Mozilla - * Update Perceval dependency to 0.12.8 - * [remo] Add 'filter_classified' parameter to metadata() - * [kitsune] Add 'filter_classified' parameter to metadata() -* SirMordred - * [doc] Fix missing --cfg param for micro mordred example - * [task_enrich] Support retain identities - * [config] Add method `get_active_data_sources` - * [sirmordred] Replace `retention_hours` with `retention_time` - * YAMLLoadWarning solved - - -# 0.2.14 - -Released: 2019-03-27 - -* Grimoire ELK - * [tests] Update finosmeetings test data -* Perceval FINOS - * [finosmeetings] Handle cm_type column - * [doc] Fix typo in README installation section -* Sigils - * [docs] Fix broken links in docs - * [jira] Add documentation about Jira panel - * [jira] Fix mislabeled "Submitters by Organization" pie visualization - * [github] Add repositories popularity panel - * Update demographics help markdown - - -# 0.2.13 - -Released: 2019-03-27 - -* Grimoire ELK - * [finosmeetings] Change project value to cm_title - - -# 0.2.12 - -Released: 2019-03-26 - -* Grimoire ELK - * [meetup-enriched] Prevent to access filter-classified attributes - * [elk] Handle filter-classified param - * [enriched] Set project name to cm_program for finosmeetings enrich - * [enriched] Add sortinghat identities info to finosmeetings - * [enrich] Prevent timeout when using ElasticSearch DSL - * [enriched] Fix `Too many dynamic script compilations` in git enrich - * [jira] Handle missing fields during the enrichment - * [jira] Handle multiple type values in `release` attribute during enrichment - * [stackexchange] Handle missing `answer_tags` - * [enriched] Apply retry mechanism HTTP 504 errors -* Perceval - * [tests] Increase test coverage for confluence backend - * [confluence] Fix typo in in-line comment - * [confluence] Skip contents if 'when' attribute is missing - * [meetup] Add 'group.topics' to the list of classified fields - * [backend] Allow to filter classified fields from the command line - * [backend] Add 'filter-classified' option to the backend argument parser - * [backend] Add 'filter_classified' parameter to fetch() function - * [backend] Support filtering of classified fields in Backend class - * [git] Fix `rev-list` call with `--max-count` - * [doc] Update docstring for `sleep_time` param - * [discourse] Add params `sleep_time` and ` max_retries` - * [discourse] Add tests for sleep_time and max_retries params - * [discourse] Complete raise statements in test code - * [discourse] Remove redundant parenthesis in test methods - * [github] Add support for GitHub tokens pool -* SirMordred - * [utils] Update setup.cfg and projects.json of micro-mordred - * [task_panels] Order dashboards by name - * [doc] Update documention for panels section - * [menu.yml] Add export panel to Jenkins - * [task_panels] Upload github repos panels - * [tests] Update aliases.json in tests folder - * [config] Add param to upload github-repo panels - * [aliases] Add raw and enrich aliases for github:repo -* Sortinghat - * [parsing] Fix YAMLLoadWarning for grimoirelab parser - - -# 0.2.11 - -Released: 2019-03-21 - -* Grimoire ELK - * [tests] Update finosmeetrings backend test to the new schema -* Perceval FINOS - * [finosmeetings] Rename activity and program fields -* SirMordred - * [task_projects] Prevent enrich unknown projects when declared also in other projects - - -# 0.2.10 - -Released: 2019-03-20 - -* Grimoire ELK - * [utils] Change assessment of last enrich date - - -# 0.2.9 - -Released: 2019-03-19 - -* Grimoire ELK - * [enrich-github] Add url field to enriched repository items - * [utils] Use `last_enrich_date` for incremental enrichment - * [elk] Add `last_enrich_date` to enrich_backend method - * [elastic_items] Add set_from_date method - * [schema] Add demography fields to Git -* SirMordred - * [task_enrich] Pass the last timestamp of the index before enrichment - - -# 0.2.8 - -Released: 2019-03-15 - -* Grimoire ELK - * [enrich] Change mappings to convert `date` field to keyword - * [raw] Change mappings to convert `date` field to keyword - * [ELK] Rename finos_meetings to finosmeetings - * [tests] Add tests for finosmeetings - * [enrich] Add connector for finosmeetings - * [raw] Add connector for finosmeetings - * [utils] Add connector for finosmeetings Perceval backend - * [setup] Add perceval-finos to install_requires list - * [requirements] Add perceval-finos to requirements.txt -* Perceval FINOS - * [finosmeetings] Fix docstrings and flake8 - * [finosmeetings] Change UUID calculation - * [finosmeetings] Add `date_iso_format` attribute - * [finosmeeting] Add backend to index FINOS meetings attendance - * Fix typo in FINOS name (hace 2 días) - * Initial import -* SirMordred - * [doc] Add section getting started in README.md - * [aliases] Add aliases for raw and enrich finosmeetings indexes - * [requirements] Add perceval-finos to requirements.txt - - -# 0.2.7 - -Released: 2019-03-12 - -* Grimoire ELK - * [utils] Add missing header to run scripts as Python scripts - * [enriched] Update `get_project_repository` for bugzilla enricher - * [enrich] Assign default project name to repos in unknown section - * [enriched] Remove `get_item_project` for bugzillarest enricher - * [elk] Add filter raw info to enrich backend -* SirMordred - * [tests] Add tests for `get_repos_by_backend_section` in TaskProjects - * [task_projects] Refactor `get_repos_by_backend_section` - - -# 0.2.6 - -Released: 2019-03-11 - -* Grimoire ELK - * [enrich] Add onion study to gerrit - * [p2o] Add None value for param `cfg_section_name` to p2o - * [enrich-confluence] Add ancestors data to enriched items - * [enriched] Add refresh param to update_by_query and delete_by_query - * [elk] Apply data retention policy to study indexes - * [utils] Set default value for variable analyzers - * [elastic] Add method `delete_items` - * [elk] Remove filter-raw-* for enrich backend - * [enriched] Handle hidden editors in mediawiki revisions - * [raw] Prevent mapping of data.ancestors.extensions for confluence raw items - * [elastic_items] Support for filter-raw-prefix - * [enrich] Remove raw filters when getting last enriched item - * [elk] Remove logic to create filters - * [elastic_items] Support filter on multiple attributes - * [raw] Remove `get_p2o_params_from_url` from Jira raw connector - * [raw] Remove `get_p2o_params_from_url` from Confluence raw connector - * [raw] Remove `get_p2o_params_from_url` from Bugzilla raw connector - * [raw] Remove `get_p2o_params_from_url` from Askbot raw connector - * [raw] Remove `get_p2o_params_from_url` from Gerrit raw connector - * [raw] Remove `get_p2o_params_from_url` from Git raw connector - * [tests] Add tests for `get_p2o_params_from_url` method - * [raw] Parse filters passed in the projects.json entries - * [enriched] Handle 502 and 503 errors - * [schema] Update jira.csv - * [enrich] Add updated field to Jira items - * [schema] Update gerrit.csv - * [enrich] Add last_updated and created_on to gerrit items - * [enrich] Add retry on status forcelist to ES connector - * [enrich] Update branch info in git commits - * [tests] Add tests for parsing projects.json in Jira raw connector - * [raw] Handle filter raw for jira - * [raw] Handle filter raw for confluence - * [schema] Add schema for GitHub repo data - * [enrich] Support enrichment of GitHub repo data - * [enrich] Handle Perceval errors on Git repo when updating items - * Revert "[enrich] Update Git references data in raw and enriched indexes" - * Revert "[schema] Update Git schema to include refs info" - * [schema] Update Git schema to include refs info - * [enrich] Update Git references data in raw and enriched indexes - * [utils] Move p2o description to main - * [utils] Move index_mapping description to main - * [utils] Move gh2k description to main - * [utils] Move gh2arthur description to main - * [utils] Move get_git_repos description to main - * [utils] Move gelk_mapping description to main - * [utils] Move gelk description to main - * [utils] Move e2k description to main - * [ELK] Update license info - * [tests] Update tests for mbox-related enrichers - * [schema] Update mbox csv - * [enrich] Add mbox_author_domain to mbox data -* Perceval - * [confluence] Extend Perceval Confluence backend to index ancestor pages - * [github] Add 'repository' category to fetch metadata from repositories - * [perceval] Update license info -* Sigils - * [jira] Add painless field that computes time of issues on the fly - * [github] Add delay with painless field to GH Issues panels - * [gerrit] Update gerrit panels adding delay with painless field - * [github] Add delay with painless field to GH Pull Requests panels - * Update onion panels and their documentation - * Address changes requested in #339 - * Add Jenkins Job Categories panel - * Add new version of emtech adoption without crates -* SirMordred - * [config] Allow None default value for int config param - * [task_enrich] Enable data retention policy after enrichment phase - * [task_collection] Enable data retention policy after collection phase - * [task] Delete data based on retation_hours param - * [doc] Add description for`retention_hours` param - * [config] Add param `retention_hours` - * [task_collection] Improve doc for filter-raw param - * [task] Refactor logic to process --filter-* params - * [tests] Fix tests after modification in perceval - * [task_enrich] Modify p2o filters-prefix params - * Add jenkins job categories panel to `menu.yml` - - -# 0.2.5 - -Released: 2019-02-13 - - -* Grimoire ELK - * [studies] Add origin based enrichment in AOC - * [elastic_items] Update ES query for incremental enrichment - * [utils] Handle `get_last_enrich` with raw filters - * [elastic] Handle multiple filters for last date of enriched items -* Toolkit - * [dependency] Update python-dateutil to 2.8.0 - - -# 0.2.4 - -Released: 2019-02-06 - -* Cereslib - * [enrich] Add .go as extension for the Go programming language -* Grimoire ELK - * Remove alias in use check for onion - * [elastic] Change log level message when alias is already in use - * [elk] Set filter raw in enrich connector - * [enrich] Allow to assign project to filtered repos - * [raw] Enable filter raw for Gerrit data source - * [git] Improve log messages when updating git commits data - * [elastic_items] Modify `fetch` method to collect all documents - * [git] Remove deleted commits from raw and enriched indexes - * [raw] Allow to perform update operations over a raw index - * [enrich] Allow to update enriched items -* Hatstall - * Update docs in order to add the env variables of docker deployment - * Link apache2 logs files to stderr and stdout -* KingArthur - * [worker] Remove unnecessary RQ connection management in ArthurWorker - * [tests] Repair some flake8 warnings - * [arthur] Add PUBSUB channel name specification -* Perceval - * [git] Add rev-list command to GitRepository class - * [tests] Add tests to check fetch without update - * [git] Allow fetch without update repo - * [phabricator] Move extra_status_force_list to Client class variable - * [meetup] Move extra_status_force_list to Client class variable - * [jenkins] Move extra_status_force_list to Client class variable - * [googlehits] Move extra_status_force_list to Client class variable - * [tests] Add test about retry error for GitHub - * [github] Handle upstream server connection problems -* Sigils - * Update StackOverflow index pattern and panel - * [chaoss-gmd] Fix screenshots for CHAOSS GMD collection - * [jira-backlog] Change label project to repo in Backlog visualization - * [jira-timing] Replace attribute project_name with project - * [jira-effort] Change label Project with Repository - * [jira] Replace project_name with project for jira_repositories viz - * Fix merges filter - * Updating new changes for the panel - * Update panel and documentation for PR merge duration panel - * Add documentation for pr merge duration panel - * Add pull request merge duration new panel - * Add screenshots and update front matter for sigils - * Remove word 'legacy' from Sigils title - * Add styles to doc pages - * [CHAOSS GMD] Update widgets in the panel according to the review - * [CHAOSS GMD] Add maintainer response to merge request duration - * Add help markdown widget to git demographics panel - * Add help markdown widget to demographics panel - * [doc][chaoss-gmd] Fix panel creation date - * [chaoss][doc] Add documentation for Lines of Code Changed panel - * [chaoss] Add Lines of Code Changed panel - * [doc] Fix front matter for pull requests merged -* SirMordred - * [doc] Add documentation about micro-mordred - * [config] Fix flake8 error - * [mordred] Remove global data sources param - * [doc] Add description for global_data_sources param - * [mordred] Update way of accessing global data sources - * [task_projects] Allow to accept list of global source - * [config] Make global data sources configurable from cfg - * [task_identities] Log message when orgs_file is not found on disk -* SortingHat - * [sortinghat] Fix deprecation warning for SafeConfigParser - * Fix a few grammatical errors in README.md (#181) - - -# 0.2.3 - -Released: 2019-01-10 - -* Grimoire ELK - * [elastic] Change log message level when inserting data to ES - * [sortinghat_elk] Include stacktrace in log message for unknown exception - * [elk] Include stacktrace in log message - * [tests] Delete onion index after test execution - * [elastic] Change log message level when alias already exists - * [enrich] Prevent adding DEMOGRAPHICS alias if already in use - * [enrich] Prevent adding ONION alias if already in use - * [git-enrich] Prevent adding AOC alias if already in use - * [enrich] Use the cfg section name to retrieve project name - * [elk] propagate cfg section name from mordred to ELK - * [elastic_items] Store value of the cfg section name - * Update github_issues.csv - * Update github_issues.csv - * Documentation added on github_issues.csv -* Hatstall - * Change redirections to the Django urls standard - * Redirect to the profile where the others profiles are merged - * Decrease minlength of the identities search input to 2 characters - * Show error when an uuid does not belong to a profile -* Perceval - * [github] Support `to-date` parameter in GitHub backend -* Sigils - * [affiliations] Set limit author entries due to performance issues - * [doc] Update Gerrit Efficiency panel documentation - * [efficiency] Specify Lead Time unit on Gerrit panel - * [doc] Update GitLab Efficiency panels documentation - * [doc] Update GitHub Efficiency panels documentation - * [efficiency] Specify Lead Time unit on both GitHub panels - * Add recommendations on how to create a panel - * Add info on how to use Jekyll with GitHub pages - * Update front matter - * Fix wrong links - * Update contributing guidelines - * [doc] Update screenshot for GitLab MRs Efficiency panel - * [efficiency] Add efficiency panel for GitLab merge requests - * [doc] Add documentation for GitLab merge requests efficiency panel - * [doc] Add documentation for GitLab issues efficiency panel - * [efficiency] Add efficiency panel for GitLab issues - * Fix link URL to CSV schema files in README.md - * Update sample documentation file - * [docs] Add markdown for Pull Requests Merged panel - * [chaoss] Add pull requests merged panel - * [git] Add lifecycle panel - * Add lifecycle.jpg - * Create lifecycle.md -* SirMordred - * [task] Remove credentials from URLs - * [task_panels] Add log message when kibiter is not reachable - * [task_panels] Replace urljoin with urijoin - * [task_enrich] Propagate cfg section name to ELK - * [task_panels] Add GitLab efficiency panels - * [menu] Add Git Lifecycle panel -* SortingHat - * [cmd:autoprofile] Fix expected string or bytes-like object error - - -# 0.2.2 - -Released: 2018-12-11 - -* Grimoire ELK - * [csv] Update gitlab merges schema - * [enrich-gitlab] Add time fields info -* KingArthur - * Fix package requirements - * Update requirements file due incompatible versions of RQ and Redis -* Manuscripts - * [manuscript] add chinese package - * Write notice message when the 'Process' section is empty -* Sigils - * [data-status] Add remo events and activities information -* SirMordred - * [doc] Update documentation of setup.cfg params - * [micro] Update micro setup.cfg - * [task_panels] Read menu.yaml from setup.cfg - * [config] Add menu_file param - - -# 0.2.1 - -Released: 2018-12-04 - -* Cereslib - * [tests] Update FilePath test code - * [enrich] Prepend file dir paths with slash -* Grimoire ELK - * [schemas] Fix GitLab CSVs to add missing columns - * [enrich-gitlab] Add doc for `time_to_close_days` and `time_to_merge_days` - * [enrich-gitlab] Fix `merged` attribute calculation - * [enrich-gitlab] Update calculation of `time_to_close_days` - * [elastic] Prevent add alias if already in use in ES -* Perceval - * [gitlab] Add retry on 503 HTTP error -* Sigils - * [docs] Fix page titles - * [docs] Remove theme - * [docs] Update local links - * [docs] Remove old documentation - * [docs] Add Jekyll based documentation - * Ignore Jekyll and Ruby related files - * [gitlab] Sync MRs index pattern title with SirMordred aliases - * [git] Update Git Demographics panel -* SortingHat - * [cmd:autoprofile] Avoid to set email addresses in name profile - - -# 0.2.0 - -Released: 2018-11-19 - -* Cereslib - * Fix date parsing errors using grimoirelab-toolkit -* Grimoire ELK - * [flake8] Add W503 to ignore list - * [studies] Improve log lines prefix - * (alpgarcia/master) [enrich] Use grimoirelab-toolkit methods - * [utils] Avoid enriching items over and over - * [enrich] Prevent find identities for none ids - * [schema] Update type for id in discouse.csv - * [enrich-askbot] Fix typo in enrich_items - * [schema] Update askbot csv - * [enrich-askbot] Update id attribute mapping - * [tests] Remove credentials info from log messages - * [enriched] Remove credentials info from log messages - * [ell] Remove credentials info from log messages - * [elastic_items] Remove credentials info from log messages - * [elastic] Add `anonymize_url` method - * [tests] Add tests for alias management - * [enrich-git] Use global variable for aoc alias - * [utils] Handle alias management - * [elk] Handle alias management - * [elastic] Support alias management - * [enrich] Remove logic to add aliases - * [elk] Refactor `refresh_identities` - * [enrich-github] Change mapping type of state attribute - * [enrich-gerrit] Change mapping type of status attribute - * [gitlab-raw] Fix mappings to avoid immense term exception - * [enrich-github] Fix attribute repository - * [elastic_items] Handle none page - * [raw-gitlab] Allow passing blacklisted items from projects.json - * [enrich-askbot] Refactor logic to enrich items - * [enrich-crates] Replace list with yield - * [enrich-phabricator] Replace list with yield - * [enrich-puppetforge] Replace list with yield - * [tests] Add method to check value has_identities - * [enrich-mediawiki] Remove `has_identities` method - * [schema] Update stackoverflow csv - * [enrich-stackexchange] Reorganize tags fields -* Hatstall - * Hide identities that does not have profile -* Kibiter - * Synchronized with Kibana 6.1.4 -* Perceval - * Updating instructions for querying stackexchange in README - * [gitlab] Fix `has_resuming` method -* Sigils - * [slack] Fix duplicates due to the avatar in top participants table - * [stackoverflow] Update field for question tags - * [affiliations] Add affiliations panel for kibana 6 - * [doc] Add GitHub and Gerrit efficiency docs - * [efficiency] Add panels for GitHub and Gerrit - * [mediawiki] Add Mediawiki panel doc - * [mediawiki] Add projects table in Mediawiki panel -* SirMordred - * [tests] Update setup.cfg with aliases_file param - * [task_enrich] Load aliases path from cfg param - * [task_collection] Load aliases path from cfg param - * [task] Load aliases.json file from variable path - * [config] Add aliases.json path in general cfg section - * Fix error importing old TaskPanelsAliases object - * [micro] Remove reference to TaskPanelsAliases - * [task_enrich] Remove reference of TaskPanelsAliases - * [sirmordred] Remove references to TaskPanelsAliases - * [task_panels] Remove TaskPanelsAliases task - * [sirmordred] Add aliases.json file - * [task_enrich] Extend enrich_backend method for alias management - * [task_collection] Extend feed_backend method for alias management - * [task] Read aliases from file - * [task-enrich] Refactor `refresh_identities` - * Reorder Gitlab panels putting them before Community panels - * Update metadashboard structure according to the new menu - * Unify the log debug messages printed by the threads - * Add the origin to the log messages both for data collection and enrichment - * Change logging level for Perceval and GrimoireELK and disable their logging files - * [menu] Add efficiency panels for GitHub and Gerrit -* SortingHat - * [api] Optimize how last modified identities are retrieved diff --git a/releases/latest b/releases/latest index d4981aec..5d80fb82 120000 --- a/releases/latest +++ b/releases/latest @@ -1 +1 @@ -0.2.69 \ No newline at end of file +old/0.3.0 \ No newline at end of file diff --git a/releases/0.2.0 b/releases/old/0.2.0 similarity index 100% rename from releases/0.2.0 rename to releases/old/0.2.0 diff --git a/releases/0.2.1 b/releases/old/0.2.1 similarity index 100% rename from releases/0.2.1 rename to releases/old/0.2.1 diff --git a/releases/0.2.10 b/releases/old/0.2.10 similarity index 100% rename from releases/0.2.10 rename to releases/old/0.2.10 diff --git a/releases/0.2.11 b/releases/old/0.2.11 similarity index 100% rename from releases/0.2.11 rename to releases/old/0.2.11 diff --git a/releases/0.2.12 b/releases/old/0.2.12 similarity index 100% rename from releases/0.2.12 rename to releases/old/0.2.12 diff --git a/releases/0.2.13 b/releases/old/0.2.13 similarity index 100% rename from releases/0.2.13 rename to releases/old/0.2.13 diff --git a/releases/0.2.14 b/releases/old/0.2.14 similarity index 100% rename from releases/0.2.14 rename to releases/old/0.2.14 diff --git a/releases/0.2.15 b/releases/old/0.2.15 similarity index 100% rename from releases/0.2.15 rename to releases/old/0.2.15 diff --git a/releases/0.2.16 b/releases/old/0.2.16 similarity index 100% rename from releases/0.2.16 rename to releases/old/0.2.16 diff --git a/releases/0.2.17 b/releases/old/0.2.17 similarity index 100% rename from releases/0.2.17 rename to releases/old/0.2.17 diff --git a/releases/0.2.18 b/releases/old/0.2.18 similarity index 100% rename from releases/0.2.18 rename to releases/old/0.2.18 diff --git a/releases/0.2.19 b/releases/old/0.2.19 similarity index 100% rename from releases/0.2.19 rename to releases/old/0.2.19 diff --git a/releases/0.2.2 b/releases/old/0.2.2 similarity index 100% rename from releases/0.2.2 rename to releases/old/0.2.2 diff --git a/releases/0.2.20 b/releases/old/0.2.20 similarity index 100% rename from releases/0.2.20 rename to releases/old/0.2.20 diff --git a/releases/0.2.21 b/releases/old/0.2.21 similarity index 100% rename from releases/0.2.21 rename to releases/old/0.2.21 diff --git a/releases/0.2.22 b/releases/old/0.2.22 similarity index 100% rename from releases/0.2.22 rename to releases/old/0.2.22 diff --git a/releases/0.2.23 b/releases/old/0.2.23 similarity index 100% rename from releases/0.2.23 rename to releases/old/0.2.23 diff --git a/releases/0.2.24 b/releases/old/0.2.24 similarity index 100% rename from releases/0.2.24 rename to releases/old/0.2.24 diff --git a/releases/0.2.25 b/releases/old/0.2.25 similarity index 100% rename from releases/0.2.25 rename to releases/old/0.2.25 diff --git a/releases/0.2.26 b/releases/old/0.2.26 similarity index 100% rename from releases/0.2.26 rename to releases/old/0.2.26 diff --git a/releases/0.2.27 b/releases/old/0.2.27 similarity index 100% rename from releases/0.2.27 rename to releases/old/0.2.27 diff --git a/releases/0.2.28 b/releases/old/0.2.28 similarity index 100% rename from releases/0.2.28 rename to releases/old/0.2.28 diff --git a/releases/0.2.29 b/releases/old/0.2.29 similarity index 100% rename from releases/0.2.29 rename to releases/old/0.2.29 diff --git a/releases/0.2.3 b/releases/old/0.2.3 similarity index 100% rename from releases/0.2.3 rename to releases/old/0.2.3 diff --git a/releases/0.2.30 b/releases/old/0.2.30 similarity index 100% rename from releases/0.2.30 rename to releases/old/0.2.30 diff --git a/releases/0.2.31 b/releases/old/0.2.31 similarity index 100% rename from releases/0.2.31 rename to releases/old/0.2.31 diff --git a/releases/0.2.32 b/releases/old/0.2.32 similarity index 100% rename from releases/0.2.32 rename to releases/old/0.2.32 diff --git a/releases/0.2.33 b/releases/old/0.2.33 similarity index 100% rename from releases/0.2.33 rename to releases/old/0.2.33 diff --git a/releases/0.2.34 b/releases/old/0.2.34 similarity index 100% rename from releases/0.2.34 rename to releases/old/0.2.34 diff --git a/releases/0.2.35 b/releases/old/0.2.35 similarity index 100% rename from releases/0.2.35 rename to releases/old/0.2.35 diff --git a/releases/0.2.36 b/releases/old/0.2.36 similarity index 100% rename from releases/0.2.36 rename to releases/old/0.2.36 diff --git a/releases/0.2.37 b/releases/old/0.2.37 similarity index 100% rename from releases/0.2.37 rename to releases/old/0.2.37 diff --git a/releases/0.2.38 b/releases/old/0.2.38 similarity index 100% rename from releases/0.2.38 rename to releases/old/0.2.38 diff --git a/releases/0.2.39 b/releases/old/0.2.39 similarity index 100% rename from releases/0.2.39 rename to releases/old/0.2.39 diff --git a/releases/0.2.4 b/releases/old/0.2.4 similarity index 100% rename from releases/0.2.4 rename to releases/old/0.2.4 diff --git a/releases/0.2.40 b/releases/old/0.2.40 similarity index 100% rename from releases/0.2.40 rename to releases/old/0.2.40 diff --git a/releases/0.2.41 b/releases/old/0.2.41 similarity index 100% rename from releases/0.2.41 rename to releases/old/0.2.41 diff --git a/releases/0.2.42 b/releases/old/0.2.42 similarity index 100% rename from releases/0.2.42 rename to releases/old/0.2.42 diff --git a/releases/0.2.43 b/releases/old/0.2.43 similarity index 100% rename from releases/0.2.43 rename to releases/old/0.2.43 diff --git a/releases/0.2.44 b/releases/old/0.2.44 similarity index 100% rename from releases/0.2.44 rename to releases/old/0.2.44 diff --git a/releases/0.2.45 b/releases/old/0.2.45 similarity index 100% rename from releases/0.2.45 rename to releases/old/0.2.45 diff --git a/releases/0.2.46 b/releases/old/0.2.46 similarity index 100% rename from releases/0.2.46 rename to releases/old/0.2.46 diff --git a/releases/0.2.47 b/releases/old/0.2.47 similarity index 100% rename from releases/0.2.47 rename to releases/old/0.2.47 diff --git a/releases/0.2.48 b/releases/old/0.2.48 similarity index 100% rename from releases/0.2.48 rename to releases/old/0.2.48 diff --git a/releases/0.2.49 b/releases/old/0.2.49 similarity index 100% rename from releases/0.2.49 rename to releases/old/0.2.49 diff --git a/releases/0.2.5 b/releases/old/0.2.5 similarity index 100% rename from releases/0.2.5 rename to releases/old/0.2.5 diff --git a/releases/0.2.50 b/releases/old/0.2.50 similarity index 100% rename from releases/0.2.50 rename to releases/old/0.2.50 diff --git a/releases/0.2.51 b/releases/old/0.2.51 similarity index 100% rename from releases/0.2.51 rename to releases/old/0.2.51 diff --git a/releases/0.2.52 b/releases/old/0.2.52 similarity index 100% rename from releases/0.2.52 rename to releases/old/0.2.52 diff --git a/releases/0.2.53 b/releases/old/0.2.53 similarity index 100% rename from releases/0.2.53 rename to releases/old/0.2.53 diff --git a/releases/0.2.54 b/releases/old/0.2.54 similarity index 100% rename from releases/0.2.54 rename to releases/old/0.2.54 diff --git a/releases/0.2.55 b/releases/old/0.2.55 similarity index 100% rename from releases/0.2.55 rename to releases/old/0.2.55 diff --git a/releases/0.2.56 b/releases/old/0.2.56 similarity index 100% rename from releases/0.2.56 rename to releases/old/0.2.56 diff --git a/releases/0.2.57 b/releases/old/0.2.57 similarity index 100% rename from releases/0.2.57 rename to releases/old/0.2.57 diff --git a/releases/0.2.58 b/releases/old/0.2.58 similarity index 100% rename from releases/0.2.58 rename to releases/old/0.2.58 diff --git a/releases/0.2.59 b/releases/old/0.2.59 similarity index 100% rename from releases/0.2.59 rename to releases/old/0.2.59 diff --git a/releases/0.2.6 b/releases/old/0.2.6 similarity index 100% rename from releases/0.2.6 rename to releases/old/0.2.6 diff --git a/releases/0.2.60 b/releases/old/0.2.60 similarity index 100% rename from releases/0.2.60 rename to releases/old/0.2.60 diff --git a/releases/0.2.61 b/releases/old/0.2.61 similarity index 100% rename from releases/0.2.61 rename to releases/old/0.2.61 diff --git a/releases/0.2.62 b/releases/old/0.2.62 similarity index 100% rename from releases/0.2.62 rename to releases/old/0.2.62 diff --git a/releases/0.2.63 b/releases/old/0.2.63 similarity index 100% rename from releases/0.2.63 rename to releases/old/0.2.63 diff --git a/releases/0.2.64 b/releases/old/0.2.64 similarity index 100% rename from releases/0.2.64 rename to releases/old/0.2.64 diff --git a/releases/0.2.65 b/releases/old/0.2.65 similarity index 100% rename from releases/0.2.65 rename to releases/old/0.2.65 diff --git a/releases/0.2.66 b/releases/old/0.2.66 similarity index 100% rename from releases/0.2.66 rename to releases/old/0.2.66 diff --git a/releases/0.2.67 b/releases/old/0.2.67 similarity index 100% rename from releases/0.2.67 rename to releases/old/0.2.67 diff --git a/releases/0.2.68 b/releases/old/0.2.68 similarity index 100% rename from releases/0.2.68 rename to releases/old/0.2.68 diff --git a/releases/0.2.69 b/releases/old/0.2.69 similarity index 100% rename from releases/0.2.69 rename to releases/old/0.2.69 diff --git a/releases/0.2.7 b/releases/old/0.2.7 similarity index 100% rename from releases/0.2.7 rename to releases/old/0.2.7 diff --git a/releases/0.2.8 b/releases/old/0.2.8 similarity index 100% rename from releases/0.2.8 rename to releases/old/0.2.8 diff --git a/releases/0.2.9 b/releases/old/0.2.9 similarity index 100% rename from releases/0.2.9 rename to releases/old/0.2.9 diff --git a/releases/0.3.0 b/releases/old/0.3.0 similarity index 100% rename from releases/0.3.0 rename to releases/old/0.3.0 diff --git a/releases/old/NEWS b/releases/old/NEWS index ccf8cc06..a2063700 100644 --- a/releases/old/NEWS +++ b/releases/old/NEWS @@ -1,3058 +1,2498 @@ -## 18.11-01 +# 0.2.69 -Released: 2018-11-06 +Released: 2022-03-18 -* Perceval -** [jenkins] Update message level when handling blacklisted jobs -** [gitlab] Allow to blacklist merge/issue ids -** Ignore W504 flake8 error code -** [backends] Fix flake8 errors - -* grimoirelab-elk -** [enrich-redmine] Add ELK metadata -** [enrich-mozillaclub] Add ELK metadata -** [enrich-mediawiki] Add ELK metadata -** [elastic_items] Handle pagination over none index -** [enrich] Handle insertion of empty identities -** [elk] Avoid processing None identities -** [enrich-meetup] Prevent insert enrich items with no time -** [enrich-discourse] Refactor logic to enrich items -** [ELK] Fix flake8 errors -** [utils] goodbye google-hits script -** [utils] Goodbye rest script -** [enrich-gitlab] Handle missing milestone attribute in raw items -** [elastic_items] Refactor `fetch` method -** [enrich-google_hits] Redifine has_identities method -** [enrich-functest] Redifine has_identities method -** [enrich-dockerhub] Redifine has_identities method -** [enrich-jenkins] Redifine has_identities method -** [elk] Add condition to skip loading identites -** [enrich] Add has_identities method -** [enrich-askbot] Replace list with yield -** [enrich-bugzillarest] Replace list with yield -** [enrich-confluence] Replace list with yield -** [enrich-discourse] Replace list with yield -** [enrich-gitlab] Replace list with yield -** [enrich-jira] Replace list with yield -** [enrich-kitsune] Replace list with yield -** [enrich-mattermost] Replace list with yield -** [enrich-mediawiki] Replace list with yield -** [enrich-phabricator] Replace list with yield -** [enrich-mozillaclub] Replace list with yield -** [enrich-puppetforge] Replace list with yield -** [enrich-redmine] Replace list with yield -** [enrich-remo] Replace list with yield -** [enrich-rss] Replace list with yield -** [enrich-stackexchange] Replace list with yield -** [enrich-slack] Replace list with yield -** [enrich-supybot] Replace list with yield -** [enrich-telegram] Replace list with yield -** [jenkins] Add node name cleaning based on RE -** [enrich-twitter] Replace list with yield +* Grimoirelab + * feat: add github event alias + * Changing `GitHub No Replay` to `GitHub No Reply` +* Cereslib + * [gha] Update tests workflow + * Remove Python 3.6 support + * [poetry] Add Poetry support +* ELK + * Support OpenSearch 1.x + * [enrich] Remove the prefix '::' of the enrollments. + * [enrich] Bugfix for hyperkitty. EnrichBackend can not get raw data. + * [poetry] Include sortinghat as extra dependency + * Remove Python 3.6 support +* Kidash + * [gha] Add workflow to automate the release process + * [gha] Add workflow to check if a changelog was included + * [gha] Update CI github action workflow + * Add flake8 and coverage as dev-dependencies + * [poetry] Add Poetry support + * Remove the support for Python 3.6 and add new versions + * [scripts] Change kidash scripts as entrypoints +* Perceval + * Add configurations of the metadata files to pyproject.toml + * [gha] Update release action using grimoirelab-github-actions +* Perceval-Mozilla + * Add configurations of the metadata files to pyproject.toml + * [gha] Update release action using grimoirelab-github-actions +* Perceval-OPNFV + * [gha] Use poetry for tests in GitHub Actions workflow + * Remove Python 3.6 support + * Support package namespaces with Poetry + * [gha] Add workflow to check if a changelog was included +* Perceval-Puppet + * [gha] Use poetry for tests in GitHub Actions workflow + * Remove Python 3.6 support + * Support package namespaces with Poetry + * [gha] Add workflow to check if a changelog was included +* Perceval-Weblate + * [gha] Use poetry for tests in GitHub Actions workflow + * Remove Python 3.6 support + * Support package namespaces with Poetry + * [gha] Add workflow to check if a changelog was included +* Sigils + * Support newer versions of Python apart from 3.7 + * [poetry] Add Poetry support + * [json] Move visualizations inside panels + * [gerrit] Replace name field to author_name in Submitters table * SirMordred -** Add demographics index pattern -** [menu] Add index pattern for attraction/retention -** [tests] Fix flake8 errors after upgrade -** [sirmordred] Set elasticsearch logging level to INFO -** [jira] Add index pattern for closed issues -** Add documentation for jenkins `node_regex` param -** [jenkins] Add support for node name cleaning - + * [gha] Use poetry for tests in GitHub Actions workflow + * [poetry] Add poetry support + * [deps] Fix dependecies in requirements + * [utils] Change sirmordred scripts as entrypoints + * Refactoring link to new tutorial page. Currently it links to a page not found and I'm pretty sure this is a better place for the reader to be sent. + * Clarify README +* Sortinghat + * Include Sortinghat command in wheel + * [gha] Update tests workflow + * Fix flake8 code style warnings + * [setup.py] Add missing commas in entry_points + * Bump numpy to 1.21.0 in requirements.txt and setup.py + * Bump numpy from 1.18.3 to 1.21.0 + * Remove Python 3.6 support + * [gha] Add workflow to check if a changelog was included + * [poetry] Add Poetry support + * [sh] Change SortingHat scripts as entrypoints + * [deps] Update Jinja version + + +# 0.2.68 + +Released: 2022-01-27 + + +* ELK + * [enrich] Fix empty value of 'author_domain' field + * [git] Add schema column for raw/calculated + * [enrich] Fix urllib3.exceptions.SSLError for 'enrich_feelings'. + * [github2] Add comments from "Approval" and "Change requests" +* Perceval + * Bump cryptography from 3.3.1 to 3.3.2 + * Bump urllib3 from 1.26.3 to 1.26.5 * Sigils -** [git] Update demographics panel to use new fields -** [gitlab] Fix latest items tables to size 100 -** [gitlab] Add missing fields in issues index pattern -** [jira] Add closed issues by project table - + * [github2_pull_requests] Add new fields to the index pattern + * [gitlab_issues] Add painless_time_open to the index pattern -## 18.10-03 -Released: 2018-10-21 - -* GrimoireLab -** Fixes dependencies problems found in GrimoireLab package +# 0.2.67 -## 18.10-02 +Released: 2022-01-13 -Released: 2018-10-18 +* ELK + * [enrich] Fix IndexError when getting main organization * Perceval -** [groupsio] Make api token a required param -** [groupsio] Fetch archives from group-specific domains -** Adding academic reference - -* grimoirelab-elk -** [enrich_mattermost] Fix error setting empty emails for identities -** [enrich_mattermost] Fix error setting blank names on identities -** [enrich-github] Include label lists in enriched items -** [enrich-git] Replace list with yield -** [enrich-github] Replace list with yield -** [enrich-gerrit] Replace list with yield -** [enrich-bugzilla] Replace list with yield -** [tests] Extend tests for demography study -** [enrich] Add method to include aliases in enriched index -** [enrich-gerrit] Add demography study to gerrit -** [install] Update dependencies -** [tests] Update .travis.yml -** [tests] Align tests for git demography study -** [enrich] Add generic demography study -** [enrich-git] Replace ad-hoc git demography -** [enrich-gitlab] Include labels list in enriched items -** [onion] Fix `all_onion` alias creation -** [onion] Add refresh interval -** [enrich] Check presence of input index onion -** [gitlab-enrich] Add onion study -** [schema] Add schema for gitlab issues -** [schema] Add schema for gitlab merges -** [aoc] Add a constant for out_index default value -** [tests] Extend tests data for Gitlab milestone attribute -** [enrich-gitlab] Add milestone attribute for gitlab items - + * [gha] Check if a changelog was included in every Pull request * SirMordred -** [onion] Add documentation for 'seconds' parameter -** [setup] Update dependencies -** [menu] Remove onion index pattern from Git panel -** [panels] Add demographics panel in community section -** [tests] Fix tests for task panels -** [tests] Fix tests for config -** [tests] Update mediawiki 1.28 archive -** [tests] Update .travis.yml -** [cfg] Update config files -** [doc] Update documentation with gitlab info -** [micro] Handle raw and enrich tasks exceptions -** [doc] Include doc for gitlab onion studies -** [doc] Add autorefresh_interval description -** [autorefresh] Add autorefresh identities in AOC - -* Sigils -** [data_status] Update google_hits data status entry -** [demographics] Add known limitations and issues -** [demographics] Add panel for multiple sources -** Update info about index patterns and panel ids -** [gitlab] Increase the number of issues shown in timing panels -** [gitlab] Remove invalid search object for MRs backlog -** [gitlab] Adjust "Avg. Time Open" column in Backlog Submitters table -** [gitlab] Show full list of participants in GitLab panels -** [gitlab] Add milestone visualizations to GitLab merge requests -** [gitlab] Add milestone visualizations to GitLab issues -** [onion] Add data source filter widget to panels -** [gitlab] Fix typo in visualizations - -* Kidash -** Add check for query key in bool filter fix - -## 18.10-01 + * [.github] Use ubuntu-18.04 instead of ubuntu-latest + * [.github] Update elasticsearch to 6.8.6 -Released: 2018-10-03 - -* Perceval -** [tests] Align mediawiki after API calls optimization -** [mediawiki] Optimize number of calls to API -** [tests] Use output method in assertLogs for mbox test -** [tests] Use output method in assertLogs for gitlab test -** [tests] Add test to handle mediawiki version exception -** [mediawiki] Fix error in client `get_version` method -** [gitlab] Fix typo initiazaling common MRs fields - -* grimoirelab-elk -** [enrich-stackexchange] Handle KeyError exception -** [aoc] Add support for autorfresh in sirmordred -** [demography] Catch conn exceptions when fetching author commits -** [enrich] Set identities fields to UNDEFINED for null values -* SirMordred -** [tasks_panels] Fix initialization of .kibana index in Kibana 6.x +# 0.2.66 -** Sigils -** [data_status] Fix error showing GitLab issues retrieval dates -** [twitter] Replaces Latest tweets widget at the bottom -** Update documentation about contributing to be updated with Kibiter 6.1.0 release -** Fix hidden legends in bar charts -** Fix title of organizations pie chart -** Fix badly stacked bar bug +Released: 2022-01-11 -* SortingHat -** Support UTF-8 fully in MySQL/MariaDB -* Hatstall -** Register new template filter when a name is blank but isn't None +* Grimoirelab + * Update events.html with MSR 2022 Hackathon details +* ELK + * [enrich] Fix refresh_identities for '*_multi_org_names' fields + * [.github] Update elasticsearch to 6.8.6 + * [enrich] Get main enrollments for *_org_name field +* Sortinghat + * [.github] Use ubuntu-18.04 instead of ubuntu-latest + * [sortinghat/utils] Fix merge_date_ranges returns an extra date -* Kidash -* [kidash] Enable Kibiter 6 configuration -## 18.09-03 +# 0.2.65 -Released: 2018-09-24 +Released: 2021-11-19 -* GrimoireLab -** [doc] Added file for community components. -** [docker] Clarify variable names in ansible file for building release. +* ELK + * [elk] Update 'non_authored_*' fields on 'refresh_identities' + * [enriched/git] Add 'non_authored_*' commit meta fields * Perceval -** [tests] Add tests for GitLab merge request data -** [gitlab] Add merge_request category -** [github] Fix doc in fetch method -** [args] Add new argument --json-line - -* grimoirelab-elk -** [tests] Include tests data for GitLab merge requests -** [enrich-gitlab] Add merge request enrich item -** [enrich-mediawiki] Fix unique id for enriched items -** [tests] Include tests data for GitHub pull requests -** [enrich-stackexchange] Add 'origin' and 'tag' fields to answer items -** [raw] Improve logging message in elastic - + * [git] Add --no-ssl-verify parameter * Sigils -** [overview] Minor change to make gitlab panels visible -** [data_status] Minor change to make gitlab panels visible -** [gitlab] Minor change on merge panels -** [gitlab] Minor change on issue panels -** [gitlab] Add Issues and MR info to Overview and Status panels -** [adoption] Panel for Rust adoption -** [dev] Panel for dev related sources -** [social] Panel for Social sources -** [mediawiki] Use 'edits' instead of 'editions' -** [gitlab mr] Update URL links and fix a couple of titles -** Add GitLab Merge Request panels -** [jenkins] Add panel to track nodes -** [jenkins] Add panel for tracking jobs -** [gitlab] Fix issue with URLs in the repositories table -** [gitlab] Update GitLab panels based on the review. Minor fixes. -** [gitlab] Add GitLab panels focused just on issues -** [github] Fix acc time widget in PRs backlog - -* SirMordred -** [utils] Update setup.cfg micro-mordred -** [config] Change gitlab param names -** [task_panels] Change gitlab data source names -** [tasks_panels] Disable kibiter 6 configuration -** [utils] Add gitlab entries in setup.cfg and .json -** [task_panels] Add aliases to gitlab indexes -** [utils] Update setup.cfg and .json micromordred -** [utils] Update menu.yml -** [menu.yml] Adding nodes and jobs panels -** [tests] Include strict param in mock tests task panels -** [task_panels] Handle strict mode loading panels via setup.cfg -** [config] Handle strict loading of panels -** [tests] Update number of loaded panels -** [utils] Align menu.yml micro-mordred with upstream one -** [menu.yml] Remove mattermost from menu.yml -** [tasks_panels] Handle mattermost panels via setup.cfg -** [config] Load mattermost panels by the setup.cfg -** [tasks_panels] Handle gitlab panels via setup.cfg -** [config] Load gitlab panels by the setup.cfg -** [tests] Include archives for gitlab merges and github pulls -** [task_panels] Align task panels with kidash -** [tests] Align configuration files with new changes -** [tests] Align tests with new changes in task_panels -** [doc] Update config.md -** [README.md] Update readme -** [config] Make kibiter url mandatory for panels section -** [task_panels] Set kibana settings programmatically -** [task-collection] Improve logging message + * [git] Update index pattern to include 'non_authored_*' + * [affiliations] Authors/Contributions by Organization and Domains +* Sortinghat + * [sortinghat/utils] Fix merge_date_ranges -* Hatstall -** Fix url redirection to /identities/hatstall -** Change absolute urls in href and actions to the Django right ones -* Kidash -** Revert previous commit -** [import] Create the Kibana index if not exists before importing anything +# 0.2.64 +Released: 2021-11-05 -## 18.09-02 +* ELK + * [setup/requirements] Upgrade requests==2.26.0 and urllib3==1.26.5 +* SirMordred + * [task_manager] Add `update_hour` in the general section -Released: 2018-09-07 -* Perceval -** Remove unused and not working config_file option +# 0.2.63 -* grimoirelab-elk -** [tests] Fix load identities test -** [tests] Add tests for googlehits connectors -** [utils] Add googlehits connectors -** [enrich] Add support to enrich googlehits raw data -** [raw] Add support for googlehits data +Released: 2021-10-25 -* Sigils -** [irc] Fix orgs table participants count -** [KIP] Restore search viz +* Grimoirelab + * Add Mystic project + * Add TDF dashboard + * Fix typos and update screenshots + * Update events.html with hacktoberfest-21 details + * [docs] Update Built with GrimoireLab section +* ELK + * [.github] Install setuptools==57.5.0 + * [enriched/git] Add commit meta fields +* Perceval + * [docs] Add information for using perceval against private git repos + * [docs] Add perceval documentation content +* Sigils + * Fix typos in my name + * [git] Update index pattern to include commit author meta fields + * [github2] Limit visualizations to fix low performance. * SirMordred -** [utils] Update micro-mordred menu.yml -** [task_panels] Modify alias for google hits -** [config] Remove google_hits from extra backends -** [archives] Update slack archive -** [archives] Update github archive -** [tests] Add tests for googlehits + * [task_enrich] Support multi author fields in refresh identities + * [docs] Add information for using sirmodred against private git repos -* Hatstall -** Add new index that show just an form in order to search identities -** Delete the first and last " with strip() -** Add CSRF_TRUSTED_ORIGINS as a docker env variable +# 0.2.62 -## 18.09-01 +Released: 2021-09-16 -Released: 2018-09-04 +* ELK + * [enriched/github2] Add demography study + * [enriched/github2] Add ghost user to calculate first attention + * [README] Update instructions for running tests * Perceval -** [googlehits] Modify item id generation -** [github] Increase number of items retrieved per page -** type fix on tests requirements file - -* Sirmordred -** [menu.yml] Fix typo in googlehits data source -** [task_panels] Include phabricator panels in overview and data status -** [task_panels] Enable kafka studies -** [config] Include option to visualize kafka studies -** [tests] Align tests for new panels -** [utils] Align micro-morded menu.yml with mordred one -** [task_panels] Include mbox-type panels -** [menu.yml] Include mbox-type entries -** [task_panels] Do not import panels that don't have the release field -** [task_panels] Replace google_hits backend name -** [menu.yml] Modify google hits source name -** [tests] Fix tests for task_panels -** [tests] Fix tests for task_enrich -** [tests] Fix tests for test_task -** [collection] Add support for mediawiki tag -** [utils] Add mattermost panels to menu.yml micro-mordred -** [menu] Add mattermost entry -** [menu.yaml] Remove duplicated community info in git menu -** [utils] Fix setup.cfg for micro-mordred -** [menu] Add index pattern for remo-activities -** [menu] Fix remo-activities index-patterns entry - -* grimoirelab-elk -** [enrich-meetup] Fix error printing the number of comments and RSVPs -** [tests] Update Git test data -** [tests] Update Slack test data -** [tests] Update Jira test data -** [enrich-jira] Remove unknown user data logic -** [enrich-git] Remove unknown user data logic -** Set Unknown to null user data (org, name and username) -** [elk] Modify logic to load new identities to SH -** [enrich-mbox] Replace lists with yields -** [enrich-meetup] Replace lists with yields -** [enriched] Update mediawiki project json params -** [enriched-jira] Set Unassigned to null assignee orgs and usernames -** [enrich-jira] Improve jira enricher -** [enrich-git] Handle commits with missing user info -** [tests] Enable tests from no-localhost ES + * [docs] Add Airtable and Bitbucket backends + * [git] Add argument base-path for the git backend + * Update README.md + * [docs] Update configurations for readthedocs -* Sigils -** [kip] Disable search panel -** [overview] Add mattermost widgets -** [data status] Add mattermost widgets -** [overview] Fix missing widget panels -** [data_status] Fix visualization ids -** [meetup] Fix visualization id for `meetups_main_numbers` -** [overview] Replace dockerhub viz by current ones -** [kip] Migrate panel to Kibana 6 -** [data status] Add remo activities index pattern -** [about] Update panel to include release date -** [data status] Fix dockerhub index pattern name -** [data status] Fix google hits widgets -** [overview] Fix index name for Dockerhub viz -** [overview] Update google hits widgets -** [google-hits] Panel updated to support new backend - - -## 18.08-01 - -Released: 2018-08-23 -* SortingHat -** [api] Fix lost enrollments error merging identities -** [db] Handle disconnection using pessimistic mode +# 0.2.61 -* Perceval -** [doc] Include doc to execute the googlehits backend -** [backends] Add backend for GoogleHits -** [slack] Fix flake8 error -** [slack] Include num members in channel info -** [doc] Update install from source code section in README.md -** Mozilla -** [doc] Update install from source code section in README.md -** OPNFV -** [doc] Update install from source code section in README.md -** Puppet -** [doc] Update install from source code section in README.md - -* Sirmordred -** Fix typos in menu.yaml for 6.x panels and index patterns -** [task_panels] Update index pattern files for Onion panels -** [utils] Add conf files for micro-mordred -** [utils] Add micro-mordred -** [test_task_panels] Update tests for community section menu -** [task_panels] Add community structure menu -** [config] Add time interval for autorefresh -** [panels] Remove unused panels -** Fix weird warning -** [tests] Update test_config.py -** [tests] Add example of enrich_pull_requests study in test_studies.cfg -** [config] Add `enrich_pull_requests` to the tuple of studies - -* grimoirelab-elk -** [enrich-mediawiki] Change way url is created -** [aoc] Replace message commit with first 80 chars -** [enrich-slack] Use `num_members` attribute to count channel members -** [studies] Add enrich_pull_requests study -** [aoc] Fix study to do nothing if no events +Released: 2021-09-07 -* Sigils -** Merge branch 'kibana6-migration' -** Use 'edits' instead of 'editions' for MediaWiki -** [mattermost] Add Kibana 6 panel and index pattern -** [reps activities] Add panel migrated to Kibana 6 -** [reps events] add panel fro Kibana 6 -** [about] Add about.json from master -** [dockerhub] Fix legend title for Stars and Pulls -** [dockerhub] Update evolutionary charts to use Timelion and use Deltas -** [dockerhub] Add DockerHub panel and index pattern -** [functest] Add panel for functest project -** [functest] Add testing overview panel -** [mediawiki] Use 'edits' instead of 'editions' -** [mozilla-club] Increase size of pie charts -** Add Mozilla Club panels and index patterns -** [google-hits] Add Google Hits panel and index pattern -** [twitter] Migrate panel to Kibana 6 -* Manuscripts -** [Notebooks] Update README with instructions to run the notebooks -** Add Notebooks for GMD metrics and sample visualisations -** Some (hopefully minor) changes -** [MS2/report/tests] Add basic tests for manuscripts2 reports -** [MS2/tests] Set up module level test fixtures -** [MS2/README] Update README with instructions to generate the report -** [MS2/manuscripts2] Update bin/manuscripts2 to take cmd inputs -** [MS2/latex] Separate github_issues and github_prs data for Overview -** [MS2/reports] Add functions to generate the PDF reports -** [MS2/reports] Add latex template folder from the old manuscripts -** [MS2/reports] Remove "_" from strings and update create_csv_fig_from_df -** [MS2/reports] Fix minor errors and change folder names -** [MS2/Reports] Add the project process section of the report -** [tests] Add tests for Metrics under project process in github_prs -** [MS2/metrics] Add project_process Metrics & function for github_prs -** [tests] Add tests for Metrics under project process in github_issues -** [MS2/metrics] Add project_process Metrics & function for github_issues -** [MS2/elasticsearch] Update calculate_bmi function -** [MS2/metrics] Change field for timeseries aggregations in ClosedIssues -** [MS2/reports] Add PROJECT_COMMUNITY section of the report -** [manuscripts2/metrics] Rename NAME variable to DS_NAMES In all the data source files -** [tests] Add tests for aggregations() in Authors and Organizations classes -** [MS2/metrics] Add capability to calculate project_community metrics -** [tests] Clean up code. Add tests/utils.py -** [manuscripts2/elasticsearch] Add get_list method for Query class -** [config] Add studies params -** [tests] Add tests for timeseries metrics generated in github_prs -** [github_prs] Add project_activity function -** [tests] Add tests for timeseries metrics generated in github_issues -** [github_issues] Add project_activity function -** [tests] Add tests for timeseries metrics generated in git -** [git] Add project_activity function -** [report] Add functionality to calculate PROJECT ACTIVITY section -** [tests] Rearrange the test data into specific folders -** [tests] Add tests for github_issues data source -** [manuscripts2] Add OVERVIEW section for github_issues data source -** [tests] Update test_elasticsearch.py to use test base class -** [tests] Update tests/data/git_commit.json file -** [tests] Update git_commit.json data -** [tests] Update test base class -** Rename manuscripts2/Readme.md to manuscripts2/README.md -** [tests] Add example to use the test base class -** [tests] Add test base class -** [manuscripts2] Add tests for OVERVIEW section of 'git' data source -** [manuscripts2] Add code to calculate OVERVIEW section for 'git' data source +* ELK + * [raw/gitlab] Handle immense term for data.head_pipeline.yaml_errors + * [elk] Pass 'no_update' to pereceval + * [enriched/github2] Fix TypeError NoneType + * [mattermost] Allow parsing normal mattermost urls +* Perceval + * [github] Extend 'max_items' for all requests + * [docs] Add Gitee community backend +* SirMordred + * [config] Support inheritance in configuration -* Kidash -* GrimoireLab Toolkit +# 0.2.60 -* King Arthur +Released: 2021-08-31 -* Bestiary -* Hatstall -** [docker] Update password of admin user when container restart -** Change href of Profiles item to "list" instead of "/" -** Update href in order to avoid absolute/relative problems -** Allow None country in the profile form -** [docker] Modify path of sqlite file when env variable exists -** [docker] Default admin account can be now set via docker environment variables -** [urls] Add support for using /identities as the base path for accessing Hatstall -** [docker] Remove gunicorn and use stage from Docker image -** [docker] Modify apache config to serve static files and generate the static files during deployment -** [static] Reorganize static contents for the base template in the django-hatstall project -** [urls] Remove gunicorn suport for static contents -** [docker] Add in stage the activation of ssl module in Apache -** [docker] Support https for accessing the Django Hatstall application -** [docker] Convert Django Hatstall deployment to Apache2 + mod_wsgi +* ELK + * [enriched/github2] Fix KeyError 'login' + * [enriched/github2] Add 'user_login' field -* Ceres -** Fix filter method when a column has no values +# 0.2.59 -## 18.07-11 +Released: 2021-08-23 -Released: 2018-07-25 -## Release details +* ELK + * [pyproject] Update packages and python to "^3.6.1" + * [enriched/githubql] Add PullRequestReview field + * [enriched/mattermost] Fix KeyError 'parent_id' + * [enriched/github2] Use user_data fields to set identities values +* Perceval + * [githubql] Add PullRequestReview event +*SirMordred + * [mordred] Add flag/arg to filter which repos run -* SortingHat -** [tests] Add tests for recovery mode in unify command -** [unify] Add resume method to unify command -* Perceval -** [askbot] Handle upstream internal server -** [gitlab] Sanitize requests before archiving -** [gitlab] Fix signature backend -** [travis] Change how perceval is installed -** [mbox] Fix test `test_mboxes_error` -** [github] Fix position GitHub client args -** [phabricator] Handle 429 HTTP errors -** [mbox] Increase test coverage -** [pipermail] Remove duplicated test -** [utils] Add checks to zip compressed type -** [mbox] Add checks to zip compressed type -** [doc] Include doc to execute the groups.io backend -** [backends] Add backend for groups.io -** [mbox] Allow support for zip file in MboxArchive -** [utils] Add support for zip compressed file type -** Mozilla -** [setup] Align setup to perceval one -** [travis] Change how perceval-mozilla is installed -** OPNFV -** [setup] Align setup to perceval one -** [travis] Change how perceval-opnfv is installed -** Puppet -** [setup] Align setup to perceval one -** [travis] Change how perceval-puppet is installed - -* Sirmordred -** [tests] Add tests for sirmordred -** [tests] Update test data -** [sirmordred] Load repos for a tagged backend sections -** [task_projects] Load repos for a tagged backend section -** [tests] Add archive for GitLab -** [utils] Goodbye cfg_generator -** [doc] Include example for GitLab -** [tests] Relax number of index-patterns in tests for panels -** [docs] Add coveralls badge -** [tests] Add perceval-* dependencies to requirements.txt -** [tests] Add grimoirelab-toolkit dependency to requirements.txt -** [config] Redirect autogenerated doc to README.md -** [config] Extend `write_doc` method -** [tests] Extend test for config file - -* grimoirelab-elk -** Change shebang line -** [elastic_items] Remove condition for old twitter items -** Add support for Groupsio -** [travis] Fix coverage execution -** [utils] Goodbye twitter scripts -** [README.md] Fix travis badge -** [travis] Execute coveralls after tests -** [README.md] Add coveralls badge -** Add support for GitLab +# 0.2.58 -* Sigils +Released: 2021-08-12 -* Manuscripts -** Update failing tests because of change in perceval git data -** Rename manuscripts2 branch files -** [travis] Narrow coveralls execution -** Update tests for manuscripts2 -** Update Query class: set start and end date filters directly into search object -** [tests] Fix travis.yml -** [travis] Add coveralls -** [doc] Fix badges in README.md -** Add initial infrastructure to generate the reports +* ELK + * [gitlab] Autodetect gitlab enterprise-url arg +* Perceval + * [mattermost] Support running with channel names + * [github] Handle reactions without user information + * [pyproject] Update python "^3.6.1" +* Perceval-finos + * [pyproject] Update python "^3.6.1" +* Perceval-mozilla + * [pyproject] Update python "^3.6.1" +* Perceval-opnfv + * [pyproject] Update python "^3.6.1" +* Perceval-puppet + * [pyproject] Update python "^3.6.1" +* Perceval-weblate + * [pyproject] Update python "^3.6.1" + + +# 0.2.57 + +Released: 2021-07-20 + + +* ELK + * [enriched/mattermost] Fix 'useAutomaticTimezone' TypeError + * [raw/mattermost] Fix mapping for 'data.props.meeting_id' + * [enriched/weblate] Fix KeyError for several fields + * [schema] Update Kafka KIP schema * Kidash + * [setup] Upgrade requests to 2.26.0 +* Perceval + * Bump grimoirelab-toolkit from 0.1.12 to 0.2 + * [gha] Create release.yml + * [nntp] Avoid line too long error + * [nntp] Handle not valid date + * [mattermost] Change the key from 'data.metadata.images' to value + * [gha] Update tests workflow + * [perceval] Change perceval script as entrypoint + * [docs] Fix typos +* Perceval-finos + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Perceval-mozilla + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Perceval-opnfv + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Perceval-puppet + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Perceval-weblate + * Bump grimoirelab-toolkit from 0.1.12 to 0.2.0 + * [perceval-finos] Add poetry support + * [travis] Support for python 3.6, 3.7 and 3.8 +* Sortinghat + * [parsing/gitdm] Update VALID_LINE_REGEX expression + * Bump jinja2 from 2.11.1 to 2.11.3 + * [CI] Migrate from Travis CI to GitHub Actions + +# 0.2.56 + +Released: 2021-06-09 + + +* ELK + * [enriched/slack] Add stopwords in the field 'text_analyzed' + * [enriched/mattermost] Improve fields + * [enriched/github] Add demography study + * [enriched/github] Fix KeyError when getting user info + * [tests/data] Improve telegram coverage + * [README] Update bugzilla data sources description + * [schema] Fix twitter schema + * tests] Add test for metadata__updated_on field + * [tests] Add test for transactionID field + * [schema] Add twitter schema file + * [schema] Fix missing values in github event schema + * [enriched/twitter] Remove deprecated attributes from enriched item +* Kidash + * Bump urllib3 from 1.24.3 to 1.26.5 +* Perceval + * [github] Fix 404 Client Error when user is not found. + * [github] Fix user_orgs for organizations with restricted access + * [CI] Use poetry for the CI github actions workflow + * [deps] Add flake8 and coverage to dev dependencies + * Create CONTRIBUTING.md + * [poetry] Add setuptools to the build-system + * [backend] Disables stack trace if debug flag is absent +* Sigils + * [mattermost] Update panel and index pattern with new fields. + * [github_issues] Update index pattern with demography fields + * [json] Update Twitter index pattern +* SirMordred + * [README] Add demography study for github + * Allowing the config files to be specified dynamically + * [micro-mordred] Improve error messages in micro.py + * [docs] Update the mariadb docker-compose configuration + * [tests] Fix flake8 errors -* GrimoireLab Toolkit - -* King Arthur +# 0.2.55 -* Bestiary +Released: 2021-03-15 -* Hatstall -* Ceres +* ELK + * [stackexchange] Make author anonymization optional for stackexchange + * [enrich-stackexchange] Handle deleted user in stackoverflow + * [enriched/gitlab] Fix KeyError without `name` value +* Perceval + * [stackexchange] Include access_token as optional argument + * [stackexchange] Change the fetch order to 'asc' -## 18.07-10 +# 0.2.54 -Released: 2018-07-17 +Released: 2021-02-11 -## Release details +* ELK + * [raw/phabricator] Fix mapping for data.fields.custom_error_stack +* Perceval + * [slack] Use channels.history to retrieve message -* grimoirelab-elk -** [studies] Use hash instead of plain text as id -** [enriched] Use metadata__update_on to index tweets +# 0.2.53 -## 18.07-09 +Released: 2021-01-26 -Released: 2018-07-15 +* Cereslib + * [flake8] Fix flake8 errors -## Release details +* ELK + * [enriched/github:prs] Add fields for Pull Requests-related data + * [enriched-cocom] Use hashlib instead hash() to create a uniq id -* Sigils -** Use kibana6-migration branch +* Kidash + * [flake8] Fix flake8 errors +* Perceval + * [supybot] Adds support for logs without timezone information + * [githubql] Support GitHub App to fetch data + * [github] Support GitHub App to fetch data + * [perceval] Add flag `-l/--list` to show list of available backends -## 18.07-08 +* Sigils + * [github] Update index pattern with new fields -Released: 2018-07-13 -## Release details +# 0.2.52 -* Sirmordred -** [menu.yaml] Add panels and index patterns for Areas of Code and Community Structure +Released: 2020-11-24 +* SortingHat + * Limit SQLAlchemy versions to <1.4 -## 18.07-07 -Released: 2018-07-12 +# 0.2.51 -## Release details +Released: 2020-11-23 -* SortingHat +* ELK + * [enriched/slack] Fix enrich items without user data + * [raw/slack] Handle fields in 'data.files' * Perceval -** Changes to work with grimoirelab_toolkit. -** Mozilla -*** Changes to work with grimoirelab_toolkit. -** OPNFV -*** Changes to work with grimoirelab_toolkit. -** Puppet -*** Changes to work with grimoirelab_toolkit. - -* Sirmordred -** [config] Add tag to backend sections - -* grimoirelab-elk -** [raw] Fix mapping Twitter -** [enriched] Add code to calculate github pull requests enriched data -** [enriched] Change toolkit import in git enricher -** [enriched] Change toolkit import in ceres_base -** [p2o] Add support for execution a list of studies -** [enrich][git][demography] Add doc and fix the incremental support + * [slack] Fix fetch message from a private user + * [askbot] Add logging debug messages to Askbot * Sigils + * [weblate] Add organization information to overview panel -* Manuscripts - -* Kidash -* GrimoireLab Toolkit -** Change module name to grimoirelab_toolkit. +# 0.2.50 -* King Arthur -** [arthur] Change toolkit import +Released: 2020-10-29 -* Bestiary +* ELK + * [enriched/githubql] Classify merged PRs within cross-references study + * [enriched/githubql] Add MergedEvent info + * [gerrit] Add last-verified approval value field to enricher -* Hatstall +* Perceval + * [githubql] Fix error `Events not collected for issue...` + * [tests] Fix pipermail not working search_fields test + * [githubql] Add MergedEvent info -* Ceres +* Sigils + * [github][github2] Update index patterns with new study fields + * [githubql] Update index pattern with MergedEvent fields + * [gerrit] Update index patterns with last Verified approval value + * [gerrit] Add Retention of Newcomers panel -## 18.07-06 -Released: 2018-07-10 +# 0.2.49 -## Release details +Released: 2020-10-13 -* SortingHat -** [travis] Include cryptography package -** [tests] Align tests to logging support -** [sortinghat] Add logging support +* ELK + * [schema] Add schema file for Weblate enriched data + * [weblate] New enricher to handle changes + * [enrich/discourse] Add credentials to collect category info + * [enriched/github] Add field issue_url for issues and pull requests + * [enriched/githubql] Update references in related indexes * Perceval -** [twitter] Change metadata_id attribute -** Mozilla -** OPNFV -** Puppet - -* Sirmordred -** [tests] Add twitter archive -** [dashboard title] Fix typo in project name extraction -** [tests] Add arthur and perceval eggs to requirements.txt -** [studies] Include raw backend to studies - -* grimoirelab-elk -** [enriched] Add support for github pull request data -** [raw] Add support for github pull request data -** [tests] Add test for kafka kip study, git studies and SSL support -** [enriched] Improve logging for studies -** [enriched] Include ocean backend in studies -** [elk] Add raw backend to studies params -** [raw] Add parser params for perceval mattermost backend -** [studies] Fix ES conns to use insecure parameter -** [enrich][mattermost] Fix project mapping support -** [enrich][slack] Fix slack project mapping to use just the channel id in the projects mapping file -** [tests] Use the projects mapping json file for testing + * Weblate backend * Sigils -** [telegram] Add Telegram panels migrated to Kibana 6 -** [apache] Add Apache panels -** Updated panels for askbot, discourse, stackoverflow, rss, bugzilla timing, redmine, maniphest, bugzilla, onion, overview, git, data status, mediawiki, jenkins, stackoverflow, confluence, slack, maniphest, github, irc, mbox, jira, bugzilla, gerrit, -* Manuscripts -** Add manuscripts2 containing new functions to calculate the metrics -** Closes #48: start date not provided use case - -* Kidash - -* GrimoireLab Toolkit + * [weblate] Add Weblate demographics panel + * [weblate] Add Weblate overview panel and index pattern + * [github] Update index pattern with issue_url field + * Update index patterns from github-related indexes -* King Arthur - -* Bestiary +* SirMordred + * Add new backend weblate -* Hatstall -** [urls] Add support for using /identities as the base path for accessing Hatstall -** [docker] Default admin account can be now set via docker environment variables -** [docker] Modify path of sqlite file when env variable exists -* Ceres +# 0.2.48 -## 18.07-05 +Released: 2020-09-28 -Released: 2018-07-04 +* ELK + * [enriched/git] `enrich_git_branches` skip --filter-no-collection repo + * [enriched/bugzilla] Add new field `whiteboard` +* Sigils + * [bugzilla] Update index pattern with the new field `whiteboard` -* Sirmordred -** Update menu.yaml to kibana 6 panel and index names -** [task_panels] Add support for loading several index patterns per data source +# 0.2.47 -## 18.07-04 +Released: 2020-09-23 -Released: 2018-07-04 +* ELK + * [enriched/githubql] Add new study 'enrich_reference_analysis' -* Kidash -** Don't sys.exit from kidash.py library (raise exceptions) +* Sigils + * [gerrit] Change `timeopen` to `painless_delay` -* Mordred -** [task_panels] Manage the error loading panels, log it and continue execution +* SirMordred + * [githubql] Add new study "enrich_reference_analysis" -## 18.07-03 +# 0.2.46 -Released: 2018-07-03 +Released: 2020-09-14 -* Sirmordred -** [task_panels] Add support for loading index patterns +* ELK + * [enriched/gerrit] Add new study 'enrich_demography_contribution' + * Check for author in comment raw data before assigning to user object + * [schema] Fix slack schema CSV file + * [enriched/gerrit] Add new fields `open` and `wip` + * [enriched/jira] Add `is_closed` and `status_category_key` fields +* Perceval + * Update dulwich package version + * Add support for specifying Gerrit SSH key location -## 18.07-02 +* Sigils + * [gerrit] Update index pattern + * Update documentation about Kidash + * [docker] Add links and import instructions + * [discourse] Add links and import instructions + * [gitlab] Add links and import instructions + * [gitter] Add links and import instructions + * [maniphest] Add links and import instructions + * [mediawiki] Add links and import instructions + * [slack] Add links and import instructions + * [global] Add links and import instructions + * [affiliations] Add links and import instructions + * [code] Add links and import instructions + * [demographics] Add links and import instructions + * [gerrit] Add links and import instructions + * [lifecycle] Add links and import instructions + * [jira] Add links and import instructions + * [jenkins] Add links and import instructions + * [chaoss] Add links and import instructions + * [onion] Add links and import instructions + * [bugzilla] Add links and import instructions + * [github] Add links and import instructions + * Add new icons license information + * [git] Add links and import instructions + * [jekyll] Update theme colors + * [jira] Use `painless_delay` as the time the issue stay open + * [jira_backlog] Use `painless_delay` as the time the issue stay open + * [jira_timing] Use `painless_delay` as the time the issue stay open -Released: 2018-07-03 +* SirMordred + * Add new study "demography_contribution" + * Update Getting Started guide with identities management section + * Fix lifecycle file name -* Kidash -** Add release date support for Index Patterns -* Sigils -** Add panels for kibiter 6.1.0 migration +# 0.2.45 +Released: 2020-07-27 -## 18.07-01 +* GrimoireLab + * Remove 'manuscripts' from the release due there is + a broken depencency with matplotlib and numpy. -Released: 2018-07-02 -* Kidash -** [tests] Add test for split-index-patterns new param -** [kidash] Add support for importing and exporting only index patterns -** Update mapping in Kibana6 if needed -** Add constant for release date field name -** Add try/except to show content of error responses -** Add release_date to panel json +# 0.2.44 +Released: 2020-07-27 -## 18.06-03 +* ELK + * [enriched/git] Study aoc support extra fields + * [enriched/mediawiki] Add `repository_labels` field -Released: 2018-06-28 +# 0.2.43 -* SortingHat -** [tests] Adapt tests to run with setup.py test -** [all] Remove support for Python 2.7 -** [db:api] Add functions for all the low level operations on SortingHat -** [api] Improve output messages for enrollment commands -** [exceptions] Rename WrappedValueError to InvalidValueError +Released: 2020-07-21 * Perceval -** [tests] Replace datetime function with equivalent toolkit one -** [meetup] Pythonicize `calculate_time_to_reset` -** [backends] Add backend for Twitter -** Mozilla -** OPNFV -** Puppet + * [githubql] Add pull request author to ClosedEvent + * [slack] Use channels.history to retrieve message + +* ELK + * Update pyproject.toml with PyMySQL pinned dep + * [deps] Pin PyMySQL dependency + * [enriched-githubql] Add pull request submitter to closed events + * [enriched/phabricator] Fix the field `time_to_close_days` + * Fix Issue#907 + * [enriched-enrich] Set user-agent for geopy + * Fix wrong quotation + * [enriched-git] Execute update_items when local repo commits are returned + * [enriched-githubql] Add page size param to duration study + +* Hatstall + * [readme] Fix instruction to install requirements * Mordred -** Change name from mordred to sirmordred - -* grimoirelab-elk -** [mattermost] Add mattermost support for gelk (raw + enrich) -** [tests] Modify tests for Twitter backend -** [utils] Modify connector information for twitter -** [twitter] Modify enrich connector -** [twitter] Modify raw connector -** [tests] Allow testing with latest grimoirelab component versions -** [enrich] Align ELK with changes in SortingHat -** [enriched][github] Add code to calculate the first reaction duration to an issue -** [enrich][redmine] Add `assigned_to` fields -** [jira] Fix mapping to avoid limit number of fields exception -** [bugzilla] Fix immense term exception for activity attribute -** [elastic] Add template to force date format -** [raw] Update mappings for jenkins to ES 5.x -** [enrich] Handle deleted user in stackoverflow -** [enriched] Add `latest_date` method to connector + * Save new changes made in Dashboard by mounting the volume in ES + * Remove inconsistency in displaying images + * Add info about pulling in latest data * Sigils -** [owlwatch] Move owlwatch to its own repo -** [GitHub] Revamp timing panels -** [GitHub ]Update PRs overview panel -** [demographics] Fix y-axis label for leaving devs -** [slack] Add projects table - -* Manuscripts -** Updated comments in esquery.py + * [github-closed-events] Include submitters and reporters in dashboard + * [maniphest] Change `painless_delay` instead of `timeopen_days` + * [github-label-events] Improve dashboard + * Add acknowledgments section to DevRel dashboards -* Kidash - -* GrimoireLab Toolkit - -* King Arthur - -* Bestiary +# 0.2.42 -* Hatstall - -* Ceres +Released: 2020-06-20 -## 18.06-02 - -Released: 2018-06-08 +* Perceval + * [slack] Handle messages without user/bot ID + +* ELK + * Add release note for rocketchat + * [enriched-slack] Handle messages without user data/bot ID + * [enriched-githubql] Add reporter data to enriched docs + * [enriched-mbox] Handle long body emails + * [enriched-githubql] Add duration analysis study + * [rocketchat] Increase test coverage and complete doc + * [rocketchat] Patch for PR #882 + * [rocketchat] Add support for RocketChat + * [grimoire_elk] Remove tzinfo for date comparison * Mordred -** [studies] Handle empty list of studies in backends + * [config] Add support for duration analysis + * [doc] Add instructions to mine rocketchat + * [docs] Update Getting-Started.md result image -## 18.06-01 +# 0.2.41 -Released: 2018-06-07 - -* SortingHat -** [parsing:sh] Make gender profile info not required +Released: 2020-06-13 * Perceval -** [backend] Include category in backend params -** [github] Add list of commits hashed included in pull requests -** [pipermail] Fix command line parameters -** OPNFV -** Puppet - -* Mordred - -* grimoirelab-elk -** [stackexchage] Fix fields for questions having an accepted answer -** [jira] Fix typo in enriched jira fields -** [studies][demography] Use author_uuid field to aggregate the authors instead of author_id -** [enrich] Modify max length for keyword fields + * [backend] Add Rocket.Chat backend + * [perceval] Fix flake8 errors + * [doc] Add Slack API token generation info + * [slack] Update resource endpoints + * [launchpad] Add missing `package` parameter in launchpad * Sigils -** [discourse] Add % of questions answered -** [stackoverflow] Fix % of questions answered -** [askbot] Add % of questions with accepted answer -** [panels] Add community structure panels & documentation -** [panels] Add accepted answers and project support -** [panels] Fixed links to issues and revamp (jira) -** [panels] Refurbish Jira panel -** [panels] Fix typo in Jira panels -** [panels] Modify answers table for consistency -** [Panels] Rearrange project and authors widgets -** [panels] Add project support to Askbot -** [panels] Add crates to Data Status + * [slack] Add DevRel dashboard + * [GitHub] Add DevRel dashboard + * [discourse] Add DevRel dashboard + * [github] Add dashboard about label-related events + * [github2-pulls] Update index pattern + * [github2-pulls] Change order results metric in table vizs + * [github2-issues] Update index pattern + * [github2-issues] Change order results metric in table vizs + * [slack] Add new files metrics to index pattern + * [gerrit] Add changeset status and value to index pattern + +* ELK + * [deps] Constrain numpy version to <= 1.18.3 + * Release 0.73.0 + * Fix formatting git private repos note + * [enriched-githubql] Add label attribute to closed events + * [enriched-mediawiki] Handle filters on repo URL + * [elastic] Support for filter no-collection on multi params URLs + * [enriched-confluence] Extract username from publicName attr + * [enriched-git] Sync AOC and Git raw index + * [enriched-git] Handle anonymized repos in update_items + * [enriched-cocom] Include files in revision + * [elk] Fix flake8 errors + * [tests] Rename study indexes for tests to ease deletion + * [elk] Handle private repos in git studies + * [enriched-utils] Remove credentials for repository filter + * [raw-git] Remove credentials from origin + * [elk] Move anonymize_url to enriched/utils.py + * [enriched-cocom] Propagate commit parents to enriched index + * [utils] Remove unused function get_time_diff_days + * [enriched-mbox-study-kip] Fix calculation for inactive days + * [grimoire_elk] Replace datetime/dateutil calls with toolkit + * [utils] Remove get_git_repos + * [enriched] Remove projects.py + * [launchpad] Add support for launchpad + * [enriched-gerrit] Propagate changeset status to patchsets + * [slack] Update files metric + * [tests] Add tests for `copy_raw_fields()` method + * [Enrich] Add `copy_raw_fields()` method and refactor enrichers + * [telegram] Improve test coverage + * [Mbox] Add tests and test data for MBox KIP study. + * [test] Add missing test for perceval params -* Manuscripts -** Updated esquery.py and created tests/test_esquery.py -** Updated esquery.py to use elasticsearch_dsl in all places +* Mordred + * [task_panels] Upload label-related dashboard + * [docs] Update getting-started with ES/Kibiter 6.8 + * [tests] Remove panels test for kibiter 5.x + * [aliases] Remove affiliations and all_enriched aliases for github2 + * [tests] Add tests to process filter-no-collection on multi params URLs + * [task_panels] Remove support for Kibiter < 6.x + * [tests] Update requirements_test + * [sirmordred] Remove credentials from private URLs + * [task_identities] add `no-enrollment-periods-validation` + * [aliases] Fix enrich alias for gerrit + +* Sortinghat + * [deps] Constrain numpy version to <= 1.18.3 + * Update version number to 0.7.13 + * [misc/grimoirelab2sh] Add new argument to avoid periods validation + +* Graal + * [cocom] Remove first slash from file path + * [travis] Change how to install nomos + * [cocom] Include files info in docs generated + * [cocom] Include parents info in docs generated -* Kidash -** [kidash] Preserve uiStateJSON dict when cleaning a dashboard from not needed data sources -** [kidash] Use #!/usr/bin/env python3 to work inside venvs correctly +* Cereslib + * [enrich-enrich] Fix flake8 E741 ambiguous variable name + * [deps] Constraint numpy version to <= 1.18.3 + * version number to 0.1.13 + * [test] Add test for Git events -* GrimoireLab Toolkit +* Kidash + * [kidash] Remove support for kibana <6.x + * [kidash] Improving log messages + * [kidash] Support import to Kibiter/Kibana 6.8 -* King Arthur -** [tests] Align tests with arthur tasks validation -** [arthur] Add validation for tasks -** [tests] Fix tests for server -** [jobs] Add category to backend arguments -** [scheduler] Fix wrong date conversion -** [server] Allow to add tasks without archiving/scheduling options -* Bestiary +# 0.2.40 -* Hatstall +Released: 2020-04-24 -* Ceres +* Perceval + * [perceval] Add githubql backend + * [doc]Fixed minor typos + * [Travis] upgrade pip and setuptools + * [pagure] Add sanitize for archive + * [mattermost] Add sanitize for archive + * [github] Add sanitize for archive + * [discourse] Add sanitize for archive + * [backend] Add predefined paramaters to clients + * [pagure] Fix failing tests + * [backend] Add Gitter backend + * [gerrit] Extend `--start` param to gerrit 3.x +* Perceval-opnfv + * [travis] Upgrade setuptools and pip +* Perceval-puppet + * [travis] Upgrade setuptools and pip +* Perceval-mozilla + * [travis] Upgrade setuptools and pip +* Perceval-finos + * [travis] Upgrade setuptools and pip +* Graal + * [travis] Upgrade setuptools and pip +* Sortinghat + * [doc] Add examples of SortingHat API via Python + * [travis] Upgrade setuptools and pip + * Clarifying sortinghat intro + * Fix broken link to Perceval in README.md +* Mordred + * [mordred] Add support for github events + * [doc-git] Add parameter `run_month_days` in `enrich_git_branches` + * This commit adds config, alias, menu entry and documentaion for gitter backend. + * Fixed the typoes of docker/README.md + * [doc] Add Pagure datasource + * [tests] Remove user/password from es_enrichment section + * Remove user and password parameter from elastic section + * added section in getting started and reformatting + * added section in getting started and formatting + * [travis] Upgrade setuptools and pip + * [tests] Add requirements_tests.txt + * [docs] revamp of getting-started.md + * Fixed Broken Backlinks + * Added some sections in 'How to' of GettingStarted document + * Make anonymization optional for each backend + * fixed link for ssl error and other fixes + * fixes made as per comments + * Corrected 'Sudo' with 'sudo' + * Added how-to dump a mapping/data from an index + * added installation for docker and docker-compose, added errors and solutions in troubleshooting section + * fix typo in README.md + * Fixing typo in Sir Mordred's README.md + * [Getting-started] Update kibiter version to 6.1.4-3 + * Add "How to modify the menu" to the getting started guide + * [doc]Added section in 'How to' in Getting-Started.md + * Fixed a backlink + * [doc] Added How to section in Getting-Started + * [sirmordred] Remove duplicate call of execute_batch_tasks +* Kingarthur + * [travis] Upgrade setuptools and pip +* Manuscripts + * [travis] Upgrade setuptools and pip + * [travis] Support for python 3.5 and 3.6 +* Cereslib + * [travis] Upgrade setuptools and pip + * Fix a small typo +* Toolkit + * [travis] Upgrade setuptools and pip +* ELK + * Fix body store-and-process-github-events.yml + * [ELK] Add poetry support + * [releases] Add release note for feature #853 + * [ELK] Store and process github events + * [enrich-git] Add the param `run_month_days` to enrich_git_branches + * [enriched-git] Handle connection problems during enrich_git_branches + * This commit addds support for gitter backend. Raw and Enriched indexes have been added along with their tests and schemas. + * [pagure] Add support for Pagure + * updated the docstring for pair_programming + * [enriched-bugzillarest] Add new field `is_open` + * changed logic to delete all test indexes + * added test for pair_programming + * [travis] Upgrade setuptools and pip + * [enriched] Check first if the instance of `item` is dict + * add language field and compute all cocom study metrics per language + * added projects_map db to improve coverage + * [releases-notes] Add release note for fix #826 + * [enriched-meetup] Handle event without geolocation + * [meetup] Make users anonymization optional for meetup + * [gitlab] Make owners data anonymization optional for gitlab + * [github] Make owners data anonymization optional for github + * [git] Make author anonymization optional for git + * Make anonymization optional for each backend + * modified:final test_git.py + * [schema] Update dockerhub.csv + * [schema] Update askbot.csv + * [schema] Update mattermost.csv +* Sigils + * [bugzilla-timing] Change `painless_time_to_now` instead of `timeopen_days` + * [github] Add dashboard about closed events + * [bugzilla-backlog] Change `painless_time_to_now` instead of `timeopen_days` + * [bugzilla] Change `painless_time_to_now` instead of `timeopen_days` + * [gitter] Add gitter panels. + * Updated docker.json, replaced sirmordred repo link -## 18.05-03 -Released: 2018-05-31 +# 0.2.39 -* SortingHat +Released: 2020-03-20 +* Kidash + * [kidash/kidash] Delete dependency with `grimoirelab-panels` + * [doc] Update README +* Graal + * [graal] Update license and copyright information +* Cereslib + * [events] Add support for multiple affiliations +* Mordred + * [doc] Add PyCharm installation instructions + * added logging to file support for micro.py + * Troubleshooting fixed + * [doc] Fix askbot configuration typos + * Fix broken backlinks in supported resources + * Refracted Readme, Added navigation and contents + * Fixed README for docker-compose(without SearchGuard) with changes + * Corrected mariadb services for docker-compose.yml for without SearchGuard section + * [doc] Added Getting-Started doc + * added color logging facility in micro.py + * [micromordred] Replace actual api-token + * fixed username and pass for kibiter login + * Update README.md troubleshooting section - processes conflict with SearchGuard + * Update README.md troubleshooting section - processes conflict with SearchGuard + * Update 'Source code and docker' section of README.md to include unsecure docker-compose + * correcting spelling mistakes in Readme + * Added Empty Index Problem with Solution in troubleshooting section of Readme + * [utils] Add script to upload menu and dashboards + * Fixed phase enrichment time duration not counting days + * Added troubleshooting section in readme + * [sirmordred] Remove support for arthur + * [task_panels] Upload panels from the sigils module + * Merge branch 'add-colic' of 'https://github.com/snack0verflow/grimoirelab-sirmordred' + * [doc] Update readme with colic data and fix lexical order + * [readme] Improve doc to get a token for twitter + * [doc] Add sample cocom fields +* ELK + * [schema] Add attribute for multi org names in github_pull_requests.csv + * [schema] Add attribute for multi org names in github_issues.csv + * [schema] Add attribute for multi org names in git.csv + * [enriched-mappings] Update aoc mappings + * [enriched-study-ceres-onion] Support for multiple affiliations + * [tests] Add tests for multi_org_name fields + * [jira] Propagate multiple affiations attributes + * [gerrit] Propagate multiple affiations attributes + * [grimoire_elk] Add support for multiple affiliations + * modified: tests/test_git.py + * [raw-gerrit] Handle long text for data.patchSets.comments.message + * Update github_backlog.csv for a field missing + * [git] Include fields related with sortinghat when it is disabled + * [meetup] Include fields related with sortinghat when it is disabled + * [gitlab] Include fields related with sortinghat when it is disabled + * [github] Include fields related with sortinghat when it is disabled + * [sortinghat] Create enriched fields related to Sortinghat when it is disabled + * [enriched-gitlab] Fix repository value in issue + * [schema] Update field description + * [schema] Add project and project_1 descriptions to jenkins + * [elk] Remove support for arthur + * Update the mattermost.csv to fix a format issue + * [doc] Update readme for secure elasticsearch * Perceval -** [tests] Increase coverage pipermail -** [pipermail] Disable SSL verification -** Mozilla -** OPNFV -** Puppet + * [groupsio] Update log message + * [perceval] Update license and copyright information + * [backend] Add Pagure backend to Perceval + * [perceval] Update license info + * [groupsio] Format from_date with utc+0 timezone + * [doc] Fix broken link in README +* Sigils + * [jenkins] Add index pattern + * Remove date formatting for grimoire_creation_date + * [all_enriched_tickets] Add date format + * [all_enriched] Add grimoire_creation_date format + * [affiliations] Add grimoire_creation_date format + * [github_issues] Update index pattern to include multi org names + * [git_areas_of_code] Update index pattern to include multi org names + * [git] Update index pattern to include multi org names + * [all_onion] Update index pattern to include multi org names + * [all_enriched_tickets] Update index pattern to include multi org names + * [all_enriched] Update index pattern to include multi org names + * [affiliations] Update index pattern to include multi org names + * Update affiliations index pattern + * [jenkins-job-categories] Add Jenkins projects pie chart + * [jenkins-nodes] Add Jenkins projects pie chart + * [jenkins-jobs] Add Jenkins projects pie chart + * [jenkins] Add Jenkins projects pie chart + * [jenkins] Update index pattern + * [twitter] Add link format to author_uuid field + * [stackoverflow] Add link format to author_uuid + * [slack] Add link format to author_uuid field + * [rss] Add link format to author_uuid field + * [redmine] Add link format to author_uuid field + * [meetup] Add link format to author_uuid field + * [mediawiki] Add link format to author_uuid field + * [mbox] Add link format to author_uuid field + * [mattermost] Add link format to author_uuid field + * [maniphest] Add link format to author_uuid field + * [kip] Add link format to author_uuid field + * [jira_resolution_date] Add format to author_uuid + * [jira] Add link format to author_uuid field + * [irc] Add link format to author_uuid field + * [gitlab-mrs] Add link format to author_uuid field + * [gitlab-issues] Add link format to author_uuid + * [github2-prs] Add link format to author_uuid + * [guthub2-issues] Add link format to author_uuid + * [git-aoc] Add link format to author_uuid field + * [gerrit] Add link format to author_uuid field + * [discourse] Add link format to author_uuid field + * [demographics] Add link format to author_uuid + * [confluence] Add link format to author_uuid field + * [bugzilla] Add link format to author_uuid field + * [askbot] Add link format to author_uuid field + * [all_onion] Add link format to author_uuid field + * [all_enriched_tickets] Add format to author_uuid + * [github-issues] Add link format to author_uuid + * [git] Add link format to author_uuid field + +# 0.2.38 + +Released: 2020-02-25 +* Perceval + * Fixed Typos and Grammatical Errors + * [telegram] Handle edited messages + * Update doc in README + * [github] Update the docstrings + * [twitter] Support for SSL verification + * [telegram] Support for SSL verification + * [stackexchange] Support for SSL verification + * [slack] Support for SSL verification + * [rss] Support for SSL verification + * [launchpad] Support for SSL verification + * [jenkins] Support for SSL verification + * [meetup] Support for SSL verification + * [mediawiki] Support for SSL verification + * [hyperkitty] Support for SSL verification + * [googlehits] Support for SSL verification + * [gitlab] Support for SSL verification + * [dockerhub] Support for SSL verification + * [discourse] Support for SSL verification + * [confluence] Support for SSL verification + * [bugzillarest] Support for SSL verification + * [groupsio] Support for SSL verification + * [github] Support for SSL verification + * [jira] Support for SSL verification + * [mattermost] Support for SSL verification + * [phabricator] Support for SSL verification + * [pipermail] Support for SSL verification + * [mbox] Support for SSL verification + * [redmine] Support for SSL verification + * [bugzilla] Support for SSL verification + * [askbot] Support for SSL verification + * [client] Support for tunable SSL verification + * [backend] Allow to disable SSL verification + * [doc] Update groupsio documentation in README.md + * [groupsio] Fetch messages after a given date +* ELK + * [github2] Fix loading identities + * [github] Fix filter classified in GitHub and GitHub2 enrich + * add schema for backlog studie + * Add additional index to compute the chronological evolution of opened issues and average opened time issues. + * add description in git schema for commit_tags field + * add "tags" field in git enriched index to get the number of releases. + * [schema] Add scheams for docker smells and deps + * [grimoire_elk] Add connectors for docker smells and deps + * [grimoire_elk] Support for Docker smells analysis + * [grimoire_elk] Support for Docker dependencies analysis + * Update README.md + * [tests] Stop loop when finding a target study + * [tests] Move httpretty to requirements_tests + * [github2] Add support for feeling study + * [enriched-enrich] Add enrich_feelings study + * [schema] Add CSV for survival git data + * [dependencies] Add statsmodels dep to setup and requirements + * [enriched-git] Add support for survival study + * [enriched-enrich] Add survival developer study + * [doc] Add documentation to run tests and coverage + * [doc] fix mistake in README.md + * [enriched-telegram] Handle edited message + * [enriched-telegram] Handle missing username in Telegram messages + * [enriched-jira] Handle missing creator/ assignee displayName and name + * [tests] Fix tests for enrich_geolocation + * [raw-bugzillarest] Prevent indexing of clones attribute +* Hatstall + * [hatstall] Fix method editing organization domain + * Update templates location to make the application self-contained + * Update files to create the django-hatstall pip package + * [docs] Update documentation * Mordred -** [studies] Allow setting up kafka_kip via cfg -** [task_projects] Add new eclipse_projects_lib.py -** [tests] Add tests for task_manager -** [config] Include sections for studies -** [tests] Align tests for studies with new functionalities -** [task_enrich] Forward study params to ELK -** [tests] Enable tests with latest versions of grimoirelab components -** [task] Improve parsing parameters for perceval - -* grimoirelab-elk -** [twitter] Set field_date for twitter enricher to created_at -** [enrich][bugzilla] Remove emails from enriched index -** [enrich][meetup] Change log from error to warning when the date are incorrect from upstream data -** [gelk-mapping] Add the script to setup.py so it is installed with the pip package -** [gelk_mapping] Generate files with the JSON mappings to be used by elasticdump to create the indexes -** [elk] Propagate study params from mordred to elk -** [enrich] Create all_onion alias if not exist -** [git] Generalize areas of code study -** [gelk_mapping.py] Script to show the mappings for a data source -** [raw] Reduce the number of fields indexed for jenkins items -** [elk] Fix enrichment of stackexchage answers - + * [mordred] Add support for backlog analysis study + * [doc] Add instructions to use dockersmells and dockerdeps + * [doc] fix docker-compose file + * Removed faulty parameter from utils/setup.cfg + * [aliases] Fix supybot alias `irc` instead of `supybot` + * [doc] Add instructions to execute the enrich_feelings study + * [config] Add `enrich_feelings` study + * [doc] Add instruction to execute `enrich_forecast_activity` study + * [config] Add support for `enrich_forecast_activity` study + * [sirmordred] Remove doc folder + * [config] Remove write_doc method + * [doc] Add an example of setup.cfg and projects.json for each data source + * [doc] Clarify the behavior of the 'Data Status' and 'Overview' dashboards + * [aliases.json] Remove old github2 aliases + * Add info about labels +* SortingHat + * [tests] Fix `test_not_null_source` in test_model + * [db-model] Remove CoerceToBool type + * Add requirements file +* Graal + * [coqua] Add support for Docker smells analysis + * [tests] Add travis support for Jadolint + * [codep] Add support for Docker dependencies analysis + * [analyzers] Add support for Jadolint + * [graal] Add exec_path as default parameter + * [graal] Use backend name to init default git path +* Sigils + * [docker] Add dashboard for docker smells and dependencies + * [feelings] Add dashboard for github comments, collaboration and feelings + * [org-tracking] Add org tracking dashboard + * Add organization tracking overview documentation + * [doc] Delete hidden documentation pages + * [doc] Update link for mediawiki dashboard + * [sigils] Remove images in docs/assets/images + * [doc] Add info to create a Gemfile in contributing.md + * Update Affiliations documentation + * Uodate all_enriched index pattern + * Update text of Hatstall links from Affiliations + * Fix collaboration dashboards documentation + +# 0.2.37 + +Released: 2020-01-28 + +* ELK + * [enriched-gitlab] Fix repository value in merge + * [travis] Support for python 3.7 + * [requirements] Relaxing pandas constraint + * [enriched-github2] Add support for geolocation study + * [enriched-enrich] Add geolocation study + * [enriched-github2] Remove hardcoded geolocation support + * [enrich-github] Remove dead code + * [enriched-github] Remove hardcoded geolocation support + * [dep] Add geopy dependency + * [enriched-dockerhub] Handle never updated images + * [git-enriched] Remove github commit support + * [elastic] Refactor all_properties method + * [tests] Add tests for elastic.py + * [elastic] Change logic to handle errors when creating a mapping + * [elastic] Initialize `error` variable for `safe_put_bulk` + * [elastic] Improve methods documentation + * [elastic] Rename `_check_instance` method + * [elastic] Replace dateutil call with str_to_datetime + * [elastic] Move logic to create index to new method + * [elastic] Enable loading of complex aliases + * [tests] Fix CI tests for elastic items + * (fix-ci-travisx) [elastic_items] Improve doc and test coverage + * [elk] Replace ElasticConnect, ElasticWriter exceptions with ElasticError + * [errors] Add ElasticError + * Let pandas be >= 0.22.0 + * [utils] Remove track_items script and related methods + * [elk] Remove `get_items_from_uuid` method + * [github2] Update github2 fields + * Fix possible error 2 + * Fix possible error + * Fix flake8 errors + * Add support for releasing scroll and waiting for available scroll (wait configurable amount of time) + * [enriched-colic] Handle missing commit message + * [enriched-cocom] Handle missing commit message + * [schema] Update colic schema + * [schema] Update cocom schema + * [enriched-colic] Handle credentials in origin + * [enriched-cocom] Handle credentials in origin + * [raw-github] Handle immense term for data.reviews_data.body +* Hatstall + * [docker] Download Hatstall code while the container is built +* Mordred + * [doc] Add example for github2 sections + * [travis] Support python 3.7 + * [config] Add support for geolocation study + * [sirmordred] Remove support for github commit + * [aliases] Handle complex aliases + * [doc] Add notes to enable github-comments + * [aliases] Add github2 aliases for issues and pull requests + * [task_panels] Support github-comments dashboard upload + * [config] Add support for github-comments + * [tests] Add test with archives for task_enrich + * [tests] Optimize test for task_collection + * [doc] Complete list of data sources supported + * Made gitlab issues naming consistent +* SortingHat + * [setup] Let pandas be >= 0.22.0 +* Cereslib + * [setup] Reduce constraints on dependencies * Sigils -** [panels] Add accepted answers to Discourse panel -** [panels] Add areas of code panel -** [confluence] Increase rows and sort by page edits -** [confluence] Use `content_url` for page links + * [docs] Add documentation for gerrit approvals dashboard + * [gerrit-approvals] Fix typo in `Approvals by Contributor` + * [docs] Add documentation for gerrit dashboard + * [docs] Update name and image of gerrit review efficiency dashboard + * [docs] Update gerrit review efficiency + * [gerrit] Align nomenclature in Gerrit panels + * Fix schema links + * Fix broken link to github2_issues schema + * [gerrit_approvals] Add total number of approvals + * Add GitHub pull requests collaboration dashboard + * Add GitHub issues collaboration and comments dash + * Update affiliations dashboard + * [colic] Update colic panels + * [cocom] Update cocom panels + * Update Jekyll installation instructions + * Update Kidash installation to mention Python 3 -* Manuscripts -** [metrics][gerrit] Use closed date field for computing the TTM (time to merge) metric -* Kidash +# 0.2.36 -* GrimoireLab Toolkit +Released: 2019-01-08 -* King Arthur -** [setup] Update Perceval version -** [jobs] Modify imports of perceval functions +* ELK + * [enriched] Remove support geolocation for github enriched indexes -* Bestiary -* Hatstall +# 0.2.35 -* Ceres +Released: 2019-01-03 +* ELK + * [raw-bugzillarest] Set text mapping type for thetext attribute +* Graal + * Fix lizard package dependency +* Hatstall + * [hatstall] Support check/uncheck all options in checkbox tables + * [hatstall] Add support for editing organizations and domains +* Kidash + * [setup] Remove ELK dependency + * [kidash/kidash] Remove ELK imports + * [bin/kidash] Remove ELK imports + * [bin/kidash] Remove unused imports +* SortingHat + * [database] Allow SSL connections -## 18.05-02 -Released: 2018-05-17 +# 0.2.34 -* SortingHat +Released: 2019-12-19 * Perceval -** [setup] Fix to let setup.py test run -** Add readthedocs badge -** [backend] Replace datetime import with grimoirelab-toolkit -** Mozilla -*** Fix support for package namespaces -** OPNFV -*** Fix support for package namespaces -** Puppet -*** Fix support for package namespaces - -* Mordred - -* grimoirelab-elk -** [enrich][twitter] Use case insesitive tags for doing the projects mapping -** [studies][demography] Add tests for the study -** [studies][demography] Use author_id field to aggregate the authors instead of Author + * [jenkins] Log debug message when builds are not found + * [jira] Add info for data obtained with authenticated access * Sigils + * Update CONTRIBUTING.md + * [engagement panel] Fix dashboard name + * [colic] Fix dashboard name + * [cocom] Fix dashboard name + * Fix file name to use hypens instead of underscores + * [github_issues] Retitle issues open to issues + * [gitlab_issues] Retitle issues open to issues + * [about] Add mention to CHAOSS project + +* ELK + * [enrich-gitlab] Handle TypeError: 'NoneType' exception + * [utils] Add 429 error to status_force_list + * [enriched-gerrit] Handle missing user info -* Manuscripts -** [docstrings] Complete docstrings for manuscripts +* SirMordred + * [docker] Remove track_items info from readme + * [tests] Fix flake8 errors + * Add unit tests for the main methods of healthcheck.py + * Add healthcheck to Docker image with a call to the script 'utils/healthcheck.py' + * Add healthcheck script to installation setup file + * Python healthcheck script added to utils folder + * [task_panels] Include OSPO panels in community menu -* Kidash +* SortingHat + * [matching-email] Remove `_filter_emails` + * [matching-email] Support blacklist when strict matching is False + * [tests] Remove hard-coded DB params + * [travis] Support for python 3.5 and 3.6 + * [tests] Set mysql `sql_mode` in travis + * [tests] Add mysql service to travis.yml -* GrimoireLab Toolkit -* King Arthur +# 0.2.33 -* Bestiary +Released: 2019-11-28 -* Hatstall +* Sigils + * [git] Update index pattern to include hour/weekday fields + * [meetup] Update index pattern to handle group_urlname attribute + * [gerrit] Update painless_delay in index pattern + * [all_enriched] Make URLs clickable + * [demographics] Update screenshot + * [sigils] Add OSPO panel collection -* Ceres +* Perceval + * [gitlab] Raise client error if oauth is set and token is not + * [discourse] Pass credentials via headers + * [jenkins] Handle workflow multibranch job builds + * [tests] Fix variable names in github test + * [github] Handle `None` requested reviewers + * [groupsio] Add log message upon download archives failure + * [travis] Support for python 3.5 and 3.6 + * [doc] Add git and build-essential to requirements section + + +* Graal + * [tests] Increase test coverage for codep and colic + * [graal] Fix worktree creation + * [graal] Change logic to create worktree + * [tests] Add base class to handle tests on analyzers + * [tests] Add base class to handle setup of test Git repo + * [graal] Replace git cmd with /usr/bin/git + * [readme] Add SCC description to README.md + * [tests] Add tests for SCC analyzer + * [cocom] Added support of scc analyzer to Code Complexity Backend + + +* KingArthur + * [server] Add reschedule method to the REST API + * [arthur] Allow to re-schedule failed tasks + * [scheduler] Allow to reset task counters + * [scheduler] Handle TaskRegistryError + * [server] Fix docstring for `task` + * [arthur] Handle TaskRegistryError + * [tasks] Raise TaskRegistryError on task operations + * [errors] Add TaskRegistryError + * [tasks] Handle Redis errors + * [arthur] Fix typos and warnings + * [tasks] List tasks based on key prefixes + * [tasks] Convert exception to warning when updating tasks + * [tasks] Replace dangerous redis commands + * [scheduler] Support for reading tasks from redis + * [tasks] Add update operation + * [tasks] Use redis to store tasks + * [scheduler] Reschedule failed tasks into the retry queue + * [travis] Support for python 3.5 and 3.6 + * [tasks] Add JobData tuple to store jobs in the task job list + * [server] Return job_number from the metadata of the Job + * [scheduler] Save job_number in the meta field of the job enqueued + + +* Grimoire ELK + * [github2] Add schema for new version of pull index + * [github2] Add schema for new version of issue index + * [enriched-github2] New enricher to handle comments and reactions + * [enriched-git] Handle missing local git repo + * [travis.yml] Support for tests using ODFE + * [studies-aoc] Support for ODFE + * [studies-onion] Support for ODFE + * [enriched] Update bulk endpoint to support ODFE + * [enriched-enrich] Update bulk endpoint for ODFE + * [enriched-ceres_base] Add class variable for ES major version + * [elastic_items] Handle ODFE page info on pagination + * [elastic] Update bulk and mapping endpoints for ODFE + * [enriched-gerrit] Handle missing reviewer info + * [raw-elastic] Change to 'format()' in the logs + * [elk] Change to 'format()' in the logs + * [elastic_items] Change to 'format()' in the logs + * [elastic] Change to 'format()' in the logs + * [enriched-study_ceres_onion] Change to 'format()' in the logs + * [enriched-study_ceres_aoc] Change to 'format()' in the logs + * [enriched-stackexchange] Change to 'format()' in the logs + * [enriched-sortinghat_gelk] Change to 'format()' in the logs + * [enriched-remo] Change to 'format()' in the logs + * [enriched-mozillaclub] Change to 'format()' in the logs + * [enriched-meetup] Change to 'format()' in the logs + * [enriched-mediawiki] Change to 'format()' in the logs + * [enriched-mbox_study_kip] Change to 'format()' in the logs + * [enriched-mbox] Change to 'format()' in the logs + * [enriched-kitsune] Change to 'format()' in the logs + * [enriched-jira] Change to 'format()' in the logs + * [enriched-jenkins] Change to 'format()' in the logs + * [enriched-gitlab] Change to 'format()' in the logs + * [enriched-enrich] Change to 'format()' in the logs + * [enriched-ceres_base] Change to 'format()' in the logs + * [enriched-askbot] Change to 'format()' in the logs + * [enriched-git] Change to 'format()' in the logs + * [enriched-gerrit] Change to 'format()' in the logs + * [enriched-functest] Change to 'format()' in the logs + * [enriched-dockerhub] Change to 'format()' in the logs + * [enriched-discourse] Change to 'format()' in the logs + * [enriched-bugzillarest] Change to 'format()' in the logs + * [enriched-bugzilla] Change to 'format()' in the logs + * [enriched-colic] Change to 'format()' in the logs + * [enriched-cocom] Change to 'format()' in the logs + * [enriched-github] Change to 'format()' in the logs + * [enriched] Return empty item_sh when sortinghat is not set + * [enriched-meetup] Fix typo in group url name + * [dependencies] Update redis to 3.0.0 + * [enriched-bugzillarest] Handle missing user info + * [travis] Support for python 3.5 and 3.6 + * [elastic_items] Remove white spaces from repo url with labels -## 18.05-01 -Released: 2018-05-10 +* SirMordred + * [sirmordred] Remove unused modules and change to 'format()' in the logs + * [sirmordred] Delete support to log rotation + * [doc] Remove eclipse load support for doc + * [sirmordred] Delete support to load eclipse projects + * [mordred] Decommission bot names params from setup.cfg + * [sortinghat] Fix issue when sortinghat is not in the config file + * [travis] Support for python 3.5 and 3.6 -* SortingHat -** [readme] Include troubleshooting section -* Perceval -** [mattermost] Add Mattermost backend -** Fix support for package namespaces -** Mozilla -** OPNFV -** Puppet +* Cereslib + * [events-events] Handle empty sortinghat dict + * [README] Add travis and coveralls badges + * [setup.cfg] Ignore W605 error + * [install] Align dependencies in requirements and setup + * [setup.cfg] Ignore W504 error + * [setup] Remove scripts param + * [cereslib] Remove import from __init__.py + * [enrich] Fix flake8 errors + * [dfutils] Fix flake8 errors + * [tests] Add travis CI -* Mordred -** [task_enrich] Ensure number of enrich tasks decreases upon failure -** [TaskManager] Fix unreachable code - -* grimoirelab-elk -** [elk] raise exception in do_studies -** [stackexchange] Add fields to csv to track accepted answers -** [discourse] Add fields to csv to track accepted answers -** [stackexchange] Add info to get the percentage of accepted answers -** [discourse] Add info to get the percentage of accepted answers -** [onion] Check author bucket to make sure it exists -** [twitter] Change date value to index tweets -** [enriched][bugzillarest] Fix comment and remove unneeded variable -** [twitter] Limit number of indexed fields -** [stackexchange] Handle deleted users -** [discourse] Add information to track accepted answers -** [stackexchange] Add information to track accepted answers -** [elastic] Remove not used global_mapping method -* Sigils +* Toolkit + * [datetime] Handle dates with offsets outside 24h + * [travis] Support for python 3.5 and 3.6 -* Manuscripts -* Kidash +# 0.2.32 -* GrimoireLab Toolkit +Released: 2019-10-28 -* King Arthur +* Sigils + * [docs] Update demographics.png + * [git-demographics] Change column name + * [demographics] Change column name + * [demographics] Change title `demographics_people_leaving_community` + * [git-demographics] Change title `git_demographics_people_living_community` -* Bestiary +* Perceval + * [github] Make fetching owners information from GitHub API optional + * [backend] Manage filtering of classified data within lists + * [github] Replace logging with logger call + * [test_backend] Provide test for find_backends + +* KingArthur + * [scheduler] Remove 'arthur' prefix and task id from job ids schema + * [setup] Update dependencies + * [jobs] Add human readable job identifier + * [arthurd] Add ignoring log-path msg when no-daemon is on + * [arthurd] Send log messages to stderr when --no-daemon is on + * [arthur] Remove 'bin/arthur' script + * [test_server] Add test of the job server endpoint + * [server] Expose jobs by job_id to the CherryPy server + * [requirements] Update package requirements + * [jobs] Replace job result object by Perceval summary + * [jobs] Refactor 'metadata' decorator + * [jobs] Generate items using BackendItemsGenerator + * [scheduler] Reschedule failed tasks with resuming + * [jobs] Remove jobs resuming support + * [tasks] Add has_resuming() method to task + * [test_worker] Add tests related to the job log storage + * [jobs] Store logs of each job in their "meta" field + +* HatStall + * Improve login form using Bootstrap style + +* Grimoire ELK + * [elastic_items] Fix message when scroll_size is 0 + * [tests] Add test for `enrich_extra_data` + * [enriched-github] Handle missing user information + * [enriched-enrich] Fix conversion projects.json to map + * [enriched-github] Removed not needed code. Added the missing sign off + * [enriched-git] Enable extra study + * [enrich] Add extra study + * [enrich] Adding new study to enable adding extra fields to a target index + * [travis] Support tests for python 3.5 and 3.6 + * [studies] Improve log messages + * [tests] Fix test enrich items discourse + * [enriched-discourse] Remove `__show_categories_tree` method + * [elk] Remove support for filter-raw-prefix + * [tests] Align tests to filter-raw-prefix removal + * [elastic-items] Remove support for `filter-raw-prefix` + * [p2o] Remove support for filter-raw-prefix + * [enriched-git] Handle empty repository errors + * [elk] Improve log messages + * [elastic_items] Change log level message + * [elastic] Compact log messages + * [raw-elastic] Improve log messages + * [enriched-utils] Change `min_enrich` value + * [tests] Increase test coverage for raw jenkins + * [tests] Increase test coverage for raw twitter + * [tests] Increase test coverage for raw supybot + * [tests] Increase test coverage for raw stackexchange + * [tests] Increase test coverage for raw nntp + * [tests] Increase test coverage for raw meetup + * [tests] Increase test coverage for raw mediawiki + * [tests] Increase test coverage for raw mbox + * [tests] Increase test coverage for raw mattermost + * [enriched-jira] Handle missing `fields` attribute + * [tests] Increase test coverage for raw github + * [tests] Increase test coverage for raw graal + * [tests] Increase test coverage for raw git + * [tests] Increase test coverage for raw functest + * [tests] Add test case for errors class + * [tests] Increase test coverage for raw dockerhub + * [tests] Increase test coverage for raw crates + * [enriched-discourse] Handle missing author information + * [raw-jenkins] Handle multiple params on repo url + * [grimoire_elk] Goodbye track_items.py + * Add minor changes to the README file. + * remove the dashboards folder -* Hatstall +* SirMordred + * [task_identities] Call sh affiliate after loading identities file + * [task_identities] Call sh unify after loading identites file + * [travis] Support tests for python 3.5 and 3.6 + * [tests] Add tests for enrich_extra_data study + * [doc] Improve desc projects_url + * [config] Add external study + * [studies] Improve log messages + * [task_enrich] Remove support for filter-raw-prefix + * [task] Remove support for filter-raw-prefix + * [task_manager] Conver INFO messages to DEBUG + * [task_enrich] Standardize refresh identities log messages + * [sirmordred] Improve log messages related to task projects + * [mordred] Ignore INFO messages from elasticsearch + * [task_enrich] Change `last_enrich_date` value + * [dependencies] Remove manuscripts dependency + * [doc] Remove reference to `task_report` + * [mordred] Remove `task_report` + * [task_project] Prevent random shuffling of repos + * [doc] Remove reference to `track_items` + * [mordred] Remove `track_items` support + * [doc] Update kibiter version to 6.1.4-5 + * [tests] Minor enhancements on tests + * [sirmordred] Set default sleep_for value if sortinghat is undefined + * [task_identities] Remove useless inherited code + * [task_enrich] Prevent calling sortinghat when not defined + * [task] Handle missing sortinghat params + * [doc] Refine README.md introduction + + +# 0.2.31 + +Released: 2019-10-01 + +* Grimoire ELK + * [doc] Improve README.md info + * [enriched-gitlab] Include milestone id, iid and url + * Add graal to setup.py, which is now a dependency. + * [enriched-git] Add weekday and hour info to enriched commits -* Ceres +* Perceval + * [gitlab] Set extra HTTP retry status from backend + * [jenkins] Handle skipped items info in summary + * [gitlab] Handle skipped items info in summary + * [gitlab] Use generic blacklist feature + * [jenkins] Replace blacklist-reviews with blacklist-ids + * [gerrit] Replace blacklist-reviews with blacklist-ids + * [backend] Add support for blacklisting items + * [errors] Add BackendCommandArgumentParserError + * [backend] Add origin unique field + * [backend] Change signature BackendCommandArgumentParser + +* Perceval-mozilla, Perceval-puppet, Perceval-opnfv, Perceval-finos + * [backend] Change signature BackendCommandArgumentParser +* Sigils + * [gitlab] Update index pattern for merge requests + * [gitlab] Update index pattern for issues -## 18.04-04 +* Graal + * [graal] Update metadata fields + * [backend] Change signature BackendCommandArgumentParser -Released: 2018-04-26 +* Manuscripts + * [manuscript] Fix flake8 errors + * [setup.cfg] Ignore W605 errors + * Added first line to make these files executable. + * [manuscripts] Update license and copyright info + * [setup] Fix format type for long description of package -* SortingHat +* SirMordred + * [README.md] Add projects.json section + * [utils] Comment arthur params in es-collection section + * [task_collection] Add filter-no-collection to ignore the collection + * [task_identities] Log number of organizations loaded + * [task_identities] Support lazy load of SH identities files + * [task_identities] Support lazy load of SH organizations + * [task_identities] Add `get_file_hash` function + +# 0.2.30 + +Released: 2019-09-18 + +* Grimoire ELK + * [tests] Fix demography test for gerrit + * [enriched-gerrit] Handle missing user information + * [enriched-onion] Filter bots from onion study + * fix num row error that GitHub complained about + * [enriched-aoc] Include origin in AOC items * Perceval -** Mozilla -** OPNFV -** Puppet -* Mordred -** [setup] Fix dependency on manuscripts -* grimoirelab-elk -** [jira] Disable dynamic mappings for data.changelog.histories -** Remove ES 2.x mappings for all data sources (alexandria is now in ES 5.1) -** [enrich] Remove emails from all enriched indexes -** [tests] Add tests using csv mappings (disabled until the results of the tests are fixed) -** [tests] Add owlwatch model to test mappings -** [phabricator] Handle long description.raw value in raw items -** [setup] Add dependency on SortingHat -* Sigils (old panels) -* Manuscripts (old reports) -** [its] Use closed_at as FIELD_DATE for closed issues metrics -** [metrics][gerrit] Use as date field closed in merged and abandoned reviews -* Kidash -* GrimoireLab Toolkit -* King Arthur -** [docker] Build various docker images -* Bestiary -* Hatstall -* Ceres + * [backend] Add search fields in metadata items + * [backend] Write summary of results to the backend command log + * [backend] Fix typos in backend module documentation + * [tests] Generate different 'updated_on' values for backend tests + * [backend] Organize BackendItemsGenerator parameters + * [backend] Add BackendItemsGenerator context manager + * [backend] Include summary of fetch executions + * [perceval] Add summary class +* Sigils + * [demographics] Rename demographics_leaving_developers + * [meetup] Update index pattern +* SirMordred + * [task_panels] Add contact link inside the About item of the menu + * [task_projects] Remove projects_last_diff + * [doc] Update README.md with graal-related panels attributes + * [utils] Update conf files to use graal backends -## 18.04-03 +# 0.2.29 -Released: 2018-04-18 +Released: 2019-09-02 +* Grimoire ELK + * [tests] Remove reference to ocean-unique-id + * [schema] Remove ocean-unique-id + * [raw-askbot] Remove fix_item + * [tests] Add main to test_load_identities + * [jenkins] Remove ocean-unique-id frmo schema + * [Jenkins] Update CSV schema for Jenkins +* Perceval + * [groupsio] Replace HTTP basic auth with cookies based auth (hace 52 minutos) + * [slack] Pass API token via headers + + +# 0.2.28 + +Released: 2019-08-29 + +* Grimoire ELK + * [enriched-git] Remove credentials from Git URLs + * [enriched-mediawiki] Remove identity/project info in get_rich_item + * [enriched-gerrit] Add status of gerrit changeset + * [enriched-gerrit] Handle negative time to first review + * [enriched-gerrit] Add time to first review patchsets + * [enriched-gerrit] Add time to first review + * [schema] Add mattermost schema + * [mattermost-enriched] Remove commented code + * [mattermost-enrich] Add channel name and creation date + * [logger] Add logs for study and Fix CoLic query + * [colic] Add category reference implementation and corresponding tests + * [tests:study] Add tests for CoCom & CoLic study implementation + * [schema] Add CoCom and CoLic schema + * [graal:tests] Add appropriate tests for Graal integration (WIP) + * [graal] Add connector for Graal Backends and Segregate common methods + * [graal] Add CoCom & CoLic enricher along with study implementation + * [requirements.txt] Add Graal module dependency for integration + * [dependencies] Update pandas dependency to 0.22.0 + * [meetup] Store `group_created` as date + * Fix outdated link to GrimoireLab tutorial + * [schema] Add time_to_first_attention to github_issues.csv +* Graal + * [graal] Force checkout command + * [colic] Filter softlinks from analysis + * [colic] Filter dir paths from analysis + * [analyzer] Add `diff_timeout` param to cloc analyzer + * [analyzers] Suppress deprecation warning lizard.analyze_file + * [docs] Update CoLic definition under documentation adn docstrings + * [colic] Add copyright flag for extraction of copyright information + * [cloc] Fix cloc error due to mulitple word language-name + * [graal] Update license info + * [setup] Fix format type for long description of package + * [tests] Fix test_init in test_graal + * [analyzer] Fix scancode_cli results + * [docs] Update documentation and links to requirements + * [cocom] Add repository level analysis via lizard + * [analyzer] Fix results for deleted files and alter tests + * [logger] Switch `info` logger level to `debug` + * [tests] Add test for deriving `git_path` from `uri` + * [graal] Derive `git_path` from `uri` +* KingArthur + * Update to RQ 1.0 +* Perceval + * [meetup] Pass oauth2 token via headers + * [tests] Increase test coverage mattermost + * [mattermost] Add channel info + * [github] Add example to initialize backend from code + * [tests] Fix metadata_updated_on of MockedBackend + * [dependency] Unpin httpretty dependency + * [doc] Remove httpretty details from Running tests section +* Sigils + * [gerrit_timing] Add time to first review info + * [gerrit] Update index pattern + * [mattermost] Add channel visualization + * [docs] Add CoCom & CoLic documentation + * [graal] Add Code License(CoLic) panels + * [graal] Add Code Complexity(CoCom) panels +* SirMordred + * [mordred] Update redis dependency + * [doc] Add section to set up dev env with Pycharm + * [doc] Update doc getting started + * [requirements] Add Graal module to requirements.txt + * [graal] Add configuration for Graal integration in ELK + * [tests] Add gerrit and its study sections + * [doc] Improve doc about `github-repos` param in panels section + * [doc] State Elasticsearch, Kibiter, MySQL/MariaDB versions + * [tests] Clean requirements.txt + * [setup] Remove dependencies installed by other components + * [tests] Clean travis.yml + + +# 0.2.27 + +Released: 2019-07-23 + +* Grimoire ELK + * [enriched-enrich] Handle errors in demography study + * [schema] Update Jira csv + * [enriched-jira] Track creator, assignee, reporter in issues + * [enriched-jira] Handle missing identity data + * [enriched-github] Set roles to allow refresh identities +* KingArthur + * [writers] Ignore Elasticsearch certificate verification + * [scheduler] Schedule task jobs in user-defined queues + * [tasks] Add queue parameter to scheduler config + * [scheduler] Set to completed tasks with expired lifetime + * [tasks] Add task lifetime attribute + * [tests] Fix server tests with non-real repositories + * [server] Publish task information + * [tasks] Use datetime_utcnow() when creating tasks + * [jobs] Add funtion to convert job results to dicts + * [scheduler] Set infinite time-to-live for jobs and results + * [scheduler] Update task jobs list when a job is enqueued + * [tasks] Add attribute to Task to store its list of jobs + * [scheduler] Handle starting job events + * [events] Add task identifier to job event class + * [events] Add event to notify when a job starts + * [events] Remove handlers initialization in JobEventsListener + * [scheduler] Refactor event handlers + * [writers] Update dynamic templates + * Install Arthur using pip in TravisCI + * [scheduler] Rename task scheduler public methods + * [scheduler] Delegate queue selection to the task scheduler + * [scheduler] Refactor private class JobScheduler in a TaskScheduler + * [scheduler] Update tasks status during its life cycle + * [tasks] Define task life cycle + * [events] Allow job events subscription + * [events] Add basic job events + * [events] Extract job listener to create a job events listener + * [README] Fix coveralls badge + * Update for rq async parameter rename, pin rq to 0.12.0 +* Perceval + * [gitlab] Recalculate outdated list of merge requests + * [slack] Handle `num_members` for archived channels + * [jenkins] Support authenticated access using user/API token + * [client] Add `auth` param to fetch method +* Sigils + * [affiliations] Udate index pattern + * [jira] Update panels to new index structure + * Update index patterns to add analyzed fields + * [meetup] Update index pattern to fix dates * SortingHat + * [setup] Set pandas dep version to 0.22.0 + * [sortinghat] Update copyright info + * [setup] Pin pandas dependency + + +# 0.2.26 + +Released: 2019-07-08 + +* Grimoire ELK + * [mediawiki] Fix grimoire_creation_date calculation + * removed .DS_Store + * Added check so that program does not break if aliases is None + * [raw-bugzillarest] Set text mapping type for changes attributes + * [elk] Add option to fetch from selected branches + * [elk] Return error msg from `feed_backend` + * [elastic] Use InvalidDateError in `get_last_item_field` + * [ELK] Make explicit indexing when mapping is of text type + * [enriched-redmine] Use grimoirelab-toolkit datetime functions + * [enriched-redmine] Add text mapping + * [enriched-mozillaclub] Add text mapping + * [enriched-mediawiki] Use grimoirelab-toolkit datetime functions + * [enriched-mediawiki] Add text mapping + * [enriched-jira] Add text mapping + * [enriched-gerrit] Add text mapping + * [enriched-discourse] Add text mapping + * [enriched-bugzillarest] Use grimoirelab-toolkit datetime functions + * [enriched-bugzillarest] Add text mapping + * [enriched-bugzilla] Use grimoirelab-toolkit datetime functions + * [enriched-bugzilla] Add text mapping + * [elk] Use grimoirelab-toolkit datetime functions + * [enriched-utils] Remove function `unixtime_to_datetime` + * Update description of time_open_days and time_to_close_days + * [enriched-meetup] Store created, time, updated as date + * [ELK] Update variable from KEYWORD_MAX_SIZE to KEYWORD_MAX_LENGTH + * [enriched-enrich] Decrease max keyword size * Perceval -** Mozilla -** OPNFV -** Puppet -* Mordred -* grimoirelab-elk -** [jenkins] Update raw mappings to deal with large comments -** [jira] Handle data.changelog.histories fields -** [tests] Update test load identites -** [elk] load identities by bulks to sortinghat -** [sortinghat_gelk] Handle possible exeception when adding identities -* Sigils (old panels) -* Manuscripts (old reports) -** [report] Show the perdiod names always as YY-Q[1-4] (16-Q4) -* Kidash -* GrimoireLab Toolkit -* King Arthur -* Bestiary -* Hatstall -** [mod_wsgi] Fix settings so Hatstall works inside Apache mod_wsgi -* Ceres - + * [git] Add proxy support to git clone command + * [mediawiki] Skip page without `pageid` attribute + * [gitlab] Update description for --is-oauth-token + * [meetup] Enable oauth token use +* Sigils + * [twitter] Add bots filter to panel + * [stackoverflow] Add bots filter to panel + * [slack] Add bots filter to the panel + * [rss] Add bots filter to panel + * [mozilla-reps] Add bots filter to panels + * [redmine] Add bots filter to redmine panels + * [mozillaclub] Add bots filter to panel + * [meetup] Add bots filter to Meetup panels + * [mediawiki] Add bots filter to panel + * [mbox] Add bots filter to mailing lists panel + * [maniphest] Add bots filter to panels + * [chaoss-gmd] Add bots filter to panels + * [git] Add bots filter to lifecycle panel + * [jira] Add bots filter to Jira panels + * [irc] Add bots filter + * [gitlab] Add bots filter to Issues and MRs panels + * [github] Add bots filter to Issues and PRs panels + * [git] Add bots filter to Git demographics panel + * [gerrit] Add bots filter and fix backlog panel + * [discourse] Add bots filter to panel + * [demographics] Add bots filter to panel + * [confluence] Add bots filter to panel + * [bugzilla] Add bots filter to bugzilla panels + * [askbot] Add bots filter to panel + * Set the right screenshot + * [affiliations] Fix label affiliations_authors_organizations chart +* SirMordred + * [tests] Add mysql service to .travis.yml + * [tests] Update slack archive + * [task_collection] Return errors info for task collection -## 18.04-02 -Released: 2018-04-14 +# 0.2.25 -* SortingHat +Released: 2019-06-23 +* Grimoire ELK + * [raw-jira] Handle data.fields.environment in raw indexes * Perceval -** [phabricator] Handle project info in core:edge transactions -** Update copyright information -** [phabricator] Include project/user information in task transactions -** [jenkins] Control detail level of Jenkins data -** [gerrit] Rename parameter 'url' to 'hostname' -** Mozilla -*** [mozillaclub] Change log level message when missing event data -** OPNFV -** Puppet + * [README] Add info to obtain a Groups.io API token + * [groupsio] Improve documentation to obtain an API token + * [groupsio] Fix description `api_token` + * [groupsio] Fix invalid value for 'limit' in subscriptions query +* Sigils + * Add how to import panel into Kibana/Kibiter + * [gerrit] Update index pattern +* SirMordred + * [task_enrich] Populate identities index only when retetion is on -* Mordred -** [task] Include projects data when creating the enrich backend for studies -** [[task_report] Fix import from report.report to manuscripts.report -** [Improve documentation about "bulk_size" and "scroll_size" -** [[tests] Update archives after sanitizing archived data - -* grimoirelab-elk -** [enrich][jira] Check that main_description field is not None before trunctating it -** [doc] Add information about alias to studies doc -** [studies] Add alias management to onion study -** [studies] Add alias management for areas of code -** [studies] Add methods to manage aliases -** [enrich] Add meta fields only if the meta field is a dict -** [tests] Add test for load identities in sortinghat -** [schema] Add Gerrit CSV aggregatable and description fields -** [phabricator] Handle dots in JSON attribute names -** [nntp] Remove X-fields in raw data -** [mbox] Remove X-fields in raw data -** [tests] Include _fix_item method in tests -** [nntp] Use mbox mappings for NNTP items -** [enrich] Handle case sensitive attributes in mbox items -** [enrich][metadata] Add project metadata fields to the enriched items -** [schema] Update git schema -** [schema] Fix `grimoire_creation_date` description -** [schema] Update areas of code schema -** [enrich] Handle long text values in mozillaclub -** [enrich] Handle different formats for failures in functest -** [travis] Add perceval-puppet dependency -** [enrich] Handle revisions without comment in mediawiki -** [tests] Update tests data for Slack -** [tests] Update test data for Jira -** [doc][studies] Improve studies doc for executing them in mordred -** [doc] Add CSV for areas of code and update doc -** [enrich] Limit size of fields.description in Jira -** [raw] Handle long description in jira fields -** [setup] Add dependency with perceval-puppet -** [raw] Filter attachment-related data of slack messages - -* Sigils (old panels) -** [panels] Update git index pattern -** [askbot] Add accepted answer info - -* Manuscripts (old reports) -** [tests] Added tests for the function replace_text_dir in report.py -** [report] Remove dependency on GREP and SED -** Update requirements for sortinghat -* Kidash +# 0.2.24 -* GrimoireLab Toolkit -** [introspect] Add function to find the properties in a class +Released: 2019-06-07 -* King Arthur -** [scheduler] Rename 'max_retries_job' to 'max_retries' -** [jobs] Replace scheduler arguments by 'max_retries' +* Grimoire ELK + * [raw-bugzillarest] Handle description longer than 32766 chars + * [raw-slack] Fix illegal_argument_exception for data.blocks.elements.text + * [enriched-enrich] Reduce number of log messages on identity retrieval +* SirMordred + * Fix README.md so that the package is admitted by pypi + + +# 0.2.22 + +Released: 2019-05-31 + +* Graal + * Added to GrimoireLab release +* Grimoire ELK + * [tests] Update elasticsearch and elasticsearchdsl versions + * [dependencies] Update urllib3 and requests dependencies + * [enriched] Use RequestsHttpConnection in Elasticsearch objs + * [dependencies] Pin urllib3 and requests dependencies + * [schema] Add `repository_labels` attribute + * [enriched] Add repo labels support to enrichers + * [elk] Add repo_labels param + * [elastic_items] Extract repository labels from projects.json + * [enriched-github] Filter review comments from ghost users + * [schema] Specify where each author field come from + * [schema] Add CSV documenting Github PRs index + * [enriched-confluence] Add email data to SH identity +* Perceval + * [gitlab] Force UTF-8 encoding on response contents +* SirMordred + * [task_enrich] Add log INFO messages + * [task_enrich] Fix elasticsearch.exceptions.SSLError: ConnectionError + * [task_enrich] Add support for repository labeling + * [task_collection] Add support for repository labeling + * [task] Add support for repository labeling + * [utils] Add example of grimoirelab identities file + * [utils-micro] Add support to load identities in micro + * [micro] Fix logging configuration at module scope +* SortingHat + * [parsing:grimoirelab] Add support to parse a blacklist + * Update languages and typos in the README -* Bestiary -* Hatstall -** [deployment] Config the Django settings for deployment in production -** [docker] Improve how gunicorn is started increasing the number of workers and the timeout -** [docker][travis] Fill the Django SECRET_KEY during deployment -** [docker] Add file based config sample for Hatstall -** [django] Remove SECRET_KEY to avoid its use in a production system -** [urls] Add urls to static contents so gunicorn can use them -** [docker] Use the CHAOSS URL to clone Hatstall -** [pip] Add all the files needed to create the django-hatstall pip package -** [hatstall app] Refactor all code to have a "hatstall" app that can be reused -** [docker] Leave alone hatstall in the docker-compose file -** [docker] Use the grimoirelab/hatstall docker image and remove link to mariadb +# 0.2.21 -* Ceres +Released: 2019-05-20 +* Grimoire ELK + * [enriched-gerrit] Enable refresh identities + * [enriched-gerrit] Add ELK metadata to enriched items + * [raw-slack] Remove channel_info.previous_names attribute + * [enriched-jira] Handle enriched items from multiple jiras +* Perceval + * [slack] Handle timestamps with more than 6 decimals + * [gitlab] Add support for Gitlab Oauth tokens + * [github] Handle pull request reviewers in Enterprise API -## 18.04-01-a -Released: 2018-04-10 +# 0.2.20 -* Mordred -** [task] Include projects data when creating the enrich backend for studies -** [task_report] Fix import from report.report to manuscripts.report -** Improve documentation about "bulk_size" and "scroll_size" -** [tests] Update archives after sanitizing archived data +Released: 2019-05-13 +* Grimoire ELK + * [enriched-git] Add log info to enrich_git_branches + * [schema] Add milestone start and due dates to gitlab schemas + * [enriched-gitlab] Add milestone start and due dates + * [enriched-mediawiki] Add `grimoire_creation_date` field + * [enriched-gerrit] Handle gerrit items from multiple servers +* Kidash + * Add viz title to data source removal checks +* Perceval + * [github] Set number of issues/pull requests fetched per page + * [gitlab] Handle missing attr `last` in pagination response +* Sigils + * [gitlab-merge-requests] Update index pattern + * [gitlab-issues] Update index pattern + * [overview] Update mediawiki panels in overview + * [mediawiki] Use grimoire_creation_date in panel and search + * [overview] Use `grimoire_creation_date` in overview panel + * [github] Use grimoire_creation_date in issue panels + * [github] Use grimoire_creation_date in pull request panels + * [Redmine] Update time field + * [gitlab] Update timelion charts in efficiency panel for issues + * [gitlab] Rename index pattern for issues + * [jira] Use grimoire_creation_date +* SirMordred + * [alias] Remove gitlab alias + * [requirements] Fix elasticsearch dependency versions + * [tests] Fix assertion in test_config + * [tests] Update archives for github pulls and issues + * [aliases.json] Rename alias for gitlab issues + + +# 0.2.19 + +Released: 2019-05-06 + +* Grimoire ELK + * [schema] Update gerrit.csv + * [enriched-gerrit] Add type attribute to changeset items + * [enriched-gerrit] Rename `number` attribute to `changeset_number` + * [enriched-gerrit] Add changeset author info to enriched items + * [enrich-gerrit] Add common field to count review-related items + * [enriched-gerrit] Update attribute names (hace 3 días) + * [tests] Enhance test for gerrit enriched items + * [enriched-gerrit] Add patchset approvals as enriched items + * [enriched-gerrit] Add patchsets as enriched items + * [enriched-gerrit] Add comments as enriched items + * [enriched-git] Add study to process git branches + * [enriched-discourse] Force type of score attribute to float + * [schema] Update functest schema with `duration_from_api` attribute + * [tests] Check duration assessment for functest enriched items + * [enriched-functest] Change duration assessment + * [tests] Update tests for functest enriched items + * [enriched-functest] Handle no float duration times + * [enriched-study-ceres-aoc] Limit search size to 500 +* Perceval + * [github] Include reviews in pull request data +* Sigils + * [gerrit] Add panel with approvals + * [gerrit] Update panels to support the new index + * [functest] Update index pattern + * [Maniphest] Update time field +* SirMordred + * [menu.yml] Add gerrit approvals panel + * [tests] Include enrich_git_branches to test_studies.cfg + * [config] Add study to process git branches -## 18.04-01 -Released: 2018-04-04 +# 0.2.18 -* SortingHat +Released: 2019-04-26 +* Grimoire ELK + * [requirements.txt] Constrain elasticsearch-related dependencies + * [setup.py] Constrain elasticsearch-related dependencies +* Perceval + * [backend] Add backend-specific options for --category in helptext +* Perceval FINOS + * [finosmeetings] Update argument parser to display categories in help message + * Update Perceval requirement to 0.12.12 or later +* Perceval Mozilla + * Update Perceval requirement to 0.12.12 or later + * [backends] Include available category options in the helptext +* Perceval OPNFV + * Update Perceval requirement to 0.12.12 or later + * [setup.py] Minor update to avoid flake8 error + * [functest] Include available category options in the helptext +* Perceval Puppet + * Update Perceval requirement to 0.12.12 or later + * [setup.py] Minor update to avoid flake8 error + * [puppetforge] Include available category options in the helptext + + +# 0.2.17 + +Released: 2019-04-22 + +* Grimoire ELK + * [aoc] Update write method to upload smaller lists + * [enriched-bugzillarest] Change logic to calculate `timeopen_days` + * [enriched] Add metadata filter raw to enriched items + * [elk] Use filter raw info to assess last enrich date + * [enriched-enrich] Add `metadata_filter_raw` method + * [enriched-utils] Add filter raw text to retrive last enrich date + * [enriched-utils] Fix last enrich date calculation +* Perceval + * [doc] Update help messages for "from-date" and "to-date" params +* Sigils + * Update Jira panel documentation + * Update Jira panels to support index with comments + + +# 0.2.16 + +Released: 2019-04-11 + +* Grimoire ELK + * [raw-jira] Update raw mapping to avoid immense term errors + * [enriched-enrich] Refactor `find_item_project` method + * [elk] Set value of `projects_json_repo` during enrichment + * [elk] Set value of `projects_json_repo` during collection + * [elastic_items] Add method `set_projects_json_repo` + * [elastic] Check presence of `properties` in mappings + * [enriched-jira] Add comments to enriched index + * [elastic_items] Handle commas in filter-raw + * [enriched-gerrit] Use grimoirelab-toolkit calls + * [elk] Handle empty sh uuid attributes + * [enriched-git] Fix handling rev-list command error + * Update row with missing aggregatable value * Perceval -** Fix the error "Not a gzipped file (b'00')" -** [client] Sanitize url, payload and headers when archiving data -** [all backends Remove credentials when archiving data -** [jira] Avoid init HTTP session when fetching data from archive -** [tests] Fix fetch_from_archive test -** Mozilla -** OPNFV -** Puppet + * [tests] Increase test coverage of Jira backend + * [jira] Add comments in issues + * [github] Handle ghost user in pull request comment + * [doc] Update documentation for github and gitlab backends +* SirMordred + * [tests] Update jira archive + * [task_enrich] Pass projects.json repo url to ELK + * [task_collection] Pass projects.json repo url to ELK + + +# 0.2.15 + +Released: 2019-04-03 + +* Grimoire ELK + * [enrich-meetup] Avoid failures when 'rsvps' field is not available + * [enrich-git] Handle rev-list command failures + * [enriched] Fix missing ancestor title in confluence enriched items + * [elk] A * dd methods to delete identities + * [sortinghat_gelk] Add method `unique_identities` + * [sortinghat_gelk] Add method `remove_identity` + * [elk] Fix docstring in `do_studies` method + * [enriched] Add function `get_diff_current_date` to utils + * [utils] Add param mapping to `get_elastic` + * [sortinghat_gelk] Add method to remove unique identities + * [elk] Retain identities based on identities index data + * [elk] Store identities in use in dedicated index + * [elastic] Refactor method `delete_items` +* Perceval + * [meetup] Add 'rsvp', 'venue', and 'event_hosts' as classified fields + * [update] Remove unused imports +* Perceval Mozilla + * Update Perceval dependency to 0.12.8 + * [remo] Add 'filter_classified' parameter to metadata() + * [kitsune] Add 'filter_classified' parameter to metadata() +* SirMordred + * [doc] Fix missing --cfg param for micro mordred example + * [task_enrich] Support retain identities + * [config] Add method `get_active_data_sources` + * [sirmordred] Replace `retention_hours` with `retention_time` + * YAMLLoadWarning solved -* Mordred -** [panels] Add hyperkitty panel (the same than mbox) -** [task_collection] Support that the name of a backend section could include a suffix -** [task_panels] Filter with data sources active only multi data source visualizations -** [tests] Add archive for testing remo - -* grimoirelab-elk -** [utils] Add PuppetForge support once perceval pip package is available -** [raw] Update mappings to filter body information in confluence items -** [enrich] Limit size of summary and main_description in bugzillarest -** [enrich] Limit size of value attribute summary in bugzilla -** [raw] Change discourse mapping for data.post_stream.posts.cooked -** [enrich] Fix mapping for attribute question_title in discourse -** [enrich] Handle missing accepted_answer_id attribute -** Added support for co-author -** Fix flake8 issues -** [schema] Update askbot.csv -** [studies] Add timeout to ES connections -** [tests] Remove old test data - -* Sigils (old panels) - -* Manuscripts (old reports) -** Remove recursive copying of report directory -** Add user defined logo option -* Kidash +# 0.2.14 -* GrimoireLab Toolkit -** [tests] Increase test coverage -** [datetime] Handle wrong timezone offset +Released: 2019-03-27 -* King Arthur -** Fix Travis CI badge -** Update required version of Perceval -** Rename GrimoireLab references to CHAOSS -** [jobs] Fix 'from_date' and 'offset' reset error +* Grimoire ELK + * [tests] Update finosmeetings test data +* Perceval FINOS + * [finosmeetings] Handle cm_type column + * [doc] Fix typo in README installation section +* Sigils + * [docs] Fix broken links in docs + * [jira] Add documentation about Jira panel + * [jira] Fix mislabeled "Submitters by Organization" pie visualization + * [github] Add repositories popularity panel + * Update demographics help markdown -* Bestiary -* Hatstall -** [conf] Configure Hatstall using the setup file if exists first and then the web form +# 0.2.13 -* Ceres +Released: 2019-03-27 +* Grimoire ELK + * [finosmeetings] Change project value to cm_title -## 18.03-05 -Released: 2018-03-27 +# 0.2.12 -* SortingHat +Released: 2019-03-26 +* Grimoire ELK + * [meetup-enriched] Prevent to access filter-classified attributes + * [elk] Handle filter-classified param + * [enriched] Set project name to cm_program for finosmeetings enrich + * [enriched] Add sortinghat identities info to finosmeetings + * [enrich] Prevent timeout when using ElasticSearch DSL + * [enriched] Fix `Too many dynamic script compilations` in git enrich + * [jira] Handle missing fields during the enrichment + * [jira] Handle multiple type values in `release` attribute during enrichment + * [stackexchange] Handle missing `answer_tags` + * [enriched] Apply retry mechanism HTTP 504 errors * Perceval -** Handle negative sleep time for rate limit reset: meetup, gitlab, github, client -** [git] Add --to-date to git backend to pull data upto a given time -** [github] Add pull request data -** [pipermail] Increase test coverage -** Mozilla -** [remo] Add params to fetch events from older to newer -** OPNFV -** Puppet + * [tests] Increase test coverage for confluence backend + * [confluence] Fix typo in in-line comment + * [confluence] Skip contents if 'when' attribute is missing + * [meetup] Add 'group.topics' to the list of classified fields + * [backend] Allow to filter classified fields from the command line + * [backend] Add 'filter-classified' option to the backend argument parser + * [backend] Add 'filter_classified' parameter to fetch() function + * [backend] Support filtering of classified fields in Backend class + * [git] Fix `rev-list` call with `--max-count` + * [doc] Update docstring for `sleep_time` param + * [discourse] Add params `sleep_time` and ` max_retries` + * [discourse] Add tests for sleep_time and max_retries params + * [discourse] Complete raise statements in test code + * [discourse] Remove redundant parenthesis in test methods + * [github] Add support for GitHub tokens pool +* SirMordred + * [utils] Update setup.cfg and projects.json of micro-mordred + * [task_panels] Order dashboards by name + * [doc] Update documention for panels section + * [menu.yml] Add export panel to Jenkins + * [task_panels] Upload github repos panels + * [tests] Update aliases.json in tests folder + * [config] Add param to upload github-repo panels + * [aliases] Add raw and enrich aliases for github:repo +* Sortinghat + * [parsing] Fix YAMLLoadWarning for grimoirelab parser + + +# 0.2.11 + +Released: 2019-03-21 + +* Grimoire ELK + * [tests] Update finosmeetrings backend test to the new schema +* Perceval FINOS + * [finosmeetings] Rename activity and program fields +* SirMordred + * [task_projects] Prevent enrich unknown projects when declared also in other projects -* Mordred -** [task_panels] Don't use anymore the kibiter version from general config in mordred -** [config] Fix howto import the version from mordred -** [doc] Add first version of the mordred params documented generated automatically -** [config] Add description to all params and remove the params not used anymore -** [doc] Initial version of setup automatic doc generation -** Update import sections to follow grimoire-elk changes -** Fix flake8 errors -** [task_identities] Fix the call to get gender data (hotfix commit) - -* grimoirelab-elk (old GrimoireELK) -** [utils] Remove puppetforge support until there is a pip package and it is supported in grimoirelab_build script -** [elk] Fix mapping path for areas of code index -** [elk] Add onion study to GitHub -** [enriched] Handle wrong time offset in Git enrichment -** [p2o] Use directly the params definition from utils.py -** [enrich] Add doc for enrich_items method and remove not needed code -** [enrich][phabricator] Add enrich metadata to enriched items -** [puppetforge] Implement the enrich spec for PuppetForge -** [enrich] Add `answer_status` field to askbot -** [raw] Fix typos in ES 2.2 mappings for gerrit -** [enrich] Fix limit comment message in gerrit, git -** [enriched] Set not accepted answer flag to askbot unanswered question -** [all] Replace arthur with with elk in import sections -** [all] Replace elk with enriched in import sections -** [all] Replace ocean with raw in import sections -** [arthur] Rename the file name arthur.py to elk.py -** [ocean/elk] Change packages names: This code renames the packages ocean and elk to raw and enriched -** [ocean][hyperkitty] Create specific HyperKittyOcean class -** [utils] Support that the name of a connector could include a suffix -** [elk] Fix params parsing for arthur tasks -** Move CSVs schema definition from Sigils to GrimoireELK -** [Askbot] Add fields to askbot.csv to track accepted answers -** [doc] Add documentation for Areas of Code study -** [elk] Include mappings to discourse backend -** [ocean] Add ES 2.x mappings for askbot backend -** [elk] Create areas of code output index if needed -** [doc] Add documentation on Onion study -** [elk] Add onion study - -* Sigils (old panels) -* [csv] Remove CSVs moved to grimoirelab-elk - -* Manuscripts (old reports) -* Kidash -** [kidash] Update elk import +# 0.2.10 -* GrimoireLab Toolkit +Released: 2019-03-20 -* King Arthur +* Grimoire ELK + * [utils] Change assessment of last enrich date -* Bestiary -* Hatstall +# 0.2.9 -* Ceres -** [examples] Update elk import -** [events] Update elk import +Released: 2019-03-19 +* Grimoire ELK + * [enrich-github] Add url field to enriched repository items + * [utils] Use `last_enrich_date` for incremental enrichment + * [elk] Add `last_enrich_date` to enrich_backend method + * [elastic_items] Add set_from_date method + * [schema] Add demography fields to Git +* SirMordred + * [task_enrich] Pass the last timestamp of the index before enrichment + + +# 0.2.8 + +Released: 2019-03-15 + +* Grimoire ELK + * [enrich] Change mappings to convert `date` field to keyword + * [raw] Change mappings to convert `date` field to keyword + * [ELK] Rename finos_meetings to finosmeetings + * [tests] Add tests for finosmeetings + * [enrich] Add connector for finosmeetings + * [raw] Add connector for finosmeetings + * [utils] Add connector for finosmeetings Perceval backend + * [setup] Add perceval-finos to install_requires list + * [requirements] Add perceval-finos to requirements.txt +* Perceval FINOS + * [finosmeetings] Fix docstrings and flake8 + * [finosmeetings] Change UUID calculation + * [finosmeetings] Add `date_iso_format` attribute + * [finosmeeting] Add backend to index FINOS meetings attendance + * Fix typo in FINOS name (hace 2 días) + * Initial import +* SirMordred + * [doc] Add section getting started in README.md + * [aliases] Add aliases for raw and enrich finosmeetings indexes + * [requirements] Add perceval-finos to requirements.txt -## 18.03-04 -Released: 2018-03-21 +# 0.2.7 -* SortingHat +Released: 2019-03-12 +* Grimoire ELK + * [utils] Add missing header to run scripts as Python scripts + * [enriched] Update `get_project_repository` for bugzilla enricher + * [enrich] Assign default project name to repos in unknown section + * [enriched] Remove `get_item_project` for bugzillarest enricher + * [elk] Add filter raw info to enrich backend +* SirMordred + * [tests] Add tests for `get_repos_by_backend_section` in TaskProjects + * [task_projects] Refactor `get_repos_by_backend_section` + + +# 0.2.6 + +Released: 2019-03-11 + +* Grimoire ELK + * [enrich] Add onion study to gerrit + * [p2o] Add None value for param `cfg_section_name` to p2o + * [enrich-confluence] Add ancestors data to enriched items + * [enriched] Add refresh param to update_by_query and delete_by_query + * [elk] Apply data retention policy to study indexes + * [utils] Set default value for variable analyzers + * [elastic] Add method `delete_items` + * [elk] Remove filter-raw-* for enrich backend + * [enriched] Handle hidden editors in mediawiki revisions + * [raw] Prevent mapping of data.ancestors.extensions for confluence raw items + * [elastic_items] Support for filter-raw-prefix + * [enrich] Remove raw filters when getting last enriched item + * [elk] Remove logic to create filters + * [elastic_items] Support filter on multiple attributes + * [raw] Remove `get_p2o_params_from_url` from Jira raw connector + * [raw] Remove `get_p2o_params_from_url` from Confluence raw connector + * [raw] Remove `get_p2o_params_from_url` from Bugzilla raw connector + * [raw] Remove `get_p2o_params_from_url` from Askbot raw connector + * [raw] Remove `get_p2o_params_from_url` from Gerrit raw connector + * [raw] Remove `get_p2o_params_from_url` from Git raw connector + * [tests] Add tests for `get_p2o_params_from_url` method + * [raw] Parse filters passed in the projects.json entries + * [enriched] Handle 502 and 503 errors + * [schema] Update jira.csv + * [enrich] Add updated field to Jira items + * [schema] Update gerrit.csv + * [enrich] Add last_updated and created_on to gerrit items + * [enrich] Add retry on status forcelist to ES connector + * [enrich] Update branch info in git commits + * [tests] Add tests for parsing projects.json in Jira raw connector + * [raw] Handle filter raw for jira + * [raw] Handle filter raw for confluence + * [schema] Add schema for GitHub repo data + * [enrich] Support enrichment of GitHub repo data + * [enrich] Handle Perceval errors on Git repo when updating items + * Revert "[enrich] Update Git references data in raw and enriched indexes" + * Revert "[schema] Update Git schema to include refs info" + * [schema] Update Git schema to include refs info + * [enrich] Update Git references data in raw and enriched indexes + * [utils] Move p2o description to main + * [utils] Move index_mapping description to main + * [utils] Move gh2k description to main + * [utils] Move gh2arthur description to main + * [utils] Move get_git_repos description to main + * [utils] Move gelk_mapping description to main + * [utils] Move gelk description to main + * [utils] Move e2k description to main + * [ELK] Update license info + * [tests] Update tests for mbox-related enrichers + * [schema] Update mbox csv + * [enrich] Add mbox_author_domain to mbox data * Perceval -** [pipermail] Handle inaccessible archive URLs -** Mozilla -** OPNFV -** Puppet + * [confluence] Extend Perceval Confluence backend to index ancestor pages + * [github] Add 'repository' category to fetch metadata from repositories + * [perceval] Update license info +* Sigils + * [jira] Add painless field that computes time of issues on the fly + * [github] Add delay with painless field to GH Issues panels + * [gerrit] Update gerrit panels adding delay with painless field + * [github] Add delay with painless field to GH Pull Requests panels + * Update onion panels and their documentation + * Address changes requested in #339 + * Add Jenkins Job Categories panel + * Add new version of emtech adoption without crates +* SirMordred + * [config] Allow None default value for int config param + * [task_enrich] Enable data retention policy after enrichment phase + * [task_collection] Enable data retention policy after collection phase + * [task] Delete data based on retation_hours param + * [doc] Add description for`retention_hours` param + * [config] Add param `retention_hours` + * [task_collection] Improve doc for filter-raw param + * [task] Refactor logic to process --filter-* params + * [tests] Fix tests after modification in perceval + * [task_enrich] Modify p2o filters-prefix params + * Add jenkins job categories panel to `menu.yml` -* Mordred -** [task_enrich] Replace bulk_upload_sync with bulk_upload -** [mordred] Remove param studies en enrich section which does not exists anymore -* GrimoireELK -** [ocean] Fix mappings with jenkins to avoid regression errors -** [enrich][mbox] Return an empty SH identity if the identity provided is None +# 0.2.5 -* Sigils (old panels) +Released: 2019-02-13 -* Manuscripts (old reports) -** Default name of manuscripts added -** Added -v argument to show version of manuscripts -* Kidash +* Grimoire ELK + * [studies] Add origin based enrichment in AOC + * [elastic_items] Update ES query for incremental enrichment + * [utils] Handle `get_last_enrich` with raw filters + * [elastic] Handle multiple filters for last date of enriched items +* Toolkit + * [dependency] Update python-dateutil to 2.8.0 -* GrimoireLab Toolkit -* King Arthur +# 0.2.4 -* Bestiary +Released: 2019-02-06 +* Cereslib + * [enrich] Add .go as extension for the Go programming language +* Grimoire ELK + * Remove alias in use check for onion + * [elastic] Change log level message when alias is already in use + * [elk] Set filter raw in enrich connector + * [enrich] Allow to assign project to filtered repos + * [raw] Enable filter raw for Gerrit data source + * [git] Improve log messages when updating git commits data + * [elastic_items] Modify `fetch` method to collect all documents + * [git] Remove deleted commits from raw and enriched indexes + * [raw] Allow to perform update operations over a raw index + * [enrich] Allow to update enriched items * Hatstall -** Add paginated table in proifle page with 3 columns instead of 2 -** Add more info of uidentity when click on 'view' in profile page -** Change behaviour of the columns when open/close columns -** Add button in the card info of unique identity to merge it -** Fix table size joining columns - -* Ceres + * Update docs in order to add the env variables of docker deployment + * Link apache2 logs files to stderr and stdout +* KingArthur + * [worker] Remove unnecessary RQ connection management in ArthurWorker + * [tests] Repair some flake8 warnings + * [arthur] Add PUBSUB channel name specification +* Perceval + * [git] Add rev-list command to GitRepository class + * [tests] Add tests to check fetch without update + * [git] Allow fetch without update repo + * [phabricator] Move extra_status_force_list to Client class variable + * [meetup] Move extra_status_force_list to Client class variable + * [jenkins] Move extra_status_force_list to Client class variable + * [googlehits] Move extra_status_force_list to Client class variable + * [tests] Add test about retry error for GitHub + * [github] Handle upstream server connection problems +* Sigils + * Update StackOverflow index pattern and panel + * [chaoss-gmd] Fix screenshots for CHAOSS GMD collection + * [jira-backlog] Change label project to repo in Backlog visualization + * [jira-timing] Replace attribute project_name with project + * [jira-effort] Change label Project with Repository + * [jira] Replace project_name with project for jira_repositories viz + * Fix merges filter + * Updating new changes for the panel + * Update panel and documentation for PR merge duration panel + * Add documentation for pr merge duration panel + * Add pull request merge duration new panel + * Add screenshots and update front matter for sigils + * Remove word 'legacy' from Sigils title + * Add styles to doc pages + * [CHAOSS GMD] Update widgets in the panel according to the review + * [CHAOSS GMD] Add maintainer response to merge request duration + * Add help markdown widget to git demographics panel + * Add help markdown widget to demographics panel + * [doc][chaoss-gmd] Fix panel creation date + * [chaoss][doc] Add documentation for Lines of Code Changed panel + * [chaoss] Add Lines of Code Changed panel + * [doc] Fix front matter for pull requests merged +* SirMordred + * [doc] Add documentation about micro-mordred + * [config] Fix flake8 error + * [mordred] Remove global data sources param + * [doc] Add description for global_data_sources param + * [mordred] Update way of accessing global data sources + * [task_projects] Allow to accept list of global source + * [config] Make global data sources configurable from cfg + * [task_identities] Log message when orgs_file is not found on disk +* SortingHat + * [sortinghat] Fix deprecation warning for SafeConfigParser + * Fix a few grammatical errors in README.md (#181) + + +# 0.2.3 + +Released: 2019-01-10 + +* Grimoire ELK + * [elastic] Change log message level when inserting data to ES + * [sortinghat_elk] Include stacktrace in log message for unknown exception + * [elk] Include stacktrace in log message + * [tests] Delete onion index after test execution + * [elastic] Change log message level when alias already exists + * [enrich] Prevent adding DEMOGRAPHICS alias if already in use + * [enrich] Prevent adding ONION alias if already in use + * [git-enrich] Prevent adding AOC alias if already in use + * [enrich] Use the cfg section name to retrieve project name + * [elk] propagate cfg section name from mordred to ELK + * [elastic_items] Store value of the cfg section name + * Update github_issues.csv + * Update github_issues.csv + * Documentation added on github_issues.csv +* Hatstall + * Change redirections to the Django urls standard + * Redirect to the profile where the others profiles are merged + * Decrease minlength of the identities search input to 2 characters + * Show error when an uuid does not belong to a profile +* Perceval + * [github] Support `to-date` parameter in GitHub backend +* Sigils + * [affiliations] Set limit author entries due to performance issues + * [doc] Update Gerrit Efficiency panel documentation + * [efficiency] Specify Lead Time unit on Gerrit panel + * [doc] Update GitLab Efficiency panels documentation + * [doc] Update GitHub Efficiency panels documentation + * [efficiency] Specify Lead Time unit on both GitHub panels + * Add recommendations on how to create a panel + * Add info on how to use Jekyll with GitHub pages + * Update front matter + * Fix wrong links + * Update contributing guidelines + * [doc] Update screenshot for GitLab MRs Efficiency panel + * [efficiency] Add efficiency panel for GitLab merge requests + * [doc] Add documentation for GitLab merge requests efficiency panel + * [doc] Add documentation for GitLab issues efficiency panel + * [efficiency] Add efficiency panel for GitLab issues + * Fix link URL to CSV schema files in README.md + * Update sample documentation file + * [docs] Add markdown for Pull Requests Merged panel + * [chaoss] Add pull requests merged panel + * [git] Add lifecycle panel + * Add lifecycle.jpg + * Create lifecycle.md +* SirMordred + * [task] Remove credentials from URLs + * [task_panels] Add log message when kibiter is not reachable + * [task_panels] Replace urljoin with urijoin + * [task_enrich] Propagate cfg section name to ELK + * [task_panels] Add GitLab efficiency panels + * [menu] Add Git Lifecycle panel +* SortingHat + * [cmd:autoprofile] Fix expected string or bytes-like object error -## 18.03-03 -Released: 2018-03-20 +# 0.2.2 -* Mordred -** [mordred] Remove param studies en enrich section which does not exists anymore +Released: 2018-12-11 +* Grimoire ELK + * [csv] Update gitlab merges schema + * [enrich-gitlab] Add time fields info +* KingArthur + * Fix package requirements + * Update requirements file due incompatible versions of RQ and Redis +* Manuscripts + * [manuscript] add chinese package + * Write notice message when the 'Process' section is empty +* Sigils + * [data-status] Add remo events and activities information +* SirMordred + * [doc] Update documentation of setup.cfg params + * [micro] Update micro setup.cfg + * [task_panels] Read menu.yaml from setup.cfg + * [config] Add menu_file param -## 18.03-02 -Released: 2018-03-20 +# 0.2.1 -* SortingHat -** [cmd:autogender] Check well-formed names only and Retry and skip connection errors +Released: 2018-12-04 +* Cereslib + * [tests] Update FilePath test code + * [enrich] Prepend file dir paths with slash +* Grimoire ELK + * [schemas] Fix GitLab CSVs to add missing columns + * [enrich-gitlab] Add doc for `time_to_close_days` and `time_to_merge_days` + * [enrich-gitlab] Fix `merged` attribute calculation + * [enrich-gitlab] Update calculation of `time_to_close_days` + * [elastic] Prevent add alias if already in use in ES * Perceval -** [backend] Remove empty category from parsed arguments -** Mozilla -*** Add tests requirements pip file -*** Add support to run tests using setup.py file - -** OPNFV -*** Add tests requirements pip file -*** Add support to run tests using setup.py file -** Puppet -*** Add tests requirements pip file -*** Add support to run tests using setup.py file - -* Mordred -** [task_projects][eclipse] Add support for extracting the github repositories -** [clean] Remove legacy testing grimoire_elk symlink -** [task_identities] Add gender support -** [task_panels] Add as data source stackoverflow if stackexchange is included -** [tests] Fix tests including the gender fields in SH identities files - -* GrimoireELK -** [elk] Fix check condition ES version for rss, meetup, nntp -** [elk] Limit size of attributes for several data sources to avoid keyword max length issues -** [elk] Fix mappings ES 5.1.x for all backends -** [ocean] Prevent Slack attachment info to be indexed -** [ocean/elasttic] Replace bulk_upload_sync with bulk_upload -** [elastic] Delete bulk_upload_sync method -** [askbot] Refine information to track accepted answers -** [tests] Modify test data for askbot -** [elk] Enrich item to track accepted answers -** [ocean] Add mappings for Askbot ocean -** [enrich][bugzillarest] Change " " with "+" in product and component names to follow Mozilla projects mapping -** [elk] Add gender info from SortingHat -** [ocean][conf] Remove legacy conf index not used anymore -** [utils] Remove not used scripts o2s.py and ocean.py -** [utils] Remove symlink grimoire_elk to avoid hacks in modules import -** [utils] Remove not needed old symlink - -* Sigils (old panels) -** [Askbot] Add fields to askbot.csv to track accepted answers -** [schema] Update Meetup schema to deal with aggregatable fields in Kibana -** [panels] Fix Gerrit panel to use author name field -** Added schema for time_to_commit - -* Manuscripts (old reports) -** Select by user for custom indices for each data -** Create default indices if no custom index is provided -** Change the default name for the enriched git index from 'git_enrich' to 'git' - -* Kidash - -* GrimoireLab Toolkit + * [gitlab] Add retry on 503 HTTP error +* Sigils + * [docs] Fix page titles + * [docs] Remove theme + * [docs] Update local links + * [docs] Remove old documentation + * [docs] Add Jekyll based documentation + * Ignore Jekyll and Ruby related files + * [gitlab] Sync MRs index pattern title with SirMordred aliases + * [git] Update Git Demographics panel +* SortingHat + * [cmd:autoprofile] Avoid to set email addresses in name profile -* King Arthur -* Bestiary -** Add new features: edit and remove ecosystems and projects -** Add information messages to web UI related to important actions -** Change position of ecosystem-related buttons +# 0.2.0 -* Hatstall -** Add custom pagination in order to retrieve the data paginated -** Add search box that searchs directly to the sh database -** Fix last_modified field show in unique identities -** Add 'show' custom in order to get length of the table paginated -** Change button show entries for 'onchange' event in the select +Released: 2018-11-19 * Cereslib -** [events] Add Git author domain from email - - -## 18.03-01-a - -Released: 2018-03-14 - -* GrimoireELK -** [ocean] Add ES 2.x mappings for all ocean backends -** [git] Add a new time_to_commit field to enriched index - -## 18.03-01 - -Released: 2018-03-13 - -* SortingHat -** [model] Fix wrong __repr__ in Profile -** [api] Add search_unique_identities_slice() function -** [cmd:autogender] Fix typo in help output -** Release 0.6.0 -** Rename GrimoireLab references to CHAOSS -** [sortinghat] Add autogender command -** [api] Add function for searching profiles -** [tests] Fix non-deterministic tests -** Add --version command line option -** [tests] Fix so that tests pass when db not in localhost -** [init] Remove annoying error -** [setup] Update pandas -** [gitdm2sh] Set option to ignore invalid email addresses - -* Perceval -** [all backends] Set category when calling fetch and fetch_from_archive -** [meetup][gitlab] Ignore sleep for rate when reading from archive -** [tests] Modify backends tests when fetching from archive -** [tests] Add mock http answers to tests launchpad -** [gerrit] Add tests for gerrit backend -** [mediawiki] Sort request payload parameters for versions >= 1.27 -** [mediawiki][phabricator] Force sort request payload parameters -** [tests][askbot] Format html content file -** [all backends] Add default parameters when init the Client -** [slack] Move parameter latest to the archived args -** [all backends] Add valid categories -** [all backends] Align fetch signature to the backend generic one -** [all backends] Add archive support -** Update CI config to run tests using Python 3.5 and 3.6 -** Update coverage call to remove 'omit' parameter -** [askbot] Add data about accepted answers -** [mbox] Define 'tmp_path' variable before copying mboxes -** [backend] Ignore errors produced while fetching from archives -** [backend] Fix 'Namespace' object has no attribute 'fetch_archive' -** Rename GrimoireLab references to CHAOSS -** [backend] Remove metadata() decorator -** [cache] Remove cache mode -** [backends] Replace cache by archive mode -** Add tests requirements pip-file -** Fix tests to support their execution in two different modes -** Add support to run tests using setup.py file -** [gmane] Remove Gmane backend -** [jenkins] Update perceval sample in README -** [backend] Use the archive manager within BackendCommand -** [backend] Add shortcut functions to fetch items -** [backend] Add 'archived-since' to the argument parser -** [backend] Add 'category' to the general arguments parser -** [backend] Define archive arguments for the argument parser -** [archive] Add class to manage a set of archives -** [archive] Replace 'item_category' by 'category' -** [errors] Add class for raising archive manager exceptions -** [pipermail, bugzilla] Avoid warning by BeautifulSoup -** [perceval] Add GitLab backend -** [all backends] Apply archive to backend -** [client] Replace type() with isinstance() -** [backend] Change method signature of _test_fetch_from_archive -** [backend] Fix backend name in fetch method -** [backend] Add fetch, fetch_from_archive and fetch_items -** [nntp] Fix KeyError 'Date' in metadata_updated_on field -** [backend] Integrate archive with generic backend -** [client] Integrate archive with generic HTTP client -** [archive] Add Archive class -** [tests] Add tests for NotImplemented method errors in backend -** [http-client] Fix rate limit reset log message -** [git] Parse additional pattern for moved files -** [all backends] Modify variable name default_sleep_time -** [client] Modify variable name default_sleep_time - -** Perceval Mozilla -*** [tests] Modify tests when fetching from archive -*** Set category when calling fetch and fetch_from_archive -*** Add valid categories -*** Align fetch signature to the backend generic one -*** Update Perceval dependency version -*** Rename GrimoireLab references to CHAOSS -*** Apply archive to all backends -*** [crates] Fix None sleep_time when using CratesCmd -*** Import perceval modules using relative paths -*** [setup] Update minimum version of perceval required -*** [crates] Change HttpClient method call - -** Perceval OPNFV -*** [functest] Set category when calling fetch and fetch_from_archive -*** [tests] Modify functest tests when fetching from archive -*** [functest] Add valid categories -*** [functest] Align fetch signature to the backend generic one -*** Update Perceval dependency version -*** Rename GrimoireLab references to CHAOSS -*** [FuncTest] Apply archive to FuncTest backend - -** Perceval Puppet -*** [puppetforge] Set category when calling fetch and fetch_from_archive -*** [tests] Modify puppetforge tests when fetching from archive -*** [puppetforge] Add valid categories -*** [puppetforge] Align fetch signature to the backend generic one -*** Update Perceval dependency version -*** Rename GrimoireLab references to CHAOSS -*** [puppetforge] Apply archive to PuppetForge backend - -* Mordred -** [tests] Add tests for the studies configuration per backend -** [task_enrich] Configure and execute studies per backend after enrichment -** [config] Remove 'studies' param from enrich section -** [tests] Add archive for all backends -** [tests] Add tests to fetch data from archives -** [mordred] Updates to use the new location for elastic module in grimoire_elk -** [task_panels] Fix support for Kibana 6 when uploading menus -** [tasks] Make use of grimoire-elk connections -** [task_enrich] Use new param pair_programming to activate this enrich feature - -* GrimoireELK -** [studies] Add support for git_author_domain field -** [setup] Fixed conflict with urllib3 version -** [elk] Fix access to mappings directory -** [utils] Use the 1st interpreter on $PATH -** [tests] Break done tests for all backends -** [elk] Fix enrich_items method -** Update elastic import to the new module path in grimoire_elk.elastic -** [elastic] Refactor elastic class -** [travis] Update travis to add new dependencies -** [elk] Add areas of code study -** [elk] Add basic structure for cereslib studies -** [elk] Refactor sortinghat module name -** [enrich][git] Fix incremental demography update for already existing authors -** [archive] Allow handling perceval archive -** [ocean] Fix mappings to index data in several data sources -** [tests] Refactor tests for backends/connectors -** [remo] Rename filenames of ocean and elk remo connectors -** [ocean] Remove ES 2.x mappings to index git data -** [ocean] Modify Pipermail input data for test -** [ocean] Add Launchpad backend -** [ocean] Add PuppetForge backend -** [ocean] Add GitLab backend -** [tests] Update tests data -** [elk] Update enrich_items method of several data sources for new tests -** [elk] Handle NNTP uppercase Date field -** [ocean] Add warning when json items are not inserted to ES -** [enrich] Track storage exceptions when uploading enriched data to ES -** [travis] Add delay to make ES start - -* Sigils (old Panels) -** Update documentation on process related panels - -* Manuscripts (old reports) -** added Content-Type information in function: get_metrics_data - -* Kidash -** [kidash] Update elastic import from grimoire_elk -** [import] Don't modify the height of visualizatons in dashboards from Kibana >= 6 - -* GrimoireLab Toolkit -** Add support to run tests using setup.py file -** Update coverage call to remove 'omit' parameter -** Rename GrimoireLab references to CHAOSS -** Update CI config to run tests using Python 3.5 and 3.6 - -* King Arthur (old Arthur): -** Add support to run tests using setup.py file -** Fix tests to support their execution in two different modes -** Modify tests requirements pip-file and Travis config. file -** Update documentation with a section for the arthurd config. file -** [worker] Add documentation to perform_job method -** [arthurd] Replace cache support with archive support -** [server] Enable server to handle archives -** [jobs] Enable jobs to handle archives -** [tasks] Enable tasks to deal with archive -** [scheduler] Enable scheduler to deal with archive tasks -** [arthur] Enable Arthur to fetch data from archives - -## elasticgirl.30.4 - -Released: 2018-02-12 - -* GrimoireELK -** [enrich][crates] Return always a correct SH identity - - -## elasticgirl.30.3 - -Released: 2018-02-11 - -* GrimoireELK -** [enrich][git] Add a new param pair_programming to activate this enrich feature -* Mordred -** [task_enrich] Use new param pair_programming to activate this enrich feature - - -## elasticgirl.30.2 - -Released: 2018-02-08 - -* GrimoireELK -** [enrich][jira] Include release field in enriched index -** [enrich][git] Add git_uuid field which is unique id in pair programming - - -## elasticgirl.30.1 - -Released: 2018-02-01 - -* GrimoireELK -** [enrich][git][demography] Fix the demography study logic so it works in incremental mode always -** [enrich][slack] Don't convert boolean fields to int in SortingHat fields -** [elastic] Track exceptions when uploading data to ES -** [enrich][git] Add a new field git_author_domain with the email domain for the Author of the commit - -* Kidash -** [import] Don't modify the height of visualizatons in dashboards from Kibana >= 6 - -## elasticgirl.30 - -Released: 2018-01-31 - -* SortingHat -** [load] Avoid some messages when not in verbose mode -** [init] Add option for reusing database - -* Perceval: frozen in 0.9.10 until Archive cache refactoring is complete -** Mozilla: frozen in 0.1.5 to be compatible with perceval 0.9.10 -** OPNFV -** Puppet - -* Mordred -** [panels] Kibiter now supports that the title for the dashboard is in a JSON inside .kibiter index. New method for uploading it. -** setup and configure RotatingFileHandler for file logging -** [mordred] Check if Bestiary projects can be read before executing mordred -** [task_panels] Add params with kibana url and version to create the .kibana -** [mordred] Retry connection with Elasticsearch and Kibiter to wait for their starting time -** [task_identities] Execute unify just after the load of identities in the same task -** [task_panels] Add mbox as data source to be shown if pipermail exists -** [autorefresh] Refactor autorefresh code thanks to the last_update field in Sortinghat -** [task_panels] Force the creation of .kibana index in Kibiter6 -** [docker] Don't download the menu.yaml file if it has not changed from our local copy - -* GrimoireELK -** [enrich][phabricator] Fix enricher when an item has an array with None as first item of projects -** [enrich] Add missing headers in PUT queries to support ES6 -** [ocean][pipermail] Define the url and dirpath params needed by arthur when using pipermail -** [elastic_items] Remove log error when there are no items or the items index does not exists yet -** [utils] Retry by default total times = connect error times -** [ocean/confluence] Filter out body.storage.value from index -** [enriched] Ensure that we have a method for refreshing whole indexes - -* Panels -** [overview] Include for studies vis a "_studies_" in the id and title - -* Manuscripts (old reports) - -* Kidash -** [kidash] Remove by default from dashboards the study related visualizations -** [visualization] Include the style needed in Kibiana6 to show metrics vis correctly -** [dashboard] Fix the bool filters for the dashboard -** [layout] Increase 1 height the panels of height 1 for kibana6 - -* GrimoireLab Toolkit -** [introspect] Ignore * and ** parameters in method signatures - -* Arthur - - -## elasticgirl.29.4 - -Released: 2018-01-29 - -* GrimoireELK -** [utils] Retry by default total times = connect error times - -* Mordred -** [arthur] Catch exception when the arthur items dict changes during its measure - - -## elasticgirl.29.3 - -Released: 2018-01-29 - -* Mordred -** [task_panels] Add mbox as data source to be shown if pipermail exists -** [task_identities] Execute unify just after the load of identities in the same task -** [mordred] Retry connection with Elasticsearch and Kibiter to wait for their starting time - -* Kidash -** [layout] Increase 1 height the panels of height 1 for kibana6 -** [dashboard] Fix the bool filters for the dashboard -** [visualization] Include the style needed in Kibiana6 to show metrics vis correctly - - -## elasticgirl.29.2 - -Released: 2018-01-25 - -* Mordred -** [autorefresh] Refactor autorefresh code thanks to the last_update field in Sortinghat - -* GrimoireELK -** [elastic_items] Remove log error when there are no items or the items index does not exists yet - - -## elasticgirl.29.1 - -Released: 2018-01-24 - -* Mordred -** [task_panels] Force the creation of .kibana index in Kibiter6 - -* GrimoireELK -** [ocean][pipermail] Define the url and dirpath params needed by arthur when using pipermail -** [enrich] Add missing headers in PUT queries to support ES6 - - -## elasticgirl.29.0 - -Released: 2018-01-23 - -* SortingHat -** [model][tests] Define an order for domains and adapt tests to MariaDB -** [tests] Change configuration to a config file - -* Perceval: frozen in 0.9.10 until Archive transition from cache is complete -** Mozilla: frozen in 0.1.5 to be compatible with perceval 0.9.10 -** OPNFV -*** [functest] Apply generic HTTP client to FuncTest -** Puppet -*** [puppetforge] Apply generic HTTP client to PuppetForge - -* Mordred -** [task_panlels] Support for Kibiter/Kibana 6.x -** [task_projects] Add a new param projects_url to download the projects data from a URL -** [task_identities] Use the last datetime for autorefresh to find the changes in SortingHat -** [task_identities] Don't load identities if autorefresh is pending -** [docker] Update docker mordred image to use a install based on pip packages -** [unified_releases] Remove 'unified_releases' directory which is now in GrimoireLab -** [task] Fix composition perceval params - -* GrimoireELK -** [ocean][confluence] Avoid creating the mapping of data.extensions.position which mutates -** [git] Add Elasticsearch 6.x support for study in git -** [kidash] Remove kidash (moved to a new repo as chaoss/grimoirelab-kidash) -** [elasticsearch] Support Elasticsearch 6 - -* Panels - -* Manuscripts (old reports) -** [setup] Modifications due to change in name (manuscripts) - -* Kidash -** [kidash] Unbundle kidash completely from GrimoireELK -** [kidash] Fix error getting the title of an index pattern -** [setup] Change to the new chaoss organization in GitHub - -* GrimoireLab Toolkit -** [datetime] Add timezone data to datetime_utcnow() - -* Arthur -** [tests] Add tests for add, remove, tasks paths of arthur server - - -## elasticgirl.28.3 - -Released: 2018-01-21 - -* GrimoireELK -** [kidash] Remove kidash (moved to a new repo as chaoss/grimoirelab-kidash) -** [elasticsearch] Support Elasticsearch 6 - - -## elasticgirl.28.2 - -Released: 2018-01-18 - -* Mordred -** [task] Fix composition perceval params -** [docker] Update docker mordred image to use a install based on pip packages -** [task_identities] Don't load identities if autorefresh is pending -** [task_identities] Use the new API SH call search_last_modified_identities to refresh identities -** [task_projects] Add a new param projects_url to download the projects data from a URL - - -## elasticgirl.28.1 - -Released: 2018-01-09 - -* Mordred -** [docker] Add symlink to kidash so mordred finds it - - -## elasticgirl.28 - -Released: 2018-01-09 - -* SortingHat - -* Perceval -** [git] Send in fetch-pack local heads refs only -** [meetup] Handle processing deleted groups -** [git] Fix cloned directory of local repository -** Mozilla -*** Apply generic HTTP client to all backends -** OPNFV: no changes -** Puppet: no changes - -* Mordred -** [panels] Use the new kidash module, instead of grimoire-kidash -** [task_collection][arthur] Limit the total number of items collected from redis -** [task_collection][arthur] Set to 200MB the max memory for the arthur python dict -** [task_collection][arthur] Limit the max size of the python memory with raw items from redis -** [tasks_panels] Add support for data sources when uploading panels -** [docker] Use the new grimoirelab github repository location to download the releases - -* GrimoireELK -** [kidash] Unbundle kidash completely -** [Jira] Extract timing for a sprint -** [Jira] Move enrichement of fields property to a classmethod -** [setup] Add kingarthur as a dependency - -* Panels - -* Reports - -* GrimoireLab Toolkit - -* Arthur -** Add support for configuration file -** [writers] Update writer to support ElasticSearch >= 5.x -** Update requirements - - -## elasticgirl.27.1 - -Released: 2017-12-28 -Warning: Change in SortingHat database. You need to either create -a new database from scratch, or convert your old SortingHat database. -See details in the main README.md in the SortingHat git repository -(section "Compatibility between versions)"). - -* SortingHat -** Release 0.5.0 -** [api] Add function to search last modified identities -** [api] Update 'last_modified' attribute when needed -** [model] Add 'last_modified' attribute to unique identities and identities -** [grimoirelab2sh] Add '--no-email-validation' option -** parsing:grimoirelab] Set option to ignore invalid email addresses - - -## elasticgirl.27 - -Released: 2017-12-28 -Warning: skip_initial_load no longer supported in Mordred. - -* SortingHat (stalled to pre 0.5.0 due to change in db schema) - -* Perceval -** [meetup] Remove 'draft' status due to a bug in Meetup API -** [git] Request in fetch-pack the outdated refs only -** [git] Fix error discovering refs in repos which don't have any -** [git] Ignore error codes when executing a command -** Mozilla: no changes -** OPNFV: no changes -** Puppet: no changes - -* Mordred -** [task_collection] Configure bulk and scroll size in arthur collection -** [tasks_project] Load projects in the initial tasks in mordred -** [task_collection] Create task in arthur only the first time -** [task_identities] Add support for '--no-email-validation' option in grimoirelab2sh - -* GrimoireELK -** [ocean][git] Map data.message to string so it is not a keyword because it is large field (>32K) in some cases -** [panels] Change the API so dashboards can be listed, imported and exported with a JSON in memory -** [enrich][meetup] Fix to support empty events during comments extraction -** [enrich][jira] Check that labels are defined in issue['fields'] before using it - -* Panels -** [Panels] Fix Twitter username field in tables -** [Panels] Add projects and orgs support for Meetup - -* Reports - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.26.2 - -Released: 2017-12-22 - -* GrimoireELK -** [enrich][meetup] Fix to support empty events during comments extraction - - -## elasticgirl.26.1 - -Released: 2017-12-21 - -* SortingHat -** [grimoirelab2sh] Add '--no-email-validation' option - -* Mordred -** [task_identities] Add support for '--no-email-validation' option in grimoirelab2sh - - -## elasticgirl.26 - -Released: 2017-12-20 - -* SortingHat - -* Perceval -** Mozilla: no changes -** OPNFV: no changes -** Puppet: no changes - -* Mordred -** [docker] Add link to arthur library so it can be used in mordred -** [task_identities] Don't load identities if autorefresh is pending -** [docker] arthur is not used with Elasticsearch anymore -** [task_collection][arthur] Compute the memory usage in intervals - -* GrimoireELK -** [mappings] If a mapping can not be created just log the issue -** [autorefresh] Group the number of identities to be refreshed -** [utils] Support enrich all items for all groups in a raw meetup index -** [enrich][meetup] Fix to support empty events during ersvp extraction - -* Panels -** [Panels] Add projects to IRC panel -** [Panels] Remove old unused panel directories -** [Panels] Add project support to Twitter panel - -* Reports - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.25.1 - -Released: 2017-12-19 - -* Mordred -** [mordred] Fix symbolic links to grimoire_elk and report changed by error - -## elasticgirl.25 - -Released: 2017-12-18 - -* SortingHat -** [db] Fix tables created with invalid collation -** [model] Coerce boolean type -** [travis] Update before_install package versions -** [setup] Upgrade dependencies -** [cmd:export] Remove trailing whitespaces in JSON files - -* Perceval -** [backend] Fix 'find_backends' to get all backend descendants -** [launchpad] Handle 404 HTTP error -** Update generic http-client parameters for phabricator, meetup, jenkins, github -** [client] Fix init headers and status codes -** [docker] Add build-essential/gcc for dulwich -** [meetup] Adapt tests to assess the sleep for rate -** [github] Adapt tests to assess the sleep for rate -** [client] Add function to calculate the time to reset for tokens -** Apply generic HTTP client to all backends -** [http-client] Add parameter "verify" to fetch method -** Mozilla: no changes -** OPNFV: no changes -** Puppet: no changes - -* Mordred -** Add Arthur support to mordred -** [mordred] Simplify how mordred is started -** [doc] Basic description of mordred -** [tests] Remove load_orgs testing because it fails in Travis -** [requirements] Reuse the deps in setup.py in requirements.txt -** [travis] Add travis support and execute all testing for PRs -** Fix all PEP-8 issues - -* GrimoireELK -** Arr arthur support -** [ocean] Simplify feed logic when getting the items from perceval cache or arthur redis -** Add travis support with test execution. Improvements in the tests. -** Fix PEP-8 issues -** [gelk] Remove ocean-unique-id unique identifier and use always the uuid from perceval. -** [enrich][sortinghat] Add identity domain using the profile information -** [enrich][phabricator] Check in p is defined before using it -** [enrich][meetup] Don't create comments and rsvps events for empty meetup items -** [kidash] Export the index patterns in searches -** [enrich][bugzillarest] Add comments field with the number of comments - -* Panels -** [tests] Remove from test checking the ocean-unique-id field -** Add Crates CSV schema definition -** Bugzilla panels updated for bugzillarest compatibility - -* Reports -** [metrics][issue] Remove Closers metric and Fix BMI implementation -** [github_issues] Removed Closers metric which is not implemented -** [tests] Fix pep8 issues in the tests -** [travis] Install deps using the requirements.txt file in Travis -** [tests] Activate the execution of the tests during CI -** [tests] Initial version of the tests -** Modify code to be PEP8 compliant -** [travis] Add initial travis file - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.24 - -Released: 2017-11-30 - -* SortingHat -** [parsing:grimoirelab] Remove `Unknown` enrollments while parsing - -* Perceval -** [client] Add generic HTTP client -** [jenkins] Fix HTTP error handling -** [gerrit] Fix no route to host error -** [github] Init rate limit info (requests left and reset time) - -* Mordred - -* GrimoireELK -** [travis] First version for CI with Travis, including pep8 and integration tests -** Fixed all PEP-8 issues -** [p2o] Remove code not needed detected during pep8 cleaning -** [tests][crates] Add testing for crates data source -** [enrich][functest] Implement get_field_author and return None -** [enrich][twitter] Check that twitter is in projects map before using it -** [enrich][bugzillarest] Change fields to use the same names than in bugzilla -** [enrich][bugzilla] Remove project_name field to avoid confussions with dashboard projects -** [ocean][phabricator] Fix to float the subpriority field -** [enrich] Check if an identity exists before trying to get her profile -** [index_mapping] Support sort-after scrolling. Use sync uploading of bulk data -** [index_mapping] Add an option so the elasticsearch for read and write could be different -** [elastic] Log the items already uploaded with the bulk API -** [elastic] Fix how the number of duplicates/lost items is tracked in bulk operations -** [elastic] Pack the items in bulk sync before uploading -** [elastic] Raise exception if there is a problem putting the data in Elasticsearch -** [ocean][crates] Remove all params to be passed to the perceval backend -** [enrich][crates] Remove project support from crates (not needed) - -* Panels - -* Reports - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.23.2 - -Released: 2017-11-28 - -* SortingHat - -* Perceval - -* Perceval-OPNFV - -* Perceval-Mozilla - -* Mordred - -* GrimoireELK -** Updated version which fixes: Enrich bugzilla rest 4611 #136 - -* Panels - -* Reports - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.23.1 - -Released: 2017-11-26 - -* SortingHat - -* Perceval - -* Perceval-OPNFV - -* Perceval-Mozilla -** Updated version - -* Mordred - -* GrimoireELK - -* Panels - -* Reports - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.23 - -Released: 2017-11-23 - -* SortingHat -** Add no-strict-matching option -** [setup] Add code for setup.py test to work - -* Perceval -** [git] Fix invalid URL when TCPGitClient is initialized - -* Mordred -** [task_identities] Add reset_on_load param to activate the reset of identities on load -** [task_identities] Add new option strict-mapping to sortinghat config -** [threads] Get the two thread locks needed for enrich and identities in the same order - -* GrimoireELK -** [enrich][meetup] Support that `time` field does not exists in meetup raw item -** [docker] Add docker compose for Elastic 6 version using Bitergia images -** [elastic] Create new method global_mapping to get the mapping added always -** [index_mapping] Remove debug code line which makes mappings to be always None -** [panels] Fix library to work with Elasticsearch6 -** [panels] Add support for listing/importing/exporting panels in ES6 -** [kidash] Add option to clean all items not included in data sources provided - -* Panels -** Add initial version of contribution guidelines -** [owlwatch] Fix path of test data files -** [owlwatch] Add init to test dir to fix test runner -** [owlwatch] Add CSV support -** [owlwatch] Add documentation for CSV comparisons - -* Reports -** [jira] Add jira data source to reports -** [stackexchange] Add new data source stackexchange to reports - -* GrimoireLab Toolkit -** [datetime] Fix to handle dates with invalid time offset - -* Arthur - - -## elasticgirl.22 - -Released: 2017-11-14 - -* SortingHat - -* Perceval -** [git] Change 'mirror' to 'bare' repositories -** [git] Limit the number of 'have' commits sent by fetch-pack -** [git] Fix error fetching latest items from empty repositories - -* Mordred -** [docker] Use the new URL for downloading releases specification - -* GrimoireELK -** [utils] Add index_mapping.py script -** [enrich] Fix log message about the size in MB of the bulk packet sent to ES - -* Panels -** Fix header row in CSV files -** [setup] Add panels/__init__.py -** Several improvements in testing - -* Reports - -* GrimoireLab Toolkit - -* Arthur -** [setup] Set cheerypy version to cherrypy>=8.1 <=11.0.0 -** [setup] Improve generation of package and running tests - -## elasticgirl.21 - -Released: 2017-11-13 - -* SortingHat - -* Perceval -** [meetup] Fix too many requests error -** [jenkins] Fix connection timed out exception -** [git] Fix fetch-pack for HTTPs connections -** [git] Work with bared repositories only -** [crates.io] Add crates backend - -* Mordred -** [task_identities] Fix downloading of identities file from GitHub -** [task_enrich] Wait 5 seconds before executing the studies (demography fix) -** [panels] Fix all panels issues -** [exceptions] Print RuntimeError in an appropriate way -** [menu] Add Functest panel to menu.yaml - -* GrimoireELK -** [enrich] Use _version.py to get GELK version -** Add badges for pypi packages -** [enrich][jira] Support that reporter does not exists in jira raw data -** [kidash] Add support for using panels in the panels module -** [jira] Add story points to enriched index, when they are available -** [setup] Improve setup.py - -* Panels -** [pkg] Add files for first Python package - -* Reports - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.20 - -Released: 2017-11-02 - -* SortingHat - -* Perceval - -* Mordred -** [task_identities] Don't use the orgs file when converting from yaml identities to JSON identities -** [mordred] Clean the threads shared queues once the execution is finished - -* GrimoireELK -** [enrich] Refactor (simplify and improve) the logic to get the SH fields from an identity - -* Panels - -* Reports -** [report] Use command line param title if provided instead of mordred short name - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.19.1 - -Released: 2017-10-26 - -* SortingHat - -* Perceval - -* Mordred - -* GrimoireELK - -* Panels - -* Reports -** Updated version - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.19 - -Released: 2017-10-26 - -* SortingHat -** [matching] Substitute sort for sort_values (pandas in unify) -** [cmd:unify] Change unicode to str - -* Perceval -** [tests] General reorganization -** [askbot] Handle TooManyRedirects error when question title is empty -** [github] Enable fetch reactions without token - -* Mordred -** [task_identities] Include for identities refresh also uuid in which other uuids are merged. -** [task_manager] Add sync logic between threads so the load of identities and the merge of identities tasks are not done during enrichment tasks execution. -** [task_identities] Add support for loading identities in GrimoireLab yaml format from files stored in GitLab and locally. -** [task_identities] Add support for not executing unify and affiliate. -** [task_manager] Execute the tasks and then wait for the interval. - -* GrimoireELK -** [enrich] Get Kibiter version during enrichment process. - -* Panels -** Migrate Reps Events panel to Kibana 5 -** Migrate reps activities panel to Kibana 5 -** Use shaded circle markers in maps -** Migrate Reps Events panel to Kibana 5 -** Migrate Functest panels to Kibana 5 -** Migrate Apache panel to Kibana 5 -** Migrate Functest panels to Kibana 5 -** Migrate MozillaClub panel to Kibana5 -** Migrate Google Hits panel to Kibana 5 -** Migrate Jira Effort Panel to Kibana 5 - -* Reports - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.18.1 - -Released: 2017-10-20 - -* SortingHat - -* Perceval -** Updated version - -* Mordred -** First pip package: updated version - -* GrimoireELK -** Updated version - -* Panels - -* Reports -** First pip package: updated version - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.18 - -Released: 2017-10-20 - -* SortingHat - -* Perceval -** [github] Fix abuse rate limit error (#173) -** [phabricator] Fix restricted access to projects data -** [mbox] Fix UnicodeDecodeError when parsing email addresses (#176) -** [launchpad] Add instructions to README.md and bin/perceval -** [launchpad] Add Launchpad backend - -* Mordred -** Add identification for threads -** [task_panels] Fix mapping problem with ElasticSearch/Kibana 5.6 -** [task_identities] Set TaskInitSortingHat as a global task not related to a data source -** [task_panel][aliases] Add functest aliases -** [tasks] Readd support to execute one time all tasks and exit. -** [task_panels] Add missing aliases: apache, google-hits, remo-events -** Adapt to produce a pipy package (remove VIzGrimoireUtils dependency) - -* GrimoireELK -** [enrich][functest] Fixes all issues and delivered to the customer -** [enrich] Several fixes in different backends to sync with panels - -* Panels -** [owlwatch] Added tool for testing enriched indexes and panels definitions. - Used now in grimoirelab release cycle. -** Migrate Redmine panels to Kibana5 -** Migrate GitHub Backlog to Kibana 5 -** Migrate mediawiki panel to Kibana5 - -* Reports -** Add support for building pip packages. -** Add LaTeX templates to the package. - -* VIzGrimoireUtils -** Not used any more - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.17 - -Released: 2017-10-06 - -* SortingHat -** Install misc scripts like grimoire2sh -** [cmd:load] Add option to clear ids relationships and enrollments -** [cmd:load] Update profile information when loading identities -** [parsing:grimoirelab] Fix style errors in the parser - -* Perceval -** [github] Reduce requests to collect reactions on issues and comments and fix formatting issues -** [git] Redefine default storing repositories path - -* Mordred - -* GrimoireELK -** [docker][kibana] Add docker compose file for Kibana 5.6.0 with X-Pack disabled -** [docker] Don't use a specific elastic config file by default. Use the one - included in the docker image (Elasticsearch). Fix permissions sample file. -** [enrich] Add support for enriching all items from a github raw index with different repositories. -** [requests] Increase the connection retry time from 10 min to 2.5d in HTTP connections -** [enrich][discourse] Fix discourse case in which there is no categories tree -** [enrich][slack] Support that message['attachments'] could be None - -* Panels T3411 -** Add CSV files as the data model schema -** Migrate Discourse to Kibana 5 - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -* Arthur - - -## elasticgirl.16 - -Released: 2017-09-25 - -* SortingHat - -* Perceval -** [github] Fix GitHub Enterprise support -** [git] Run Git commands setting HOME environment variable -** [github] Include reaction information for issues -** [github] Fetch multiple assignees from issues -** [github] Fetch GitHub issue comments -** [discourse] Do not process topics without posts in them - -* Mordred -** Add support for DockerHub (#29) - -* GrimoireELK -** [enrich][github] Support that the user data dict is empty -** [utils] Support https insecure when getting the kibiter version -** [enrich][confluence] Use the space field for project grouping in wiki pages -** [enrich][discourse] Support that a discourse site does not use subcategories -** [enrich][phabricator] Check that item['fields']['ownerData'] is not None before using it -** [enrich][functest] Check that func_test['details'] is not None before using it -** [ocean] Add support in perceval fetch call to the param latest_items -** [enrich][studies] Fix how the date is computed for the last execution of a study. Implemented for the demography study -** [enrich][mediawiki] Add to url field "view" between wiki origin and the page title - -* Panels -** Add Kafka Improvement Proposals panel - -* Reports -** [offset] Include the offset in the start and end dates. -** [projects] Add a new flag --projects to generate the projects data or not. -** [offset] Fix quarter report name when using the offset param. -** [LaTeX] Add report date frame to the summary - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.15 - -Released: 2017-08-08 - -* SortingHat - -* Perceval -** [slack] Fix precision problems in 'oldest' parameter -** Add badge for pypi version - -* Mordred -** [task_collection] Print the full stack trace when there is an exception collecting the data -** [task_projects] Add discourse to the data sources that are always downloaded globally -** [menu] Add Maniphest panels to menu -** [menu] Fix name of Bugzilla panels -** Change schedule to upload panels + menu in the initial phase -** Fix wrong URL when trying to set up defaul time frame and index pattern -** Update menu according to latest 5.1.1 GrimoireLab panels - -* GrimoireELK -** Fix string to integer concatenation error. -** [enrich][discourse] Support that some categories ids don't appear in categories names list -** [enrich][discourse] The category_id must be a string in the projects mapping -** [mbox][kip] Return None if the subject is None when trying to extract the KIP from the subject -** [enrich][confluence] Add confluence space field to the enriched index -** [enrich][askbot] Support that the author_askbot_user_name does not exist. - -* Panels -** Migrate affiliations panel to Kibana 5 -** Add Overview, Data Status and Last Month Contributors panels -** Add GitHub Backlog panel -** Add About panel with some help about the general use of Kibana -** Update About section -** Remove "highlightAll":true string to downgrade panels to 5.1.1 -** Add maniphest panels for 5.1.1 -** Add Mediawiki panel for 5.1.1 - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -* Arthur - -## elasticgirl.14 - -Released: 2017-08-04 - -* SortingHat - -* Perceval - -* Mordred -** Use branch master and the json directory for panels loading. Fix panels names. -** [identities] Create the SortingHat database in mordred initial step - -* GrimoireELK -** Support projects in all data sources -** Fix mappings for stackexchange and twitter for ES5 aggregatable strings fields -** Fix tests adding dockerhub and functest data sources -** [enrich][phabricator] Use directly the list of tags instead of a comma separated string with the tags. - -* Panels -** Migrate discourse, twitter, confluence, RSS, stackooverflow, git, Jenkins, gerrit, bugzilla, mailing list, jira, aaskbot, dockerhub, irc, slack, meetup, github panels to Kibana 5 - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit -** Avoid problems for building the package when no pandoc is installed. - -* Arthur - -## elasticgirl.13 - -Released: 2017-07-20 - -* SortingHat: Updated to the last version. **Don't use it without upgrading the SH database following the procedure below** - -mysqldump --no-create-info db > db.sql -mysqladmin drop db -sortinghat init db -mysql db < db.sql - -** Release 0.4.0 -** [cmd:unify] Print which unique identities were merged -** [api] Add source filter to search_unique_identities() - -* Perceval -** Release 0.9.0 - -* Mordred -** Improve in mordred and enrichment logs about autorefresh -** [docker] Use in default mordred docker image the stage that starts arthur env - -* GrimoireELK -** [enrich][askbot] Fix identities extraction for "bot" like answered_by. -** [ocean][functest] Avoid mapping the field details which changes now between a dict, a list and a string. -** [enrich][mbox] Update the eclipse archives location so the project of a mailing lists can be found in projects.json -** [enrich][git] Use grimoire_creation_date as the date field for git. -** [enrich][meetup] Catch eitem['time_date'] exception when the timedate in the item is wrong. -** Add files needed for building clean pip packages. -** Move kidash to a new directory. -** [enrich][meetup] Catch eitem['time_date'] exception when the timedate in the item is wrong. -** [dashboards] Add KIP draft panel (Kafka Improvement Process) -** [gelk] Get Kibiter version and share it as a global variable of grimoire_elk.utils. -** [enrich][supybot] Add grimoire_creation_date and is_supybot_message standard fields -** [gelk] Remove urljoin to combine the base URL with the kibana config path because it removes the /data path. -** [enrich][askbot] Add author_url field to questions, answers and comments. -** [enrich][askbot][meetup] Copy list of items directly to enriched index. Kibana supports aggregating them directly. -** [enrich][slack] Use fielddata=True for text_analyzed in Kibiter 5. Fix also the enrichment of user_data when it does not include some fields -** [enrich][dockerhub] Implement the enrichment process according to panels team specification. -** [enrich][dockerhub] Enrich events and also create a image enriched item with the data from the last event. -** Avoid adding '//' to URL to be used with Elasticsearch API REST because the API REST petition will fail if '//' are in the URL path. - -* Panels - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -* Arthur: First time arthur is included - -## elasticgirl.12 - -Released: 2017-07-13 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** [slack] Fix error processing comment messages -** [OPNFV] [functest] Fix 'pagination' key not found error - -* Mordred -** Upload Sortinghat identities to a GitHub repository -** [task_track] Get upstream files contribs from all git repositories for OPNFV following the pattern: https://git.opnfv.org//plain/UPSTREAM -** [mordred] Remove the general load of identities used during the initial step. - -* GrimoireELK -** [track_items] Check that upstream contributors file exists. - -* Panels -** Added Confluence panel - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -## elasticgirl.11 - -Released: 2017-07-06 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** New git backend which syncs a repository using low-level commands - -* Mordred -** [docker] Add certificate for some mailing lists -** [autorefresh] Autorefresh will be done after enrichment if there are new data in Sorting Hat identities database. -** [task_panels] Move aliases logic to a new task TaskPanelsAliases so it can be called isolated from the loading of panels. -** [mordred] Use the new task TaskPanelsAliases to create the aliases during enrichment so the aliases are created once the enriched indexes are available. -** [task_identites] Extract Sortinghat unique identities modified in unify and affiliate commands. -** [identities] Add support for getting the uuids that have changed during Sortinghat unify and affiliate and refreshing them during next enrichment execution for all data sources. - -* GrimoireELK -** [enrich][functest] Add support for enriching FuncTest data source coming from OPNFV -** Change TZ so that it comes from author_date -** [enrich][sortinghat] Suppport the autorefresh of identities using a list of ids or uuids in an enriched index -** [enrich] Use always metadata__timestamp for detecting thew new items that must be enriched in incremental mode. Also do it for demography study. -** [panels] Add new method exists_dashboard to check if a dashboard already exists. -** [enrich][meetup] Use time_date as the grimoire_creation_date -** Merge branch 'master' into kafka-kip -** [enrich][mbox] Extract only the needed lines from the boyd of the message to avoid having huge body messages in the enriched index. -** [enrich][slack] Support that from_['real_name'] does no always exists -** [enrich][confluence] Add grimoire_creation_date -** [ocean] Avoid getting the mapping for some raw fields with problems in askbot, bugzilla, bugzillarest, jira and redmine - -* Panels - -* Reports -** [report] Improve log messages - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - - -## elasticgirl.10 - -Released: 2017-06-09 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** [perceval] Add Docker Hub backend - -* Mordred -** [doc] Update the mordred docker sample doc with last features and config params added to mordred. -** [task_identities] Don't try to load empty identities files -** [task_panels] Add support for defining the time frame and default index in an empty Kibiter. - -* GrimoireELK -** [enrich][git][demography] Fill author_min_date also if its value is None no matter it exists -** [enrich][github] Use grimoire_creation_date for getting the affiliation of authors - -* Panels -** Fixed issue with bold texts - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - - - -## elasticgirl.9 - -Released: 2017-05-24 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** Release 0.8.0 -** Remove deprecated functions from utils module. This functions are now part of GrimoireLab toolkit package. -** [backends] Use GrimoireLab toolkit. Datetime handling and introspection has been delegate to GrimoireLab toolkit. - -* Mordred -** [task_identities] Support filter raw in TaskIdentitiesCollection when we have one repository. - -* GrimoireELK -** [enrich][discourse] Add categories support to the enriched posts -** [errors][network] Retry in networking errors for connections and reads using the requests.packages.urllib3.util.retry.Retry -** [enrich][slack] Don't try to find the email in the user profile when it is not available. -** [enrich][stackexchange] Use arrays for tags in enriched index -** [docker] Add compose and elasticsearch config for kibiter 5.4.0 and ElasticSearch 5.4.0 - -* Panels - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit - -## elasticgirl.8 - -Released: 2017-05-17 - -Note: In this release we can not include perceval 0.8 because perceval-mozilla and perceval-puppet are not updated. - -* SortingHat: not upgraded because it needs a migration script - -* Perceval -** [bugzilla] Set User-Agent header on Bugzilla clients -** [askbot] Support old URLs schema - -* Mordred -** [task] Fix error configuring unaffiliated_group during enrichment in identities refresh -** [task_identities] Add support for downloading identities file from remote locations -** [task_identities] Don't load orgs if load_orgs is false -** [task_collection][task_enrich] Add support for config the bulk_size and scroll_size params - -* GrimoireELK -** Add the size of the JSON document to be indexed to the logs -** [ocean] Avoid showing the commits when analyzing git repositories in debug mode. It is too verbose in large repositories. -** [p2o][gelk] Add support for changing the number of items in ES bulk operations and ES scrolling searches. - -* Panels -** Add Lag info and performance KPIs -** Add Lag Solving Issues help -** Add section for the last 7 days of activity -** Add timeframe 7 days selection -** Update summary links in frequently asked metrics -** Add documentation about newcomers in the community as use case -** Add Frequent Asked Metrics section - -* Reports - -* VIzGrimoireUtils - -* GrimoireLab Toolkit -** [uris] Add module for handling URIs -** [datetime] Add module for managing datatime objects -** [introspect] Add module for handling instrospection -** Release 0.1.0 - -## elasticgirl.7 - -Released: 2017-05-04 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval - -* Mordred -** [task_identities] Execute affiliate, autoprofile and unify in subprocesses to avoid memory issues. -** [config] Add additional data sources that are loaded globally: confluece, jenkins, jira -** [task_collection] Do not use project field in data collection. (github project and project_1 issue) - -* GrimoireELK -** [enrich][sortinghat] Improve logs when error appears during SH activity in arthur.py. -** [enrich][meetup] Add a new field time_date with the date in which the event is planned -** [enrich][jira] Add projects support to JIRA. - -* Panels - -* Reports - -* VIzGrimoireUtils - - -## elasticgirl.6 - -Released: 2017-04-28 - -* SortingHat: not upgraded because it needs a migration script - -* Perceval - -* Mordred -** Add the new TaskProjects task which manages the projects data for a dashboard -** Implement mordred projects creation and update from Eclipse projects -** Recover the project enrichment support for bugzilla and gerrit -** Add VIzGrimoireUtils dependency for Eclipse projects parsing - -* GrimoireELK -** [enrich] Show enrich exception call trace in logs -** [enrich][twitter] Don't try to configure perceval backend in non perceval data sources -** [enrich][logs] Show datasource in loading identities logs -** [enrich][twitter] Fix identities extraction in twitter -** [enrich][askbot] Fix SortingHat identities find in answers and comments. -** [enrich][git][p2p] Activate pair programming if origin url includes https://github.com/cloudfoundry-incubator -** [enrich][meetup] Define venue_geolocation field as a geolocation type value in the mapping. - -* Panels -** Add missing search widgets -** Update overview to include mediawiki - -* Reports -** [report] Get the active data sources in the mordred config file -** [report] Fix community section, GitHub metrics in overview, template string replacing in subdirs and quarter name. - -* VIzGrimoireUtils: added to the relase as mordred dependency -** [eclipse_projects] Break down eclipse_projects.py script in a library to be used for managing eclipse projects info and the script which uses it. The library is compatible with python2 and python3. - -## elasticgirl.5.1 - -Released: 2017-04-21 - -* SortingHat - -* Perceval - -* Mordred -** [config] Add new method get_data_sources to get the active data sources in a mordred config file. - -* GrimoireELK -** Fixes related to the change from iterator to generator of ocean API affecting askbot, discourse, mbox and meetup and track_items in elasticgirl.4 -** Fixes in pair programming logic - -* Panels - -* Reports -** Create a unified template and supporting code for generating the reports - -## elasticgirl.4 - -Released: 2017-04-10 - -* SortingHat -** [utils] Fix encoding error generting UUIDs in Python 3 -** [mailmap2sh] Add tool to convert mailmap files to a Sorting Hat JSON - -* Perceval -** [supybot] Include filepath data on ParseError exception -** [gerrit] Add option to disable SSH host keys checks -** [confluence] Add content URL to each item - -* Mordred -** [config] Add type checking for all config params -** Several improvements in tests so all of them work now -** Added track_items task -** Add report task -** [mordred] Add a new option -p to execute the a list of phases different from config file. - -* GrimoireELK -** [enrich][mediawiki] Fix extraction of identities from mediawiki reviews -** [enrich][confluence] Add the new field content_url to the enrich index -** [enrich][askbot] Add filter-raw support for askbot -** [ocean] Use a generator to access the items in ocean. -** [enrich] Get enriched items using the same logic than getting items from ocean -** [enrich][git] Fix demography study so it works with pair programming -** [ocean][meetup] Add the group meetup as tag so the raw index can store several groups in the same index -** [enrich][slack] Add missing field text_analyzed - -* Panels -** Add metrics.md file to the general README - -* Reports - - -## elasticgirl.3 - -Released: 2017-03-30 - + * Fix date parsing errors using grimoirelab-toolkit +* Grimoire ELK + * [flake8] Add W503 to ignore list + * [studies] Improve log lines prefix + * (alpgarcia/master) [enrich] Use grimoirelab-toolkit methods + * [utils] Avoid enriching items over and over + * [enrich] Prevent find identities for none ids + * [schema] Update type for id in discouse.csv + * [enrich-askbot] Fix typo in enrich_items + * [schema] Update askbot csv + * [enrich-askbot] Update id attribute mapping + * [tests] Remove credentials info from log messages + * [enriched] Remove credentials info from log messages + * [ell] Remove credentials info from log messages + * [elastic_items] Remove credentials info from log messages + * [elastic] Add `anonymize_url` method + * [tests] Add tests for alias management + * [enrich-git] Use global variable for aoc alias + * [utils] Handle alias management + * [elk] Handle alias management + * [elastic] Support alias management + * [enrich] Remove logic to add aliases + * [elk] Refactor `refresh_identities` + * [enrich-github] Change mapping type of state attribute + * [enrich-gerrit] Change mapping type of status attribute + * [gitlab-raw] Fix mappings to avoid immense term exception + * [enrich-github] Fix attribute repository + * [elastic_items] Handle none page + * [raw-gitlab] Allow passing blacklisted items from projects.json + * [enrich-askbot] Refactor logic to enrich items + * [enrich-crates] Replace list with yield + * [enrich-phabricator] Replace list with yield + * [enrich-puppetforge] Replace list with yield + * [tests] Add method to check value has_identities + * [enrich-mediawiki] Remove `has_identities` method + * [schema] Update stackoverflow csv + * [enrich-stackexchange] Reorganize tags fields +* Hatstall + * Hide identities that does not have profile +* Kibiter + * Synchronized with Kibana 6.1.4 * Perceval -** Add agent header so rss from wordpress could be retrieved - -* Mordred -** Clean docker image and add support for reports (prettyplotlib and elasticsearch_dsl) -** Fixes in config params -** Check that there are tasks to execute in update mode before executing them to avoid infinite loop in update -** Add new Task to track items upstream, including config and task implemetation. -** Add new Task to generate reports including config and task implemetation. -** Add unaffiliated_group to configure the name of the unaffiliated org name - -* GrimoireELK -** [enrich][demography] Fix author_min_date when executing in incremental mode -** [track_items] Add library and sample script using it -** Add Slack support - -* Panels -** Update mailing lists file name - -* Reports -** First version integrated - - -## elasticgirl.2 - -Released: 2017-03-23 - + * Updating instructions for querying stackexchange in README + * [gitlab] Fix `has_resuming` method +* Sigils + * [slack] Fix duplicates due to the avatar in top participants table + * [stackoverflow] Update field for question tags + * [affiliations] Add affiliations panel for kibana 6 + * [doc] Add GitHub and Gerrit efficiency docs + * [efficiency] Add panels for GitHub and Gerrit + * [mediawiki] Add Mediawiki panel doc + * [mediawiki] Add projects table in Mediawiki panel +* SirMordred + * [tests] Update setup.cfg with aliases_file param + * [task_enrich] Load aliases path from cfg param + * [task_collection] Load aliases path from cfg param + * [task] Load aliases.json file from variable path + * [config] Add aliases.json path in general cfg section + * Fix error importing old TaskPanelsAliases object + * [micro] Remove reference to TaskPanelsAliases + * [task_enrich] Remove reference of TaskPanelsAliases + * [sirmordred] Remove references to TaskPanelsAliases + * [task_panels] Remove TaskPanelsAliases task + * [sirmordred] Add aliases.json file + * [task_enrich] Extend enrich_backend method for alias management + * [task_collection] Extend feed_backend method for alias management + * [task] Read aliases from file + * [task-enrich] Refactor `refresh_identities` + * Reorder Gitlab panels putting them before Community panels + * Update metadashboard structure according to the new menu + * Unify the log debug messages printed by the threads + * Add the origin to the log messages both for data collection and enrichment + * Change logging level for Perceval and GrimoireELK and disable their logging files + * [menu] Add efficiency panels for GitHub and Gerrit * SortingHat -** Release 0.3.0: https://github.com/grimoirelab/sortinghat/releases/tag/0.3.0 - -* Perceval -** Release 0.7.0: https://github.com/grimoirelab/perceval/releases/tag/0.7.0 - -* Mordred -** Support several entries in menu.yaml for the same data source, fixed menu creation and add one level menus for Overview, Data Status, About -** Improved config management: check config, create config and overall params management -** Added new aliases to remo indexes to fix data freshness issue -** Improvements in logs to find errors in threads -** The initial load step could be skipped using the skip_initial_load config param - -* GrimoireELK -** [enrich][git] Add effort pair programming metrics -** [enrich][phabricator] Add missing fields assigned_to and timeopen_days (T2305 ) -** [ocean][twitter] Order raw items using @timestamp during enrichment (T2367) -** [enrich][hyperkitty] Support -** [enrich][jenkins] Add "main" as built_on when built_on field is empty (thanks @lcanas and @jgb) -** [track_items] Upload first complete version with gerrit contributions support - -* Panels -** doc fixes and typo fixes - -## elasticgirl.1 - -Released: 2017-03-09 - -* Perceval -** Automatic checking of code style using flake8 using Travis. Fixed codying style in all perceval. -** Slack backend improvements -** Logs improvements in gerrit -** [backend] Escape invalid chars when UUIDs are generated - -* GrimoireELK -** Logging now includes the correct modules. Several logging fixes. -** [ocean] Fix mappings for gerrit and mbox to avoid immense term issue. -** [ocean][jenkins] Add support for jenkins-rename-file param in mordred - -* Mordred -** Add support for jenkins-rename-file param in mordred -** Add g++ to docker image to compile pandas -** [tests] Add more tests, including a test for testing the full stack and check the number of items generated - -* Panels -** Add first version of general panel description - -## dagger - -Released: 2017-02-23 - -** Support for nntp, puppetforge and hyperkitty (perceval + gelk). slack supported in perceval. -** Support for --filters-raw-prefix (gelk) -** Support remo and remo:activities as data sources in mordred (pending merge branch in mordred) -** Twitter enrichment does not support from_date parameter (gelk) - -## catwoman - -Released: 2017-02-02 - -## batgirl - -Released: 2016-12-23 - -## atom_girl - -Released: 2016-12-14 + * [api] Optimize how last modified identities are retrieved diff --git a/releases/old/NEWS.old b/releases/old/NEWS.old new file mode 100644 index 00000000..ccf8cc06 --- /dev/null +++ b/releases/old/NEWS.old @@ -0,0 +1,3058 @@ +## 18.11-01 + +Released: 2018-11-06 + +* Perceval +** [jenkins] Update message level when handling blacklisted jobs +** [gitlab] Allow to blacklist merge/issue ids +** Ignore W504 flake8 error code +** [backends] Fix flake8 errors + +* grimoirelab-elk +** [enrich-redmine] Add ELK metadata +** [enrich-mozillaclub] Add ELK metadata +** [enrich-mediawiki] Add ELK metadata +** [elastic_items] Handle pagination over none index +** [enrich] Handle insertion of empty identities +** [elk] Avoid processing None identities +** [enrich-meetup] Prevent insert enrich items with no time +** [enrich-discourse] Refactor logic to enrich items +** [ELK] Fix flake8 errors +** [utils] goodbye google-hits script +** [utils] Goodbye rest script +** [enrich-gitlab] Handle missing milestone attribute in raw items +** [elastic_items] Refactor `fetch` method +** [enrich-google_hits] Redifine has_identities method +** [enrich-functest] Redifine has_identities method +** [enrich-dockerhub] Redifine has_identities method +** [enrich-jenkins] Redifine has_identities method +** [elk] Add condition to skip loading identites +** [enrich] Add has_identities method +** [enrich-askbot] Replace list with yield +** [enrich-bugzillarest] Replace list with yield +** [enrich-confluence] Replace list with yield +** [enrich-discourse] Replace list with yield +** [enrich-gitlab] Replace list with yield +** [enrich-jira] Replace list with yield +** [enrich-kitsune] Replace list with yield +** [enrich-mattermost] Replace list with yield +** [enrich-mediawiki] Replace list with yield +** [enrich-phabricator] Replace list with yield +** [enrich-mozillaclub] Replace list with yield +** [enrich-puppetforge] Replace list with yield +** [enrich-redmine] Replace list with yield +** [enrich-remo] Replace list with yield +** [enrich-rss] Replace list with yield +** [enrich-stackexchange] Replace list with yield +** [enrich-slack] Replace list with yield +** [enrich-supybot] Replace list with yield +** [enrich-telegram] Replace list with yield +** [jenkins] Add node name cleaning based on RE +** [enrich-twitter] Replace list with yield + +* SirMordred +** Add demographics index pattern +** [menu] Add index pattern for attraction/retention +** [tests] Fix flake8 errors after upgrade +** [sirmordred] Set elasticsearch logging level to INFO +** [jira] Add index pattern for closed issues +** Add documentation for jenkins `node_regex` param +** [jenkins] Add support for node name cleaning + +* Sigils +** [git] Update demographics panel to use new fields +** [gitlab] Fix latest items tables to size 100 +** [gitlab] Add missing fields in issues index pattern +** [jira] Add closed issues by project table + + +## 18.10-03 + +Released: 2018-10-21 + +* GrimoireLab +** Fixes dependencies problems found in GrimoireLab package + +## 18.10-02 + +Released: 2018-10-18 + +* Perceval +** [groupsio] Make api token a required param +** [groupsio] Fetch archives from group-specific domains +** Adding academic reference + +* grimoirelab-elk +** [enrich_mattermost] Fix error setting empty emails for identities +** [enrich_mattermost] Fix error setting blank names on identities +** [enrich-github] Include label lists in enriched items +** [enrich-git] Replace list with yield +** [enrich-github] Replace list with yield +** [enrich-gerrit] Replace list with yield +** [enrich-bugzilla] Replace list with yield +** [tests] Extend tests for demography study +** [enrich] Add method to include aliases in enriched index +** [enrich-gerrit] Add demography study to gerrit +** [install] Update dependencies +** [tests] Update .travis.yml +** [tests] Align tests for git demography study +** [enrich] Add generic demography study +** [enrich-git] Replace ad-hoc git demography +** [enrich-gitlab] Include labels list in enriched items +** [onion] Fix `all_onion` alias creation +** [onion] Add refresh interval +** [enrich] Check presence of input index onion +** [gitlab-enrich] Add onion study +** [schema] Add schema for gitlab issues +** [schema] Add schema for gitlab merges +** [aoc] Add a constant for out_index default value +** [tests] Extend tests data for Gitlab milestone attribute +** [enrich-gitlab] Add milestone attribute for gitlab items + +* SirMordred +** [onion] Add documentation for 'seconds' parameter +** [setup] Update dependencies +** [menu] Remove onion index pattern from Git panel +** [panels] Add demographics panel in community section +** [tests] Fix tests for task panels +** [tests] Fix tests for config +** [tests] Update mediawiki 1.28 archive +** [tests] Update .travis.yml +** [cfg] Update config files +** [doc] Update documentation with gitlab info +** [micro] Handle raw and enrich tasks exceptions +** [doc] Include doc for gitlab onion studies +** [doc] Add autorefresh_interval description +** [autorefresh] Add autorefresh identities in AOC + +* Sigils +** [data_status] Update google_hits data status entry +** [demographics] Add known limitations and issues +** [demographics] Add panel for multiple sources +** Update info about index patterns and panel ids +** [gitlab] Increase the number of issues shown in timing panels +** [gitlab] Remove invalid search object for MRs backlog +** [gitlab] Adjust "Avg. Time Open" column in Backlog Submitters table +** [gitlab] Show full list of participants in GitLab panels +** [gitlab] Add milestone visualizations to GitLab merge requests +** [gitlab] Add milestone visualizations to GitLab issues +** [onion] Add data source filter widget to panels +** [gitlab] Fix typo in visualizations + +* Kidash +** Add check for query key in bool filter fix + +## 18.10-01 + +Released: 2018-10-03 + +* Perceval +** [tests] Align mediawiki after API calls optimization +** [mediawiki] Optimize number of calls to API +** [tests] Use output method in assertLogs for mbox test +** [tests] Use output method in assertLogs for gitlab test +** [tests] Add test to handle mediawiki version exception +** [mediawiki] Fix error in client `get_version` method +** [gitlab] Fix typo initiazaling common MRs fields + +* grimoirelab-elk +** [enrich-stackexchange] Handle KeyError exception +** [aoc] Add support for autorfresh in sirmordred +** [demography] Catch conn exceptions when fetching author commits +** [enrich] Set identities fields to UNDEFINED for null values + +* SirMordred +** [tasks_panels] Fix initialization of .kibana index in Kibana 6.x + +** Sigils +** [data_status] Fix error showing GitLab issues retrieval dates +** [twitter] Replaces Latest tweets widget at the bottom +** Update documentation about contributing to be updated with Kibiter 6.1.0 release +** Fix hidden legends in bar charts +** Fix title of organizations pie chart +** Fix badly stacked bar bug + +* SortingHat +** Support UTF-8 fully in MySQL/MariaDB + +* Hatstall +** Register new template filter when a name is blank but isn't None + +* Kidash +* [kidash] Enable Kibiter 6 configuration + +## 18.09-03 + +Released: 2018-09-24 + +* GrimoireLab +** [doc] Added file for community components. +** [docker] Clarify variable names in ansible file for building release. + +* Perceval +** [tests] Add tests for GitLab merge request data +** [gitlab] Add merge_request category +** [github] Fix doc in fetch method +** [args] Add new argument --json-line + +* grimoirelab-elk +** [tests] Include tests data for GitLab merge requests +** [enrich-gitlab] Add merge request enrich item +** [enrich-mediawiki] Fix unique id for enriched items +** [tests] Include tests data for GitHub pull requests +** [enrich-stackexchange] Add 'origin' and 'tag' fields to answer items +** [raw] Improve logging message in elastic + +* Sigils +** [overview] Minor change to make gitlab panels visible +** [data_status] Minor change to make gitlab panels visible +** [gitlab] Minor change on merge panels +** [gitlab] Minor change on issue panels +** [gitlab] Add Issues and MR info to Overview and Status panels +** [adoption] Panel for Rust adoption +** [dev] Panel for dev related sources +** [social] Panel for Social sources +** [mediawiki] Use 'edits' instead of 'editions' +** [gitlab mr] Update URL links and fix a couple of titles +** Add GitLab Merge Request panels +** [jenkins] Add panel to track nodes +** [jenkins] Add panel for tracking jobs +** [gitlab] Fix issue with URLs in the repositories table +** [gitlab] Update GitLab panels based on the review. Minor fixes. +** [gitlab] Add GitLab panels focused just on issues +** [github] Fix acc time widget in PRs backlog + +* SirMordred +** [utils] Update setup.cfg micro-mordred +** [config] Change gitlab param names +** [task_panels] Change gitlab data source names +** [tasks_panels] Disable kibiter 6 configuration +** [utils] Add gitlab entries in setup.cfg and .json +** [task_panels] Add aliases to gitlab indexes +** [utils] Update setup.cfg and .json micromordred +** [utils] Update menu.yml +** [menu.yml] Adding nodes and jobs panels +** [tests] Include strict param in mock tests task panels +** [task_panels] Handle strict mode loading panels via setup.cfg +** [config] Handle strict loading of panels +** [tests] Update number of loaded panels +** [utils] Align menu.yml micro-mordred with upstream one +** [menu.yml] Remove mattermost from menu.yml +** [tasks_panels] Handle mattermost panels via setup.cfg +** [config] Load mattermost panels by the setup.cfg +** [tasks_panels] Handle gitlab panels via setup.cfg +** [config] Load gitlab panels by the setup.cfg +** [tests] Include archives for gitlab merges and github pulls +** [task_panels] Align task panels with kidash +** [tests] Align configuration files with new changes +** [tests] Align tests with new changes in task_panels +** [doc] Update config.md +** [README.md] Update readme +** [config] Make kibiter url mandatory for panels section +** [task_panels] Set kibana settings programmatically +** [task-collection] Improve logging message + +* Hatstall +** Fix url redirection to /identities/hatstall +** Change absolute urls in href and actions to the Django right ones + +* Kidash +** Revert previous commit +** [import] Create the Kibana index if not exists before importing anything + + + +## 18.09-02 + +Released: 2018-09-07 + +* Perceval +** Remove unused and not working config_file option + +* grimoirelab-elk +** [tests] Fix load identities test +** [tests] Add tests for googlehits connectors +** [utils] Add googlehits connectors +** [enrich] Add support to enrich googlehits raw data +** [raw] Add support for googlehits data + +* Sigils +** [irc] Fix orgs table participants count +** [KIP] Restore search viz + +* SirMordred +** [utils] Update micro-mordred menu.yml +** [task_panels] Modify alias for google hits +** [config] Remove google_hits from extra backends +** [archives] Update slack archive +** [archives] Update github archive +** [tests] Add tests for googlehits + +* Hatstall +** Add new index that show just an form in order to search identities +** Delete the first and last " with strip() +** Add CSRF_TRUSTED_ORIGINS as a docker env variable + + +## 18.09-01 + +Released: 2018-09-04 + +* Perceval +** [googlehits] Modify item id generation +** [github] Increase number of items retrieved per page +** type fix on tests requirements file + +* Sirmordred +** [menu.yml] Fix typo in googlehits data source +** [task_panels] Include phabricator panels in overview and data status +** [task_panels] Enable kafka studies +** [config] Include option to visualize kafka studies +** [tests] Align tests for new panels +** [utils] Align micro-morded menu.yml with mordred one +** [task_panels] Include mbox-type panels +** [menu.yml] Include mbox-type entries +** [task_panels] Do not import panels that don't have the release field +** [task_panels] Replace google_hits backend name +** [menu.yml] Modify google hits source name +** [tests] Fix tests for task_panels +** [tests] Fix tests for task_enrich +** [tests] Fix tests for test_task +** [collection] Add support for mediawiki tag +** [utils] Add mattermost panels to menu.yml micro-mordred +** [menu] Add mattermost entry +** [menu.yaml] Remove duplicated community info in git menu +** [utils] Fix setup.cfg for micro-mordred +** [menu] Add index pattern for remo-activities +** [menu] Fix remo-activities index-patterns entry + +* grimoirelab-elk +** [enrich-meetup] Fix error printing the number of comments and RSVPs +** [tests] Update Git test data +** [tests] Update Slack test data +** [tests] Update Jira test data +** [enrich-jira] Remove unknown user data logic +** [enrich-git] Remove unknown user data logic +** Set Unknown to null user data (org, name and username) +** [elk] Modify logic to load new identities to SH +** [enrich-mbox] Replace lists with yields +** [enrich-meetup] Replace lists with yields +** [enriched] Update mediawiki project json params +** [enriched-jira] Set Unassigned to null assignee orgs and usernames +** [enrich-jira] Improve jira enricher +** [enrich-git] Handle commits with missing user info +** [tests] Enable tests from no-localhost ES + +* Sigils +** [kip] Disable search panel +** [overview] Add mattermost widgets +** [data status] Add mattermost widgets +** [overview] Fix missing widget panels +** [data_status] Fix visualization ids +** [meetup] Fix visualization id for `meetups_main_numbers` +** [overview] Replace dockerhub viz by current ones +** [kip] Migrate panel to Kibana 6 +** [data status] Add remo activities index pattern +** [about] Update panel to include release date +** [data status] Fix dockerhub index pattern name +** [data status] Fix google hits widgets +** [overview] Fix index name for Dockerhub viz +** [overview] Update google hits widgets +** [google-hits] Panel updated to support new backend + + +## 18.08-01 + +Released: 2018-08-23 + +* SortingHat +** [api] Fix lost enrollments error merging identities +** [db] Handle disconnection using pessimistic mode + +* Perceval +** [doc] Include doc to execute the googlehits backend +** [backends] Add backend for GoogleHits +** [slack] Fix flake8 error +** [slack] Include num members in channel info +** [doc] Update install from source code section in README.md +** Mozilla +** [doc] Update install from source code section in README.md +** OPNFV +** [doc] Update install from source code section in README.md +** Puppet +** [doc] Update install from source code section in README.md + +* Sirmordred +** Fix typos in menu.yaml for 6.x panels and index patterns +** [task_panels] Update index pattern files for Onion panels +** [utils] Add conf files for micro-mordred +** [utils] Add micro-mordred +** [test_task_panels] Update tests for community section menu +** [task_panels] Add community structure menu +** [config] Add time interval for autorefresh +** [panels] Remove unused panels +** Fix weird warning +** [tests] Update test_config.py +** [tests] Add example of enrich_pull_requests study in test_studies.cfg +** [config] Add `enrich_pull_requests` to the tuple of studies + +* grimoirelab-elk +** [enrich-mediawiki] Change way url is created +** [aoc] Replace message commit with first 80 chars +** [enrich-slack] Use `num_members` attribute to count channel members +** [studies] Add enrich_pull_requests study +** [aoc] Fix study to do nothing if no events + +* Sigils +** Merge branch 'kibana6-migration' +** Use 'edits' instead of 'editions' for MediaWiki +** [mattermost] Add Kibana 6 panel and index pattern +** [reps activities] Add panel migrated to Kibana 6 +** [reps events] add panel fro Kibana 6 +** [about] Add about.json from master +** [dockerhub] Fix legend title for Stars and Pulls +** [dockerhub] Update evolutionary charts to use Timelion and use Deltas +** [dockerhub] Add DockerHub panel and index pattern +** [functest] Add panel for functest project +** [functest] Add testing overview panel +** [mediawiki] Use 'edits' instead of 'editions' +** [mozilla-club] Increase size of pie charts +** Add Mozilla Club panels and index patterns +** [google-hits] Add Google Hits panel and index pattern +** [twitter] Migrate panel to Kibana 6 + +* Manuscripts +** [Notebooks] Update README with instructions to run the notebooks +** Add Notebooks for GMD metrics and sample visualisations +** Some (hopefully minor) changes +** [MS2/report/tests] Add basic tests for manuscripts2 reports +** [MS2/tests] Set up module level test fixtures +** [MS2/README] Update README with instructions to generate the report +** [MS2/manuscripts2] Update bin/manuscripts2 to take cmd inputs +** [MS2/latex] Separate github_issues and github_prs data for Overview +** [MS2/reports] Add functions to generate the PDF reports +** [MS2/reports] Add latex template folder from the old manuscripts +** [MS2/reports] Remove "_" from strings and update create_csv_fig_from_df +** [MS2/reports] Fix minor errors and change folder names +** [MS2/Reports] Add the project process section of the report +** [tests] Add tests for Metrics under project process in github_prs +** [MS2/metrics] Add project_process Metrics & function for github_prs +** [tests] Add tests for Metrics under project process in github_issues +** [MS2/metrics] Add project_process Metrics & function for github_issues +** [MS2/elasticsearch] Update calculate_bmi function +** [MS2/metrics] Change field for timeseries aggregations in ClosedIssues +** [MS2/reports] Add PROJECT_COMMUNITY section of the report +** [manuscripts2/metrics] Rename NAME variable to DS_NAMES In all the data source files +** [tests] Add tests for aggregations() in Authors and Organizations classes +** [MS2/metrics] Add capability to calculate project_community metrics +** [tests] Clean up code. Add tests/utils.py +** [manuscripts2/elasticsearch] Add get_list method for Query class +** [config] Add studies params +** [tests] Add tests for timeseries metrics generated in github_prs +** [github_prs] Add project_activity function +** [tests] Add tests for timeseries metrics generated in github_issues +** [github_issues] Add project_activity function +** [tests] Add tests for timeseries metrics generated in git +** [git] Add project_activity function +** [report] Add functionality to calculate PROJECT ACTIVITY section +** [tests] Rearrange the test data into specific folders +** [tests] Add tests for github_issues data source +** [manuscripts2] Add OVERVIEW section for github_issues data source +** [tests] Update test_elasticsearch.py to use test base class +** [tests] Update tests/data/git_commit.json file +** [tests] Update git_commit.json data +** [tests] Update test base class +** Rename manuscripts2/Readme.md to manuscripts2/README.md +** [tests] Add example to use the test base class +** [tests] Add test base class +** [manuscripts2] Add tests for OVERVIEW section of 'git' data source +** [manuscripts2] Add code to calculate OVERVIEW section for 'git' data source + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall +** [docker] Update password of admin user when container restart +** Change href of Profiles item to "list" instead of "/" +** Update href in order to avoid absolute/relative problems +** Allow None country in the profile form +** [docker] Modify path of sqlite file when env variable exists +** [docker] Default admin account can be now set via docker environment variables +** [urls] Add support for using /identities as the base path for accessing Hatstall +** [docker] Remove gunicorn and use stage from Docker image +** [docker] Modify apache config to serve static files and generate the static files during deployment +** [static] Reorganize static contents for the base template in the django-hatstall project +** [urls] Remove gunicorn suport for static contents +** [docker] Add in stage the activation of ssl module in Apache +** [docker] Support https for accessing the Django Hatstall application +** [docker] Convert Django Hatstall deployment to Apache2 + mod_wsgi + +* Ceres +** Fix filter method when a column has no values + + +## 18.07-11 + +Released: 2018-07-25 + +## Release details + +* SortingHat +** [tests] Add tests for recovery mode in unify command +** [unify] Add resume method to unify command + +* Perceval +** [askbot] Handle upstream internal server +** [gitlab] Sanitize requests before archiving +** [gitlab] Fix signature backend +** [travis] Change how perceval is installed +** [mbox] Fix test `test_mboxes_error` +** [github] Fix position GitHub client args +** [phabricator] Handle 429 HTTP errors +** [mbox] Increase test coverage +** [pipermail] Remove duplicated test +** [utils] Add checks to zip compressed type +** [mbox] Add checks to zip compressed type +** [doc] Include doc to execute the groups.io backend +** [backends] Add backend for groups.io +** [mbox] Allow support for zip file in MboxArchive +** [utils] Add support for zip compressed file type +** Mozilla +** [setup] Align setup to perceval one +** [travis] Change how perceval-mozilla is installed +** OPNFV +** [setup] Align setup to perceval one +** [travis] Change how perceval-opnfv is installed +** Puppet +** [setup] Align setup to perceval one +** [travis] Change how perceval-puppet is installed + +* Sirmordred +** [tests] Add tests for sirmordred +** [tests] Update test data +** [sirmordred] Load repos for a tagged backend sections +** [task_projects] Load repos for a tagged backend section +** [tests] Add archive for GitLab +** [utils] Goodbye cfg_generator +** [doc] Include example for GitLab +** [tests] Relax number of index-patterns in tests for panels +** [docs] Add coveralls badge +** [tests] Add perceval-* dependencies to requirements.txt +** [tests] Add grimoirelab-toolkit dependency to requirements.txt +** [config] Redirect autogenerated doc to README.md +** [config] Extend `write_doc` method +** [tests] Extend test for config file + +* grimoirelab-elk +** Change shebang line +** [elastic_items] Remove condition for old twitter items +** Add support for Groupsio +** [travis] Fix coverage execution +** [utils] Goodbye twitter scripts +** [README.md] Fix travis badge +** [travis] Execute coveralls after tests +** [README.md] Add coveralls badge +** Add support for GitLab + +* Sigils + +* Manuscripts +** Update failing tests because of change in perceval git data +** Rename manuscripts2 branch files +** [travis] Narrow coveralls execution +** Update tests for manuscripts2 +** Update Query class: set start and end date filters directly into search object +** [tests] Fix travis.yml +** [travis] Add coveralls +** [doc] Fix badges in README.md +** Add initial infrastructure to generate the reports + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres + + +## 18.07-10 + +Released: 2018-07-17 + +## Release details + +* grimoirelab-elk +** [studies] Use hash instead of plain text as id +** [enriched] Use metadata__update_on to index tweets + + +## 18.07-09 + +Released: 2018-07-15 + +## Release details + +* Sigils +** Use kibana6-migration branch + + +## 18.07-08 + +Released: 2018-07-13 + +## Release details + +* Sirmordred +** [menu.yaml] Add panels and index patterns for Areas of Code and Community Structure + + +## 18.07-07 + +Released: 2018-07-12 + +## Release details + +* SortingHat + +* Perceval +** Changes to work with grimoirelab_toolkit. +** Mozilla +*** Changes to work with grimoirelab_toolkit. +** OPNFV +*** Changes to work with grimoirelab_toolkit. +** Puppet +*** Changes to work with grimoirelab_toolkit. + +* Sirmordred +** [config] Add tag to backend sections + +* grimoirelab-elk +** [raw] Fix mapping Twitter +** [enriched] Add code to calculate github pull requests enriched data +** [enriched] Change toolkit import in git enricher +** [enriched] Change toolkit import in ceres_base +** [p2o] Add support for execution a list of studies +** [enrich][git][demography] Add doc and fix the incremental support + +* Sigils + +* Manuscripts + +* Kidash + +* GrimoireLab Toolkit +** Change module name to grimoirelab_toolkit. + +* King Arthur +** [arthur] Change toolkit import + +* Bestiary + +* Hatstall + +* Ceres + +## 18.07-06 + +Released: 2018-07-10 + +## Release details + +* SortingHat +** [travis] Include cryptography package +** [tests] Align tests to logging support +** [sortinghat] Add logging support + +* Perceval +** [twitter] Change metadata_id attribute +** Mozilla +** OPNFV +** Puppet + +* Sirmordred +** [tests] Add twitter archive +** [dashboard title] Fix typo in project name extraction +** [tests] Add arthur and perceval eggs to requirements.txt +** [studies] Include raw backend to studies + +* grimoirelab-elk +** [enriched] Add support for github pull request data +** [raw] Add support for github pull request data +** [tests] Add test for kafka kip study, git studies and SSL support +** [enriched] Improve logging for studies +** [enriched] Include ocean backend in studies +** [elk] Add raw backend to studies params +** [raw] Add parser params for perceval mattermost backend +** [studies] Fix ES conns to use insecure parameter +** [enrich][mattermost] Fix project mapping support +** [enrich][slack] Fix slack project mapping to use just the channel id in the projects mapping file +** [tests] Use the projects mapping json file for testing + +* Sigils +** [telegram] Add Telegram panels migrated to Kibana 6 +** [apache] Add Apache panels +** Updated panels for askbot, discourse, stackoverflow, rss, bugzilla timing, redmine, maniphest, bugzilla, onion, overview, git, data status, mediawiki, jenkins, stackoverflow, confluence, slack, maniphest, github, irc, mbox, jira, bugzilla, gerrit, +* Manuscripts +** Add manuscripts2 containing new functions to calculate the metrics +** Closes #48: start date not provided use case + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall +** [urls] Add support for using /identities as the base path for accessing Hatstall +** [docker] Default admin account can be now set via docker environment variables +** [docker] Modify path of sqlite file when env variable exists + +* Ceres + +## 18.07-05 + +Released: 2018-07-04 + +* Sirmordred +** Update menu.yaml to kibana 6 panel and index names +** [task_panels] Add support for loading several index patterns per data source + + +## 18.07-04 + +Released: 2018-07-04 + +* Kidash +** Don't sys.exit from kidash.py library (raise exceptions) + +* Mordred +** [task_panels] Manage the error loading panels, log it and continue execution + + +## 18.07-03 + +Released: 2018-07-03 + +* Sirmordred +** [task_panels] Add support for loading index patterns + + +## 18.07-02 + +Released: 2018-07-03 + +* Kidash +** Add release date support for Index Patterns + +* Sigils +** Add panels for kibiter 6.1.0 migration + + +## 18.07-01 + +Released: 2018-07-02 + +* Kidash +** [tests] Add test for split-index-patterns new param +** [kidash] Add support for importing and exporting only index patterns +** Update mapping in Kibana6 if needed +** Add constant for release date field name +** Add try/except to show content of error responses +** Add release_date to panel json + + +## 18.06-03 + +Released: 2018-06-28 + +* SortingHat +** [tests] Adapt tests to run with setup.py test +** [all] Remove support for Python 2.7 +** [db:api] Add functions for all the low level operations on SortingHat +** [api] Improve output messages for enrollment commands +** [exceptions] Rename WrappedValueError to InvalidValueError + +* Perceval +** [tests] Replace datetime function with equivalent toolkit one +** [meetup] Pythonicize `calculate_time_to_reset` +** [backends] Add backend for Twitter +** Mozilla +** OPNFV +** Puppet + +* Mordred +** Change name from mordred to sirmordred + +* grimoirelab-elk +** [mattermost] Add mattermost support for gelk (raw + enrich) +** [tests] Modify tests for Twitter backend +** [utils] Modify connector information for twitter +** [twitter] Modify enrich connector +** [twitter] Modify raw connector +** [tests] Allow testing with latest grimoirelab component versions +** [enrich] Align ELK with changes in SortingHat +** [enriched][github] Add code to calculate the first reaction duration to an issue +** [enrich][redmine] Add `assigned_to` fields +** [jira] Fix mapping to avoid limit number of fields exception +** [bugzilla] Fix immense term exception for activity attribute +** [elastic] Add template to force date format +** [raw] Update mappings for jenkins to ES 5.x +** [enrich] Handle deleted user in stackoverflow +** [enriched] Add `latest_date` method to connector + +* Sigils +** [owlwatch] Move owlwatch to its own repo +** [GitHub] Revamp timing panels +** [GitHub ]Update PRs overview panel +** [demographics] Fix y-axis label for leaving devs +** [slack] Add projects table + +* Manuscripts +** Updated comments in esquery.py + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres + +## 18.06-02 + +Released: 2018-06-08 + +* Mordred +** [studies] Handle empty list of studies in backends + +## 18.06-01 + +Released: 2018-06-07 + +* SortingHat +** [parsing:sh] Make gender profile info not required + +* Perceval +** [backend] Include category in backend params +** [github] Add list of commits hashed included in pull requests +** [pipermail] Fix command line parameters +** OPNFV +** Puppet + +* Mordred + +* grimoirelab-elk +** [stackexchage] Fix fields for questions having an accepted answer +** [jira] Fix typo in enriched jira fields +** [studies][demography] Use author_uuid field to aggregate the authors instead of author_id +** [enrich] Modify max length for keyword fields + +* Sigils +** [discourse] Add % of questions answered +** [stackoverflow] Fix % of questions answered +** [askbot] Add % of questions with accepted answer +** [panels] Add community structure panels & documentation +** [panels] Add accepted answers and project support +** [panels] Fixed links to issues and revamp (jira) +** [panels] Refurbish Jira panel +** [panels] Fix typo in Jira panels +** [panels] Modify answers table for consistency +** [Panels] Rearrange project and authors widgets +** [panels] Add project support to Askbot +** [panels] Add crates to Data Status + +* Manuscripts +** Updated esquery.py and created tests/test_esquery.py +** Updated esquery.py to use elasticsearch_dsl in all places + +* Kidash +** [kidash] Preserve uiStateJSON dict when cleaning a dashboard from not needed data sources +** [kidash] Use #!/usr/bin/env python3 to work inside venvs correctly + +* GrimoireLab Toolkit + +* King Arthur +** [tests] Align tests with arthur tasks validation +** [arthur] Add validation for tasks +** [tests] Fix tests for server +** [jobs] Add category to backend arguments +** [scheduler] Fix wrong date conversion +** [server] Allow to add tasks without archiving/scheduling options + +* Bestiary + +* Hatstall + +* Ceres + +## 18.05-03 + +Released: 2018-05-31 + +* SortingHat + +* Perceval +** [tests] Increase coverage pipermail +** [pipermail] Disable SSL verification +** Mozilla +** OPNFV +** Puppet + +* Mordred +** [studies] Allow setting up kafka_kip via cfg +** [task_projects] Add new eclipse_projects_lib.py +** [tests] Add tests for task_manager +** [config] Include sections for studies +** [tests] Align tests for studies with new functionalities +** [task_enrich] Forward study params to ELK +** [tests] Enable tests with latest versions of grimoirelab components +** [task] Improve parsing parameters for perceval + +* grimoirelab-elk +** [twitter] Set field_date for twitter enricher to created_at +** [enrich][bugzilla] Remove emails from enriched index +** [enrich][meetup] Change log from error to warning when the date are incorrect from upstream data +** [gelk-mapping] Add the script to setup.py so it is installed with the pip package +** [gelk_mapping] Generate files with the JSON mappings to be used by elasticdump to create the indexes +** [elk] Propagate study params from mordred to elk +** [enrich] Create all_onion alias if not exist +** [git] Generalize areas of code study +** [gelk_mapping.py] Script to show the mappings for a data source +** [raw] Reduce the number of fields indexed for jenkins items +** [elk] Fix enrichment of stackexchage answers + +* Sigils +** [panels] Add accepted answers to Discourse panel +** [panels] Add areas of code panel +** [confluence] Increase rows and sort by page edits +** [confluence] Use `content_url` for page links + +* Manuscripts +** [metrics][gerrit] Use closed date field for computing the TTM (time to merge) metric + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur +** [setup] Update Perceval version +** [jobs] Modify imports of perceval functions + +* Bestiary + +* Hatstall + +* Ceres + + +## 18.05-02 + +Released: 2018-05-17 + +* SortingHat + +* Perceval +** [setup] Fix to let setup.py test run +** Add readthedocs badge +** [backend] Replace datetime import with grimoirelab-toolkit +** Mozilla +*** Fix support for package namespaces +** OPNFV +*** Fix support for package namespaces +** Puppet +*** Fix support for package namespaces + +* Mordred + +* grimoirelab-elk +** [enrich][twitter] Use case insesitive tags for doing the projects mapping +** [studies][demography] Add tests for the study +** [studies][demography] Use author_id field to aggregate the authors instead of Author + +* Sigils + +* Manuscripts +** [docstrings] Complete docstrings for manuscripts + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres + + +## 18.05-01 + +Released: 2018-05-10 + +* SortingHat +** [readme] Include troubleshooting section + +* Perceval +** [mattermost] Add Mattermost backend +** Fix support for package namespaces +** Mozilla +** OPNFV +** Puppet + +* Mordred +** [task_enrich] Ensure number of enrich tasks decreases upon failure +** [TaskManager] Fix unreachable code + +* grimoirelab-elk +** [elk] raise exception in do_studies +** [stackexchange] Add fields to csv to track accepted answers +** [discourse] Add fields to csv to track accepted answers +** [stackexchange] Add info to get the percentage of accepted answers +** [discourse] Add info to get the percentage of accepted answers +** [onion] Check author bucket to make sure it exists +** [twitter] Change date value to index tweets +** [enriched][bugzillarest] Fix comment and remove unneeded variable +** [twitter] Limit number of indexed fields +** [stackexchange] Handle deleted users +** [discourse] Add information to track accepted answers +** [stackexchange] Add information to track accepted answers +** [elastic] Remove not used global_mapping method + +* Sigils + +* Manuscripts + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres + + +## 18.04-04 + +Released: 2018-04-26 + +* SortingHat +* Perceval +** Mozilla +** OPNFV +** Puppet +* Mordred +** [setup] Fix dependency on manuscripts +* grimoirelab-elk +** [jira] Disable dynamic mappings for data.changelog.histories +** Remove ES 2.x mappings for all data sources (alexandria is now in ES 5.1) +** [enrich] Remove emails from all enriched indexes +** [tests] Add tests using csv mappings (disabled until the results of the tests are fixed) +** [tests] Add owlwatch model to test mappings +** [phabricator] Handle long description.raw value in raw items +** [setup] Add dependency on SortingHat +* Sigils (old panels) +* Manuscripts (old reports) +** [its] Use closed_at as FIELD_DATE for closed issues metrics +** [metrics][gerrit] Use as date field closed in merged and abandoned reviews +* Kidash +* GrimoireLab Toolkit +* King Arthur +** [docker] Build various docker images +* Bestiary +* Hatstall +* Ceres + + +## 18.04-03 + +Released: 2018-04-18 + +* SortingHat +* Perceval +** Mozilla +** OPNFV +** Puppet +* Mordred +* grimoirelab-elk +** [jenkins] Update raw mappings to deal with large comments +** [jira] Handle data.changelog.histories fields +** [tests] Update test load identites +** [elk] load identities by bulks to sortinghat +** [sortinghat_gelk] Handle possible exeception when adding identities +* Sigils (old panels) +* Manuscripts (old reports) +** [report] Show the perdiod names always as YY-Q[1-4] (16-Q4) +* Kidash +* GrimoireLab Toolkit +* King Arthur +* Bestiary +* Hatstall +** [mod_wsgi] Fix settings so Hatstall works inside Apache mod_wsgi +* Ceres + + +## 18.04-02 + +Released: 2018-04-14 + +* SortingHat + +* Perceval +** [phabricator] Handle project info in core:edge transactions +** Update copyright information +** [phabricator] Include project/user information in task transactions +** [jenkins] Control detail level of Jenkins data +** [gerrit] Rename parameter 'url' to 'hostname' +** Mozilla +*** [mozillaclub] Change log level message when missing event data +** OPNFV +** Puppet + +* Mordred +** [task] Include projects data when creating the enrich backend for studies +** [[task_report] Fix import from report.report to manuscripts.report +** [Improve documentation about "bulk_size" and "scroll_size" +** [[tests] Update archives after sanitizing archived data + +* grimoirelab-elk +** [enrich][jira] Check that main_description field is not None before trunctating it +** [doc] Add information about alias to studies doc +** [studies] Add alias management to onion study +** [studies] Add alias management for areas of code +** [studies] Add methods to manage aliases +** [enrich] Add meta fields only if the meta field is a dict +** [tests] Add test for load identities in sortinghat +** [schema] Add Gerrit CSV aggregatable and description fields +** [phabricator] Handle dots in JSON attribute names +** [nntp] Remove X-fields in raw data +** [mbox] Remove X-fields in raw data +** [tests] Include _fix_item method in tests +** [nntp] Use mbox mappings for NNTP items +** [enrich] Handle case sensitive attributes in mbox items +** [enrich][metadata] Add project metadata fields to the enriched items +** [schema] Update git schema +** [schema] Fix `grimoire_creation_date` description +** [schema] Update areas of code schema +** [enrich] Handle long text values in mozillaclub +** [enrich] Handle different formats for failures in functest +** [travis] Add perceval-puppet dependency +** [enrich] Handle revisions without comment in mediawiki +** [tests] Update tests data for Slack +** [tests] Update test data for Jira +** [doc][studies] Improve studies doc for executing them in mordred +** [doc] Add CSV for areas of code and update doc +** [enrich] Limit size of fields.description in Jira +** [raw] Handle long description in jira fields +** [setup] Add dependency with perceval-puppet +** [raw] Filter attachment-related data of slack messages + +* Sigils (old panels) +** [panels] Update git index pattern +** [askbot] Add accepted answer info + +* Manuscripts (old reports) +** [tests] Added tests for the function replace_text_dir in report.py +** [report] Remove dependency on GREP and SED +** Update requirements for sortinghat + +* Kidash + +* GrimoireLab Toolkit +** [introspect] Add function to find the properties in a class + +* King Arthur +** [scheduler] Rename 'max_retries_job' to 'max_retries' +** [jobs] Replace scheduler arguments by 'max_retries' + +* Bestiary + +* Hatstall +** [deployment] Config the Django settings for deployment in production +** [docker] Improve how gunicorn is started increasing the number of workers and the timeout +** [docker][travis] Fill the Django SECRET_KEY during deployment +** [docker] Add file based config sample for Hatstall +** [django] Remove SECRET_KEY to avoid its use in a production system +** [urls] Add urls to static contents so gunicorn can use them +** [docker] Use the CHAOSS URL to clone Hatstall +** [pip] Add all the files needed to create the django-hatstall pip package +** [hatstall app] Refactor all code to have a "hatstall" app that can be reused +** [docker] Leave alone hatstall in the docker-compose file +** [docker] Use the grimoirelab/hatstall docker image and remove link to mariadb + +* Ceres + + +## 18.04-01-a + +Released: 2018-04-10 + +* Mordred +** [task] Include projects data when creating the enrich backend for studies +** [task_report] Fix import from report.report to manuscripts.report +** Improve documentation about "bulk_size" and "scroll_size" +** [tests] Update archives after sanitizing archived data + + +## 18.04-01 + +Released: 2018-04-04 + +* SortingHat + +* Perceval +** Fix the error "Not a gzipped file (b'00')" +** [client] Sanitize url, payload and headers when archiving data +** [all backends Remove credentials when archiving data +** [jira] Avoid init HTTP session when fetching data from archive +** [tests] Fix fetch_from_archive test +** Mozilla +** OPNFV +** Puppet + +* Mordred +** [panels] Add hyperkitty panel (the same than mbox) +** [task_collection] Support that the name of a backend section could include a suffix +** [task_panels] Filter with data sources active only multi data source visualizations +** [tests] Add archive for testing remo + +* grimoirelab-elk +** [utils] Add PuppetForge support once perceval pip package is available +** [raw] Update mappings to filter body information in confluence items +** [enrich] Limit size of summary and main_description in bugzillarest +** [enrich] Limit size of value attribute summary in bugzilla +** [raw] Change discourse mapping for data.post_stream.posts.cooked +** [enrich] Fix mapping for attribute question_title in discourse +** [enrich] Handle missing accepted_answer_id attribute +** Added support for co-author +** Fix flake8 issues +** [schema] Update askbot.csv +** [studies] Add timeout to ES connections +** [tests] Remove old test data + +* Sigils (old panels) + +* Manuscripts (old reports) +** Remove recursive copying of report directory +** Add user defined logo option + +* Kidash + +* GrimoireLab Toolkit +** [tests] Increase test coverage +** [datetime] Handle wrong timezone offset + +* King Arthur +** Fix Travis CI badge +** Update required version of Perceval +** Rename GrimoireLab references to CHAOSS +** [jobs] Fix 'from_date' and 'offset' reset error + +* Bestiary + +* Hatstall +** [conf] Configure Hatstall using the setup file if exists first and then the web form + +* Ceres + + +## 18.03-05 + +Released: 2018-03-27 + +* SortingHat + +* Perceval +** Handle negative sleep time for rate limit reset: meetup, gitlab, github, client +** [git] Add --to-date to git backend to pull data upto a given time +** [github] Add pull request data +** [pipermail] Increase test coverage +** Mozilla +** [remo] Add params to fetch events from older to newer +** OPNFV +** Puppet + +* Mordred +** [task_panels] Don't use anymore the kibiter version from general config in mordred +** [config] Fix howto import the version from mordred +** [doc] Add first version of the mordred params documented generated automatically +** [config] Add description to all params and remove the params not used anymore +** [doc] Initial version of setup automatic doc generation +** Update import sections to follow grimoire-elk changes +** Fix flake8 errors +** [task_identities] Fix the call to get gender data (hotfix commit) + +* grimoirelab-elk (old GrimoireELK) +** [utils] Remove puppetforge support until there is a pip package and it is supported in grimoirelab_build script +** [elk] Fix mapping path for areas of code index +** [elk] Add onion study to GitHub +** [enriched] Handle wrong time offset in Git enrichment +** [p2o] Use directly the params definition from utils.py +** [enrich] Add doc for enrich_items method and remove not needed code +** [enrich][phabricator] Add enrich metadata to enriched items +** [puppetforge] Implement the enrich spec for PuppetForge +** [enrich] Add `answer_status` field to askbot +** [raw] Fix typos in ES 2.2 mappings for gerrit +** [enrich] Fix limit comment message in gerrit, git +** [enriched] Set not accepted answer flag to askbot unanswered question +** [all] Replace arthur with with elk in import sections +** [all] Replace elk with enriched in import sections +** [all] Replace ocean with raw in import sections +** [arthur] Rename the file name arthur.py to elk.py +** [ocean/elk] Change packages names: This code renames the packages ocean and elk to raw and enriched +** [ocean][hyperkitty] Create specific HyperKittyOcean class +** [utils] Support that the name of a connector could include a suffix +** [elk] Fix params parsing for arthur tasks +** Move CSVs schema definition from Sigils to GrimoireELK +** [Askbot] Add fields to askbot.csv to track accepted answers +** [doc] Add documentation for Areas of Code study +** [elk] Include mappings to discourse backend +** [ocean] Add ES 2.x mappings for askbot backend +** [elk] Create areas of code output index if needed +** [doc] Add documentation on Onion study +** [elk] Add onion study + +* Sigils (old panels) +* [csv] Remove CSVs moved to grimoirelab-elk + +* Manuscripts (old reports) + +* Kidash +** [kidash] Update elk import + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall + +* Ceres +** [examples] Update elk import +** [events] Update elk import + + +## 18.03-04 + +Released: 2018-03-21 + +* SortingHat + +* Perceval +** [pipermail] Handle inaccessible archive URLs +** Mozilla +** OPNFV +** Puppet + +* Mordred +** [task_enrich] Replace bulk_upload_sync with bulk_upload +** [mordred] Remove param studies en enrich section which does not exists anymore + +* GrimoireELK +** [ocean] Fix mappings with jenkins to avoid regression errors +** [enrich][mbox] Return an empty SH identity if the identity provided is None + +* Sigils (old panels) + +* Manuscripts (old reports) +** Default name of manuscripts added +** Added -v argument to show version of manuscripts + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary + +* Hatstall +** Add paginated table in proifle page with 3 columns instead of 2 +** Add more info of uidentity when click on 'view' in profile page +** Change behaviour of the columns when open/close columns +** Add button in the card info of unique identity to merge it +** Fix table size joining columns + +* Ceres + +## 18.03-03 + +Released: 2018-03-20 + +* Mordred +** [mordred] Remove param studies en enrich section which does not exists anymore + + +## 18.03-02 + +Released: 2018-03-20 + +* SortingHat +** [cmd:autogender] Check well-formed names only and Retry and skip connection errors + +* Perceval +** [backend] Remove empty category from parsed arguments +** Mozilla +*** Add tests requirements pip file +*** Add support to run tests using setup.py file + +** OPNFV +*** Add tests requirements pip file +*** Add support to run tests using setup.py file +** Puppet +*** Add tests requirements pip file +*** Add support to run tests using setup.py file + +* Mordred +** [task_projects][eclipse] Add support for extracting the github repositories +** [clean] Remove legacy testing grimoire_elk symlink +** [task_identities] Add gender support +** [task_panels] Add as data source stackoverflow if stackexchange is included +** [tests] Fix tests including the gender fields in SH identities files + +* GrimoireELK +** [elk] Fix check condition ES version for rss, meetup, nntp +** [elk] Limit size of attributes for several data sources to avoid keyword max length issues +** [elk] Fix mappings ES 5.1.x for all backends +** [ocean] Prevent Slack attachment info to be indexed +** [ocean/elasttic] Replace bulk_upload_sync with bulk_upload +** [elastic] Delete bulk_upload_sync method +** [askbot] Refine information to track accepted answers +** [tests] Modify test data for askbot +** [elk] Enrich item to track accepted answers +** [ocean] Add mappings for Askbot ocean +** [enrich][bugzillarest] Change " " with "+" in product and component names to follow Mozilla projects mapping +** [elk] Add gender info from SortingHat +** [ocean][conf] Remove legacy conf index not used anymore +** [utils] Remove not used scripts o2s.py and ocean.py +** [utils] Remove symlink grimoire_elk to avoid hacks in modules import +** [utils] Remove not needed old symlink + +* Sigils (old panels) +** [Askbot] Add fields to askbot.csv to track accepted answers +** [schema] Update Meetup schema to deal with aggregatable fields in Kibana +** [panels] Fix Gerrit panel to use author name field +** Added schema for time_to_commit + +* Manuscripts (old reports) +** Select by user for custom indices for each data +** Create default indices if no custom index is provided +** Change the default name for the enriched git index from 'git_enrich' to 'git' + +* Kidash + +* GrimoireLab Toolkit + +* King Arthur + +* Bestiary +** Add new features: edit and remove ecosystems and projects +** Add information messages to web UI related to important actions +** Change position of ecosystem-related buttons + +* Hatstall +** Add custom pagination in order to retrieve the data paginated +** Add search box that searchs directly to the sh database +** Fix last_modified field show in unique identities +** Add 'show' custom in order to get length of the table paginated +** Change button show entries for 'onchange' event in the select + +* Cereslib +** [events] Add Git author domain from email + + +## 18.03-01-a + +Released: 2018-03-14 + +* GrimoireELK +** [ocean] Add ES 2.x mappings for all ocean backends +** [git] Add a new time_to_commit field to enriched index + +## 18.03-01 + +Released: 2018-03-13 + +* SortingHat +** [model] Fix wrong __repr__ in Profile +** [api] Add search_unique_identities_slice() function +** [cmd:autogender] Fix typo in help output +** Release 0.6.0 +** Rename GrimoireLab references to CHAOSS +** [sortinghat] Add autogender command +** [api] Add function for searching profiles +** [tests] Fix non-deterministic tests +** Add --version command line option +** [tests] Fix so that tests pass when db not in localhost +** [init] Remove annoying error +** [setup] Update pandas +** [gitdm2sh] Set option to ignore invalid email addresses + +* Perceval +** [all backends] Set category when calling fetch and fetch_from_archive +** [meetup][gitlab] Ignore sleep for rate when reading from archive +** [tests] Modify backends tests when fetching from archive +** [tests] Add mock http answers to tests launchpad +** [gerrit] Add tests for gerrit backend +** [mediawiki] Sort request payload parameters for versions >= 1.27 +** [mediawiki][phabricator] Force sort request payload parameters +** [tests][askbot] Format html content file +** [all backends] Add default parameters when init the Client +** [slack] Move parameter latest to the archived args +** [all backends] Add valid categories +** [all backends] Align fetch signature to the backend generic one +** [all backends] Add archive support +** Update CI config to run tests using Python 3.5 and 3.6 +** Update coverage call to remove 'omit' parameter +** [askbot] Add data about accepted answers +** [mbox] Define 'tmp_path' variable before copying mboxes +** [backend] Ignore errors produced while fetching from archives +** [backend] Fix 'Namespace' object has no attribute 'fetch_archive' +** Rename GrimoireLab references to CHAOSS +** [backend] Remove metadata() decorator +** [cache] Remove cache mode +** [backends] Replace cache by archive mode +** Add tests requirements pip-file +** Fix tests to support their execution in two different modes +** Add support to run tests using setup.py file +** [gmane] Remove Gmane backend +** [jenkins] Update perceval sample in README +** [backend] Use the archive manager within BackendCommand +** [backend] Add shortcut functions to fetch items +** [backend] Add 'archived-since' to the argument parser +** [backend] Add 'category' to the general arguments parser +** [backend] Define archive arguments for the argument parser +** [archive] Add class to manage a set of archives +** [archive] Replace 'item_category' by 'category' +** [errors] Add class for raising archive manager exceptions +** [pipermail, bugzilla] Avoid warning by BeautifulSoup +** [perceval] Add GitLab backend +** [all backends] Apply archive to backend +** [client] Replace type() with isinstance() +** [backend] Change method signature of _test_fetch_from_archive +** [backend] Fix backend name in fetch method +** [backend] Add fetch, fetch_from_archive and fetch_items +** [nntp] Fix KeyError 'Date' in metadata_updated_on field +** [backend] Integrate archive with generic backend +** [client] Integrate archive with generic HTTP client +** [archive] Add Archive class +** [tests] Add tests for NotImplemented method errors in backend +** [http-client] Fix rate limit reset log message +** [git] Parse additional pattern for moved files +** [all backends] Modify variable name default_sleep_time +** [client] Modify variable name default_sleep_time + +** Perceval Mozilla +*** [tests] Modify tests when fetching from archive +*** Set category when calling fetch and fetch_from_archive +*** Add valid categories +*** Align fetch signature to the backend generic one +*** Update Perceval dependency version +*** Rename GrimoireLab references to CHAOSS +*** Apply archive to all backends +*** [crates] Fix None sleep_time when using CratesCmd +*** Import perceval modules using relative paths +*** [setup] Update minimum version of perceval required +*** [crates] Change HttpClient method call + +** Perceval OPNFV +*** [functest] Set category when calling fetch and fetch_from_archive +*** [tests] Modify functest tests when fetching from archive +*** [functest] Add valid categories +*** [functest] Align fetch signature to the backend generic one +*** Update Perceval dependency version +*** Rename GrimoireLab references to CHAOSS +*** [FuncTest] Apply archive to FuncTest backend + +** Perceval Puppet +*** [puppetforge] Set category when calling fetch and fetch_from_archive +*** [tests] Modify puppetforge tests when fetching from archive +*** [puppetforge] Add valid categories +*** [puppetforge] Align fetch signature to the backend generic one +*** Update Perceval dependency version +*** Rename GrimoireLab references to CHAOSS +*** [puppetforge] Apply archive to PuppetForge backend + +* Mordred +** [tests] Add tests for the studies configuration per backend +** [task_enrich] Configure and execute studies per backend after enrichment +** [config] Remove 'studies' param from enrich section +** [tests] Add archive for all backends +** [tests] Add tests to fetch data from archives +** [mordred] Updates to use the new location for elastic module in grimoire_elk +** [task_panels] Fix support for Kibana 6 when uploading menus +** [tasks] Make use of grimoire-elk connections +** [task_enrich] Use new param pair_programming to activate this enrich feature + +* GrimoireELK +** [studies] Add support for git_author_domain field +** [setup] Fixed conflict with urllib3 version +** [elk] Fix access to mappings directory +** [utils] Use the 1st interpreter on $PATH +** [tests] Break done tests for all backends +** [elk] Fix enrich_items method +** Update elastic import to the new module path in grimoire_elk.elastic +** [elastic] Refactor elastic class +** [travis] Update travis to add new dependencies +** [elk] Add areas of code study +** [elk] Add basic structure for cereslib studies +** [elk] Refactor sortinghat module name +** [enrich][git] Fix incremental demography update for already existing authors +** [archive] Allow handling perceval archive +** [ocean] Fix mappings to index data in several data sources +** [tests] Refactor tests for backends/connectors +** [remo] Rename filenames of ocean and elk remo connectors +** [ocean] Remove ES 2.x mappings to index git data +** [ocean] Modify Pipermail input data for test +** [ocean] Add Launchpad backend +** [ocean] Add PuppetForge backend +** [ocean] Add GitLab backend +** [tests] Update tests data +** [elk] Update enrich_items method of several data sources for new tests +** [elk] Handle NNTP uppercase Date field +** [ocean] Add warning when json items are not inserted to ES +** [enrich] Track storage exceptions when uploading enriched data to ES +** [travis] Add delay to make ES start + +* Sigils (old Panels) +** Update documentation on process related panels + +* Manuscripts (old reports) +** added Content-Type information in function: get_metrics_data + +* Kidash +** [kidash] Update elastic import from grimoire_elk +** [import] Don't modify the height of visualizatons in dashboards from Kibana >= 6 + +* GrimoireLab Toolkit +** Add support to run tests using setup.py file +** Update coverage call to remove 'omit' parameter +** Rename GrimoireLab references to CHAOSS +** Update CI config to run tests using Python 3.5 and 3.6 + +* King Arthur (old Arthur): +** Add support to run tests using setup.py file +** Fix tests to support their execution in two different modes +** Modify tests requirements pip-file and Travis config. file +** Update documentation with a section for the arthurd config. file +** [worker] Add documentation to perform_job method +** [arthurd] Replace cache support with archive support +** [server] Enable server to handle archives +** [jobs] Enable jobs to handle archives +** [tasks] Enable tasks to deal with archive +** [scheduler] Enable scheduler to deal with archive tasks +** [arthur] Enable Arthur to fetch data from archives + +## elasticgirl.30.4 + +Released: 2018-02-12 + +* GrimoireELK +** [enrich][crates] Return always a correct SH identity + + +## elasticgirl.30.3 + +Released: 2018-02-11 + +* GrimoireELK +** [enrich][git] Add a new param pair_programming to activate this enrich feature +* Mordred +** [task_enrich] Use new param pair_programming to activate this enrich feature + + +## elasticgirl.30.2 + +Released: 2018-02-08 + +* GrimoireELK +** [enrich][jira] Include release field in enriched index +** [enrich][git] Add git_uuid field which is unique id in pair programming + + +## elasticgirl.30.1 + +Released: 2018-02-01 + +* GrimoireELK +** [enrich][git][demography] Fix the demography study logic so it works in incremental mode always +** [enrich][slack] Don't convert boolean fields to int in SortingHat fields +** [elastic] Track exceptions when uploading data to ES +** [enrich][git] Add a new field git_author_domain with the email domain for the Author of the commit + +* Kidash +** [import] Don't modify the height of visualizatons in dashboards from Kibana >= 6 + +## elasticgirl.30 + +Released: 2018-01-31 + +* SortingHat +** [load] Avoid some messages when not in verbose mode +** [init] Add option for reusing database + +* Perceval: frozen in 0.9.10 until Archive cache refactoring is complete +** Mozilla: frozen in 0.1.5 to be compatible with perceval 0.9.10 +** OPNFV +** Puppet + +* Mordred +** [panels] Kibiter now supports that the title for the dashboard is in a JSON inside .kibiter index. New method for uploading it. +** setup and configure RotatingFileHandler for file logging +** [mordred] Check if Bestiary projects can be read before executing mordred +** [task_panels] Add params with kibana url and version to create the .kibana +** [mordred] Retry connection with Elasticsearch and Kibiter to wait for their starting time +** [task_identities] Execute unify just after the load of identities in the same task +** [task_panels] Add mbox as data source to be shown if pipermail exists +** [autorefresh] Refactor autorefresh code thanks to the last_update field in Sortinghat +** [task_panels] Force the creation of .kibana index in Kibiter6 +** [docker] Don't download the menu.yaml file if it has not changed from our local copy + +* GrimoireELK +** [enrich][phabricator] Fix enricher when an item has an array with None as first item of projects +** [enrich] Add missing headers in PUT queries to support ES6 +** [ocean][pipermail] Define the url and dirpath params needed by arthur when using pipermail +** [elastic_items] Remove log error when there are no items or the items index does not exists yet +** [utils] Retry by default total times = connect error times +** [ocean/confluence] Filter out body.storage.value from index +** [enriched] Ensure that we have a method for refreshing whole indexes + +* Panels +** [overview] Include for studies vis a "_studies_" in the id and title + +* Manuscripts (old reports) + +* Kidash +** [kidash] Remove by default from dashboards the study related visualizations +** [visualization] Include the style needed in Kibiana6 to show metrics vis correctly +** [dashboard] Fix the bool filters for the dashboard +** [layout] Increase 1 height the panels of height 1 for kibana6 + +* GrimoireLab Toolkit +** [introspect] Ignore * and ** parameters in method signatures + +* Arthur + + +## elasticgirl.29.4 + +Released: 2018-01-29 + +* GrimoireELK +** [utils] Retry by default total times = connect error times + +* Mordred +** [arthur] Catch exception when the arthur items dict changes during its measure + + +## elasticgirl.29.3 + +Released: 2018-01-29 + +* Mordred +** [task_panels] Add mbox as data source to be shown if pipermail exists +** [task_identities] Execute unify just after the load of identities in the same task +** [mordred] Retry connection with Elasticsearch and Kibiter to wait for their starting time + +* Kidash +** [layout] Increase 1 height the panels of height 1 for kibana6 +** [dashboard] Fix the bool filters for the dashboard +** [visualization] Include the style needed in Kibiana6 to show metrics vis correctly + + +## elasticgirl.29.2 + +Released: 2018-01-25 + +* Mordred +** [autorefresh] Refactor autorefresh code thanks to the last_update field in Sortinghat + +* GrimoireELK +** [elastic_items] Remove log error when there are no items or the items index does not exists yet + + +## elasticgirl.29.1 + +Released: 2018-01-24 + +* Mordred +** [task_panels] Force the creation of .kibana index in Kibiter6 + +* GrimoireELK +** [ocean][pipermail] Define the url and dirpath params needed by arthur when using pipermail +** [enrich] Add missing headers in PUT queries to support ES6 + + +## elasticgirl.29.0 + +Released: 2018-01-23 + +* SortingHat +** [model][tests] Define an order for domains and adapt tests to MariaDB +** [tests] Change configuration to a config file + +* Perceval: frozen in 0.9.10 until Archive transition from cache is complete +** Mozilla: frozen in 0.1.5 to be compatible with perceval 0.9.10 +** OPNFV +*** [functest] Apply generic HTTP client to FuncTest +** Puppet +*** [puppetforge] Apply generic HTTP client to PuppetForge + +* Mordred +** [task_panlels] Support for Kibiter/Kibana 6.x +** [task_projects] Add a new param projects_url to download the projects data from a URL +** [task_identities] Use the last datetime for autorefresh to find the changes in SortingHat +** [task_identities] Don't load identities if autorefresh is pending +** [docker] Update docker mordred image to use a install based on pip packages +** [unified_releases] Remove 'unified_releases' directory which is now in GrimoireLab +** [task] Fix composition perceval params + +* GrimoireELK +** [ocean][confluence] Avoid creating the mapping of data.extensions.position which mutates +** [git] Add Elasticsearch 6.x support for study in git +** [kidash] Remove kidash (moved to a new repo as chaoss/grimoirelab-kidash) +** [elasticsearch] Support Elasticsearch 6 + +* Panels + +* Manuscripts (old reports) +** [setup] Modifications due to change in name (manuscripts) + +* Kidash +** [kidash] Unbundle kidash completely from GrimoireELK +** [kidash] Fix error getting the title of an index pattern +** [setup] Change to the new chaoss organization in GitHub + +* GrimoireLab Toolkit +** [datetime] Add timezone data to datetime_utcnow() + +* Arthur +** [tests] Add tests for add, remove, tasks paths of arthur server + + +## elasticgirl.28.3 + +Released: 2018-01-21 + +* GrimoireELK +** [kidash] Remove kidash (moved to a new repo as chaoss/grimoirelab-kidash) +** [elasticsearch] Support Elasticsearch 6 + + +## elasticgirl.28.2 + +Released: 2018-01-18 + +* Mordred +** [task] Fix composition perceval params +** [docker] Update docker mordred image to use a install based on pip packages +** [task_identities] Don't load identities if autorefresh is pending +** [task_identities] Use the new API SH call search_last_modified_identities to refresh identities +** [task_projects] Add a new param projects_url to download the projects data from a URL + + +## elasticgirl.28.1 + +Released: 2018-01-09 + +* Mordred +** [docker] Add symlink to kidash so mordred finds it + + +## elasticgirl.28 + +Released: 2018-01-09 + +* SortingHat + +* Perceval +** [git] Send in fetch-pack local heads refs only +** [meetup] Handle processing deleted groups +** [git] Fix cloned directory of local repository +** Mozilla +*** Apply generic HTTP client to all backends +** OPNFV: no changes +** Puppet: no changes + +* Mordred +** [panels] Use the new kidash module, instead of grimoire-kidash +** [task_collection][arthur] Limit the total number of items collected from redis +** [task_collection][arthur] Set to 200MB the max memory for the arthur python dict +** [task_collection][arthur] Limit the max size of the python memory with raw items from redis +** [tasks_panels] Add support for data sources when uploading panels +** [docker] Use the new grimoirelab github repository location to download the releases + +* GrimoireELK +** [kidash] Unbundle kidash completely +** [Jira] Extract timing for a sprint +** [Jira] Move enrichement of fields property to a classmethod +** [setup] Add kingarthur as a dependency + +* Panels + +* Reports + +* GrimoireLab Toolkit + +* Arthur +** Add support for configuration file +** [writers] Update writer to support ElasticSearch >= 5.x +** Update requirements + + +## elasticgirl.27.1 + +Released: 2017-12-28 +Warning: Change in SortingHat database. You need to either create +a new database from scratch, or convert your old SortingHat database. +See details in the main README.md in the SortingHat git repository +(section "Compatibility between versions)"). + +* SortingHat +** Release 0.5.0 +** [api] Add function to search last modified identities +** [api] Update 'last_modified' attribute when needed +** [model] Add 'last_modified' attribute to unique identities and identities +** [grimoirelab2sh] Add '--no-email-validation' option +** parsing:grimoirelab] Set option to ignore invalid email addresses + + +## elasticgirl.27 + +Released: 2017-12-28 +Warning: skip_initial_load no longer supported in Mordred. + +* SortingHat (stalled to pre 0.5.0 due to change in db schema) + +* Perceval +** [meetup] Remove 'draft' status due to a bug in Meetup API +** [git] Request in fetch-pack the outdated refs only +** [git] Fix error discovering refs in repos which don't have any +** [git] Ignore error codes when executing a command +** Mozilla: no changes +** OPNFV: no changes +** Puppet: no changes + +* Mordred +** [task_collection] Configure bulk and scroll size in arthur collection +** [tasks_project] Load projects in the initial tasks in mordred +** [task_collection] Create task in arthur only the first time +** [task_identities] Add support for '--no-email-validation' option in grimoirelab2sh + +* GrimoireELK +** [ocean][git] Map data.message to string so it is not a keyword because it is large field (>32K) in some cases +** [panels] Change the API so dashboards can be listed, imported and exported with a JSON in memory +** [enrich][meetup] Fix to support empty events during comments extraction +** [enrich][jira] Check that labels are defined in issue['fields'] before using it + +* Panels +** [Panels] Fix Twitter username field in tables +** [Panels] Add projects and orgs support for Meetup + +* Reports + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.26.2 + +Released: 2017-12-22 + +* GrimoireELK +** [enrich][meetup] Fix to support empty events during comments extraction + + +## elasticgirl.26.1 + +Released: 2017-12-21 + +* SortingHat +** [grimoirelab2sh] Add '--no-email-validation' option + +* Mordred +** [task_identities] Add support for '--no-email-validation' option in grimoirelab2sh + + +## elasticgirl.26 + +Released: 2017-12-20 + +* SortingHat + +* Perceval +** Mozilla: no changes +** OPNFV: no changes +** Puppet: no changes + +* Mordred +** [docker] Add link to arthur library so it can be used in mordred +** [task_identities] Don't load identities if autorefresh is pending +** [docker] arthur is not used with Elasticsearch anymore +** [task_collection][arthur] Compute the memory usage in intervals + +* GrimoireELK +** [mappings] If a mapping can not be created just log the issue +** [autorefresh] Group the number of identities to be refreshed +** [utils] Support enrich all items for all groups in a raw meetup index +** [enrich][meetup] Fix to support empty events during ersvp extraction + +* Panels +** [Panels] Add projects to IRC panel +** [Panels] Remove old unused panel directories +** [Panels] Add project support to Twitter panel + +* Reports + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.25.1 + +Released: 2017-12-19 + +* Mordred +** [mordred] Fix symbolic links to grimoire_elk and report changed by error + +## elasticgirl.25 + +Released: 2017-12-18 + +* SortingHat +** [db] Fix tables created with invalid collation +** [model] Coerce boolean type +** [travis] Update before_install package versions +** [setup] Upgrade dependencies +** [cmd:export] Remove trailing whitespaces in JSON files + +* Perceval +** [backend] Fix 'find_backends' to get all backend descendants +** [launchpad] Handle 404 HTTP error +** Update generic http-client parameters for phabricator, meetup, jenkins, github +** [client] Fix init headers and status codes +** [docker] Add build-essential/gcc for dulwich +** [meetup] Adapt tests to assess the sleep for rate +** [github] Adapt tests to assess the sleep for rate +** [client] Add function to calculate the time to reset for tokens +** Apply generic HTTP client to all backends +** [http-client] Add parameter "verify" to fetch method +** Mozilla: no changes +** OPNFV: no changes +** Puppet: no changes + +* Mordred +** Add Arthur support to mordred +** [mordred] Simplify how mordred is started +** [doc] Basic description of mordred +** [tests] Remove load_orgs testing because it fails in Travis +** [requirements] Reuse the deps in setup.py in requirements.txt +** [travis] Add travis support and execute all testing for PRs +** Fix all PEP-8 issues + +* GrimoireELK +** Arr arthur support +** [ocean] Simplify feed logic when getting the items from perceval cache or arthur redis +** Add travis support with test execution. Improvements in the tests. +** Fix PEP-8 issues +** [gelk] Remove ocean-unique-id unique identifier and use always the uuid from perceval. +** [enrich][sortinghat] Add identity domain using the profile information +** [enrich][phabricator] Check in p is defined before using it +** [enrich][meetup] Don't create comments and rsvps events for empty meetup items +** [kidash] Export the index patterns in searches +** [enrich][bugzillarest] Add comments field with the number of comments + +* Panels +** [tests] Remove from test checking the ocean-unique-id field +** Add Crates CSV schema definition +** Bugzilla panels updated for bugzillarest compatibility + +* Reports +** [metrics][issue] Remove Closers metric and Fix BMI implementation +** [github_issues] Removed Closers metric which is not implemented +** [tests] Fix pep8 issues in the tests +** [travis] Install deps using the requirements.txt file in Travis +** [tests] Activate the execution of the tests during CI +** [tests] Initial version of the tests +** Modify code to be PEP8 compliant +** [travis] Add initial travis file + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.24 + +Released: 2017-11-30 + +* SortingHat +** [parsing:grimoirelab] Remove `Unknown` enrollments while parsing + +* Perceval +** [client] Add generic HTTP client +** [jenkins] Fix HTTP error handling +** [gerrit] Fix no route to host error +** [github] Init rate limit info (requests left and reset time) + +* Mordred + +* GrimoireELK +** [travis] First version for CI with Travis, including pep8 and integration tests +** Fixed all PEP-8 issues +** [p2o] Remove code not needed detected during pep8 cleaning +** [tests][crates] Add testing for crates data source +** [enrich][functest] Implement get_field_author and return None +** [enrich][twitter] Check that twitter is in projects map before using it +** [enrich][bugzillarest] Change fields to use the same names than in bugzilla +** [enrich][bugzilla] Remove project_name field to avoid confussions with dashboard projects +** [ocean][phabricator] Fix to float the subpriority field +** [enrich] Check if an identity exists before trying to get her profile +** [index_mapping] Support sort-after scrolling. Use sync uploading of bulk data +** [index_mapping] Add an option so the elasticsearch for read and write could be different +** [elastic] Log the items already uploaded with the bulk API +** [elastic] Fix how the number of duplicates/lost items is tracked in bulk operations +** [elastic] Pack the items in bulk sync before uploading +** [elastic] Raise exception if there is a problem putting the data in Elasticsearch +** [ocean][crates] Remove all params to be passed to the perceval backend +** [enrich][crates] Remove project support from crates (not needed) + +* Panels + +* Reports + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.23.2 + +Released: 2017-11-28 + +* SortingHat + +* Perceval + +* Perceval-OPNFV + +* Perceval-Mozilla + +* Mordred + +* GrimoireELK +** Updated version which fixes: Enrich bugzilla rest 4611 #136 + +* Panels + +* Reports + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.23.1 + +Released: 2017-11-26 + +* SortingHat + +* Perceval + +* Perceval-OPNFV + +* Perceval-Mozilla +** Updated version + +* Mordred + +* GrimoireELK + +* Panels + +* Reports + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.23 + +Released: 2017-11-23 + +* SortingHat +** Add no-strict-matching option +** [setup] Add code for setup.py test to work + +* Perceval +** [git] Fix invalid URL when TCPGitClient is initialized + +* Mordred +** [task_identities] Add reset_on_load param to activate the reset of identities on load +** [task_identities] Add new option strict-mapping to sortinghat config +** [threads] Get the two thread locks needed for enrich and identities in the same order + +* GrimoireELK +** [enrich][meetup] Support that `time` field does not exists in meetup raw item +** [docker] Add docker compose for Elastic 6 version using Bitergia images +** [elastic] Create new method global_mapping to get the mapping added always +** [index_mapping] Remove debug code line which makes mappings to be always None +** [panels] Fix library to work with Elasticsearch6 +** [panels] Add support for listing/importing/exporting panels in ES6 +** [kidash] Add option to clean all items not included in data sources provided + +* Panels +** Add initial version of contribution guidelines +** [owlwatch] Fix path of test data files +** [owlwatch] Add init to test dir to fix test runner +** [owlwatch] Add CSV support +** [owlwatch] Add documentation for CSV comparisons + +* Reports +** [jira] Add jira data source to reports +** [stackexchange] Add new data source stackexchange to reports + +* GrimoireLab Toolkit +** [datetime] Fix to handle dates with invalid time offset + +* Arthur + + +## elasticgirl.22 + +Released: 2017-11-14 + +* SortingHat + +* Perceval +** [git] Change 'mirror' to 'bare' repositories +** [git] Limit the number of 'have' commits sent by fetch-pack +** [git] Fix error fetching latest items from empty repositories + +* Mordred +** [docker] Use the new URL for downloading releases specification + +* GrimoireELK +** [utils] Add index_mapping.py script +** [enrich] Fix log message about the size in MB of the bulk packet sent to ES + +* Panels +** Fix header row in CSV files +** [setup] Add panels/__init__.py +** Several improvements in testing + +* Reports + +* GrimoireLab Toolkit + +* Arthur +** [setup] Set cheerypy version to cherrypy>=8.1 <=11.0.0 +** [setup] Improve generation of package and running tests + +## elasticgirl.21 + +Released: 2017-11-13 + +* SortingHat + +* Perceval +** [meetup] Fix too many requests error +** [jenkins] Fix connection timed out exception +** [git] Fix fetch-pack for HTTPs connections +** [git] Work with bared repositories only +** [crates.io] Add crates backend + +* Mordred +** [task_identities] Fix downloading of identities file from GitHub +** [task_enrich] Wait 5 seconds before executing the studies (demography fix) +** [panels] Fix all panels issues +** [exceptions] Print RuntimeError in an appropriate way +** [menu] Add Functest panel to menu.yaml + +* GrimoireELK +** [enrich] Use _version.py to get GELK version +** Add badges for pypi packages +** [enrich][jira] Support that reporter does not exists in jira raw data +** [kidash] Add support for using panels in the panels module +** [jira] Add story points to enriched index, when they are available +** [setup] Improve setup.py + +* Panels +** [pkg] Add files for first Python package + +* Reports + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.20 + +Released: 2017-11-02 + +* SortingHat + +* Perceval + +* Mordred +** [task_identities] Don't use the orgs file when converting from yaml identities to JSON identities +** [mordred] Clean the threads shared queues once the execution is finished + +* GrimoireELK +** [enrich] Refactor (simplify and improve) the logic to get the SH fields from an identity + +* Panels + +* Reports +** [report] Use command line param title if provided instead of mordred short name + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.19.1 + +Released: 2017-10-26 + +* SortingHat + +* Perceval + +* Mordred + +* GrimoireELK + +* Panels + +* Reports +** Updated version + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.19 + +Released: 2017-10-26 + +* SortingHat +** [matching] Substitute sort for sort_values (pandas in unify) +** [cmd:unify] Change unicode to str + +* Perceval +** [tests] General reorganization +** [askbot] Handle TooManyRedirects error when question title is empty +** [github] Enable fetch reactions without token + +* Mordred +** [task_identities] Include for identities refresh also uuid in which other uuids are merged. +** [task_manager] Add sync logic between threads so the load of identities and the merge of identities tasks are not done during enrichment tasks execution. +** [task_identities] Add support for loading identities in GrimoireLab yaml format from files stored in GitLab and locally. +** [task_identities] Add support for not executing unify and affiliate. +** [task_manager] Execute the tasks and then wait for the interval. + +* GrimoireELK +** [enrich] Get Kibiter version during enrichment process. + +* Panels +** Migrate Reps Events panel to Kibana 5 +** Migrate reps activities panel to Kibana 5 +** Use shaded circle markers in maps +** Migrate Reps Events panel to Kibana 5 +** Migrate Functest panels to Kibana 5 +** Migrate Apache panel to Kibana 5 +** Migrate Functest panels to Kibana 5 +** Migrate MozillaClub panel to Kibana5 +** Migrate Google Hits panel to Kibana 5 +** Migrate Jira Effort Panel to Kibana 5 + +* Reports + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.18.1 + +Released: 2017-10-20 + +* SortingHat + +* Perceval +** Updated version + +* Mordred +** First pip package: updated version + +* GrimoireELK +** Updated version + +* Panels + +* Reports +** First pip package: updated version + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.18 + +Released: 2017-10-20 + +* SortingHat + +* Perceval +** [github] Fix abuse rate limit error (#173) +** [phabricator] Fix restricted access to projects data +** [mbox] Fix UnicodeDecodeError when parsing email addresses (#176) +** [launchpad] Add instructions to README.md and bin/perceval +** [launchpad] Add Launchpad backend + +* Mordred +** Add identification for threads +** [task_panels] Fix mapping problem with ElasticSearch/Kibana 5.6 +** [task_identities] Set TaskInitSortingHat as a global task not related to a data source +** [task_panel][aliases] Add functest aliases +** [tasks] Readd support to execute one time all tasks and exit. +** [task_panels] Add missing aliases: apache, google-hits, remo-events +** Adapt to produce a pipy package (remove VIzGrimoireUtils dependency) + +* GrimoireELK +** [enrich][functest] Fixes all issues and delivered to the customer +** [enrich] Several fixes in different backends to sync with panels + +* Panels +** [owlwatch] Added tool for testing enriched indexes and panels definitions. + Used now in grimoirelab release cycle. +** Migrate Redmine panels to Kibana5 +** Migrate GitHub Backlog to Kibana 5 +** Migrate mediawiki panel to Kibana5 + +* Reports +** Add support for building pip packages. +** Add LaTeX templates to the package. + +* VIzGrimoireUtils +** Not used any more + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.17 + +Released: 2017-10-06 + +* SortingHat +** Install misc scripts like grimoire2sh +** [cmd:load] Add option to clear ids relationships and enrollments +** [cmd:load] Update profile information when loading identities +** [parsing:grimoirelab] Fix style errors in the parser + +* Perceval +** [github] Reduce requests to collect reactions on issues and comments and fix formatting issues +** [git] Redefine default storing repositories path + +* Mordred + +* GrimoireELK +** [docker][kibana] Add docker compose file for Kibana 5.6.0 with X-Pack disabled +** [docker] Don't use a specific elastic config file by default. Use the one + included in the docker image (Elasticsearch). Fix permissions sample file. +** [enrich] Add support for enriching all items from a github raw index with different repositories. +** [requests] Increase the connection retry time from 10 min to 2.5d in HTTP connections +** [enrich][discourse] Fix discourse case in which there is no categories tree +** [enrich][slack] Support that message['attachments'] could be None + +* Panels T3411 +** Add CSV files as the data model schema +** Migrate Discourse to Kibana 5 + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +* Arthur + + +## elasticgirl.16 + +Released: 2017-09-25 + +* SortingHat + +* Perceval +** [github] Fix GitHub Enterprise support +** [git] Run Git commands setting HOME environment variable +** [github] Include reaction information for issues +** [github] Fetch multiple assignees from issues +** [github] Fetch GitHub issue comments +** [discourse] Do not process topics without posts in them + +* Mordred +** Add support for DockerHub (#29) + +* GrimoireELK +** [enrich][github] Support that the user data dict is empty +** [utils] Support https insecure when getting the kibiter version +** [enrich][confluence] Use the space field for project grouping in wiki pages +** [enrich][discourse] Support that a discourse site does not use subcategories +** [enrich][phabricator] Check that item['fields']['ownerData'] is not None before using it +** [enrich][functest] Check that func_test['details'] is not None before using it +** [ocean] Add support in perceval fetch call to the param latest_items +** [enrich][studies] Fix how the date is computed for the last execution of a study. Implemented for the demography study +** [enrich][mediawiki] Add to url field "view" between wiki origin and the page title + +* Panels +** Add Kafka Improvement Proposals panel + +* Reports +** [offset] Include the offset in the start and end dates. +** [projects] Add a new flag --projects to generate the projects data or not. +** [offset] Fix quarter report name when using the offset param. +** [LaTeX] Add report date frame to the summary + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.15 + +Released: 2017-08-08 + +* SortingHat + +* Perceval +** [slack] Fix precision problems in 'oldest' parameter +** Add badge for pypi version + +* Mordred +** [task_collection] Print the full stack trace when there is an exception collecting the data +** [task_projects] Add discourse to the data sources that are always downloaded globally +** [menu] Add Maniphest panels to menu +** [menu] Fix name of Bugzilla panels +** Change schedule to upload panels + menu in the initial phase +** Fix wrong URL when trying to set up defaul time frame and index pattern +** Update menu according to latest 5.1.1 GrimoireLab panels + +* GrimoireELK +** Fix string to integer concatenation error. +** [enrich][discourse] Support that some categories ids don't appear in categories names list +** [enrich][discourse] The category_id must be a string in the projects mapping +** [mbox][kip] Return None if the subject is None when trying to extract the KIP from the subject +** [enrich][confluence] Add confluence space field to the enriched index +** [enrich][askbot] Support that the author_askbot_user_name does not exist. + +* Panels +** Migrate affiliations panel to Kibana 5 +** Add Overview, Data Status and Last Month Contributors panels +** Add GitHub Backlog panel +** Add About panel with some help about the general use of Kibana +** Update About section +** Remove "highlightAll":true string to downgrade panels to 5.1.1 +** Add maniphest panels for 5.1.1 +** Add Mediawiki panel for 5.1.1 + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +* Arthur + +## elasticgirl.14 + +Released: 2017-08-04 + +* SortingHat + +* Perceval + +* Mordred +** Use branch master and the json directory for panels loading. Fix panels names. +** [identities] Create the SortingHat database in mordred initial step + +* GrimoireELK +** Support projects in all data sources +** Fix mappings for stackexchange and twitter for ES5 aggregatable strings fields +** Fix tests adding dockerhub and functest data sources +** [enrich][phabricator] Use directly the list of tags instead of a comma separated string with the tags. + +* Panels +** Migrate discourse, twitter, confluence, RSS, stackooverflow, git, Jenkins, gerrit, bugzilla, mailing list, jira, aaskbot, dockerhub, irc, slack, meetup, github panels to Kibana 5 + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit +** Avoid problems for building the package when no pandoc is installed. + +* Arthur + +## elasticgirl.13 + +Released: 2017-07-20 + +* SortingHat: Updated to the last version. **Don't use it without upgrading the SH database following the procedure below** + +mysqldump --no-create-info db > db.sql +mysqladmin drop db +sortinghat init db +mysql db < db.sql + +** Release 0.4.0 +** [cmd:unify] Print which unique identities were merged +** [api] Add source filter to search_unique_identities() + +* Perceval +** Release 0.9.0 + +* Mordred +** Improve in mordred and enrichment logs about autorefresh +** [docker] Use in default mordred docker image the stage that starts arthur env + +* GrimoireELK +** [enrich][askbot] Fix identities extraction for "bot" like answered_by. +** [ocean][functest] Avoid mapping the field details which changes now between a dict, a list and a string. +** [enrich][mbox] Update the eclipse archives location so the project of a mailing lists can be found in projects.json +** [enrich][git] Use grimoire_creation_date as the date field for git. +** [enrich][meetup] Catch eitem['time_date'] exception when the timedate in the item is wrong. +** Add files needed for building clean pip packages. +** Move kidash to a new directory. +** [enrich][meetup] Catch eitem['time_date'] exception when the timedate in the item is wrong. +** [dashboards] Add KIP draft panel (Kafka Improvement Process) +** [gelk] Get Kibiter version and share it as a global variable of grimoire_elk.utils. +** [enrich][supybot] Add grimoire_creation_date and is_supybot_message standard fields +** [gelk] Remove urljoin to combine the base URL with the kibana config path because it removes the /data path. +** [enrich][askbot] Add author_url field to questions, answers and comments. +** [enrich][askbot][meetup] Copy list of items directly to enriched index. Kibana supports aggregating them directly. +** [enrich][slack] Use fielddata=True for text_analyzed in Kibiter 5. Fix also the enrichment of user_data when it does not include some fields +** [enrich][dockerhub] Implement the enrichment process according to panels team specification. +** [enrich][dockerhub] Enrich events and also create a image enriched item with the data from the last event. +** Avoid adding '//' to URL to be used with Elasticsearch API REST because the API REST petition will fail if '//' are in the URL path. + +* Panels + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +* Arthur: First time arthur is included + +## elasticgirl.12 + +Released: 2017-07-13 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** [slack] Fix error processing comment messages +** [OPNFV] [functest] Fix 'pagination' key not found error + +* Mordred +** Upload Sortinghat identities to a GitHub repository +** [task_track] Get upstream files contribs from all git repositories for OPNFV following the pattern: https://git.opnfv.org//plain/UPSTREAM +** [mordred] Remove the general load of identities used during the initial step. + +* GrimoireELK +** [track_items] Check that upstream contributors file exists. + +* Panels +** Added Confluence panel + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +## elasticgirl.11 + +Released: 2017-07-06 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** New git backend which syncs a repository using low-level commands + +* Mordred +** [docker] Add certificate for some mailing lists +** [autorefresh] Autorefresh will be done after enrichment if there are new data in Sorting Hat identities database. +** [task_panels] Move aliases logic to a new task TaskPanelsAliases so it can be called isolated from the loading of panels. +** [mordred] Use the new task TaskPanelsAliases to create the aliases during enrichment so the aliases are created once the enriched indexes are available. +** [task_identites] Extract Sortinghat unique identities modified in unify and affiliate commands. +** [identities] Add support for getting the uuids that have changed during Sortinghat unify and affiliate and refreshing them during next enrichment execution for all data sources. + +* GrimoireELK +** [enrich][functest] Add support for enriching FuncTest data source coming from OPNFV +** Change TZ so that it comes from author_date +** [enrich][sortinghat] Suppport the autorefresh of identities using a list of ids or uuids in an enriched index +** [enrich] Use always metadata__timestamp for detecting thew new items that must be enriched in incremental mode. Also do it for demography study. +** [panels] Add new method exists_dashboard to check if a dashboard already exists. +** [enrich][meetup] Use time_date as the grimoire_creation_date +** Merge branch 'master' into kafka-kip +** [enrich][mbox] Extract only the needed lines from the boyd of the message to avoid having huge body messages in the enriched index. +** [enrich][slack] Support that from_['real_name'] does no always exists +** [enrich][confluence] Add grimoire_creation_date +** [ocean] Avoid getting the mapping for some raw fields with problems in askbot, bugzilla, bugzillarest, jira and redmine + +* Panels + +* Reports +** [report] Improve log messages + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + + +## elasticgirl.10 + +Released: 2017-06-09 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** [perceval] Add Docker Hub backend + +* Mordred +** [doc] Update the mordred docker sample doc with last features and config params added to mordred. +** [task_identities] Don't try to load empty identities files +** [task_panels] Add support for defining the time frame and default index in an empty Kibiter. + +* GrimoireELK +** [enrich][git][demography] Fill author_min_date also if its value is None no matter it exists +** [enrich][github] Use grimoire_creation_date for getting the affiliation of authors + +* Panels +** Fixed issue with bold texts + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + + + +## elasticgirl.9 + +Released: 2017-05-24 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** Release 0.8.0 +** Remove deprecated functions from utils module. This functions are now part of GrimoireLab toolkit package. +** [backends] Use GrimoireLab toolkit. Datetime handling and introspection has been delegate to GrimoireLab toolkit. + +* Mordred +** [task_identities] Support filter raw in TaskIdentitiesCollection when we have one repository. + +* GrimoireELK +** [enrich][discourse] Add categories support to the enriched posts +** [errors][network] Retry in networking errors for connections and reads using the requests.packages.urllib3.util.retry.Retry +** [enrich][slack] Don't try to find the email in the user profile when it is not available. +** [enrich][stackexchange] Use arrays for tags in enriched index +** [docker] Add compose and elasticsearch config for kibiter 5.4.0 and ElasticSearch 5.4.0 + +* Panels + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit + +## elasticgirl.8 + +Released: 2017-05-17 + +Note: In this release we can not include perceval 0.8 because perceval-mozilla and perceval-puppet are not updated. + +* SortingHat: not upgraded because it needs a migration script + +* Perceval +** [bugzilla] Set User-Agent header on Bugzilla clients +** [askbot] Support old URLs schema + +* Mordred +** [task] Fix error configuring unaffiliated_group during enrichment in identities refresh +** [task_identities] Add support for downloading identities file from remote locations +** [task_identities] Don't load orgs if load_orgs is false +** [task_collection][task_enrich] Add support for config the bulk_size and scroll_size params + +* GrimoireELK +** Add the size of the JSON document to be indexed to the logs +** [ocean] Avoid showing the commits when analyzing git repositories in debug mode. It is too verbose in large repositories. +** [p2o][gelk] Add support for changing the number of items in ES bulk operations and ES scrolling searches. + +* Panels +** Add Lag info and performance KPIs +** Add Lag Solving Issues help +** Add section for the last 7 days of activity +** Add timeframe 7 days selection +** Update summary links in frequently asked metrics +** Add documentation about newcomers in the community as use case +** Add Frequent Asked Metrics section + +* Reports + +* VIzGrimoireUtils + +* GrimoireLab Toolkit +** [uris] Add module for handling URIs +** [datetime] Add module for managing datatime objects +** [introspect] Add module for handling instrospection +** Release 0.1.0 + +## elasticgirl.7 + +Released: 2017-05-04 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval + +* Mordred +** [task_identities] Execute affiliate, autoprofile and unify in subprocesses to avoid memory issues. +** [config] Add additional data sources that are loaded globally: confluece, jenkins, jira +** [task_collection] Do not use project field in data collection. (github project and project_1 issue) + +* GrimoireELK +** [enrich][sortinghat] Improve logs when error appears during SH activity in arthur.py. +** [enrich][meetup] Add a new field time_date with the date in which the event is planned +** [enrich][jira] Add projects support to JIRA. + +* Panels + +* Reports + +* VIzGrimoireUtils + + +## elasticgirl.6 + +Released: 2017-04-28 + +* SortingHat: not upgraded because it needs a migration script + +* Perceval + +* Mordred +** Add the new TaskProjects task which manages the projects data for a dashboard +** Implement mordred projects creation and update from Eclipse projects +** Recover the project enrichment support for bugzilla and gerrit +** Add VIzGrimoireUtils dependency for Eclipse projects parsing + +* GrimoireELK +** [enrich] Show enrich exception call trace in logs +** [enrich][twitter] Don't try to configure perceval backend in non perceval data sources +** [enrich][logs] Show datasource in loading identities logs +** [enrich][twitter] Fix identities extraction in twitter +** [enrich][askbot] Fix SortingHat identities find in answers and comments. +** [enrich][git][p2p] Activate pair programming if origin url includes https://github.com/cloudfoundry-incubator +** [enrich][meetup] Define venue_geolocation field as a geolocation type value in the mapping. + +* Panels +** Add missing search widgets +** Update overview to include mediawiki + +* Reports +** [report] Get the active data sources in the mordred config file +** [report] Fix community section, GitHub metrics in overview, template string replacing in subdirs and quarter name. + +* VIzGrimoireUtils: added to the relase as mordred dependency +** [eclipse_projects] Break down eclipse_projects.py script in a library to be used for managing eclipse projects info and the script which uses it. The library is compatible with python2 and python3. + +## elasticgirl.5.1 + +Released: 2017-04-21 + +* SortingHat + +* Perceval + +* Mordred +** [config] Add new method get_data_sources to get the active data sources in a mordred config file. + +* GrimoireELK +** Fixes related to the change from iterator to generator of ocean API affecting askbot, discourse, mbox and meetup and track_items in elasticgirl.4 +** Fixes in pair programming logic + +* Panels + +* Reports +** Create a unified template and supporting code for generating the reports + +## elasticgirl.4 + +Released: 2017-04-10 + +* SortingHat +** [utils] Fix encoding error generting UUIDs in Python 3 +** [mailmap2sh] Add tool to convert mailmap files to a Sorting Hat JSON + +* Perceval +** [supybot] Include filepath data on ParseError exception +** [gerrit] Add option to disable SSH host keys checks +** [confluence] Add content URL to each item + +* Mordred +** [config] Add type checking for all config params +** Several improvements in tests so all of them work now +** Added track_items task +** Add report task +** [mordred] Add a new option -p to execute the a list of phases different from config file. + +* GrimoireELK +** [enrich][mediawiki] Fix extraction of identities from mediawiki reviews +** [enrich][confluence] Add the new field content_url to the enrich index +** [enrich][askbot] Add filter-raw support for askbot +** [ocean] Use a generator to access the items in ocean. +** [enrich] Get enriched items using the same logic than getting items from ocean +** [enrich][git] Fix demography study so it works with pair programming +** [ocean][meetup] Add the group meetup as tag so the raw index can store several groups in the same index +** [enrich][slack] Add missing field text_analyzed + +* Panels +** Add metrics.md file to the general README + +* Reports + + +## elasticgirl.3 + +Released: 2017-03-30 + +* Perceval +** Add agent header so rss from wordpress could be retrieved + +* Mordred +** Clean docker image and add support for reports (prettyplotlib and elasticsearch_dsl) +** Fixes in config params +** Check that there are tasks to execute in update mode before executing them to avoid infinite loop in update +** Add new Task to track items upstream, including config and task implemetation. +** Add new Task to generate reports including config and task implemetation. +** Add unaffiliated_group to configure the name of the unaffiliated org name + +* GrimoireELK +** [enrich][demography] Fix author_min_date when executing in incremental mode +** [track_items] Add library and sample script using it +** Add Slack support + +* Panels +** Update mailing lists file name + +* Reports +** First version integrated + + +## elasticgirl.2 + +Released: 2017-03-23 + +* SortingHat +** Release 0.3.0: https://github.com/grimoirelab/sortinghat/releases/tag/0.3.0 + +* Perceval +** Release 0.7.0: https://github.com/grimoirelab/perceval/releases/tag/0.7.0 + +* Mordred +** Support several entries in menu.yaml for the same data source, fixed menu creation and add one level menus for Overview, Data Status, About +** Improved config management: check config, create config and overall params management +** Added new aliases to remo indexes to fix data freshness issue +** Improvements in logs to find errors in threads +** The initial load step could be skipped using the skip_initial_load config param + +* GrimoireELK +** [enrich][git] Add effort pair programming metrics +** [enrich][phabricator] Add missing fields assigned_to and timeopen_days (T2305 ) +** [ocean][twitter] Order raw items using @timestamp during enrichment (T2367) +** [enrich][hyperkitty] Support +** [enrich][jenkins] Add "main" as built_on when built_on field is empty (thanks @lcanas and @jgb) +** [track_items] Upload first complete version with gerrit contributions support + +* Panels +** doc fixes and typo fixes + +## elasticgirl.1 + +Released: 2017-03-09 + +* Perceval +** Automatic checking of code style using flake8 using Travis. Fixed codying style in all perceval. +** Slack backend improvements +** Logs improvements in gerrit +** [backend] Escape invalid chars when UUIDs are generated + +* GrimoireELK +** Logging now includes the correct modules. Several logging fixes. +** [ocean] Fix mappings for gerrit and mbox to avoid immense term issue. +** [ocean][jenkins] Add support for jenkins-rename-file param in mordred + +* Mordred +** Add support for jenkins-rename-file param in mordred +** Add g++ to docker image to compile pandas +** [tests] Add more tests, including a test for testing the full stack and check the number of items generated + +* Panels +** Add first version of general panel description + +## dagger + +Released: 2017-02-23 + +** Support for nntp, puppetforge and hyperkitty (perceval + gelk). slack supported in perceval. +** Support for --filters-raw-prefix (gelk) +** Support remo and remo:activities as data sources in mordred (pending merge branch in mordred) +** Twitter enrichment does not support from_date parameter (gelk) + +## catwoman + +Released: 2017-02-02 + +## batgirl + +Released: 2016-12-23 + +## atom_girl + +Released: 2016-12-14