v1.2.2-stable

ADDED

1. Added steps counter for basic scan
2. Added counter for received and accessed subdomains
3. Reactivated XLSX report selection
4. Added system requirements in ReadTheDocs page

DELETED

1. Temporarily removed API scan results insertion in XLSX report
2. Removed pagesearch_keyword variable usage in HTML report
3. Removed transfer of unused variables into reporting functions
4. Removed some redundant imports
5. Removed redundant pagesearch_main module

CHANGED

1. Done some code clean up
2. Fixed wrong code (tried to join short_domain string)
3. Simplified logic of used API flag insertion in report_storage.db
4. Bumped version for required Jinja2 (security issue)
5. Clarified valid and tested Python versions in pyproject.toml
6. Minor CLI visual changes
7. Cleaned-up redundant requirements
8. Updated XLSX report with new content
9. Corrected installation ways in ReadTheDocs

v1.2.1-stable

ADDED

1. Added support of HudsonRock API. It doesn't require a key, so you can give it a try!
2. Added domain's main page snapshotting (with screenshot)
3. Added domain's main page snapshotting (by making HTML copy of domain's main page)
4. Added config parameters for selenium snapshotting setups
5. Added selenium and webdriver-manager requirements
6. Significantly widened amount of results returned from VirusTotal API

DELETED

1. Removed PageSearch Sitemap Inspection module

CHANGED

1. Fixed "dirty API key" problem for SecurityTrails API and VirusTotal API (API keys transfered with invisible symbols from SQLite DB)
2. Temporarily disabled XLSX reporting module
3. Unified returns from SecurityTrails API and VirusTotal API in individual variables
4. Significantly changed visual design for API reports in DPULSE CLI

v1.2 - API & Dorking update

Dorking mode rework

As you may remember, Google Dorking automatization was implemented in DPULSE for a long time. It was a very simple concept solution that only proved the functionality of this method. Since v1.1 this concept has been expanded into a working solution that offers much better interaction during investigation process. However, work on this mode is not finished and will continue in the future.

API integration

There are many third-party APIs that are useful in OSINT research. In order to simplify the process of their use it was decided to integrate several APIs (VirusTotal and SecurityTrails) directly into DPULSE with local API keys database. However, similar to Google Dorking mode, work on the more APIs integration will continue in the future.

PDF reports deprecation

Working with PDF reports in Python did not meet expectations. It requires a lot of effort in code development when it comes to appearance customization or supporting different encodings or languages. Therefore, it was decided to deprecate PDF reports, which were replaced by a more convenient and easier to support HTML reports.

ReadTheDocs documentation

High-quality and accurate documentation is one of the key factors in future development of open-source project. That's why Readthedocs documentation page was created. It is already filled with the basic details about the DPULSE, but during DPULSE development and updating process this page will be expanded.

v1.1.6-stable

ADDED

1. Added XLSX and HTML report examples

DELETED

1. Removed warning about deprecated PDF report

CHANGED

1. Changed XLSX report content in order to replicate HTML report content
2. Unified data_array content both for XLSX and HTML reports
3. Extended bad emails clean-up support for scans without PageSearch
4. Improved handling of API results returning in XLSX report
5. Fixed error when selecting only 1 API to scan crashes program entirely
6. Extended column sizes for some XLSX sheets
7. Updated Jinja2 required version to 3.1.5+ in order to fix security issue
8. Fixed wrong cosmetical wrap for not found SSL certificate info
9. Some code clean up

v1.1.5-stable

ADDED

1. Added keywords_list None value if PageSearch was not selected
2. Added proxifier.py to handle proxies gathering for Google Dorking
3. Added user-agents list support for config generator
4. Added user-agents rotation support
5. Added CLI output for user-agent changing
6. Added X.com links parsing support
7. Extended Twitter links paragraph with X.com links in HTML report
8. Added new paragraph for proxies file path
9. Added code to handle proxies usage
10. Added support of VirusTotal API and SecurityTrails API scans reporting

CHANGED

1. Moved Google Dorking DB related functions to db_creator.py
2. Modified color scheme for dorking results output
3. Corrected local imports names
4. HTML report cosmetical improvements (PS and SI)
5. Cosmetical update for N/A organization name filler
6. Some code clean-up and CLI cosmetical improvements

v1.1.4-stable

ADDED

1. Added Table of Contents in HTML report
2. Added paragraph separators in HTML report
3. Added PageSearch paragraphs in HTML report
4. Added Dorking results paragraph in HTML report
5. Added used API flag transfer to Report Storage DB
6. Added API scan status to show in Report Storage DB CLI Inspector
7. Added dorking_results.txt file removal after creating HTML report. You won't see this file anymore

DELETED

1. Deleted choice for PDF report creation. Forever
2. Removed deprecated HTML report templates
3. Removed PDF report handling functions and modules
4. Removed xhtml2pdf requirement
5. Removed empty line in basic_dorking.db
6. Removed some double imports

CHANGED

1. Rewritten "None" dorking mark to "N" when starting a scan
2. Fixed bug with wrong api_scan_db handling in XLSX report
3. Improved config editing exception hanling
4. Fixed some typos
5. Unified report creation calling function, so there'll be no more duplication of code
6. Fixed long spaces between some string and menus in some places
7. Adapted XLSX report for unified report creation function

v1.1.3-stable

ADDED

1. Added basic support for APIs
2. Added basic VirusTotal API support
3. Added basic SecurityTrails API support
4. Added reference API Keys DB

DELETED

1. Removed some unused imports from modules

CHANGED

1. Fixed incomplete URL sanitization security issue
2. Improved exception handling for dorking processes
3. Reactivated and reworked API Keys DB menu in Settings
4. Moved API key enter menu point to separate main menu point
5. Moved some long prints to cli_init module
6. Fixed wrong config file check logic
7. Fixed wrong XLSX report creation with Dorking module activated
8. Made cosmetical fix for XLSX Google Dorking sheet if mode was set to None
9. Refactored PageSearch documents saving code
10. Optimized imports by making them situational
11. Changed "Clear journal content" menu point from 5 to 3
12. Fixed incorrect separators appearing during PageSearch process

v1.1.2-stable

ADDED

1. Added support for adminpanels_dorking.db
2. Added config parameters for Google Dorking module
3. Added new settings point menu
4. Added "Clear journal content" function
5. Added webstructure_dorking database
6. Added separate module to handle custom Dorking DB generation
7. Added custom Dorking DB usage support
8. Added check on existent custom DB name
9. Added possibility to view and edit config file

CHANGED

1. Modified dorking_delay and delay_step transfer
2. Some CLI visual changes
3. Reactivated some parts of settings menu
4. Fixed DPULSE stuck by config file absence
5. Updated basic_dorking table content
6. Fixed SSL/TLS and incomplete URL sanitization security issues
7. Fixed 'No such file or directory' error when dorking mode is set to None
8. Reactivated "Generate custom Dorking DB" menu point
9. Done some code refactoring

v1.1.1-stable

ADDED

1. Extended README with new installation commands set for rolling versions
2. Added 3 databases with different dorks to use them in new extended scan mode
3. Added new extended scan mode: Google Dorking with different dorking types (which are represented by DBs)
4. Added check on presence of databases with dorks
5. Added config file (temporarily it is a test change, and it's still WIP)
6. Added domain regex and connectivity check
7. Added misc.py module to control various mini functions
8. Added config_processor.py module
9. Added dorking post-scan summary output
10. Added folder for future APIs module
11. Added possibility to recreate HTML reports from report storage DB

REMOVED

1. [TEMPORARILY] Disabled Settings menu
2. Deprecated old dorking_processor.py module and TXT file with dorks
3. Removed some double imports

CHANGED

1. Minor CLI changes (different checks were moved before DPULSE main banner)
2. Moved and reworked functions from dorking_processor.py to dorking_handler.py
3. Fixed bug when 0 found subdomains stops DPULSE when PS is activated
4. Fixed wrong keywords search result printing in reports (PS)

v1.1 - PageSearch update

PageSearch mode

For complex OSINT, it's not enough to find only vectors for their further use. Sensitive or other specific information that interests investigator is also important for more accurate approaches. We've added PageSearch feature, which allows you to find more e-mail addresses, API keys, exposed passwords, cookies, hidden forms of data and other web page elements, documents, config files, databases files and specified words by user in PDF files. Although PageSearch will continue to develop, you can use it to get some interesting results in v1.1

XLSX and HTML report support

We decided to add a little variety when you choose the type of report which DPULSE generates. XLSX is an extremely common and no less convenient format than PDF for creating reports. In our XLSX report file you can see several sheets, each of which contains some information

Also, HTML reports support was added. We had some problems with encodings in xhtml2pdf library and PDF reports, so HTML reports are more like an alternative way to get correct output in final report file. In further releases PDF report most likely will be removed, but if solution will appear - PDF reports remain

No more wkhtmltopdf installation requirement

Installing various third-party programs while working with another software is extremely inconvenient. We decided to rework the process of PDF reports creation using a different set of libraries that do not require installation of wkhtmltopdf. This will allow you to start using DPULSE much faster right after downloading it

Scan journal

In situations when errors appear, user wants to know what caused it. With this idea, scan log was introduced. It collects all successful scanning phase and various errors in a separate journal.log file. You can find it in DPULSE root folder after conducting at least one scan

Rolling releases branch

When v1.1 will be released, we will create new branch in GitHub repository. It will contain rolling releases which are being developed in live mode.