🚀 AnalisiOpenData - Open Data Analyzer

DESCRIPTION

Python software development project for analyzing and extracting open data from the official dati.gov.it search portal.

MAIN FEATURES

	Search and filtering of available datasets
	Automatic download and analysis of CSV data
	Geographic visualization of maps
	Export to CSV and Excel formats
	Modular architecture well organized
	Complete test suite for validation
	Centralized configuration for easy maintenance

INSTALLATION

git clone https://github.com/1ESA1/AnalisiOpenData.git
cd AnalisiOpenData

REQUIREMENTS

	Version Requests
	Call API
	For manipulation data
	For interactive map
	Extensible and Compatible

The dependencies are present in the file. requirements.txt.

pip install -r requirements.txt

USAGE

🚀Click to Web App Live || Public URL

https://brluhecnkuvhp99tuzhzv3.streamlit.app/

cd src
streamlit run app.py

Local Access (Same Machine):

http://localhost:8501

Deploy to Streamlit Cloud - (External Users) - 🌐

1.		GitHub with your project
2.		Sign up at streamlit.io/cloud
3.		Click "New app" and select your repository
4.		Share the public URL with users worldwide

Steamlit Features Interface:

	Interactive dataset search with keyword filtering
	Browse and select datasets from dati.gov.it
	Analyze individual datasets or process all results
	View interactive maps for geographic data
	Download analysis results as CSV
	View data summaries and statistics

RUN

Version	CLI
Modular	bash cd src python main.py
Original	bash cd src python AnalisiOpenData.py

Application Testing

# Run all tests
cd tests
python run_unified_tests.py

# Specific tests
python test_config.py      # Configuration tests
python test_unified.py     # Unified tests
python test_utils.py       # Utility tests

📁 OUTPUT

data/	JSON files with dataset metadata
output/mappa_incidenti.html	Interactive map
output/output.xlsx	Excel report
output/output.csv	Data exported to CSV

🏆 Improvements Implemented

	Independent and reusable components
	Centralized settings
	Robust error handling
	Complete test suite for validation
	Detailed documentation
	Legacy code maintained

🏗️ Project Structure

Module Architecture

AnalisiOpenData/
│
├── 📁 src/                   # Modular source code
│   ├── 🎯 main.py              # Main control
│   ├── ⚙️ config.py              # Centralized configuration (URLs, paths, constants)
│   ├── 🔌 services.py            # API and data services
│   ├── 📄 file_manager.py        # File I/O management (JSON, CSV, Excel)
│   ├── 📊 analyzer.py            # Accident analysis
│   ├── 💬 ui.py                  # User interface
│   └── 📜 AnalisiOpenData.py     # Original code (backup)
│
├── 🧪 tests/                 # Complete test suite
│   ├── 📄 base_test.py           # Base tests
│   ├── 📄 test_config.py         # Configuration tests
│   ├── 📄 test_unified.py        # Unified tests
│   ├── 📄 test_utils.py          # Test utilities
│   └── 🏃 run_unified_tests.py   # Unified test runner
│
├── 📊 data/                  # Input data
│   ├── 📊 Condizioni.xlsx        # Weather conditions
│   ├── 📄 DatiGovIt.json         # Raw data from data.gov.it
│   ├── 📄 DatiGovItFiltrati.json # Filtered data
│   └── 📄 DatiSelezionati.json # Data selected for analysis
│
├── 📈 output/                # Generated output files
│   ├── 🗺️ mappa_incidenti.html   # Interactive map
│   ├── 📊 output.xlsx             # Excel report
│   └── 📄 output.csv             # Data exported to CSV
│
├── 📖 README.md              # Complete documentation
├── 📖 CHANGELOG.md           # Updates documentation
└── 📄 LICENSE                # Apache 2.0 License

Structure view:

tree -I '__pycache__' --dirsfirst

TEST AND QUALITY

• ✅ Modules: 6/6 source files validated
• ✅ Configuration: Working settings tests
• ✅ Functionality: Core components tested
• ✅ Integration: Complete system validated

Run All Tests

cd tests
python run_unified_tests.py

Individual Tests

cd tests
python test_config.py      # Configuration tests
python test_unified.py     # Unified tests
python test_utils.py       # Utility tests

Project Structure Verification

# Display project structure
tree -I '__pycache__'

# Check main files
ls -la src/
ls -la tests/
ls -la data/
ls -la output/

Read CONTRIBUTING.md for the complete guidelines on how to contribute to the project.