Master Sovereign Operations Control Dashboard
Full-Width Laptop Workstation • All Confidential Sensitive Data Masked
Welcome to the Sovereign Operations Control (SOC) Command Hub. This live platform orchestrates 24/7 automated business lead discovery across 52 dedicated worksheets spanning all 26 Republic of Ireland counties, 6 Northern Ireland counties, and major UK commercial hubs. Currently indexing 44,748 master B2B leads with 14,827 direct verified emails (33.1% coverage), operating at an continuous speed of 500+ leads per hour backed by a 60-second Watchdog supervisor.
ANY INTRUDERS? ZERO INTRUDERS DETECTED (100% SECURE)
SIEM Security Audit:0 Active Breaches • 10 Auth Login Probes Flagged & Blocked • 38 WAF Scanners Dropped • 14 SQLi/XSS Exploit Payloads Intercepted
Web App URL:
https://script.google.com/macros/s/AKfycbwxzQSSb5.../exec • Spreadsheet ID: 1dVwMHEzNFW8KO73RCT3R5pdwmsF0MNMw
1. Growth Progression (1 Day / 24h)
2. Scraper Acquisition Log (1 Day / 24h)
3. Regional Lead Distribution (%)
1. Industry Sector Ecosystem ("The Irish Business Economic Pie")
21,256 Master LeadsAnalogy: Like slicing a national economic pie into key industries. Shows exact lead concentration across Schooling, Hospitality, Healthcare, Retail, Trade, and Tech.
2. Regional Harvest Yield ("Where the Lead Gold is Found")
52 WorksheetsAnalogy: Like measuring gold yield per mining region. Ranks Leinster/Dublin, Munster, Connacht, Ulster (NI), and UK hubs by lead volume.
3. Direct Email Coverage Funnel ("The Gold Filter Funnel")
6,125 Verified EmailsAnalogy: Like sifting raw river sediment to find pure gold nuggets. Compares raw business listings against verified direct email addresses per sector.
4. Scraper Efficiency & Ping Latency ("Engine RPM & Fuel Efficiency")
620 Leads/hr PeakAnalogy: Like checking your car dashboard RPM vs fuel efficiency. Tracks crawler hourly throughput against API mirror response times (ms).
5. SIEM Cyber Intrusion Sentry & Security Shield ("The Cyber Shield Radar")
100% SECURE (Zero Intrusion)Analogy: Like a military radar shield tracking incoming airspace probes. Visualizes IPTables firewall rules, Fail2Ban IP bans, ModSecurity WAF, Webmin TLS, and Watchdog heartbeats.
| Tool Name | Category & License | Key Privacy / Security Function | Recommended Usage |
|---|---|---|---|
| BleachBit | Free / Open-Source | File Shredder, Disk Wiper, Cookie & Cache Scrubbing | Run monthly to securely wipe deleted files & temp data |
| Malwarebytes Free | Free On-Demand | Deep System Malware & Spyware Scanner | Run weekly on-demand scans alongside Windows Defender |
| O&O ShutUp10+ | Free Portable | Disables 50+ Windows Telemetry & Surveillance Switches | Run once to toggle off all Windows tracking telemetry |
| Cloudflare WARP (1.1.1.1) | Free Encrypted DNS | Encrypted DNS-over-HTTPS & Fast WireGuard Tunneling | Enable when using public/cafe Wi-Fi networks |
| Mullvad VPN | Strict No-Logs | WireGuard Encrypted Privacy Tunnel | Enable for anonymous web browsing & IP masking |
Mode A: VPN / WARP OFF (Direct Route)
- SSH Connection: Direct connection to
51.210.11.1:22via SSH Key. - Thunderbird Mail: Direct connection to
mail.sitecraft.ie(Ports 993 & 587). - Webmin Panel: Direct access to
https://51.210.11.1:10000. - Performance: Zero latency overhead; best for high-volume mail merges.
Mode B: VPN / WARP ON (Encrypted Tunnel Route)
- SSH Connection: 100% Operational over WireGuard tunnel.
- Thunderbird Mail: 100% Operational (SASL & TLS authentication verified).
- Webmin Panel: 100% Operational over HTTPS.
- Protection: Local PC IP address is masked; all outbound web traffic encrypted.
| Security Vector / Audit Domain | Detection Engine | Monitored Target | Log Status & Event Count |
|---|---|---|---|
| SSH Auth Login Probes | sovereign_log_siem_analyzer.py |
/var/log/auth.log |
10 Probes Flagged (0 Breach) |
| Web Application Firewall (WAF) | Nginx / ModSecurity |
Port 80 / 443 HTTP |
38 Malicious Scanners Blocked |
| SQLi & XSS Exploit Filter | Regex Pattern Engine |
HTTP Query Strings |
14 Exploit Payloads Dropped |
| Fail2Ban IP Jails | IPTables / Netfilter |
System Firewall |
Active (Zero Unauthorized Entry) |
| Watchdog Process Supervisor | sovereign_watchdog.py |
System Daemons |
ACTIVE (60s Polling Check) |
Garda National Cyber Crime Bureau (GNCCB) & NCSC Threat Advisory
The Garda National Cyber Crime Bureau (GNCCB) warns Irish SMEs regarding a 40% surge in AI-generated phishing emails and invoice redirection fraud (BEC). Attackers utilize generative AI to mirror authentic supplier language. Official Advice: Always verify invoice bank changes via secondary trusted phone calls before transferring funds.
National Cyber Security Centre (NCSC) Ireland alerts organizations regarding double-extortion ransomware operations and elevated targeting during Ireland's EU Council Presidency. Mandatory Controls: Enforce strict MFA on all remote portals, isolate offline backups, and never pay criminal ransoms.
INTERNAL SYSTEM WIKI & REPRODUCTION TREE DEPLOYED
Target Directory:G:\My Drive\TRYAGAIN-NEW\WIKI\ • Direct AI Agent prompt & full architectural topology mapped.
| WIKI MODULE FILE | SYSTEM DOMAIN | ARCHITECTURAL COVERAGE | DIRECT FILE LINK |
|---|---|---|---|
| 00_INDEX_TREE_OF_KNOWLEDGE.md | Master Index | C4 System Context Diagram, Mermaid Topology, Global Tech Stack Index | View Index |
| 01_HARDWARE_AND_INFRASTRUCTURE_TOPOLOGY.md | Hardware & VPS | Local PC Specs, VPS Host 51.210.11.1, Webmin 10000, Postfix/Dovecot, Nginx | View Specs |
| 02_SCRAPER_ENGINE_AND_MICRO_GRID_MATRIX.md | 500+/hr Scraper | 50-Worker Thread Pool, 20 Micro-Grids, Triple Overpass Mirror Failover | View Scrapers |
| 03_DATA_PIPELINE_AND_GOOGLE_SHEETS_ENTANGLEMENT.md | Google Sheets | Master Excel (44,748 leads), 11-Batch Apps Script Sync (52 Worksheets) | View Pipeline |
| 04_SIEM_SECURITY_AND_INTRUSION_DETECTION.md | SIEM Intrusion | auth.log scanner, ModSecurity WAF, Fail2Ban, GNCCB & NCSC Cyber Intelligence | View SIEM |
| 05_TELEMETRY_REPORT_GENERATOR_AND_PDF_SCHEDULER.md | PDF ReportLab | 2-Page PDF Generator, Matplotlib 48h charts, Direct MX SMTP dispatch | View PDF Engine |
| 06_CRON_DAEMON_AND_SUPERVISOR_WATCHDOG.md | Cron & Watchdog | JOB-01 to JOB-08 scheduler matrix, 60s Watchdog heartbeat & revival | View Daemon |
| 07_AGENTIC_REPRODUCTION_AND_RECOVERY_BLUEPRINT.md | AI Reproduction | 9-Step Reproduction Matrix, 20 Free CLI Utilities, Master AI Prompt | View Blueprint |
AGENTIC AI WORKER REPRODUCTION PROMPT (COPY & PASTE TO NEW AI AGENT)
10 Free-Forever CLI Automation Tools
| CLI SCRIPT | CORE AUTOMATION TASK | STATUS |
|---|---|---|
sovereign_lead_deduplicator.py |
Master Lead Deduplication & Scrubbing | ACTIVE |
sovereign_email_verifier.py |
Email Syntax & Domain Quality Audit | ACTIVE |
sovereign_watchdog.py |
24/7 Watchdog Supervisor & Auto-Revive Daemon | SUPERVISOR ONLINE |
sovereign_log_rotator.py |
Automatic Log Rotation & Compression | ACTIVE |
sovereign_backup_manager.py |
Timestamped ZIP Excel Backup Manager | ACTIVE |
sovereign_network_latency_checker.py |
DNS & WebApp Ping Latency Audit | ACTIVE |
sovereign_system_resource_monitor.py |
CPU, RAM & Disk Storage Monitor | ACTIVE |
sovereign_pdf_archiver.py |
PDF Telemetry Report Cataloger | ACTIVE |
sovereign_domain_dns_auditor.py |
Managed Web Domain DNS Verification | ACTIVE |
sovereign_data_exporter.py |
Master Dataset CSV Packager | ACTIVE |
sovereign_cli_suite_runner.py |
Master Orchestration Runner | RUNNER |
10 Custom Advanced System Debuggers
| DEBUGGER MODULE | DIAGNOSTIC TARGET | STATUS |
|---|---|---|
01_excel_schema_debugger.py |
38-Sheet Column & Schema Audit | PASSED |
02_email_syntax_debugger.py |
Syntax Anomaly & Typo Detection | PASSED |
03_google_webapp_debugger.py |
Apps Script WebApp Payload Ping | PASSED |
04_cron_process_debugger.py |
Daemon Process & Thread Monitor | PASSED |
05_chart_canvas_debugger.py |
Mobile Canvas Reuse Guard Check | PASSED |
06_dns_propagation_debugger.py |
Domain IPv4 Resolution Check | PASSED |
07_pdf_generation_debugger.py |
ReportLab PDF Flowables Audit | PASSED |
08_path_permissions_debugger.py |
File System Lock & Access State | PASSED |
09_memory_leak_debugger.py |
Python Object Allocation & GC | PASSED |
10_master_debugger_suite.py |
Unified Master Diagnostic Suite | RUNNER |
Postfix & OpenDKIM Anti-Spam Rate Limit Configuration Commands
sudo sed -i 's/relaxed\/simple/relaxed\/relaxed/g' /etc/opendkim.conf
# 2. Configure Postfix Outbound Rate Throttling & ISP Protection
sudo postconf -e 'smtp_destination_concurrency_limit=5'
sudo postconf -e 'default_destination_concurrency_limit=5'
sudo postconf -e 'smtp_destination_rate_delay=1s'
sudo postconf -e 'disable_vrfy_command=yes'
# 3. Restart Daemons & Verify
sudo systemctl restart opendkim postfix dovecot
sudo postconf -n | grep -E 'concurrency|delay|vrfy'
Sovereign Python Mail Merge Engine Script Location & Execution (VPS Deployed)
/opt/sitecraft_reporting/sovereign_mail_merge_engine.py
# 2. Command to Run Campaign on VPS:
python3 /opt/sitecraft_reporting/sovereign_mail_merge_engine.py
# 3. Dual Thunderbird Account Roundtrip Test Execution:
python3 run_both_accounts_roundtrip.py • [PASSED] [email protected] (100% OK) & [email protected] (100% OK)
| # | Exact Timestamp (UTC) | User | Remote IP Address (Protected) | Authentication Type & Result | Security Action |
|---|---|---|---|---|---|
| #12 | Jul 24 09:24:11 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #11 | Jul 24 09:21:52 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #10 | Jul 24 09:20:56 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #9 | Jul 24 09:18:10 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #8 | Jul 24 08:21:52 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #7 | Jul 24 08:18:22 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #6 | Jul 24 08:00:01 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #5 | Jul 23 21:18:27 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #4 | Jul 23 20:59:05 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #3 | Jul 23 20:51:41 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #2 | Jul 23 19:10:02 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
| #1 | Jul 23 19:07:00 | ubuntu | 51.199.***.*** | ACCEPTED (Publickey) | Whitelisted Admin IP |
Traffic Share per Website (%)
Weekly Traffic Volume by Day of the Week
Primary Account: [email protected]
Account 2: [email protected]
| Domain | Primary Mailbox | Linux User | Password (Masked) | IMAP SSL Port | SMTP Submission Port | SSL Certificate Status |
|---|---|---|---|---|---|---|
| eamonoleary.ie | [email protected] |
info |
|
993 (SSL/TLS) | 587 (STARTTLS) | TRUSTED (Let's Encrypt) |
| anto47.ie | [email protected] |
info |
|
993 (SSL/TLS) | 587 (STARTTLS) | TRUSTED (Let's Encrypt) |
| carparkmarkings.ie | [email protected] |
info |
|
993 (SSL/TLS) | 587 (STARTTLS) | TRUSTED (Let's Encrypt) |
Postfix Main Configuration (/etc/postfix/main.cf)
mydestination = $myhostname, mail.sitecraft.ie, sitecraft.ie, eamonoleary.ie, anto47.ie, libertiestours.ie, carparkmarkings.ie, localhost
virtual_alias_maps = hash:/etc/postfix/virtual
smtpd_sasl_auth_enable = yes
smtpd_sasl_type = dovecot
smtpd_sasl_path = private/auth
smtpd_tls_cert_file = /etc/letsencrypt/live/mail.sitecraft.ie/fullchain.pem
smtpd_tls_key_file = /etc/letsencrypt/live/mail.sitecraft.ie/privkey.pem
smtpd_milters = inet:localhost:8891
non_smtpd_milters = inet:localhost:8891
smtp_destination_concurrency_limit = 5
default_destination_concurrency_limit = 5
smtp_destination_rate_delay = 1s
disable_vrfy_command = yes
Dovecot 2.4 SSL Configuration (/etc/dovecot/conf.d/10-ssl.conf)
ssl_server_cert_file = /etc/letsencrypt/live/mail.sitecraft.ie/fullchain.pem
ssl_server_key_file = /etc/letsencrypt/live/mail.sitecraft.ie/privkey.pem
ssl_min_protocol = TLSv1.2
mail_driver = maildir
mail_path = %{home}/Maildir
default._domainkey.sitecraft.ie | Canonicalization: relaxed/relaxed | Key Path: /etc/dkimkeys/default.privatesudo journalctl -u postfix -n 30 --no-pager
sudo postfix flush
sudo systemctl status postfix dovecot opendkim
Master Architecture Overview & Operational Analogies
This Hourly Telemetry Report Engine & Autonomous Master Infrastructure represents a high-density, multi-threaded enterprise web scraping, database indexing, SIEM intrusion detection, and automated report generation ecosystem. Built entirely using open-source Python 3.11, ReportLab PDF, Chart.js, and APScheduler, the system operates continuously 24 hours a day, 7 days a week, 365 days a year without human intervention.
Think of sovereign_watchdog.py as a high-security military sentry stationed outside a command bunker. Every 60 seconds, the sentry checks if the main Cron Supervisor daemon is breathing. If the daemon trips, freezes, or experiences an OS crash, the sentry instantly executes a revive sequence, guaranteeing zero downtime.
Trying to push 44,748 leads across 52 worksheets in a single massive HTTP POST request to Google Apps Script is like attempting to drive a 100-ton cargo truck over a wooden bridge—it trips Google's strict 60-second execution wall. Our engine (google_apps_script_sync.py) splits the workload into 11 smaller, agile delivery trucks with automatic 3x retry buffers.
Our SIEM Security Analyzer (sovereign_log_siem_analyzer.py) acts like an airport X-ray scanner inspecting every incoming byte from /var/log/auth.log and Nginx web access logs. It automatically categorizes failed SSH probes, drops SQLi/XSS attack signatures, and compiles real-time threat ratings.
Step-by-Step Reproduction Guide for AI Agents & Engineers
| Phase | Subsystem Module | Target File Path / Script | Implementation Blueprint & Core Logic |
|---|---|---|---|
| STEP 1 | Environment & Dependencies | requirements.txt / pip |
Install reportlab, pandas, openpyxl, apscheduler, tqdm, beautifulsoup4, requests. Ensure Python 3.11 environment is active. |
| STEP 2 | Master Lead Consolidation | consolidate_all_leads_into_one_master_sheet.py |
Iterate over 52 regional worksheets (ROI 26 counties + UK major hubs), clean email string whitespaces, deduplicate master records, and write to primary worksheet All_Master_Leads. |
| STEP 3 | Regional Scraper Expansion | uk_ni_regional_expander.py |
Execute polite 20-worker thread pool scraping target regional micro-grids (NI 6 counties: Antrim, Armagh, Down, Fermanagh, Londonderry, Tyrone + London, Liverpool, Manchester). Respect crawler limits. |
| STEP 4 | SIEM Security Log Audit | sovereign_log_siem_analyzer.py |
Parse system authentication logs and web server logs. Count failed logins, scan for malicious IP probes, calculate risk metrics, and save output JSON to siem_security_audit.json. |
| STEP 5 | Executive PDF Report Generator | report_scheduler.py |
Generate 2-page PDF using ReportLab Flowables. Render 48h acquisition bar chart and growth line chart via ReportLab Graphics. Embed interactive PDF button toolbars linking to soc.html?type=...&tf=.... Email PDF to recipient via direct SMTP relay. |
| STEP 6 | Google Sheets Batch Sync Engine | google_apps_script_sync.py |
Read all 52 worksheets, chunk payload into 11 batches of 5 worksheets each, execute HTTP POST to Google WebApp endpoint with 3-attempt exponential backoff retry loop per batch. |
| STEP 7 | 24/7 Master Cron Manager | sovereign_cron_manager.py |
Initialize APScheduler BackgroundScheduler to orchestrate JOB-01 through JOB-08. Log execution states to cron_manager.log and state cache. |
| STEP 8 | 24/7 Watchdog Supervisor | sovereign_watchdog.py |
Run continuous 60-second polling loop querying Windows Win32_Process or Linux psutil. If sovereign_cron_manager.py drops, execute auto-restart. |
| STEP 9 | SOC Telemetry Dashboard | G:\My Drive\TRYAGAIN-NEW\soc.html |
Construct single-page HTML5 dashboard with Chart.js line/bar charts, timeframe selectors (1D-30D-AllTime), URL query parameter parsing (URLSearchParams), interactive credentials copy buttons, and SIEM security tables. |
Critical Code Blueprints & Script Invocations
py sovereign_watchdog.py
py report_scheduler.py
| Domain Name | Traffic Share (%) | VPS Document Root | HTTP Status | HTTPS SSL Status | SSL Renewal Engine |
|---|---|---|---|---|---|
| sitecraft.ie | 35.0% | /var/www/html/sitecraft.ie/ |
200 OK | 200 OK | Certbot Let's Encrypt (certbot.timer 2x Daily) |
| eamonoleary.ie | 25.0% | /var/www/html/eamonoleary.ie/ |
200 OK | 200 OK | Certbot Let's Encrypt (certbot.timer 2x Daily) |
| anto47.ie | 15.0% | /var/www/html/anto47.ie/ |
200 OK | 200 OK | Certbot Let's Encrypt (certbot.timer 2x Daily) |
| libertiestours.ie | 15.0% | /var/www/html/libertiestours.ie/ |
200 OK | 200 OK | Certbot Let's Encrypt (certbot.timer 2x Daily) |
| carparkmarkings.ie | 10.0% | /var/www/html/carparkmarkings.ie/ |
200 OK | 200 OK | Certbot Let's Encrypt (certbot.timer 2x Daily) |
| Page Target | Active 30-Day Target Keywords | Rotation Status | Next Scheduled Rotation |
|---|---|---|---|
index.php |
Dublin Web App Developers, Bespoke Software Engineering Ireland, High Performance Custom Websites, Headless E-Commerce | Active (Cycle #2) | 24 August 2026 |
websites.html |
Custom Website Design Dublin, Mobile First Web Development Ireland, Sub Second Load Speed Optimization, Responsive Bootstrap 5 | Active (Cycle #2) | 24 August 2026 |
seo.html |
Technical SEO Agency Dublin, Google Insights Optimization Ireland, Automated Core Web Vitals Audit, Schema.org JSON-LD | Active (Cycle #2) | 24 August 2026 |
news.html |
Cyber Security News, Garda Cyber Crime Bureau Alerts, NCSC Ireland Advisories, Quantum Mechanics Qubits | Active (Cycle #2) | 24 August 2026 |
custom-software.html |
Custom Software Development Dublin, Python API Engineering Ireland, Dedicated Database Architecture, Multi Threaded Scrapers | Active (Cycle #2) | 24 August 2026 |
android-development.html |
Android App Engineering Dublin, Mobile Application Development Ireland, Custom Kotlin Android Apps, Secure Mobile Telemetry | Active (Cycle #2) | 24 August 2026 |
security.html |
SIEM Security Audits Dublin, Hardened VPS Linux Server Security, Fail2Ban WAF Protection, Vulnerability Penetration Testing | Active (Cycle #2) | 24 August 2026 |
1. 10 Free-Forever Linux CLI Packages Installed
Execute on VPS terminal to install/verify core automation & security packages:
sudo apt-get update -y && sudo apt-get install -y \ python3 python3-pip curl jq certbot \ fail2ban rkhunter rsync nmap htop libxml2-utils
2. 30-Day Automated SEO Rotator Cron
Automated monthly crontab execution command (runs 1st of every month):
(crontab -l 2>/dev/null | grep -v 'sovereign_seo_keyword_rotator'; \ echo '0 0 1 * * /usr/bin/python3 /var/www/html/sitecraft.ie/sovereign_seo_keyword_rotator.py >> /var/www/html/sitecraft.ie/seo_rotator.log 2>&1') | crontab -
3. Emergency Fail2Ban Unban Command
If Thunderbird or SASL mail client is locked out, run this to unban all IPs instantly:
sudo fail2ban-client unban --all && \ sudo fail2ban-client status postfix-sasl
4. Hourly PDF Telemetry Dispatch
Launch background daemon to send hourly PDF reports to [email protected]:
python report_scheduler.py daemon && \ python sovereign_cron_manager.py daemon