Pipeline Execution Logs & Audit Trail
| Run ID | Date & Time | Pipeline Stage | Status | Records Processed | Duration | Summary Log | Actions | |
|---|---|---|---|---|---|---|---|---|
| Loading execution logs... | ||||||||
SharePoint MFA Session & Extraction
First Login & MFA Session
Authenticates and stores persistent session credentials.
SharePoint Daily Download
Downloads latest Roster and Commitment Excel files.
SharePoint URLs Config
Live MFA Authenticator Screen & 2-Digit Code Preview
When running First Login Session, if Microsoft asks for a 2-digit MFA number on your phone, check the live screen below:
HubSpot MFA Session & Extraction
First Login & MFA Session
Authenticates and stores persistent HubSpot session credentials.
HubSpot Daily Download
Downloads latest HubSpot Form export files.
HubSpot URLs Config
Live HubSpot Authenticator Screen & Code Preview
When running First Login Session (HubSpot), if 2FA/MFA verification code appears, check the live screen below:
Enter 6-Digit Verification Code
If HubSpot, Google, or Microsoft requests a 6-digit email or SMS verification code, enter it below and click Submit:
Master Excel Template Manager
Upload or manage the Master Excel Template (`2026 Copy of Overall Attendance.xlsx`). Uploading automatically saves the template directly into the MinIO `Template/` folder for automated pipeline execution.
2026 Copy of Overall Attendance.xlsx
Checking MinIO Template status...
Consolidation Engine
Consolidates SharePoint rosters, commitment submissions, and Zoom API telemetry into the master report.
Delivered Output Files (Dropbox & MinIO)
ETL Execution Run Audit Log
| Timestamp (EST) | Roster Synced | Commitment Synced | Commitment Matched (Roster) | Commitment Unmatched (Mkup) | Zoom Records Created | Zoom Matched (LL1) | Zoom Matched (LL2) | In-Person Synced | In-Person Matched (LL1) | In-Person Matched (LL2) | Form 1 Unmatched (Mkup) | Form 2 Unmatched (Mkup) | Total Pipeline Records | F: New Attendee | F: No Company | F: New Company | F: Roster (No Com) | F: Com (No Roster) | F: Late Com | F: IP (No Forms) | F: No Match IP/Zoom | F: Date Not Found | F: Zoom Matched LL1 | F: Zoom Matched LL2 | F: Zoom Matched Both | F: IP Matched LL1 | F: IP Matched LL2 | F: IP Matched Both | F: Zoom Name Review | F: HS Name Default | Created At | Delivery Status |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Loading ETL audit run summaries... | ||||||||||||||||||||||||||||||||
Schedule Configuration
Manual Override
Click the button below to bypass the scheduler and trigger an immediate run of the ETL pipeline in the background.