| Solution | Avg. Latency (min) | 95 % CI | Pass SLA? | |----------|-------------------|--------|-----------| | SSIS (static batch) | 10.42 | ± 0.28 | ✗ | | | 8.73 | ± 0.15 | ✓ | | NiFi + Hive | 12.18 | ± 0.34 | ✗ | | ADF + Synapse | 11.61 | ± 0.31 | ✗ |
This manages the workflow of a package. It handles control flow elements like loops, containers, and task execution. SSIS-397-sub-javhd.today02-28-10 Min
| Step | Description | |------|-------------| | | Run the generator without any ETL (raw files only) to confirm data volume and arrival pattern. | | 9.2 SSIS Configuration | Deploy the pipeline with the adaptive batch algorithm disabled (static batch = 50 k). | | 9.3 SSIS‑Adaptive | Enable adaptive batch sizing; record CPU, memory, I/O, and latency per interval. | | 9.4 Alternative 1 – NiFi + Hive | Replicate the same dataflow using Apache NiFi (Kafka → Hive) on the same hardware. | | 9.5 Alternative 2 – Azure Data Factory + Synapse | Use Azure‑hosted services (ADF copy activity → Synapse dedicated SQL pool) with a comparable VM size. | | 9.6 Failure Injection | At minute 5, kill one SSIS host process; measure time to checkpoint recovery. | | 9.7 Reproducibility | Publish Docker containers for generator, PowerShell orchestrator, and a PowerShell script that rebuilds the SSIS project from source. | | Solution | Avg