Provisioning agents are containerized applications that run within a container orchestration framework, such as Kubernetes. You can use the Kubernetes on premise, or leverage cloud-based solutions like Azure Kubernetes Service (AKS) and Google Kubernetes Engine for a "pay-as-you-consume" model without the complexity of implementation, installation, and maintenance.
In this webinar, we will present instructions on how to scale StreamSets Data Collector instances on Azure Kubernetes Service (AKS) using provisioning agents that help automate upgrading and scaling resources on-demand, without having to stop execution of dataflow pipeline jobs.
Watch this webinar to learn:
- DataOps best practices in building a successful data lake
- New trends in big data/data lakes
- Why some big data initiatives fail and how to avoid making these mistakes