In today’s rapidly evolving regulatory landscape, financial institutions face increasing pressure to modernize their data infrastructure. A leading financial institution in Brazil partnered with Artefact to transform its legacy data platform, achieving significant improvements in efficiency and governance.

The challenge: Unlocking real-time insights from brewery operations.

The client sought to leverage IoT sensor data to gain real-time visibility into its brewery processes. Key challenges included:

  • Data extraction: The need to extract near real-time information from a vast network of IoT sensors.
  • Data-driven decisions: The need to support data-driven decision-making to reduce waste and operational losses.
  • Optimization: The need to optimize energy usage and cooling processes.

The solution: A scalable and cost-effective AWS-base data pipeline.

Artefact designed and implemented a robust data pipeline on AWS to capture, process, and visualize IoT sensor data in near real-time. The solution included:

  • Layered architecture: A layered architecture following the medallion pattern for data organization and quality.
  • Redundant data storage: Redundant data storage in Amazon S3 (Parquet format) and Amazon Aurora, AWS’s managed relational database.
  • Efficient data processing: AWS Lambda functions orchestrated through Amazon SQS queues for efficient data ingestion and transformation.
  • Real-time monitoring: Grafana dashboards for near real-time monitoring and visualization of key performance indicators.

The results: Real-time visibility and optimized operations.

The solution delivered transformative results, enabling the client to optimize its brewery operations and reduce waste:

  • Reduced update interval: The time from data ingestion to visualization in Grafana was reduced from approximately 30 minutes to just 6 minutes.
  • Cost-effective and scalable architecture: The AWS-based stack proved to be cost-effective, easy to maintain, and highly scalable to accommodate future growth.
  • Data-driven optimization: Operators gained real-time visibility into refrigeration unit performance, enabling them to optimize energy usage and reduce waste.

By embracing IoT and AWS, the global beverage company achieved a new level of operational efficiency, driving significant cost savings and improving sustainability.