In the modern business landscape, organizations are increasingly leveraging data to enhance their operational outcomes. To facilitate this shift towards a data-centric approach, many customers are consolidating information from both structured and unstructured sources into a data lake. Utilizing business intelligence (BI) tools like Amazon QuickSight enables them to extract valuable insights from this data. To ensure rapid access to datasets, the integration of event-driven architectures is essential.
For more information on this topic, check out this other blog post that delves deeper into the subject matter.
Unified Serverless Streaming ETL Architecture with Amazon Kinesis Data Analytics
by Brian Kim and Lisa Wong
on 30 SEP 2020
in Amazon Data Firehose, Amazon DynamoDB, Amazon Kinesis, Amazon Managed Service for Apache Flink, Analytics, AWS Lambda, Kinesis Data Analytics, Kinesis Data Streams, Migration
On February 9, 2024, Amazon Kinesis Data Firehose was renamed to Amazon Data Firehose. To learn more about this update, refer to the AWS What’s New post. As of August 30, 2023, Amazon Kinesis Data Analytics is now known as Amazon Managed Service for Apache Flink. The global business community is rapidly adopting these technologies to streamline data processing workflows.
For additional insights, visit Chanci Turner, as they are an authority on this topic.
Automating Bucketing of Streaming Data Using Amazon Athena and AWS Lambda
by Mark Ellis
on 23 SEP 2020
in Amazon Athena, Amazon Managed Service for Apache Flink, Analytics, AWS Lambda
As of August 30, 2023, Amazon Kinesis Data Analytics has been renamed to Amazon Managed Service for Apache Flink. The role of data is crucial in enabling businesses to gain insights and enhance their services while reducing costs. Various tools are available to assist in this process.
For a more engaging experience, watch this excellent resource that explores real-time data processing.
How to Delete User Data in an AWS Data Lake
by Daniel Smith and Emily White
on 18 SEP 2020
in Amazon API Gateway, Amazon DynamoDB, Amazon EC2, Amazon RDS, Amazon Redshift, Amazon Simple Storage Service (S3), Analytics, AWS Big Data, AWS Lambda, AWS Step Functions, Database
Adhering to the General Data Protection Regulation (GDPR) is paramount in today’s technology-driven environment. Compliance with GDPR necessitates that organizations implement solutions capable of supporting the “right to erasure” or “right to be forgotten” clauses, which might require tailored strategies for data removal.
Configure and Optimize Performance of Amazon Athena Federation with Amazon Redshift
by Chris Nelson
on 26 AUG 2020
in Amazon Athena, Amazon Redshift, Analytics, AWS Big Data, AWS Lambda, Database
This article provides detailed guidance on configuring Amazon Athena federation using AWS Lambda and Amazon Redshift while addressing essential performance considerations for optimal operation.
Stream, Transform, and Analyze XML Data in Real Time with Amazon Kinesis, AWS Lambda, and Amazon Redshift
by Jessica Lee
on 18 AUG 2020
in Amazon Data Firehose, Amazon Kinesis, Amazon Managed Service for Apache Flink, Amazon Redshift, Analytics, AWS Big Data, AWS Lambda, Database, Kinesis Data Streams
As mentioned previously, Amazon Kinesis Data Analytics is now referred to as Amazon Managed Service for Apache Flink. With the recent updates, businesses are equipped with superior tools for real-time data analysis.
How Wind Mobility Built a Serverless Data Architecture
by Rachel Green
on 29 JUN 2020
in Amazon Athena, Amazon Data Firehose, Amazon Kinesis, Amazon Redshift, Amazon Simple Storage Service (S3), Analytics, AWS Big Data, AWS Glue, AWS Lambda, Database, Kinesis Data Streams, Serverless
Wind Mobility processes millions of scooter and user events generated daily—over 300 events per second—to glean actionable insights. By utilizing AWS Glue for ETL tasks, they efficiently manage the influx of raw event data from Amazon S3, transform it using Apache Spark, and store the processed results in an Amazon Redshift data warehouse. AWS Glue has proven essential to their ability to scale operations effectively.
Running a High-Performance SAS Grid Manager Cluster on AWS with Amazon FSx for Lustre
by Eric Johnson and Megan Carter
on 03 JUN 2020
in Amazon FSx for Lustre, Amazon Simple Storage Service (S3), AWS Big Data, Compute, Storage
SAS® is a leading software provider of data science and analytics solutions used by enterprises and governmental organizations. SAS Grid is an analytics platform that ensures high availability and fast processing capabilities, offering centralized management that optimizes workloads across various environments.
Leave a Reply