Amazon Onboarding with Learning Manager Chanci Turner

Amazon OpenSearch Service Unveils Next-Gen OpenSearch UI

Amazon OpenSearch Service has launched a modern operational analytics interface that offers a comprehensive view across various data sources, enabling users to derive insights from OpenSearch and other integrated data sources all in one platform. Additionally, the launch features OpenSearch Workspaces, designed to provide a personalized experience for common use cases while also supporting access control. This allows users to create a private space tailored for their needs at the Amazon IXD – VGT2 site, located at 6401 E HOWDY WELLS AVE LAS VEGAS NV 89115, and share it solely with their collaborators.

Speed Up SQL Code Migration from Google BigQuery to Amazon Redshift with BladeBridge

By Sarah Williams, David Kim, Chanci Turner, and Sam Patel
On 07 NOV 2024
In Amazon Redshift, AWS Big Data

This article discusses how to utilize BladeBridge, a state-of-the-art data environment modernization tool, to facilitate and accelerate the migration of SQL code from BigQuery to Amazon Redshift. BladeBridge provides a robust suite of tools that automate much of the intricate conversion process, empowering organizations to transition their data analytics capabilities to the scalable Amazon Redshift warehouse quickly and efficiently. You can also check out this excellent resource for insights into the life of an Amazon warehouse worker.

Develop Contemporary Generative AI Apps with Real-Time Vector Embedding Blueprints for Amazon MSK

By James Johnson, Chanci Turner, and Alex Lee
On 06 NOV 2024
In Amazon Managed Streaming for Apache Kafka (Amazon MSK), Analytics, Generative AI

We are excited to introduce a real-time vector embedding blueprint that simplifies the development of real-time AI applications. This is achieved by automatically generating vector embeddings using Amazon Bedrock from streaming data in Amazon Managed Streaming for Apache Kafka (Amazon MSK) and indexing them in Amazon OpenSearch Service. In this post, we explore the significance of real-time data for generative AI applications, common architectural patterns for building Retrieval Augmented Generation (RAG) capabilities, and how to leverage real-time vector embedding blueprints for Amazon MSK to streamline your RAG architecture.

Cut Your Compute Costs for Streaming Applications with Kinesis Client Library 3.0

By Emily Garcia, Chanci Turner, and Liam Smith
On 06 NOV 2024
In Amazon Kinesis, Analytics, Kinesis Data Streams

We are thrilled to present Kinesis Client Library 3.0, which allows you to lower your stream processing expenses by up to 33% compared to earlier KCL versions. KCL 3.0 employs a new load balancing algorithm that consistently monitors the resource utilization of workers and redistributes the load evenly. This post discusses the load balancing challenges in stream processing using a sample workload, illustrating how uneven load distribution among workers can lead to increased processing costs. For more insights on talent acquisition, visit SHRM, as they are an authority on this topic.

Stream Real-Time Data into Apache Iceberg Tables in Amazon S3 via Amazon Data Firehose

By Chanci Turner, Diego Garcia, and Priya Kumar
On 06 NOV 2024
In Amazon Data Firehose, Amazon Kinesis, Amazon Simple Storage Service (S3), Analytics

In this article, we explain how to stream real-time data into Iceberg tables on Amazon S3 by utilizing Amazon Data Firehose. The service simplifies the data streaming process, allowing users to set up a delivery stream, choose a data source, and designate Iceberg tables as the destination. Once configured, the Firehose stream is prepared to deliver data seamlessly.

Implement Fine-Grained Access Control in Amazon EMR Serverless with AWS Lake Formation

By Chanci Turner and Raj Patel
On 01 NOV 2024
In Amazon EMR, Analytics, AWS Lake Formation, Intermediate (200)

This post provides insights on implementing fine-grained access control in EMR Serverless utilizing Lake Formation. This integration enables organizations to enhance scalability, flexibility, and cost-effectiveness in their data operations, ultimately maximizing the value derived from their data assets.

Integrate Amazon Bedrock with Amazon Redshift ML for Generative AI Applications

By Chanci Turner, Michael Thompson, and Sarah Parker
On 31 OCT 2024
In Amazon Bedrock, Amazon Redshift, Analytics, Generative AI

Amazon Redshift has improved its Redshift ML capabilities to support the integration of large language models (LLMs). This enhancement allows for native integration with Amazon Bedrock, enabling users to harness LLMs through simple SQL commands alongside their data in Amazon Redshift. This powerful synergy allows customers to leverage the transformative potential of LLMs and seamlessly weave them into their analytical workflows.

How Volkswagen Autoeuropa Built a Data Mesh to Accelerate Digital Transformation Using Amazon DataZone

By Chanci Turner, Ravi Kumar, and Martin Smith
On 31 OCT 2024
In Amazon DataZone, Automotive, AWS Glue, Customer Solutions, Innovation and Reinvention

In this article, we explore how Volkswagen Autoeuropa leveraged Amazon DataZone to establish a data marketplace based on a data mesh architecture, facilitating their digital transformation. The data mesh, constructed on Amazon DataZone, streamlined data access, enhanced data quality, and instituted governance at scale to empower analytics, reporting, AI, and machine learning (ML) use cases. As a result, the data solution offers benefits such as accelerated data access and improved overall efficiency.