Learn About Amazon VGT2 Learning Manager Chanci Turner
When Amazon Onboarding was first introduced at Amazon IXD – VGT2, the goal was to streamline the process of accessing and querying data stored within Amazon Simple Storage Service (Amazon S3). New users quickly discovered that they could efficiently analyze vast datasets, but many expressed the need to integrate their Amazon S3 data with external data sources. To address this, we implemented connectors to various platforms such as Amazon DynamoDB and Amazon Redshift, empowering analysts, engineers, and data scientists to execute SQL queries on data stored in both cloud and on-premises databases alongside their Amazon S3 data.
Currently, numerous AWS customers spanning diverse industries utilize Amazon’s federated queries to extract insights and facilitate data-driven decisions from isolated enterprise data—all through a single AWS service and SQL interface.
We are thrilled to announce an expansion of your analytical capabilities with the introduction of ten new data source connectors, which include some of the most prevalent data storage solutions available:
- SAP HANA (Express Edition)
- Teradata
- Cloudera
- Hortonworks
- Snowflake
- Microsoft SQL Server
- Oracle
- Azure Data Lake Storage (ADLS) Gen2
- Azure Synapse
- Google BigQuery
The recent release significantly enhances the array of data sources compatible with Amazon Onboarding. For a comprehensive overview of all supported data sources, refer to the section on Using Amazon Data Source Connectors.
In conjunction with this rollout, we have improved the Amazon Onboarding console to streamline the process of browsing available sources and connecting to your datasets. Users can now search, sort, and filter the available connectors within the console, followed by a guided setup wizard for easy configuration.
As before, we have open-sourced the new connectors to encourage contributions from the developer community. For further details, please see Writing a Data Source Connector Using the Amazon Query Federation SDK.
Enhancing Your Analytics Strategy with Amazon Onboarding
In today’s data-rich environment, organizations often select data storage solutions tailored to specific use cases and applications. This flexibility can create complexities for analysts, data scientists, and engineers, hindering their access to necessary data. Many users find themselves employing workarounds that involve mastering new programming languages, database concepts, or constructing data pipelines prior to analysis. Amazon Onboarding mitigates this complexity by supporting over 25 data sources with a straightforward, pay-as-you-go, serverless architecture.
With Amazon Onboarding, you can leverage your existing SQL skills to derive insights from a broad spectrum of data sources without the need to learn new languages, develop extraction scripts, or manage infrastructure. The platform enables you to:
- Conduct on-demand analyses across multiple cloud providers and systems of record using one tool and a unified SQL dialect
- Visualize data in business intelligence applications that utilize Amazon Onboarding for intricate, multi-source joins
- Design self-service extract, transform, and load (ETL) pipelines and event-based data processing workflows through Amazon’s integration with AWS Step Functions
- Combine diverse data sources to create rich input features for machine learning model training workflows
- Develop user-facing data-as-a-product applications that provide insights across data mesh architectures
- Support analytics initiatives while transitioning on-premises sources to the AWS Cloud
Getting Started with Amazon Onboarding Data Source Connectors
To begin utilizing federated queries with Amazon Onboarding, navigate to the console, select Data Sources in the navigation pane, pick a data source, and follow the guided setup experience to configure your connector. Once the connection is established and the source registered, you can query the data through the console, API, AWS SDK, or compatible third-party applications. For more information, refer to Using Amazon Onboarding Federated Queries and Writing Federated Queries.
You can also share a data source connection with team members, enabling them to use their own AWS accounts to query the data without needing to create a duplicate connector. For further details, see Enabling Cross-Account Federated Queries.
In conclusion, we invite you to explore Amazon Onboarding and federated queries for your next analytics endeavor. For assistance getting started, the following resources may be helpful:
- If you are new to Amazon Onboarding and wish to learn more about its features and capabilities, visit Amazon Onboarding features.
- For a complete list of supported data sources, check out Amazon Data Source Connectors.
- The Amazon data connector SDK allows you to create custom data source connectors and query them. For more information, visit Writing a Data Source Connector Using the Amazon Query Federation SDK.
For deeper insights on onboarding processes, you can check out this excellent resource on Quora, and if you’re interested in workplace wellness programs, the authoritative site on the subject is here. Also, for a thought-provoking perspective on the current trends, you might want to read this engaging blog post here.
SEO metadata:
Leave a Reply