Airbyte Expands Platform With Iceberg Support, Enterprise Connectors, and More
Organizations face the challenge of leveraging AI while maintaining control over sensitive information, such as strategic metrics or customer data.
Understandably, this challenge often leads to hesitation about sharing internal company data with external AI tools. However, as the adoption of AI technologies continues to accelerate, the need for secure and efficient data movement across platforms has become a critical requirement for businesses.
Open data movement platform Airbyte aims to address these concerns by equipping enterprises with the tools needed to move data at scale while ensuring data governance and sovereignty. The update focuses on maintaining sovereignty over sensitive data, while also enabling secure inter-platform data transfer.
The San Francisco-based company has released a host of new capabilities for moving data at scale for AI and analytics workloads. Announced during the company’s annual move (data) 2025 conference, these enhancements target key challenges around data governance, security, and operational efficiency.
By providing the ability to transfer company data without relying on third-party applications, such as SaaS tools, Airbyte’s approach allows organizations to retain greater control over their data.
One of the new features introduces connectors to help enterprises utilize their data without compromising on data sovereignty and governance. The Enterprise Connector Bundle includes data connector pipelines for applications such as SAP, Oracle, Workday, ServiceNow, and NetSuite. These connectors make it easier for organizations to access critical data without sacrificing security or compliance.
Airbyte’s update also includes support for transferring unstructured data from platforms such as Google Drive, SharePoint, and OneDrive. This addition ensures that businesses can move a wide range of files, including their metadata and permissions while making this data accessible for AI-related tasks.
Another significant enhancement is support for the Iceberg standard, which facilitates the transfer of data into modern lake house architectures. These architectures serve as a foundation for AI workloads utilizing large language models (LLMs) and for performing large-scale modern analytics. With its wide compatibility across various platforms, the inclusion of Iceberg support stands out as a key upgrade to the platform.
Airbyte has also introduced new features to help organizations stay compliant with data privacy regulations such as HIPAA and GDPR. The new Mappers tool allows users to make lightweight data transformations directly within the Airbyte interface. These changes include encryption or hashing sensitive data, renaming fields, and filtering specific rows.
In addition, Airbyte now supports AWS PrivateLink, enabling private cloud-to-cloud data transfers without exposing information to public internet traffic. This feature is intended to reduce security risks. However, the actual impact may vary depending on how enterprises manage their broader data infrastructure.
OAuth 2.0 support has been introduced to enhance integration processes by providing secure authentication. While this may help in reducing manual work, Airbyte did not share how this approach will work with existing enterprise systems. There could be challenges in the form of legacy system compatibility, conflicts with custom authentication systems, and scalability issues for enterprises that handle huge volumes of data and high user traffic.
Other notable updates are related to simplifying operations, including new resource management tools to help sync and prioritize data for critical data pipelines. This is particularly relevant for organizations handling large-scale or time-sensitive data workflows.
Airbyte has also added support for OpenTelemetry (OTEL) with the aim of improving observability through key metrics that monitor data movement, such as pipeline performance, API activity, and data volume. The updated Python Connector Developer Kit (CDK) aims to speed up the creation of new connectors, potentially reducing development time for organizations with unique data needs.
Many organizations now use a mix of on-premises, private cloud, and public cloud environments. Features like AWS PrivateLink and support for OpenTelemetry could be pivotal in ensuring secure and efficient data movement across these diverse setups.
Founded in 2020, Airbyte has evolved from a solution focused on simplifying and standardizing data integration into a platform that offers both open-source tools and a fully managed cloud service. The company reports serving over 7,000 enterprises, with contributions from more than 900 developers and a community of over 230,000 members. According to Airbyte, it has become the industry’s largest open data movement platform.
(La1n/Shutterstock)
“We make it possible for organizations to protect their data, ensuring that it doesn’t accidentally become accessible outside the organization by consumers of AI models,” said Michel Tricot, co-founder and CEO, Airbyte. “What we’re delivering today helps eliminate data silos – and improves data accessibility while still ensuring security and compliance to maintain data sovereignty without adding operational overhead.”
In a market where safeguarding enterprise data is as vital as extracting value from it, Airbyte’s latest updates are designed to equip organizations with solutions for enhanced data control, all while maintaining high levels of performance and operational flexibility. It helps position the platform as a valuable tool for data movement.
The post Airbyte Expands Platform With Iceberg Support, Enterprise Connectors, and More appeared first on BigDATAwire.
