In this demo, see how you can bring the right unstructured data to Snowflake and Databricks with Komprise Transparent File Tables.
_______________________
Komprise Transparent File Tables: Deliver the Right Unstructured Data Sets to the Data Lakehouse
Watch how Komprise lets you export a curated subset of your unstructured data, directly to Snowflake or Databricks, as queryable tables. This demo shows the full flow: starting with a Komprise Deep Analytics query to curate exactly the files you want (in this case, DICOM medical images and their attributes), exporting that result as a Parquet/Iceberg table to Snowflake, and then querying the file metadata directly inside Snowflake like any other table. No files move. Only the metadata is exported, so your data teams can search, filter, and analyze unstructured data using the tools they already work in every day.
Learn more about Komprise Transparent File Tables: komprise.com.com/tft
Transparent File Tables FAQs
What are Komprise Transparent File Tables (TFT)?
Komprise Transparent File Tables is a capability that exports unstructured file metadata as queryable tables in Apache Iceberg format, directly into data lakehouses like Snowflake and Databricks. Data teams can query file attributes such as type, size, classification, and custom tags using standard SQL, without moving the underlying files out of their existing storage location.
How are Komprise Transparent File Tables different from traditional data ingestion methods?
Traditional ETL and ELT pipelines copy raw files into a data lakehouse before they can be queried, which is slow, expensive, and difficult to scale at petabyte volumes. Komprise exports only the metadata, not the files themselves, as queryable Iceberg tables. Files stay in their original location while data teams query file attributes directly in Snowflake or Databricks using the same SQL tools they already use for structured data.
Can I export a subset of my data instead of everything?
Yes. Komprise Deep Analytics lets you curate exactly the data you want to export before creating a table. Rather than exporting the entire Global Metadatabase, you can run a query, for example to isolate DICOM medical images and their attributes, and export only that curated result set as a Parquet/Iceberg table.
Does exporting data to Snowflake or Databricks move my files?
No. Komprise Transparent File Tables exports only the metadata associated with your files, not the files themselves. The underlying data remains in its original storage location. This eliminates the cost, time, and risk of moving petabytes of unstructured data just to make it queryable in an analytics platform.
What format does Komprise use to export data to data lakehouses, and why?
Komprise exports curated metadata as Parquet files in Apache Iceberg format. Iceberg is an open, industry-standard table format supported natively by Snowflake, Databricks, and most modern data lakehouse platforms, which means exported tables behave exactly like any other table your data team already queries, with no proprietary connectors or custom integration work required.