Smart Data Workflows
Automate unstructured data discovery and turn data volumes into value.
” The ability to automate workflows so we can further define this data at a more granular level and then feed it into analytics tools to help meet our scientists’ needs is a game changer. “
– Senior Director of IT
Unstructured Data Workflows in Action
Komprise Smart Data Workflows allow you to define and execute automated processes, which are often industry and domain specific, to visualize, mobilize and get greater value from unstructured data. With the Smart Data Workflow Manager you can search across on-premises, edge and cloud data storage silos to find the data you need, execute Komprise or external functions on a subset of data and tag the data with additional metadata. Move only the data you need, built custom AI data workflows, and manage the lifecycle of unstructured data intelligently. Watch the chalk talk > >
How IT Teams are Using Komprise
Showback
- Authorized departmental users can monitor and understand their data usage (how many and what type of files, where stored, biggest consumers, etc.)
- Create queries to get real-time visibility and manage costs, rather than ask IT to create static reports.
- Example: A new research initiative at a life-sciences organization requires 100TB of data storage and the project lead needs to work with IT to move older file shares to cloud storage and free up space.
Read the Post: How Storage Teams Use Komprise Deep Analytics > >
User-Driven Tagging
- Users can enrich data with additional metadata tags to facilitate easier search and data management actions such as archival storage or compliance and legal hold.
- Example: HR director needs to ensure that all files with employee PII data are tagged so that information is properly and securely stored for privacy requirements and searchable for deletion when the employee leaves.
Using Amazon Macie with Komprise for Detecting Sensitive Content in On-Premises Data > >
User-Driven Data Mobility
- Authorized users can identify data sets with certain characteristics (such as project or age) to move to cloud storage or other secondary storage for more cost-effective data management or research initiatives.
- Example: All files related to a project need to be copied to the cloud for data analytics. The entire workflow between users and IT is automated via Komprise.
Why Komprise? The fast, easy, no lock-in path to the cloud. > >
Industry Use Cases
Genomics Sequencing Use Case
- Search & Curate: Define and execute a custom query to find all data for Project X with Komprise Deep Analytics and the Komprise Global File Index.
- Execute & Enrich: Execute an external function on Project X data to look for a specific DNA sequence for a mutation and tag such data as “Mutation XYZ”.
- Cull & Extract: Move only Project X data tagged with “Mutation XYZ” to the cloud using Komprise Deep Analytics Actions for central processing.
- Manage Lifecycle: Move the data to a lower storage tier for cost savings once the analysis is complete.
Legal Divestiture Use Case
- Search & Curate: Define and execute a custom query to find all data related to a divestiture project with Komprise Deep Analytics and the Komprise Global File Index.
- Execute & Enrich: Execute an external function to identify PII data and tag it.
- Cull & Extract: Move sensitive data to an object-locked cloud storage bucket and move the rest to a writable cloud bucket using Komprise Deep Analytics Actions.
- Manage Lifecycle: Move the data to a lower storage tier for cost savings once the analysis is complete.
Autonomous Vehicles Use Case
- Search & Curate: Find crash test data related to abrupt stopping of a specific vehicle model with Komprise Deep Analytics and the Komprise Global File Index.
- Execute & Enrich: Execute an external function to identify and tag data with “Reason = Abrupt Stop”.
- Cull & Extract: Move only the related data to the cloud data lakehouse to reduce time and cost associated with moving & analyzing unrelated data using Komprise Deep Analytics Actions.
- Manage Lifecycle: Move the unrelated data to a lower storage tier for cost savings (or delete it) once the analysis is complete.
Webinar: Building a Modern Data Strategy for the Automotive Industry > >
Visibility
Search and index data across file, object and cloud data storage to build a comprehensive Global File Index.
Mobility
Systematically and continuously move data from multiple unstructured data storage silos to the right target location.
Value
Efficiently find, enrich, move the data you need for analytics projects and orchestrate the information lifecycle in the cloud.
The Unstructured Data Blindspot
Industry analysts predict that at least 80% of the world’s data will be unstructured by 2025. This data is critical for AI and ML-driven applications and insights, yet much of it is locked away in disparate data storage silos. This creates an unstructured data blind spot, resulting in billions of dollars in overspending on data storage and missed big data and AI opportunities.
