Smart Data Workflows
Automate unstructured data discovery,
detect and take action on sensitive data and turn data volumes into value for AI.
“With the new PII capabilities, storage admins get an extremely powerful feature on top of an already impressive tool. “
– Komprise partner – Read the Press Release
Unstructured Data Workflows in Action
Komprise Smart Data Workflows allow you to define and execute automated processes to visualize, mobilize and get greater value from unstructured data. The Smart Data Workflow Manager offers a simple point-and-click UI wizard to set up an automated data workflow: search across on-premises, edge and cloud data storage silos to find the data you need, execute Komprise or external AI functions on a subset of data and tag the data with additional metadata. Move only the data you need, build custom AI data workflows, and manage the lifecycle of unstructured data intelligently. Watch the chalk talk > >
How IT Teams are Using Komprise
Showback
- Authorized departmental users can monitor and understand their data usage (how many and what type of files, where stored, biggest consumers, etc.)
- Create queries to get real-time visibility and manage costs, rather than ask IT to create static reports.
- Example: A new research initiative at a life-sciences organization requires 100TB of data storage and the project lead needs to work with IT to move older file shares to cloud storage and free up space.
Read the Post: How Storage Teams Use Komprise Deep Analytics > >
User-Driven Tagging
- Users can enrich data with additional metadata tags to facilitate easier search and data management actions such as archival storage or compliance and legal hold.
- Example: HR director needs to ensure that all files with employee PII data are tagged so that information is properly and securely stored for privacy requirements and searchable for deletion when the employee leaves.
Using Amazon Macie with Komprise for Detecting Sensitive Content in On-Premises Data > >
User-Driven Data Mobility
- Authorized users can identify data sets with certain characteristics (such as project or age) to move to cloud storage or other secondary storage for more cost-effective data management or research initiatives.
- Example: All files related to a project need to be copied to the cloud for data analytics. The entire workflow between users and IT is automated via Komprise.
Why Komprise? The fast, easy, no lock-in path to the cloud. > >
Industry Use Cases
Genomics Sequencing Use Case
- Search & Curate: Define and execute a custom query to find all data for Project X with Komprise Deep Analytics and the Komprise Global File Index.
- Execute & Enrich: Execute an external function on Project X data to look for a specific DNA sequence for a mutation and tag such data as “Mutation XYZ”.
- Cull & Extract: Move only Project X data tagged with “Mutation XYZ” to the cloud using Komprise Deep Analytics Actions for central processing.
- Manage Lifecycle: Move the data to a lower storage tier for cost savings once the analysis is complete.
Legal Divestiture Use Case
- Search & Curate: Define and execute a custom query to find all data related to a divestiture project with Komprise Deep Analytics and the Komprise Global File Index.
- Execute & Enrich: Execute an external function to identify PII data and tag it.
- Cull & Extract: Move sensitive data to an object-locked cloud storage bucket and move the rest to a writable cloud bucket using Komprise Deep Analytics Actions.
- Manage Lifecycle: Move the data to a lower storage tier for cost savings once the analysis is complete.
Autonomous Vehicles Use Case
- Search & Curate: Find crash test data related to abrupt stopping of a specific vehicle model with Komprise Deep Analytics and the Komprise Global File Index.
- Execute & Enrich: Execute an external function to identify and tag data with “Reason = Abrupt Stop”.
- Cull & Extract: Move only the related data to the cloud data lakehouse to reduce time and cost associated with moving & analyzing unrelated data using Komprise Deep Analytics Actions.
- Manage Lifecycle: Move the unrelated data to a lower storage tier for cost savings (or delete it) once the analysis is complete.
Webinar: Building a Modern Data Strategy for the Automotive Industry > >
Visibility
Search and index data across file, object and cloud data storage to build a comprehensive Global File Index.
Mobility
Systematically and continuously move data from multiple unstructured data storage silos to the right target location.
Value
Efficiently find, enrich, move the data you need for AI projects and orchestrate the information lifecycle in the cloud.
Sensitive Data Management for AI Governance and Cybersecurity
AI data governance is a growing, complex requirement. Data storage teams need to know how to find and protect the most sensitive data—such as personally identifiable information (PII), IP, internal research data and more. Doing this is across massive volumes of unstructured data, which lives in silos across hybrid storage, is extremely difficult. And most of the tools that enterprise IT teams use don’t have effective, scalable capabilities for sensitive data detection or data mobility.
Learn more about Sensitive Data Management from Komprise > >