Expanding Deep Analytics Use Cases for Unstructured Data Management
Cloud-based analytics and AI and ML applications are opening the doors to leverage unstructured data in new ways while also demanding changes to unstructured data management platforms. Data lifecycle management is imperative today, given the volume and complexity of data assets in storage — but this process of finding, moving, copying and replicating data to maximize value over time can be overwhelming for traditional IT infrastructure and enterprise data storage teams. The analytics-first approach of Komprise Intelligent Management gives customers the means to understand their data and ultimately uncover new insights from massive volumes of file and object data.
Since our launch of Deep Analytics Actions in October 2021, we’ve added a number of important new features, updates and enhancements to the Komprise Intelligent Data Management platform. As always, our customers and partners are encouraged to review the documentation site for details. In this post, I’ll summarize the salient updates.
Deep Analytics Actions – Adding Copy and Confine Functions
Komprise Deep Analytics Actions gives users the ability to create powerful queries for granular data sets; those queries can then serve as criteria for a Komprise data management plan. Komprise delivers a unified, Google-like search across on-premises and cloud data storage silos, which we call the Global File Index. This allows users to feed custom data sets into automated plans for ongoing tiering or copy into machine learning pipelines. Komprise delivers data tagging through the UI with automated tagging capability through the API, such as from AI/ML applications.
Komprise now supports these additional actions for Deep Analytics Actions:
- Copy: Now users can copy specific data sets to NAS, cloud NAS, and object storage targets. Make a copy of data for collaboration with other business units or external partners while ensuring the source data is not modified. Feed analytics and AI/ML pipelines with specific data sets.Migrate specific data sets to new storage such as cloud NAS. Enable caching by copying data to other locations for lower latency access by applications or users such as for Content Distribution Network or similar use cases. Watch a demo.
- Confine: Find and move specific data sets for deletion. Configure data management policies to expire data sets according to compliance/ regulatory requirements. Locate ex-employee or other obsolete data for deletion.
Data consumers and/or line of business teams can create queries to find data sets. These new features are now options in your policy-driven Komprise data management plan. The actions are systematically and automatically applied at the interval specified. You can keep remote copies of your data synched with the original copies and confine data as it ages and meets the criteria.
Staying Current with AWS Innovation
To meet customers’ changing use cases and requirements, independent data management platforms must support new AWS features. As an AWS Migration and Modernization Competency partner, Komprise gives customers the flexibility and power to use the best of the cloud. Unlike storage-based “cloud gateways” or other proprietary data management technologies that limit storage classes and cloud features, Komprise ensures that customers can rapidly adopt new AWS features and reduce costs.
Komprise now supports two additional S3 storage classes:
- Amazon S3 Glacier Deep Archive – Amazon S3’s lowest-cost storage class is ideal for long-term retention of data that is accessed infrequently enough that users can tolerate access times of up to 12 hours. The common use case is when customers must comply with regulations to retain data for many years, such as in government or healthcare. Komprise customers can choose to move or copy data directly to Amazon S3 Deep Archive or have Komprise move it over time through data lifecycle management policies.
- Amazon S3 Glacier Instant Retrieval – This new Glacier service is 80% less expensive than S3 Standard-IA with the same fast access and throughput. The one caveat is you are charged higher fees than S3 for data retrieval. This is ideal for data that is accessed no more than once a quarter but requires fast access for applications and users—for example medical images from non-active cases or research from completed projects. Komprise makes it simple for customers to find data sets that haven’t been accessed for six months or more and tier that data to Amazon S3 Glacier Instant Retrieval to slash storage costs, while not affecting user experience because of our Transparent Move Technology™ (TMT).
Support for AWS GovCloud
U.S. Government customers and their partners that must adhere to compliance mandates and strict security standards can now leverage Komprise to move data to AWS GovCloud storage. AWS GovCloud provides specialized AWS Regions designed to meet the isolation and security needs of federal customers and partners. Read more about Komprise AWS GovCloud here.
Speed Up Migrations with Migration Iteration Error Log
Many customers delay data migrations because of the hassle of untangling complex permissions and other issues. While Komprise can’t promise to eliminate these issues altogether, we can make it easier to find and address the problem with the new Migration Iteration Error Log. By unifying error messages for all migration failures for each iteration into a central log, Komprise helps you find and correct problems between migration iterations. This means your team can discover and resolve issues faster and thereby complete data migrations in fewer iterations.