Iota: Intelligent filtering and segmentation of unstructured datasets

The ever increasing data and the storage needs have marked the necessity for highly scalable on demand storage. Not only storage, but high speed read and writes of the data is also essentially important for performance. Cloud Computing, now a days, solves this problem and gives the most efficient solutions especially for storage and computing needs. Though different cloud service providers offer different services, but the challenges of cost effective storage of data and its fast retrieval still remains an objection. Several different solutions are available for meeting this problem, yet there is a provocation to make these solutions more effective. There are some algorithms for segmentation and filtering of databases, but when the question comes to large data sets (for example data storage and processing for billions of rows) the performance is however compromised. This paper discusses the main concerns that relate to the effective filtering, storage and segmentation of the data. Focus is placed on the software application (IOTA) which is being developed by us which is intended to addresses all the stated concerns and how different modules in the software work together to deliver seamless service.