Science 2.0: 'Data Smashing' With An Algorithm Could Unshackle Automated Discovery
Saturday, October 11, 2014 - 08:01
in Mathematics & Economics
A little known secret in data mining is that simply feeding raw data into a data analysis algorithm is unlikely to produce meaningful results. From recognizing speech to identifying unusual stars, new discoveries often begin with comparison of data streams to find connections and spot outliers. But most data comparison algorithms today have one major weakness – somewhere, they rely on a human expert to specify what aspects of the data are relevant for comparison, and what aspects aren't. But experts aren't keeping pace with the growing amounts and complexities of big data. read more