Mining an information explosion

Updated: 2012-02-19 08:36 By Steve Lohr (The New York Times) Big Data is shorthand for advancing trends in technology that open the door to a new approach to understanding the world and making decisions. Data analysts help businesses make sense of an explosion of data - Web traffic and social network comments, as well as software and sensors that monitor shipments, suppliers and customers - to guide decisions, trim costs and lift sales. But the march of quantification, made possible by enormous new sources of data, will sweep through academia, business and government. The new megarich of Silicon Valley, at Google and Facebook, are masters at linking Web data- searches, posts and messages - with Internet advertising.

Whitelist words:

1. artifici intellig: 2 occurrences
2. languag process: 1 occurrence
3. machin learn: 1 occurrence
4. pattern recognit: 1 occurrence

Categorization (need >= 0.5 to match):

1. AIOverview: 0.450727
2. Agents: 0.123539
3. Applications: 0.938448
4. CognitiveScience: 0.019748
5. Education: 0.000355567
6. Ethics: 0.0222935
7. Games: 0.00159543
8. History: 0.0803139
9. Interfaces: 0.0157105
10. MachineLearning: 0.32202
11. NaturalLanguage: 0.42645
12. Philosophy: 0.000447849
13. Reasoning: 0.0741054
14. Representation: 0.08869
15. Robots: 0.0266008
16. ScienceFiction: 0.00245838
17. Speech: 0.00212987
18. Systems: 0.030657
19. Vision: 0.0211193

Duplicates (threshold=0.17):

Transcript:

1. Published