College of LAS Events
College of LAS Events
If you need disability-related accommodations in order to participate in a program or event and cannot find an event contact listed, please contact MT Hudson at (217) 333-0885 or email@example.com. Early requests are strongly encouraged to allow sufficient time to meet your access needs.
|go to week of Nov 25, 2012||25||26||27||28||29||30||1|
|go to week of Dec 2, 2012||2||3||4||5||6||7||8|
|go to week of Dec 9, 2012||9||10||11||12||13||14||15|
|go to week of Dec 16, 2012||16||17||18||19||20||21||22|
Event Detail Information
BigData: Probabilistic Methods for Efficient Search and Statistical Learning in Extremely High-Dimensional Data
This talk will present a series of work on probabilistic hashing methods which typically transform a challenging (or infeasible) massive data computational problem into a probability and statistical estimation problem. For example, fitting a logistic regression (or SVM) model on a dataset with billion observations and billion (or billion square) variables would be difficult. Searching for similar documents (or images) in a repository of billion web pages (or images) is another challenging example. In certain important applications in the search industry, a web page is often represented as a binary (0/1) vector in billion square (2 to power 64) dimensions. For those data, both data reduction (i.e., reducing number of nonzero entries) and dimensionality reduction are crucial for achieving efficient search and statistical learning.
This talk will present two closely related probabilistic methods: (1) b-bit minwise hashing and (2) one permutation hashing, which simultaneously perform effective data reduction and dimensionality reduction on massive, high-dimensional, binary data. For example, training an SVM for classification on a text dataset of size 24GB took only 3 seconds after reducing the dataset to merely 70MB using our probabilistic methods. Experiments on close to 1TB data will also be presented. Several challenging probability problems still remain open.
Key references:  P. Li, A. Owen, C-H Zhang, On Permutation Hashing, NIPS 2012;  P. Li, C. Konig, Theory and Applications of b-Bit Minwise Hashing, Research Highlights in Communications of the ACM 2011.