CS4920: Automated Document and Media Exploitation

Wed Oct 1, 2008

Literature and Evaluation Strategies

Seminar 1 <<                     Seminar 2                    >> Seminar 3

• Glen Koue, NPS Libraries, addresses the class.
• Precision vs. Recall
• ROC Curves

Links

• Wikipedia's article on Full Text Search

=Readings

• An experimental study of the impact of information extraction accuracy on semantic search performance, Jennifer Chu-Carroll, John Prager, November 2007, CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management

• Some ideas for estimating the number of relevant documents Robert T. Dattola, August 1980, ACM SIGIR Forum, Volume 15 Issue 1

Optional

This is really tough, but it's worth reading.

• An extensive empirical study of feature selection metrics for text classification, George Forman, March 2003, The Journal of Machine Learning Research, Volume 3

• Retrieval system evaluation using recall and precision: problems and answers, V. V. Raghavan, P. Bollmann, G. S. Jung, June 1989

• Autonomously semantifying wikipedia Fei Wu, Daniel S. Weld November 2007, CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
• Improving web spam classification using rank-time features, Krysta M. Svore, Qiang Wu, Chris J. C. Burges, Aaswath Raman, May 2007, AIRWeb '07: Proceedings of the 3rd international workshop on Adversarial information retrieval on the web
• Automatically refining the wikipedia infobox ontology, Fei Wu, Daniel S. Weld, April 2008, WWW '08: Proceeding of the 17th international conference on World Wide Web
• Autonomously semantifying wikipedia, Fei Wu, Daniel S. Weld, November 2007, CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management

Lab