INTERNET BASED C OMPUTING
Xiannong Meng
Department of Computer Science
The University of Texas - Pan American
meng@panam.edu
May 5, 1998

Outline of the Presentation

• Internet activities: information service and parallel computing.
• Information service: search, cache, retrieval, visualization, ranking and others.
• Parallel computing: objectives, models, promises and problems.
• DaVIME
• ParaCrawler
• Conclusion

Information Service Over the Internet

• Estimated a lower bound of 320 million pages on the Internet
• Search service strategies:
  • indexing extensively return results on demand (e.g. Harvest, AltaVista, HotBot)

    AltaVista: (as of 8/29/96)

    • 30 M pages, 13 B words, 45 GB on disk
    • 6 GB of main memory
    • on seven machines with 10 CPUs each
    • 800 fetch threads
    • access to 14,000 news groups and web pages
  • meta-searching - use other search engines
• Issue of caching and proxy server
  • Internet Cache Protocol : if-modified-since
  • Squid is one implementation of ICP.
  • Proxy servers: used in ICP.

Information Service ... continued

• Visualization (RHF's talk)
• Ranking and relevance(!) (RHF and others' work)
• View the Web as a database : designed for resource and knowledge discovery in a global information system; uses multi-layered database architecture.

Parallel Computing Over the Internet

• Javalin: Clients request computing power from hosts with the help of brokers; Java-based.
• ParaWeb: Clients use internet and intranet as a part of their computing infrastructure in a seamless fashion. The use of a scheduling server (broker).
• ATLAS: Manager, clients, and computing server, software system, work stealing.
• Legion: Virtual supercomputing based on campus wide network.
• Globus: Supercomputers connected by Internet where major scientific computation tasks can be carried out.
  • Related project GUSTO won the GII (Global Information Infrastructure Next Generation) award on April 20, 1998
  • Related project I-Way : is an ATM network connecting supercomputers, mass storage systems, and advanced visualization devices at 17 different sites within North America.

DaVIME

DaVIME - Data Visualization, Indexing and Mining Engine, which is a parallel computing architecture for information service over the Internet.

 
Figure: System Architecture of DaVIME 

ParaCrawler

• Create our own meta-search engine so we can experiment with various policies and mechanisms
• ParaCrawler: parallel search, ranking, sorting, pruning ...

 
Figure: ParaCrawler Structures

Conclusion

• Internet can be used as a global scale, desk-top supercomputer using existing technologies
• Internet can support computing as well as information engineering
• Build a system that can make use of idle computing powers
• Use the idea of meta-computer, meta-search engines

• About this document ...