Challenges in PubChem: Past, Present, and Future

In this talk I will describe some of the technical challenges in PubChem
that I've had a part in overcoming. The biggest general issue has been
growth of the volume of data in the system and our scale-up efforts to
accommodate it. Much of my work in the past few years has involved data
flow in some way: high-throughput data uploads, an automated update
schedule, efficient Entrez dumps, and regular FTP site updates. I have
also been particularly concerned with programmatic tools for accessing
PubChem and Entrez data both internally and externally, mainly via
eUtils and eDirect, PUG, and PUG SOAP (recently presented at a
multi-industry conference). I will summarize the architecture of these
systems, and take a brief look at what we will be facing in coming
months as PubChem enters its sixth year.

 - Paul

-- 
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
   Paul A.   |        NCBI / NIH
  Thiessen   |  thiessen@ncbi.nlm.nih.gov
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+