12 year old established and profitable Internet company seeks to hire a software developer with extensive experience in the field of spidering site content on a large scale, to work on a project basis.

We need to develop a server-side spider application that will, on a frequent basis and as efficiently as possible, crawl approximately 10,000 sites, and spider thousands of pages on each site to retrieve a list of specific data and URL’s from those pages and insert that data into a MySQL DB. Hardware will be standard Dual Intel Xeon’s running Redhat Linux, Perl, PHP, MySQL, etc.

Applicant should be able to provide examples of previous work in this specific field, developing crawlers and/or working on search engine related technologies. Experience in the field of photo sharing, organizing photos, tagging photos, indexing photos, and searching photos, is a plus.

Although this posting is for a specific project, we are always looking to hire highly skilled developers on a more permanent basis.

* Compensation: Competitive
* Telecommuting is ok.
* This is a part-time job.
* This is a contract job.

click here for article

Bookmark to: