Software Engineer

Scrapinghub provides the leading technology and consulting services to deliver successful web crawling and data processing solutions.

We are always looking for full time developers to join our Professional Services team and will consider a broad range of experience as we have a few positions available, particularly in crawler development.

• Web crawler development with Scrapy
• Systems to process large amounts of crawled data
• Text processing in python (ETL scripts, machine learning, NLP, information extraction, information retrieval, etc.)
• Distributed web crawling infrastructure

This is the perfect job for someone seeking to work on interesting and challenging problems, with a team that is truly passionate about programming.

• Python guru :)
• Internet technologies like HTTP, HTML, Javascript, Networking, etc.
• Familiarity with some of the common technologies and techniques for crawling, extracting and processing data, e.g. Scrapy, NLTK, pandas, scikit-learn, mapreduce, nosql, etc.
• Linux experience
• Excellent communication in written english
• Available to work full time
• Did we mention Python?

Nice to have:

• Knowledge of Scrapy would be fantastic
• Erlang would be very beneficial
• C & Java
• Involvement in open source
• Familiarity with AWS (S3, EC2, SWF) or similar
• Experience working with distributed teams

Please send source code that shows your programming ability well. If you have many projects on github (or similar) please tell us which we should look at. If you have nothing suitable then we will ask you to perform a programming task.