Join our team in Toronto and let's do great things together.
About TinEye
TinEye is an image search company. We’re computer vision, pattern recognition, neural networks, and machine learning experts. Our mission is to make images searchable.
We have built a small, tight-knit and exceptional team based in Toronto. We deliver image search and recognition solutions to industries where searching images is mission-critical. Today, millions of people use TinEye. Our image search technologies power billions of searches across a wide range of industries. We are privately owned, profitable and founder-led, and we're looking for a Web Crawling and Scraping Engineer to join our team.
We value ingenuity, hard work and problem-solving over pedigree. We expect every team member to solve challenging technical problems. We also believe that experience comes in many shapes and forms, so if you think you have the qualities to make you an excellent addition to our team, please apply to start a conversation. If you have any questions, reach out to us at
[email protected].
This is an in-office position.
As part of our team, you will:
- Architect ever-changing crawling strategies to prioritize and index web pages based on client requests.
- Maintain our high-throughput crawling and ingestion pipeline, including frontier scheduling, rate limiting, deduplication, parsing, and proxies.
- Improve monitoring and logging systems to track crawler performance, crawl health, website coverage, uptime, crawl success rate, and latency.
- Pinpoint and eliminate bottlenecks in crawling and extraction, ensuring efficient resource usage and scalability.
- Maintain clear documentation of debugging procedures.
- Work closely with other engineering teams to ensure crawled data flows into indexing and matching.
- 4+ years of engineering experience designing and operating large-scale web crawling and indexing infrastructure.
- Extensive experience with distributed systems, crawler frontier design and real-time URL prioritization.
- Expertise in crawling frameworks, scraping libraries, and HTTP protocols.
- Strong programming skills in Python, Go, Rust, or C++ with experience in asynchronous/network programming.
- Hands-on experience with Puppeteer and Selenium.
- Experience with asynchronous I/O, queues, and storage systems (e.g. PostgreSQL).
- Solid knowledge of SQL and NoSQL databases.
- Excellent problem-solving, analytical, and communication skills, with a proactive attitude towards system improvement.
- Grit, smarts and persistence.
What you can expect working at TinEye:
- You will be solving engaging and complex technical challenges.
- You will be able to see your code deployed in production environments and powering some of our largest enterprise client implementations.
- You will work within a small development team alongside the scrappy co-founder.
- Your voice will be heard, and you will have the opportunity to provide input on all aspects of our work. We believe great ideas can come from our entire team.
- Did we mention a 4-day work week (eligible after your first year of employment), health benefits, home office expense budget, a fully stocked kitchen, downtown location, free parking, last but not least, our maker space — should you, like us, be interested in tinkering with hardware.
#J-18808-Ljbffr
📌 Web Crawling and Scraping Engineer In Office · Toronto, Canada
🏢 TinEye / Idee
📍 Toronto