Jobs Companies Oxylabs Web Scraping Engineer - Python (Mid/Senior)

Über diese Web Scraping Engineer - Python (Mid/Senior) Stelle bei Oxylabs

Oxylabs · Hybrid · Vilnius
We’re a team of 500+ professionals who develop cutting-edge proxy and web data scraping solutions for thousands of the world’s best known businesses, including Fortune 500 companies. 

What’s in store for you:
You’ll be solving complex challenges and maintaining our own infrastructure with 60PB+ monthly data traffic. Here are its scale and maturity in numbers:

- 6PB+ Ceph storage
- 60PB+ monthly data traffic through our systems
- 300k+ service requests/sec processed
- 500k+ Kafka messages/sec streamed

The team waiting for you: 
 
We run one of the most advanced and largest scraping and parsing products in the world. We serve thousands of requests per second with a very high success rate. Our scrapers and parsers are used by leading e-commerce, market intelligence, and AI industry players making the work challenging and truly global. The team is a blend of different interesting personalities from different walks of life and nationalities. Here you can find people who are experts in gaming, playing guitar, riding bicycles, and other areas. We, as a team, will support you in learning how to build your own scrapers and will share all the tips, tricks and hacks we know to ensure that you are onboard in no time.

In this role, you’ll:

  • Develop scalable scrapers.
  • Define resilient scraping strategies, unblock websites for scraping.
  • Improve observability in the system.
  • Develop back-end solutions for scraping & parsing problems of various magnitudes.
  • Maintain the current system and develop new features related to scraping & parsing.
  • Your skills & experience:

  • Experience working with Python.
  • Understanding of computer science, including data structures, algorithms, computability and complexity.
  • Version Control skills using Git.
  • Knowledge on how to unblock websites for scraping.
  • Is able to use different scraping techniques & open-source tools to build scrapers.
  • Is comfortable with using Dev Tools.
  • Network (TLS/SSL) knowledge.
  • Worked with browser automations.
  • Knows their way around asynchronous programming.
  •  
     

    Nice to have:

  • Web development knowledge.
  • Knows how to use CSS Selectors / XPaths for parsing.
  • Experience working with Go & C++.
  • Worked on browser source code.
  • Knowledge of any front-end framework.
  • Experience working with Pydantic, FastAPI, SQLAlchemy.
  • Has experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus.
  • Experience with machine learning that is scraping domain-specific.
  • Has experience in building scalable systems.
  • Salary & Benefits:

  • Gross salary: 3500-6100 EUR/month. Keep in mind that we are open to discussing a different salary based on your skills and experience.
  • Growth & Learning: 40+ internal learning options, external conferences, mentorship, and year-round knowledge-sharing.
  • Health & Well-being: Private health insurance, psychotherapy, on-site well-being consultants, 24/7 gym access, and a wellness app.
  • Celebration & Community: Team events, an overseas workation, quarterly team-building budgets, and plenty of ways to mark milestones together.
  • Plus bonus vacation days, paid life-moment days off, barista coffee, and all the tools you need. See the full list of benefits here: https://career.oxylabs.io/blog/our-work-benefits/.

  • Up for the challenge? Let’s talk!
    Bereit, sich bei Oxylabs zu bewerben?
    Bei Oxylabs bewerben

    Ähnliche Jobs

    Registrieren für Vorschläge, die auf die von Ihnen geöffneten Jobs und gespeicherten Suchen zugeschnitten sind.

    Mehr Jobs bei Oxylabs

    Alle Jobs bei Oxylabs ansehen →

    Jetzt bewerben
    🤖

    Moment — langsam

    JobsRadar wurde für echte Menschen gebaut, die eine schwere Zeit bei der Jobsuche haben — nicht für automatisierte Anfragen. Sie klicken viel zu schnell und sind jetzt vorübergehend blockiert.

    Kommen Sie später wieder. Wenn Sie wirklich auf Jobsuche sind, stehen wir hinter Ihnen — verhalten Sie sich einfach wie ein Mensch.

    Catch your next role the second it’s posted.

    Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

    Create free account

    Free forever · takes 30 seconds · already have one?

    Verschaffe dir einen Vorsprung bei der Jobsuche.

    Tritt unserem Telegram-Kanal bei für das, was dir hilft, die Stelle zu bekommen — Gehaltsbenchmarks, den wöchentlichen Marktpuls und neue Feature-Drops. Kein Spam, nur Signal.

    Dem Kanal beitreten — kostenlos