About the Role

iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate will have hands-on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related services. This role will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals.

Responsibilities

• Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
• Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session or token-based login flows.
• Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
• Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.
• Integrate and manage complex workflows across multiple portals, APIs, and data sources.
• Contribute to architectural decisions, tooling, and best practices.

Qualifications

• Bachelor’s or master’s degree in computer science, software engineering, or related field, or equivalent professional experience
• 10+ years of experience in Python development, with a strong focus on automation and data extraction
• Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests
• In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session or cookie management
• Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager
• Experience with asynchronous programming, headless browsers, and JavaScript-rendered content
• Solid understanding of web protocols (i.e. HTTP, HTTPS, cookies, headers), and the ability to reverse-engineer network calls and authentication mechanisms
• Comfortable working with APIs, JSON/XML, and data transformation
• Experience with CI or CD pipelines, Docker, and infrastructure as code (i.e. CloudFormation, Terraform)
• Familiar with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions
• Prior experience scraping from secure or enterprise-level portals (i.e. financial, healthcare, legal)
• Background in data engineering or ETL workflows is a plus
• Exposure to Python testing frameworks and writing unit or integration tests

Benefits

The base salary range for this role is $130,000 to $160,000.  iCapital offers a compensation package which includes salary, equity for all full-time employees, and an annual performance bonus. Employees also receive a comprehensive benefits package that includes an employer matched retirement plan, generously subsidized healthcare with 100% employer paid dental, vision, telemedicine, and virtual mental health counseling, parental leave, and unlimited paid time off (PTO).

We believe the best ideas and innovation happen when we are together. Employees in this role will work in the office Monday-Thursday, with the flexibility to work remotely on Friday.

For additional information on iCapital, please visit https://www.icapitalnetwork.com/about-us  Twitter: @icapitalnetwork | LinkedIn: https://www.linkedin.com/company/icapital-network-inc | Awards Disclaimer: https://www.icapitalnetwork.com/about-us/recognition/

iCapital is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, gender, sexual orientation, gender identity, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

ABOUT THIS ROLE

As a Software Development Engineer in Test (SDET III), you will be a pillar of our Software Quality team, ensuring the performance and reliability of an AI-driven platform that operates in the real world. You will partner with engineers and product managers to architect scalable automation frameworks and drive a culture of technical excellence. We are looking for a high-level individual contributor who doesn't just find bugs, but engineers the infrastructure that prevents them.

This role is based in-office out of our Headquarters in American Fork, Utah.

ROLE RESPONSIBILITIES

• Framework Architecture: Design, implement, and maintain scalable automation frameworks from scratch for UI (web/mobile), API, and backend services.

• Technical Leadership: Lead quality initiatives for complex, multi-service projects, providing architectural guidance and performing deep-dive code reviews for test code.

• CI/CD Integration: Own the integration of automated test suites into DevOps pipelines to ensure seamless execution and rapid feedback loops for the engineering team.

• Root Cause Analysis: Debug complex distributed systems to identify root causes across application code, infrastructure, and network configurations.

• Performance & Reliability: Design and execute sophisticated load, stress, and performance tests to ensure system stability under peak traffic and real-world conditions.

• Tooling Development: Build custom internal tools and dashboards to improve developer productivity, test data management, and environment orchestration.

• Test Case Management: Strategize and maintain comprehensive test coverage, utilizing manual testing only where automation is not feasible or effective.

• Cross-Functional Collaboration: Partner with stakeholders to define quality metrics and ensure all applications meet LVT’s high standards before deployment.

OUR IDEAL CANDIDATE

• Technical Education: Holds a Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field.

• Programming Mastery: Expert-level proficiency in at least one major language (e.g., Python or TypeScript) with a focus on writing clean, maintainable, and DRY code.

• Automation Expertise: 5+ years of hands-on experience with modern tools like Playwright, Selenium, or Appium, and API frameworks such as PyTest.

• Architecture Knowledge: Deep understanding of microservices, REST/GraphQL APIs, and the communication protocols of distributed systems.

• DevOps Proficiency: Experienced with Docker, Kubernetes, and cloud platforms (AWS, Azure, or GCP), including managing CI/CD tools like GitHub Actions or Jenkins.

• Data Savvy: Advanced SQL skills and experience testing NoSQL databases such as MongoDB or DynamoDB.

• Security & Observability Mindset: Familiarity with automated security scanning (SAST/DAST) and monitoring stacks like ELK, Splunk, or Datadog.

• Mentorship: A proven track record of mentoring junior-to-mid-level SDETs and fostering a culture of technical rigor and excellence.