HG Insights - Remote, USA

HG Insights is seeking a versatile and experienced Platform Architect. The ideal candidate will bring a strong mix of technical expertise, leadership experience, and a proven track record in building scalable distributed systems.

What You’ll Do:

We are looking for a Platform Architect to drive technical excellence, mentor teams, and lead the development of our next-generation products.
The role requires someone who can balance strategic thinking with hands-on technical leadership.

What You'll Be Responsible For:

• Lead and mentor engineering teams across frontend, backend, and infrastructure domains
• Drive technical vision and architecture decisions for complex distributed systems
• Collaborate with executive leadership on product strategy and technical roadmap
• Build and scale engineering teams through effective hiring, mentoring, and development
• Establish engineering best practices, processes, and quality standards
• Drive innovation in cloud-native architectures and deployment strategies
• Lead implementation of cost-effective and performant cloud solutions
• Oversee development of scalable frontend and backend systems
• Manage site operations and technical infrastructure

What You’ll Need: 

• 20+ years of software engineering experience with at least 5 years in leadership roles
• Strong experience in cloud-native technologies, distributed systems
• Proven track record of leading full-stack engineering teams
• Deep expertise in modern frontend and backend technologies
• Experience with cloud platforms and infrastructure management
• Strong background in API design and microservices architecture
• Experience with monitoring, observability, and performance optimization
• Track record of successful product deliveries and team scaling
• Bachelor's degree in Computer Science, Engineering, or related field

Technical Skills

• Cloud Platforms & Technologies: Docker, Kubernetes, Cloud-native architectures
• Frontend: React.js, Angular, JavaScript/TypeScript, HTML/CSS
• Backend: Java, Go, Node.js, RESTful services
• Databases: Experience with both SQL and NoSQL databases
• Infrastructure: Experience with monitoring tools, CI/CD pipelines
• Architecture: Microservices, distributed systems, high-availability systems

Leadership Competencies

• Strategic thinking and ability to translate business requirements into technical solutions
• Strong team building and mentoring capabilities
• Excellent communication skills with both technical and non-technical stakeholders
• Experience in agile methodologies and project management
• Ability to drive innovation and technical excellence
• Strong focus on engineering quality and best practices

Location: Remote, USA

Employment Type: Full-time

About HG Insights

Headquartered in Santa Barbara, California, HG Insights is the global leader in technology intelligence. We help the world's most innovative companies accelerate their go-to-market efforts with precision through advanced data science methodologies and proprietary data assets. We offer a culture that blends innovation, collaboration, and growth, where each team member is empowered to make a measurable impact.

Role Overview

HG Insights runs data infrastructure across three organizations, two clouds, and sixteen database and caching technologies. As we scale, we're consolidating database ownership under Platform Engineering. This role leads that function.

You will be the first database specialist on our DevOps team; embedded, not siloed. You'll own the full database portfolio: operational health, security posture, cost optimization, and the migration work required to modernize our data layer. As you build the practice, you'll cross-train DevOps engineers so the capability compounds beyond one person.

This is a Senior/Staff individual contributor role. You will set direction on database strategy and own its execution. The team you're joining manages 140+ IaC repositories across AWS, GCP, and Kubernetes.

Job Overview 

_{What You'll Own}

Database ownership across the portfolio

• Primary operator for PostgreSQL (RDS, Aurora, Cloud SQL, NeonDB), MySQL, Redshift, ClickHouse, Elasticsearch, OpenSearch, MongoDB Atlas, and Databricks
• Caching layer ownership: ElastiCache Redis, Dragonfly, Valkey
• Version management and patching across a multi-repo Terraform estate; coordinate EOL remediations across AWS and GCP
• Establish backup, recovery, and DR standards across all managed data layers

Migration and modernization

• Lead Elasticsearch modernization; approved architecture, ready to execute
• Lead ClickHouse stabilization and standardization
• Phoenix data repatriation: move third-party-hosted data in-house as Phoenix migration progresses
• NeonDB consolidation evaluation

Performance and cost

• Own database cost optimization across the portfolio: capacity planning, rightsizing, reserved instance and savings plan recommendations
• Query analysis, slow query identification, connection pool tuning
• Identify and execute on addressable savings in the database infrastructure spend

Platform integration

• Terraform and Terraform Cloud for all database infrastructure; standardize configurations across a fragmented estate
• ArgoCD and Kubernetes (EKS, GKE) for database workloads running in-cluster (Elasticsearch, ClickHouse, Dragonfly)
• GitHub Actions CI for database migration testing and backup validation
• Build and own the database observability layer in Datadog: dashboards, monitors, slow query alerting, replication lag, connection saturation

Collaboration with application engineering

• Partner with application engineering teams on database design, schema changes, query optimization, and technology selection; you are the subject matter authority they escalate to
• Establish and maintain standards for how application teams interact with the data layer: migration tooling, connection management, index design review, and capacity requests
• Own the feedback loop between application performance and database infrastructure; connect slow query data to engineering teams who can act on it

Cross-training and knowledge transfer

• Structured cross-training with the DVO team so database operational capability isn't concentrated in one person
• Document operational runbooks, incident response procedures, and capacity planning models

What We're Looking For

• 5+ years of hands-on database administration or database engineering; not theoretical
• Deep PostgreSQL expertise: replication, vacuum tuning, connection pooling (PgBouncer/PgCat), index strategy, major version upgrades
• Elasticsearch operational experience at scale; index lifecycle management, shard sizing, snapshot/restore, Kubernetes-hosted clusters
• ClickHouse or columnar database experience is a strong plus
• AWS RDS, Aurora, Redshift, ElastiCache; day-to-day operations, not just provisioning
• Terraform and Terraform Cloud; you will be reading and writing IaC on day one
• Kubernetes (EKS or GKE); database workloads run in-cluster and you need to be comfortable there
• Python or Bash scripting; maintenance windows, backup validation, migration tooling
• Migration experience; schema migrations, cross-engine moves, zero-downtime cutover strategies
• Datadog or equivalent observability tooling

Nice to have

• BigQuery, DynamoDB, or Databricks administration
• Redis/Valkey/Dragonfly at production scale
• MongoDB Atlas administration
• Cloud cost optimization (reserved capacity, savings plans)

About HG Insights

Headquartered in Santa Barbara, California, HG Insights is the global leader in technology intelligence. We help the world’s most innovative companies accelerate their go-to-market efforts with precision through advanced data science methodologies and proprietary data assets. We offer a culture that blends innovation, collaboration, and growth, where each team member is empowered to make a measurable impact.

Role Overview

We are looking for a Staff/Senior Machine Learning Engineer to join our growing AI and Data Platform team in Pune, India. In this role, you will be responsible for designing, building, and scaling ML systems that power our core data intelligence products. You’ll work at the intersection of data engineering and machine learning, collaborating closely with data scientists, software engineers, and product teams to turn models and agents into robust, production-ready systems.

This is a high-impact role suited for someone who thrives on ownership, scalability, and deploying real-world ML and AI solutions at scale.

Key Responsibilities

ML & AI System Development

• Design and build end-to-end ML pipelines, from data ingestion and feature engineering to model training, serving, and monitoring.
• Productionize AI agents, including LLM-backed workflows, multi-step tool use, and API orchestration.
• Collaborate with data scientists to bring experimental models into stable, high-performing production systems.
  
  

MLOps & Infrastructure

• Implement and maintain MLOps workflows (CI/CD for ML), tracking experiments, managing model versions, and automating retraining.
• Set up observability for models and agents, including tracing, logging, latency/error tracking, and fallback logic.
• Ensure infrastructure supports scalability, performance, and compliance requirements.
  
  

Technical Leadership & Collaboration

• Lead technical architecture for key AI and ML systems, ensuring maintainability and extensibility.
• Partner with product and platform teams to translate business needs into reliable and performant ML solutions.
• Mentor junior engineers and help elevate technical practices across the engineering org.

Minimum Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 8+ years of industry experience, with at least 4+ years in ML engineering or MLOps.
• Strong programming skills in Python and experience with ML libraries such as PyTorch, TensorFlow, and scikit-learn.
• Experience deploying AI agents in production, including retrieval-augmented generation (RAG), multi-step reasoning, and tool-use orchestration.
• Familiarity with LangChain, LlamaIndex, Haystack, or similar frameworks for agent development.
• Hands-on with LLMs (OpenAI, Anthropic, Cohere, etc.), embedding models, and vector store integration.
• Expertise in MLOps tools like MLflow, Airflow, SageMaker, or Kubeflow.
• Experience with cloud platforms (preferably AWS), Docker/Kubernetes, and large-scale data systems (e.g., Snowflake, Databricks).
• Excellent problem-solving and system design skills, including CI/CD, testing, and infrastructure-as-code.
  
  

Preferred Qualifications

• Experience with streaming pipelines, online inference, and model monitoring at scale.
• Exposure to agent memory, feedback loops, or AI workflow orchestration in customer-facing products.
• Prior contributions to open-source ML or LLM projects are a plus.
  
  

Why Join HG Insights?

• Work on high-impact AI products used by global enterprise customers.
• Lead the ML engineering strategy and shape our AI platform.
• Competitive compensation and benefits tailored for India-based employees.
• A collaborative and innovation-focused team environment.
  
  

Ready to build the future of AI infrastructure? Apply now to join HG Insights as a Staff Machine Learning Engineer in Pune.

Director, Data Engineering
Location: Remote (US)

About Us:

Headquartered in beautiful Santa Barbara, HG Insights is the global leader in technology intelligence. HG Insights uses advanced data science methodologies to help the world’s largest technology firms and the fastest-growing companies accelerate their sales, marketing, and strategy efforts. We offer a competitive salary, 401K, growth potential, stock options, great benefits, and a casual yet professional environment. We are passionate about our jobs with a get-it-done attitude, yet we don’t take ourselves too seriously.

What You’ll Do:

As the Director of Data Engineering, you will lead a high-performing team responsible for designing, building, and managing the data infrastructure and pipelines that drive HG Insights’ data products and services. You will define the strategic direction of the Data Engineering function, collaborate with cross-functional teams, and ensure the scalability, efficiency, and reliability of our data systems. Your role will be pivotal in ensuring the success of our data-driven initiatives.

What You’ll Be Responsible For:

Strategic Leadership

• Define and execute the strategic roadmap for the Data Engineering team.
• Align the data infrastructure and processes with the company’s business objectives and growth strategy.

Team Leadership and Development

• Lead, mentor, and grow a team of skilled data engineers, fostering a culture of collaboration, innovation, and excellence.
• Attract and retain top talent to build a world-class Data Engineering organization.

Data Infrastructure Management

• Oversee the development and optimization of scalable, reliable, and efficient data pipelines and platforms.
• Ensure data systems are designed for high availability, security, and performance.

Collaboration and Stakeholder Management

• Partner with Product, Data Science, Engineering, and Business teams to understand their data needs and deliver solutions that meet those needs.
• Act as a key liaison between technical teams and business stakeholders, ensuring alignment and transparency.

Innovation and Continuous Improvement

• Stay abreast of emerging technologies and industry best practices in data engineering.
• Drive the adoption of new tools, technologies, and methodologies to enhance the team’s efficiency and effectiveness.

Operational Excellence

• Define and enforce standards, processes, and best practices for data engineering.
• Monitor and optimize the performance of data systems to ensure they meet SLAs and business requirements.

1. Data Governance and Compliance

• Ensure that all data systems and processes comply with relevant regulations and standards.
• Implement robust data governance practices to maintain data quality and integrity.

What You’ll Need:

• BS or MS in Computer Science, Data Engineering, or a related field.
• 10+ years of experience in data engineering, with at least 5 years in a leadership role.
• Proven track record of designing and managing large-scale, distributed data systems.
• Deep expertise in data engineering technologies such as Hadoop, Spark, Kafka, and cloud platforms (AWS, Azure, GCP).
• Strong knowledge of database systems (SQL and NoSQL) and ETL processes.
• Excellent leadership and communication skills, with the ability to influence across all levels of the organization.
• Experience with data governance, compliance, and best practices.
• A passion for building scalable, efficient, and innovative data systems.

Why Join Us:

• Be part of a dynamic and innovative team driving growth in the tech industry.
• Opportunity to lead impactful projects and shape the future of data engineering at HG Insights.
• Competitive salary and benefits package.
• Collaborative and inclusive work environment.

Apply Today to lead the next phase of innovation in data engineering!

About us:

HG Insights is the pioneer of Revenue Growth Intelligence. For more than a decade, we have delivered comprehensive, AI-driven datasets on B2B buyers, technology adoption, IT spend, and buyer intent, sourced from billions of data points. Today, we are a trusted partner to Fortune 500 technology companies, hyperscalers, and innovative B2B vendors seeking precise go-to-market analytics and decision-making.

Through an evolving suite of AI agents that incorporate first-party data and buyer signals, HG Insights enables AI-powered GTM automation across sales, marketing, RevOps, and data analytics teams, modernizing GTM execution from strategy through activation.

What You'll Do:

We’re searching for an experienced Full Stack developer to work on our product teams who is passionate about developing products that are simple, intuitive, and beautiful. We build big-data systems utilizing cutting-edge technologies and solutions that allow our developers to learn and develop while shipping amazing products.

As part of our team, you’ll be working on our Big Data Insights Platform products and elevating user experiences. Our stack is based on Elixir, React, and GraphQL APIs. We are a growing company with small, focused engineering teams that are delivering innovative features in a fast-growing market.

What You’ll Be Responsible For:

• You will work on our Product Engineering Teams
• You will design and enhance core business-driving services and products
• You will develop features in our databases, backend apps, and front end UI
•  You will help architect and design service-driven UI via RESTful and GraphQL APIs
• You will work on ideas from different team members as well as your own
• Participate in our on-call rotation, Fix bugs rapidly and investigate and resolve production problems
• Attend daily stand-up meetings, planning sessions, encourage others, and collaborate at 
  a rapid pace

What You’ll Need:

•  BS/MS in Computer Science, or other related fields. Or on-the-job experience.
• 5+ years of designing and programming in a work setting 
• Proficient in backend (Elixir) and frontend (JavaScript/TypeScript) with real-world experience applying system and code design patterns.
• Strong in React or similar
• Experience building RESTful or GraphQL APIs
• Good knowledge of SQL
• Experience with Amazon Web Services (EC2, S3, RDS, Lambdas, EKS, etc.)
• Comfortable working with CI/CD and automation tools: Docker, Kubernetes, Terraform or
  similar
• Good DevOps skills (automate everything, infrastructure as code)
• Comfortable in an agile development environment
• Self-learner, hacker, and technology advocate who can work on anything
• Thrive in a fast-growing environment
• Proven track record of successful project delivery
• Excellent written and spoken English communication

Nice-to-haves:

•  You've worked on Enterprise-grade SaaS applications
• Experience leading a project / team
• Familiar with ElasticSearch, Snowflake/Databricks, ClickHouse or similar Big Data technology
• Loves startup culture where everyone's contributions are felt and loved.

HG Insights is the leading provider of Technology Intelligence for B2B organizations. We help revenue teams focus on the right accounts, at the right time, with the right message by combining deep technographic insights with advanced analytics and data-driven workflows.

You'll be joining the team that builds and scales our data-intensive, analytics-driven products—powering high-impact go-to-market decisions for our customers.

Job Title: Sr. Data Acquisition Specialist
Department: Data Operations

What You’ll Do: 

In this role, you will research and vet new data providers as data needs arise, handle vendor relationships and contracts, and manage intent-related projects to ensure the integrity of our data. You’ll work closely with data analytics and internal clients to increase the trackability of the technology products, improve our firmographic data, increase intent mapping, and support data insight projects.

Our Ideal Candidate:
The Sr. Data Acquisition Specialist is a highly organized, team player who is able to manage multiple projects simultaneously, provide the critical communication link between data analytics, engineering, and data vendors, and ensure accurate and expansive global data coverage. The ideal candidate possesses the following:

• Advanced research and analytical skills
• Solid understanding of data - including firmographics, intent, and technographic intelligence
• Ability to identify and evaluate potential data sources
• Expertise in interpreting and managing contracts
• Strong negotiation skills
• Meticulous attention to detail
• Clear written and verbal communication skills
• Critical thinking and problem-solving ability

What You'll Be Responsible For:

• Tracking data deliveries and communicate issue to data providers
• Monitoring the timeliness and completeness of data ingestion across all sources
• Identifying gaps in current data and recommending sources or processes to improve coverage 
• Assessing whether current providers are meeting contract obligations
• Determining if the data provided is fulfilling HG’s needs, if the contract should be cancelled, renewed, or allowed to lapse
• Researching possible alternate provider, write up analyses, and determine if they are a viable replacement
• Compare and recommend best option for acquisition
• Reviewing and redlining contracts, coordinating revisions with HG legal team, and renegotiating renewals as appropriate
• Maintaining contract copies, data acquisition budget sheet, and update as changes occur
• Working with data analytics and/or engineering to evaluate samples from potential data providers to determine uplift
• Ensuring consistent delivery of intent topics, timely mapping of new topics, and inclusion of topics in intent collections
• Analyzing intent mappings and surfacing/correcting errors and anomalies
• Support of other Data Operations production activities (such as technographics, firmographics, functional area intelligence, partner intelligence, new product launches, and special projects)

What You’ll Need: 

• Analysis report writing skills 
• Ability to manage multiple projects, adapt to changing priorities, and deliver by deadlines
• Team-minded work ethic with the ability to work under limited supervision
• Contract experience
• Clear written and verbal communication skills
• Critical thinking/Problem-solving prowess
• Proficiency with MS Office and Google Suite, Confluence, Jira, and Zoom
• Familiarity/working knowledge of MySQL, Athena, and Boolean search skills
• Native fluency in English 
• 1-2 years of experience working in an office environment is required
• Bachelor’s degree in Business Administration, Law, or a Technology-related field preferred

HG Insights Company is an Equal Opportunity Employer 

Please note that HG Insights does not accept unsolicited resumes from recruiters or employment agencies. In the event of a recruiter or agency submitting a resume or candidate without a signed agreement being in place, we explicitly reserve the right to pursue and hire such candidates without any financial obligation to the recruiter or agency. Any unsolicited resumes, including those submitted directly to hiring managers, are deemed to be the property of HG Insights

HG Insights is the pioneer of Revenue Growth Intelligence. For more than a decade, we have delivered comprehensive, AI-driven datasets on B2B buyers, technology adoption, IT spend, and buyer intent, sourced from billions of data points. Today, we are a trusted partner to Fortune 500 technology companies, hyperscalers, and innovative B2B vendors seeking precise go-to-market analytics and decision-making.

Through an evolving suite of AI agents that incorporate first-party data and buyer signals, HG Insights enables AI-powered GTM automation across sales, marketing, RevOps, and data analytics teams, modernizing GTM execution from strategy through activation.

Product Group: TrustRadius is a B2B technology decisioning platform that helps buyers make confident software purchase decisions and enables vendors to activate high‑intent, in‑market buyers through rich review content and intent data signals. As part of HG Insights, TrustRadius powers data‑driven go‑to‑market strategies for leading B2B technology brands worldwide.

Job Title: Principal Engineer

Role Overview

We are looking for a Principal Engineer – Engineering to provide technical thought leadership for our vendor‑side data platform and pipelines. This is a senior individual contributor role (IC) with Principal Engineer scope, responsible for the architecture, evolution, and reliability of our microservices and data pipelines that power vendor lead generation, intent resolution.

You will set the long‑term technical direction, mentor senior/staff engineers, and stay hands‑on in critical code paths across NestJS/Node.js, TypeScript, Python data pipelines, and event‑driven services.

Key Responsibilities

• Own the end‑to‑end architecture for data ingestion and processing pipelines, from external data sources through Airflow‑orchestrated Python workflows into storage on S3 and downstream services.
• Design and evolve microservices built with NestJS/Node.js and TypeScript, exposing APIs for lead generation, vendor management, and intent resolution at scale.
• Define and drive database architectures across PostgreSQL and MongoDB and Elastic, including complex data models for B2B lead scoring, vendor relationships, and customer analytics.
• Provide technical thought leadership to create and grow an agile, high‑performing engineering team culture around CI/CD, trunk‑based development, testing, observability, and rapid iteration.
• Lead the adoption of real‑world AI/ML in engineering workflows (code generation, code review, test generation, incident analysis) to materially improve development speed and quality.
• Partner with product and marketing to design data and service architectures that maximize content/intent data pipelines that make TrustRadius a top‑ranked destination for vendors and buyers.
• Implement and evolve secure authentication and authorization patterns using Auth0, OAuth2, and JWT for a multi‑tenant SaaS platform serving enterprise customers.
• Integrate and scale third‑party services such as LinkedIn APIs, intent enrichment, Salesforce CRM, and payment processors, with robust resilience, observability, and fault‑tolerant retry strategies.
• Architect and optimize event‑driven systems on Google Cloud Pub/Sub for real‑time data processing, enrichment, and inter‑service communication.
• Drive performance and cost optimization of APIs and data pipelines, including caching strategies, query tuning, horizontal scaling, and right‑sizing of cloud resources.
• Champion best practices for data quality, governance, and monitoring across vendor data feeds and internal platforms to ensure accurate, trusted signals for downstream analytics and GTM activation.
• Mentor Engineers, providing guidance on system design, trade‑offs, and long‑term roadmap, while influencing technical decisions.

Core Technical Skills

• Expert‑level experience designing and building large‑scale backend systems and microservices with NestJS/Node.js and TypeScript.
• Strong hands‑on experience with Python data ingestion and ETL/ELT pipelines, ideally orchestrated using Apache Airflow and cloud object storage such as S3.
• Deep understanding of relational and NoSQL database design, specifically PostgreSQL and MongoDB, including schema design, indexing, and performance tuning.
• Proven experience with secure authentication/authorization in SaaS environments using Auth0, OAuth2, and JWT.
• Strong background integrating external APIs and SaaS systems.
• Hands‑on experience with event‑driven architectures and messaging systems.
• Solid understanding of cloud infrastructure (preferably GCP), containerization, CI/CD pipelines, and production observability (logging, metrics, tracing).

Nice‑to‑Have Skills

• Experience with MCP architectures and tools development.
• Practical knowledge of machine learning techniques applied to data pipelines.
• Experience in content/intent‑data‑driven products, especially in B2B SaaS or marketplaces.
• Familiarity with data platforms in the B2B buyer intent or intent data provider space.

Business Outcomes and Impact

In this role, you will be accountable for:

• Building and sustaining an agile, high‑impact engineering culture through technical thought leadership, standards, and mentorship.
• Demonstrable improvements in engineering efficiency and quality through AI‑assisted tooling, automation, and better platform abstractions.
• A continuously evolving, scalable data and service architecture that strengthens TrustRadius’s position as the number‑one destination for SEO and GEO‑driven software buying traffic, and as a key provider of high‑quality intent data to vendors.

About Us

HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. Our platform informs go-to-market decisions, and we influence how businesses spend millions of marketing and sales budgets.

What You’ll Do

We’re searching for an experienced backend JavaScript engineer to join our product teams and help build systems that are simple, intuitive, and scalable. We develop big-data platforms using modern technologies and architectures, giving engineers the autonomy to learn, grow, and ship impactful products.

In this role, you’ll collaborate closely with Product Managers, Product Designers, and fellow engineers on our Insights Platform, designing and building reliable backend services that power great user experiences. Our backend stack is primarily based on Node.js.

What You’ll Be Responsible For

• Work as part of our Product Engineering teams
• Architect, design, and implement service-oriented backend systems and APIs
• Build, maintain, and evolve RESTful APIs
• Collaborate on ideas across the team, from concept through production
• Fix bugs quickly while continuously improving system reliability and performance
• Participate in our on-call rotation and help investigate and resolve production issues
• Attend daily stand-ups and planning sessions, collaborate at a fast pace, and help raise the engineering bar
  
  

What You’ll Need

• BS/MS in Computer Science or a related field, or equivalent real-world experience
• 7+ years of professional software engineering experience
• Strong proficiency in JavaScript and TypeScript, with a backend focus
• Proven experience applying system and code design patterns in production environments
• Experience using AI-assisted development tools (e.g. Codex, Claude, Gemini) with advanced workflows
• A self-learner and technology advocate comfortable working across different areas of the system
• Ability to thrive in a fast-growing, high-ownership environment
• Excellent written and spoken English communication skills

Nice-to-Haves

• Experience building or maintaining enterprise-grade SaaS applications with large datasets
• Experience designing or building AI-powered features or systems
• Experience working with Python
• Enjoys startup culture where individual contributions are visible, impactful, and valued

About HG Insights

Headquartered in Santa Barbara, California, HG Insights is the global leader in technology intelligence. We help the world's most innovative companies accelerate their go-to-market efforts with precision through advanced data science methodologies and proprietary data assets. We offer a culture that blends innovation, collaboration, and growth, where each team member is empowered to make a measurable impact.

Role Overview

We are looking for a Senior Staff Engineer to join our growing AI and Data Platform team in the USA. We're looking for strong engineers who are able to clearly articulate and command the technical requirements of multiple product areas.

Knowledge and Skills

• Solid knowledge of engineering and development principles and best practices
• Solid knowledge of the tools and frameworks used at HG Insights
• Solid communication skills
• Solid organization skills
• Solid understanding of prioritization and optimization processes
• Mentors others to inspire and instill confidence
• Solid and reference display of technical knowledge in multiple domains (AI/ML/Agentic Frameworks, FE, BE, Data, Infra, QA, etc.)
• Full technical command and product understanding of multiple areas of the product

Etiquette

• Solid display of HG Insights Values
• Proactively seeks to improve the technical codebase of multiple areas of the product
• Proactively contributes to the improvement of the entire engineering team skillset
• Proactively works towards improving the current technical stack
• Proactively takes care of the future of the codebase and suggests changes
• Contributes actively to the execution of key projects and taskforce teams
• Contributes actively to the execution of cross-area projects

Progress

• Works towards comprehending more than the assigned product areas
• Works towards empowering other engineers to better comprehend all product areas

Expects

• Continuous feedback on all things
• Helps to solve complex problems
• Maintain and control technical debt
• Training in other areas of the product

Why Join HG Insights?

• Work on high-impact AI products used by global enterprise customers.
• Competitive compensation and benefits
• A collaborative and innovation-focused team environment.

About Us

HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. Our platform informs go-to-market decisions, and we influence how businesses spend millions of marketing and sales budgets.

What You’ll Do:

• Design, build, and optimize large-scale distributed data pipelines for processing billions of events from and to multiple sources of data.
• Architect and scale enterprise-grade big-data systems, including data lakes, ETL/ELT workflows, and syndication platforms for customer-facing products.
• Orchestrate pipelines and workflows with Airflow.
• Write optimized data into analytical databases such as ClickHouse, DuckDB, and Redshift
• Ensure data quality, consistency, and reliability across the pipeline.
• Monitor pipeline performance and troubleshoot data issues.
• Collaborate with product teams to develop features across databases, and backend services.
• Implement cutting-edge solutions for data ingestion, transformation, and analytics.
• Drive system reliability through automation, CI/CD pipelines (Docker, Kubernetes, Terraform), and infrastructure-as-code practices.

What You’ll Be Responsible For

• Development of the Data side of our Platform, ensuring scalability, performance, and cost-efficiency across distributed systems.
• Collaborating in agile workflows (daily stand-ups, sprint planning) to deliver features rapidly while maintaining system stability.
• Ensuring security and compliance across data workflows, including access controls, encryption, and governance policies.

What You’ll Need

• BS/MS/Ph.D. in Computer Science or related field, with 7+ years of experience building production-grade big data systems.
• Strong SQL skills and solid data modeling fundamentals with hands-on experience building ETL / ELT pipelines.
• Proficiency in Python for data processing and integrations.
• Familiarity with dbt, Airflow, Databricks and modern analytics engineering practices

Nice-to-Haves

• Knowledge of data governance frameworks and compliance standards (GDPR, CCPA).
• Contributions to open-source big data projects or published technical blogs/papers.
• DevOps proficiency in monitoring tools (Prometheus, Grafana) and serverless architectures.