OPEN POSITION ANNOUNCEMENT!

Data Engineer

Open until filled.

Posted 4/29/2026 San Diego County – hybrid work schedule set by SDCP

About the role:  The San Diego Community Power (SDCP) is seeking a seasoned Data Engineer to join our growing team of analytics experts who will be responsible for designing, maintaining, expanding, and optimizing our data infrastructure for data collection, management, transformation, and access. A key priority of this role will be to assist in SDCP’s development of centralizing its data eco-system to allow for creation of pipelines that convert raw data into usable formats for data analysts and other data consumers to utilize. The Data Engineer will handle the core data aspects of software engineering and data science and utilize software engineering principles to develop algorithms that automate the data flow process. They will collaborate with data and system analysts to build machine learning and analytics infrastructure from testing to deployment. 

WHO IS SAN DIEGO COMMUNITY POWER?

San Diego Community Power is a community-driven, not-for-profit public agency providing cleaner energy to the San Diego region. Formed in 2019, Community Power is the second largest Community Choice Aggregator (CCA) in California, serving nearly 1 million customer accounts across its member agencies: the Cities of San Diego, Chula Vista, Encinitas, Imperial Beach, La Mesa and National City, as well as the unincorporated areas of San Diego County.  

OUR HISTORY

San Diego Community Power was formed in 2019 as a public, not-for-profit community choice aggregator (CCA) in the San Diego region. We began electric service in 2021 and serve five member agencies: San Diego, Chula Vista, Encinitas, La Mesa and Imperial Beach, County of San Diego, and National City. SDCP was formed to bring local control and customer choice to San Diego while also providing clean and renewable energy at competitive rates. By the end of 2023, SDCP will provide electricity for nearly half the electric load in San Diego Gas and Electric’s service territory and will be the second largest CCA in California. For more information, please visit SDCommunityPower.org.

COMMITMENT TO DIVERSITY

At SDCP, we value diversity and are committed to creating an inclusive environment for all employees. We represent a diverse customer base and hope to hire employees that reflect our communities. We provide equal employment opportunities to all applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. 

ESSENTIAL DUTIES AND PRIMARY RESPONSIBILITES

• Building and maintaining a centralized cloud-based data infrastructure for optimal extraction, transformation, and loading of data from a wide variety of sources. 
• Assemble large, complex data sets that meet functional/non-functional business requirements. 
• Developing data tools and APIs for data analysis. 
• Deploying and monitoring machine learning algorithms and statistical methods in production environments to solve organizational needs. 
• Ensuring data accessibility and security and implementing company data policies regarding data privacy and confidentiality. 
• Improving data systems reliability, speed, and performance. 
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer trends, operational efficiency, and other key business performance metrics. 
• Collaborating with other internal teams, data analysts, and other stakeholders to understand and optimize how data can be leveraged to meet business needs. 
• Assist in drafting data and analytics’ solicitations and in the selection of consultants. 
• Assist with drafting staff reports and presentations for Board and Committee meetings. 
• Performs other related duties and responsibilities as required. 

MINIMUM KNOWLEDGE, SKILLS, AND ABILITES

• Advance working knowledge of SQL, experience working with relational databases, query authoring (SQL) and working familiarity with various databases. 
• Demonstrated experience in developing API and integrations to support analytics in cloud environment. 
• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets. 

• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. 
• Strong analytic skills related to working with unstructured datasets. 
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management. 
• A successful history of manipulating, processing, and extracting value from large, disconnected datasets. 
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores. 
• Good understanding of data architecture, data design, data warehousing and data modeling concepts. 
• Strong project management and organizational skills. 
• Experience supporting and working with cross-functional teams in a dynamic environment. 

PREFERRED KNOWLEDGE, SKILLS, AND ABILITES

• Experience in the energy sector and/or supporting the implementation of programs funded by California state agencies (e.g., California Public Utilities Commission, California Energy Commission, California Air Resources Board).
• Ability to strongly represent the organization in various professional engagement settings from local to national convenings (conferences, workshops, executive meetings, etc.).

PREFERRED QUALIFICATIONS, EDUCATION AND EXPERIENCE

Minimum of two (2) to three (3) years of professional experience in a Data Engineer role, preferably in the energy industry with a graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. The candidate should also have experience using the following software/tools:

• Experience with big data tools: Hadoop, Spark, PowerBI, Kafka, etc.
• Experience with AWS, Azure and Google Cloud services.
• Experience with relational SQL and NoSQL databases.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with open-source technologies: Python, Pytorch, Flask, Tensorflow or Keras
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Java, C++ etc.
• Experience with batch, micro-batching and real-time data ingestion methodologies.
• Experience with GitHub or similar code repositories

WORK ENVIROMENT & CONDITIONS

Prolonged periods sitting at a desk and working on a computer. The position requires occasional carrying, lifting and/or moving objects up to 25 pounds. Occasional local travel required and reliable transportation to be able to attend SDCP events, meetings, and workshops as needed is expected. At SDCP we work in the communities we serve and in the office. SDCP works to ensure a safe and healthy workplace for employees and in our communities. SDCP requires employees to be fully vaccinated for COVID-19. SDCP is an agency required to adopt and promulgate a Conflict-of-Interest Code (“COI”). The COI code requires employees in designated positions, including those identified under the interim disclosure process to file a Statement of Economic Interests (Form 700) on an annual basis. A Successful candidate accepting this position may be required to file Conflict of Interest forms subject to the regulations of the Fair Political Practices Commission.

COMPENSATION: 

Salary Range: The position salary range is: $84,900 - $110,400; with exact compensation to be determined by SDCP, depending upon experience. 

Benefits: Standard benefits package including but not limited to:

Insurance: SDCP offers group health benefits, including medical, vision, and dental insurance, for eligible FT employees. Also provided is a $100,000 Life & AD&D policy, STD and LTD coverage that is 100% paid by SDCP.

Retirement: SDCP offers a 457(b) plan for employee contributions and contributes 10% of eligible compensation to the employee’s Money Purchase Plan.

Paid Time Off: 11 holidays per year + paid winter holiday (between 12/24-12/31), 160 hours of accrued paid time off per year (increases with time in service), and 96 hours per year of accrued paid sick leave.

This job description may not be inclusive of all assigned duties, responsibilities, or aspects of the job described, and may be amended at the discretion of SDCP as needed. 

Brain Corp is a San Diego, California, USA-based AI company creating transformative core technology for the robotics industry. Our purpose is to create autonomous technology that helps the real world work better. Brain's robotic and AI solutions help retailers ensure that the right product is on the right shelf at the right price, in a clean environment. Through the BrainOS® Robotics Platform, which powers the largest global fleet of the Autonomous Mobile Robots (AMRs) in operation in commercial public spaces, Brain Corp delivers insightful and efficient automated solutions in both commercial floor cleaning and inventory management, empowering organizations and their employees to achieve more. Brain Corp currently powers more than 30,000 AMRs, representing the largest fleet of its kind in the world. Brain Corp is funded by the SoftBank Vision Fund, Clearbridge, and Qualcomm Ventures.

Named a top workplace by the San Diego Union Tribune and USA today in 2025, we make life-changing impacts through innovation, helping workers globally unlock their abilities in orchestration with intelligent machines.

Position Overview:

As a member of our Software Engineering team, the Software Engineer II, Data Engineering will play a key role in designing and maintaining the data infrastructure that powers the BrainOS platform. This role requires a solid foundation in data engineering concepts and technologies; with experience in building scalable data pipelines and ensuring the integrity and performance of data systems. The Software Engineer II, Data Engineering will work independently on mid-sized projects and collaborate with senior engineers to tackle larger initiatives.

Essential Job Functions:

• Design and Develop Data Pipelines: Implement robust, scalable pipelines for processing structured and unstructured data
• Data Architecture & Modeling: Contribute to the design of complex data models and optimize storage solutions in support of engineering and business objectives
• Optimize Performance and Scalability: Enhance the efficiency and scalability of data pipelines and storage systems by identifying bottlenecks, and configuring cluster resources
• Collaborate and Support: Collaborate with data analysts, data scientists, and other business teams to support data-related technical issues and support their data infrastructure needs
• Data Security & Compliance: Implement security best practices, including encryption and access control policies, while maintaining data integrity and compliance with quality standards
• Incident Management: Monitor and troubleshoot data pipeline failures and reliability issues

Education and/or Work Experience Requirements:

• BS or MS in Computer Science or applicable engineering discipline
• 2-5 years of proven software development experience, with at least 2 of those years focused on data engineering

Required Knowledge, Skills, Abilities, and Other Characteristics:

• Proficiency in SQL as well as one or more programming languages (Python, Go, or TypeScript)
• Experience with data warehousing (BigQuery, Snowflake, Firestore, MySQL, PostgreSQL)
• Familiarity with stream processing frameworks (Apache Beam, Pub/Sub, Spark Streaming)
• Understanding of data governance, security, and compliance best practices
• Strong problem-solving skills and ability to work independently on projects
• Familiarity using Generative AI tools to enhance development workflows, such as code generation, data exploration, and documentation support
• Effective communication skills demonstrated by effective written and verbal communication; with an ability to articulate technical concepts to both technical and non-technical stakeholders

Things that make a difference:

• Experience with machine learning models and data science methodologies
• Experience with Google Cloud and their data ecosystem
• Familiarity with BI tools (e.g., Tableau, Power BI) and data frameworks (e.g., Hadoop, Spark)
• Experience with infrastructure as code (e.g., Terraform, Pulumi) and containerization and orchestration tools (e.g., Docker, Kubernetes)

Physical Demands:

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Essential functions may require maintaining the physical condition necessary for sitting, walking or standing for periods of time; operating a computer and keyboard; use of hands to finger and grasp; talk and hear at normal room levels; visual acuity to determine the accuracy, neatness, and thoroughness of the work assigned or to make general observations of facilities or structures; push or pull up to 20 pounds.

Work Environment:

The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. The noise level in the work environment is usually quiet to moderate. Employees are exposed to the typical office environment with computers, printers and telephones.

Salary Range:

The anticipated salary range for candidates who will work in San Diego, California is $130,000. The final salary offered to a successful candidate will be dependent on several factors that may include but are not limited to the type and length of experience within the job, type and length of experience within the industry, education, etc. Brain Corp is a multi-state employer and this salary range may not reflect positions that work in other states.

About SHEIN 

SHEIN is a global online fashion and lifestyle retailer, offering SHEIN branded apparel and products from a global network of vendors, all at affordable prices. Headquartered in Singapore, with more than 15,000 employees operating from offices around the world, SHEIN is committed to making the beauty of fashion accessible to all, promoting its industry-leading, on-demand production methodology, for a smarter, future-ready industry. 

Position Summary 

We are seeking a Senior Site Reliability Engineer (Official Title: Senior Site Reliability Engineer I) with deep experience operating and evolving large-scale, mission-critical systems where availability and reliability are non-negotiable. At SHEIN, Site Reliability Engineers are hybrid software and systems engineers responsible for keeping production services always on while enabling the platform to scale rapidly and safely. In this role, you will own and support complex services and infrastructure, ensuring they consistently meet reliability and performance expectations. The SRE team owns and maintains critical open-source and in-house technologies that underpin the platform and serves as a core contributor to major engineering initiatives. We are accountable for driving platform operability forward by reducing incident frequency, minimizing MTTR, and improving system resilience, efficiency, and resource utilization. You will work closely with global, cross-functional teams to design, build, and evolve observability and operational tooling—including metrics, logs, traces, alerting, and automation—providing deep visibility into system behavior. Through hands-on engineering and operational excellence, you will proactively identify risks and failure modes, help prevent incidents before they occur, and lead fast, effective responses when they do. To succeed in this role, you will combine strong software engineering skills, solid to deep expertise in Linux, networking, and distributed systems, and a passion for solving problems of scale, complexity, and reliability. Your work will directly contribute to delivering a stable, scalable, and high-performing experience for customers worldwide.

 Job Responsibilities 

• Keep SHEIN’s mission-critical production systems running 24/7/365, participating in on-call rotations and acting decisively during incidents. 
• Triage and resolve production incidents, leveraging AI-assisted log analysis and anomaly detection to accelerate root cause identification; drive continuous improvements that reduce MTTR and prevent recurrence.
• Monitor and manage capacity planning and resource utilization, partnering with cross-functional teams to ensure systems scale safely while remaining cost-effective.
• Own and operate core open-source infrastructure such as APISIX, Nginx, Kubernetes, Kafka, Elasticsearch, Redis, Consul, Etcd, Zookeeper and other large-scale distributed systems.
• Design, build, and maintain observability solutions (metrics, logs, traces, alerting), incorporating AI-powered anomaly detection and intelligent alert correlation to surface actionable signals from high-volume telemetry, improving system visibility and resiliency.
• Automate operational workflows and eliminate manual toil through scripting, tooling, and process improvements, including the use of AI-assisted development tools (e.g., Claude Code) to accelerate the building and iteration of internal operational platforms.
• Develop and maintain technical documentation, including runbooks, architecture diagrams, operational procedures, and on-call playbooks.
• Work closely with global engineering teams to improve infrastructure reliability and performance through better system design and operational discipline.

 Job Requirements 

• Bachelor’s degree in Computer Science, Information Systems, or a related technical discipline, or equivalent practical experience. 
• 3+ years of experience owning and operating large-scale, high-traffic, 24/7 production systems, ideally in cloud or cloud-native environments. 
• Solid foundations in Linux, networking, and distributed systems, with the ability to debug complex production issues end to end.
• Hands-on experience with incident response, troubleshooting, and performance optimization in distributed systems.
• Experience applying AI/LLM-powered tools to reliability engineering, including designing and building automation or internal tools using AI-assisted development tools (e.g., Claude Code).
• Strong software engineering skills with experience building automation, tooling, or platforms in languages such as Python or Go. 
• Experience operating or supporting open-source infrastructure components such as APISIX, Nginx, Kubernetes, Kafka, Elasticsearch, Redis, Consul, Etcd, Zookeeper, etc.
• Experience with observability and monitoring systems (Prometheus, Grafana, Zabbix, etc.) and performance analysis.
• Familiarity with Git, CI/CD pipelines, and configuration management tools (e.g., Ansible).
• A strong sense of ownership, a systematic approach to problem-solving, and a passion for making systems more reliable.
• Strong communication skills and the ability to collaborate effectively with geographically distributed teams.

 Nice to Have 

• Bilingual fluency in Mandarin and English.
• Kubernetes Administrator certification or equivalent real-world experience.
• Experience operating big data platforms (Hadoop, Yarn, HBase, Hive, Spark).
• Experience applying AI/LLM-powered tools to reliability engineering, including designing and building automation or internal tools using AI-assisted development platforms (e.g., Claude Code).

Benefits and Perks 

• Bonus eligible
• Healthcare (medical, dental, vision, prescription drugs) 
• Health Savings Account with Employer Funding 
• Flexible Spending Accounts (Healthcare and Dependent care) 
• Company-Paid Basic Life/AD&D insurance 
• Company-Paid Short-Term and Long-Term Disability 
• Voluntary Benefit Offerings (Voluntary Life/AD&D, Hospital Indemnity, Critical Illness, and Accident) 
• Employee Assistance Program 
• Business Travel Accident Insurance 
• 401(k) Savings Plan with discretionary company match and access to a financial advisor  
• Vacation, paid holidays, floating holiday and sick days   
• Employee discounts 
• Free weekly catered lunch 
• Dog-friendly office (available at select locations) 
• Free gym access (available at select locations) 
• Free swag giveaways 
• Annual Holiday Party 
• Invitations to pop-ups and other company events 
• Complimentary daily office snacks and beverages

#LI-ED1

About SHEIN 

SHEIN is a global online fashion and lifestyle retailer, offering SHEIN branded apparel and products from a global network of vendors, all at affordable prices. Headquartered in Singapore, with more than 15,000 employees operating from offices around the world, SHEIN is committed to making the beauty of fashion accessible to all, promoting its industry-leading, on-demand production methodology, for a smarter, future-ready industry. 

Position Summary 

We are seeking a Staff Site Reliability Engineer (Official Title: Staff Site Reliability Engineer I) with deep experience operating and evolving large-scale, mission-critical systems where availability and reliability are non-negotiable.

At SHEIN, Site Reliability Engineers are hybrid software and systems engineers responsible for keeping production services always on while enabling the platform to scale rapidly and safely. In this role, you will own and support complex services and infrastructure, ensuring they consistently meet reliability and performance expectations.  At the Staff level, you will also provide technical leadership, influencing platform architecture, reliability strategy, and operational standards across the organization.

 The SRE team owns and maintains critical open-source and in-house technologies that underpin the platform and serves as a core contributor to major engineering initiatives. We are accountable for driving platform operability forward by reducing incident frequency, minimizing MTTR, and improving system resilience, efficiency, and resource utilization.

You will work closely with global, cross-functional teams to design, build, and evolve observability and operational tooling—including metrics, logs, traces, alerting, and automation—providing deep visibility into system behavior. Through hands-on engineering and operational excellence, you will proactively identify risks and failure modes, help prevent incidents before they occur, and lead fast, effective responses when they do. To succeed in this role, you will combine strong software engineering skills, solid to deep expertise in Linux, networking, and distributed systems, and a passion for solving problems of scale, complexity, and reliability. Your work will directly contribute to delivering a stable, scalable, and high-performing experience for customers worldwide.

 Job Responsibilities 

• Keep SHEIN’s mission-critical production systems running 24/7/365, participating in on-call rotations and acting decisively during incidents. 
• Triage and resolve production incidents, leveraging AI-assisted log analysis and anomaly detection to accelerate root cause identification; drive continuous improvements that reduce MTTR and prevent recurrence.
• Monitor and manage capacity planning and resource utilization, partnering with cross-functional teams to ensure systems scale safely while remaining cost-effective.
• Own and operate core open-source infrastructure such as APISIX, Nginx, Kubernetes, Kafka, Elasticsearch, Redis, Consul, Etcd, Zookeeper and other large-scale distributed systems.
• Design, build, and maintain observability solutions (metrics, logs, traces, alerting), incorporating AI-powered anomaly detection and intelligent alert correlation to surface actionable signals from high-volume telemetry, improving system visibility and resiliency.
• Automate operational workflows and eliminate manual toil through scripting, tooling, and process improvements, including the use of AI-assisted development tools (e.g., Claude Code) to accelerate the building and iteration of internal operational platforms.
• Develop and maintain technical documentation, including runbooks, architecture diagrams, operational procedures, and on-call playbooks.
• Work closely with global engineering teams to improve infrastructure reliability and performance through better system design and operational discipline.
• Mentor Senior and mid-level SREs, raising the overall technical bar and operational maturity of the team.
• Lead efforts to modernize the platform in alignment with industry best practices and evolving technology standards.

 Job Requirements 

• Bachelor’s degree in Computer Science, Information Systems, or a related technical discipline, or equivalent practical experience. 
• 6+ years of experience owning and operating large-scale, high-traffic, 24/7 production systems, ideally in cloud or cloud-native environments.
• Experience applying AI/LLM-powered tools to reliability engineering, including designing and building automation or internal tools using AI-assisted development tools (e.g., Claude Code).
• Solid foundations in Linux, networking, and distributed systems, with the ability to debug complex production issues end to end.
• Hands-on experience with incident response, troubleshooting, and performance optimization in distributed systems.
• Strong software engineering skills with experience building automation, tooling, or platforms in languages such as Python or Go.
• Experience operating or supporting open-source infrastructure components such as APISIX, Nginx, Kubernetes, Kafka, Elasticsearch, Redis, Consul, Etcd, Zookeeper, etc.
• Experience with observability and monitoring systems (Prometheus, Grafana, Zabbix, etc.) and performance analysis.
• Familiarity with Git, CI/CD pipelines, and configuration management tools (e.g., Ansible).
• A strong sense of ownership, a systematic approach to problem-solving, and a passion for making systems more reliable.
• Strong communication skills and the ability to collaborate effectively with geographically distributed teams.

 Nice to Have 

• Bilingual fluency in Mandarin and English.
• Kubernetes Administrator certification or equivalent real-world experience.
• Experience operating big data platforms (Hadoop, Yarn, HBase, Hive, Spark).
• Experience applying AI/LLM-powered tools to reliability engineering, including designing and building automation or internal tools using AI-assisted development platforms (e.g., Claude Code).

Benefits and Perks 

• Bonus and RSU eligible
• Healthcare (medical, dental, vision, prescription drugs) 
• Health Savings Account with Employer Funding 
• Flexible Spending Accounts (Healthcare and Dependent care) 
• Company-Paid Basic Life/AD&D insurance 
• Company-Paid Short-Term and Long-Term Disability 
• Voluntary Benefit Offerings (Voluntary Life/AD&D, Hospital Indemnity, Critical Illness, and Accident) 
• Employee Assistance Program 
• Business Travel Accident Insurance 
• 401(k) Savings Plan with discretionary company match and access to a financial advisor  
• Vacation, paid holidays, floating holiday and sick days   
• Employee discounts 
• Free weekly catered lunch 
• Dog-friendly office (available at select locations) 
• Free gym access (available at select locations) 
• Free swag giveaways 
• Annual Holiday Party 
• Invitations to pop-ups and other company events 
• Complimentary daily office snacks and beverages

#LI-ED1