itD Tech

Compensation

Full Description

itD is seeking a Software Engineer to design and scale the data pipelines that power next-generation foundation models for machine-generated data, including time series, logs, and large-scale event streams. This role contributes directly to the success of model training and production systems by enabling reliable, high-performance data infrastructure at scale. The ideal candidate will bring deep experience in distributed systems and data engineering, along with a proven track record of delivering scalable, production-ready data pipelines that support machine learning workflows. Location: Remote (U.S.-based; time zone alignment with Pacific or Central preferred) We provide comprehensive medical benefits, a 401(k) plan, paid holidays, and more. Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship. Responsibilities: Build and scale distributed data pipelines for large-scale time series, log data, and high-volume event streams. Design and maintain reliable, high-performance Spark and Python workflows to support model training datasets. Analyze and resolve performance bottlenecks related to latency, memory utilization, data skew, and throughput. Improve data quality, validation processes, and reproducibility for machine learning workloads. Partner with machine learning engineers and researchers to accelerate foundation model development. Measure and optimize application and transaction performance in production data systems. Collaborate cross-functionally to ensure data infrastructure aligns with evolving research and product needs. Internal Responsibilities: Attend regular internal practice community meetings. Collaborate with your itD practice team on industry thought leadership. Complete client case studies and learning material (blogs, media material). Build out material to contribute to the Digital Transformation practice. Attend internal itD networking events (in person and virtual). Work with leadership on career fast-track opportunities. Required Qualifications and Skills: 5+ years of software engineering experience. Strong proficiency in Python. Hands-on experience with Apache Spark (PySpark or Scala). Experience building large-scale data pipelines in distributed environments. Experience working with time series data, logs, or high-volume event streams. Strong debugging skills and experience with performance optimization in distributed systems. Preferred Qualifications and Skills: Experience supporting machine learning or large model training workflows. Familiarity with sequence modeling or time series data systems. Experience with streaming systems such as Kafka or Spark Streaming. Experience with cloud-native or Kubernetes-based platforms. Cisco experience a plus Education: Bachelor’s degree in a relevant field or equivalent work experience required. Company Description About itD: We are part of a new generation of consulting and software development company that blends diversity, innovation, and integrity with real business results. Our structure rejects any strong hierarchy, empowering us to deliver excellent results. We are a woman- and minority-led firm. Every day, we challenge ourselves to be considerate, fair and to re-think what great outcomes mean for our customers. This permeates down to how we approach every interaction, on every project, for every client. You’ll thrive here if you are a dynamic self-starter, a difference-maker or someone who wants to deliver great results, without constraints. The itD Digital Experience: Joining us means you’ll be part of our global community, you have a say about your own career journey, and you’ll get a chance to give back to causes that matter. You will experience working with Fortune 500 companies and high-performance teams across numerous industries. itD offers our employees excellent benefits such as medical, dental, vision, life insurance, paid holidays, 401K + matching, networking & career learning and development programs. We are growing and we want to see you grow! Visit https://itdtech.com/careers to learn more about what working at itD can mean for you. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law. itD is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the application process, or to perform the essential functions of a position, please contact us at recruiting@itdtech.com and let us know the nature of your request and your contact information. Additional Info Dynamic environment in a culture of respect, empowerment and recognition for a job well done, apply today!