Manager, Data Platforms
a09b9cc2-0657-474f-81f8-222e68d0e57f
- Employment type
- full_time
- Compensation
- 140000.00 to 160000.00 (USD) Annually
- Source
- adp
TRANSIT TECHNOLOGIES
Job Description
Manager, Data Platforms
Build the trusted data foundation behind better mobility.
About Transit Technologies
At Transit Technologies, we’re transforming the future of mobility.
As a leading provider of enterprise software and technology-enabled services, we help public agencies, universities, healthcare organizations, and private transportation providers deliver safer, smarter, and more efficient mobility solutions. Every day, our technology helps millions of people get where they need to go—from work and school to medical appointments and beyond.
Through our growing portfolio of innovative companies, we’re building one of the industry’s most comprehensive transportation technology platforms. Our solutions improve operational efficiency, enhance rider experiences, strengthen compliance, and help organizations make better data-driven decisions.
We’re growing through innovation, strategic acquisitions, and exceptional customer partnerships. Just as important, we’re building a culture where talented people are empowered to take ownership, collaborate across teams, continuously learn, and make a meaningful impact on the communities we serve.
About the Opportunity
As Data Platforms Manager, you’ll design, build, and operate the data platform that enables Transit Technologies to collect, process, govern, and analyze data across the organization. Databricks is the backbone of our analytics stack, and you’ll work hands-on in the platform every day—building pipelines on a medallion architecture, managing governed access through Unity Catalog, orchestrating workloads with Lakeflow, and delivering trusted datasets for product analytics, business intelligence, operational reporting, and conversational AI.
You’ll partner closely with Product and Engineering teams and help ensure the platform is reliable, well-governed, performant, and cost-conscious. This is a hands-on technical role that combines strong coding and system design with production-level Databricks experience.
Why This Role Matters
Product teams, business partners, and operators need data they can trust to understand performance and make informed decisions. You’ll build and operate the pipelines, governance, and data assets that support analytics across Transit Technologies—from product and business intelligence to operational reporting and conversational AI workflows.
Your work will help make data more dependable, discoverable, and responsibly accessible, while keeping the platform ready to support evolving business and product needs.
What You’ll Do
Build and Orchestrate Production Data Pipelines
Design, develop, and maintain scalable batch and streaming pipelines on Databricks using PySpark, Spark SQL, Delta Lake, and Lakeflow Jobs and Declarative Pipelines.
Ingest data from internal systems, third-party applications, and external sources using Auto Loader, Structured Streaming, Lakehouse Federation, and API- or file-based integrations.
Design medallion-architecture layers and data models that support efficient downstream use in Databricks SQL, BI tools, and agentic workflows.
Build and maintain pipelines with data quality expectations, validation, automated testing, and monitoring.
Govern Data and Protect Its Integrity
Implement and administer Unity Catalog governance, including catalogs and schemas, access controls, lineage, row- and column-level security, and data masking.
Apply data security and compliance best practices to help protect sensitive information and ensure governed access.
Document data architecture, pipelines, and processes so teams can understand, maintain, and responsibly use the platform.
Improve Performance, Reliability, and Cost Efficiency
Monitor data systems, troubleshoot complex pipeline and data issues, and maintain platform availability and performance.
Optimize pipelines, compute, SQL warehouses, and storage for performance, reliability, and cost-efficiency.
Evaluate cluster and SQL warehouse sizing, serverless versus classic compute, Photon, and Delta table optimization approaches such as OPTIMIZE, liquid clustering or Z-ordering, and VACUUM.
Track platform costs and identify opportunities to improve the efficiency of compute and storage.
Strengthen Delivery and Cross-Functional Integration
Apply Git-based CI/CD practices to Databricks development, including Databricks Asset Bundles.
Partner with Engineering teams to integrate product systems with the Databricks platform.
Work closely with Product and other stakeholders to deliver data assets that support analytics, reporting, and conversational AI use cases.
Evaluate new Databricks features and complementary tools, then implement improvements that strengthen platform capabilities.
Who You Are
You’re a hands-on data platform builder who can move between system design, production pipeline work, and cross-functional problem-solving. You value reliable data, thoughtful governance, and clear communication, and you’re comfortable making sound technical decisions as requirements evolve.
Drives Results Relentlessly — you deliver production-ready pipelines and keep working through complex data or reliability issues until they’re resolved.
Owns It — you take responsibility for data assets from design through operation, documentation, monitoring, and follow-through.
Inspires and Elevates Others — you partner generously with Product and Engineering teams, helping them use trusted data to do their best work.
Thinks Critically, Acts Decisively — you evaluate architecture, performance, governance, and cost tradeoffs, then make informed technical decisions.
Communicates with Impact — you explain data architecture, risks, and recommendations clearly to technical partners and business stakeholders.
Obsessed with Growth — you stay curious about Databricks and complementary tools, seek feedback, and continuously improve your technical practice.
Raises the Standard — you build quality, testing, observability, governance, and cost awareness into the platform rather than treating them as afterthoughts.
Coachable — you welcome feedback, adapt as platform needs change, and treat learning as part of strong engineering practice.
What You’ll Bring
Required Qualifications
Bachelor’s degree in Computer Science, Engineering, Data Science, or a related technical field.
At least 4 years of data engineering experience, including at least 2 years of hands-on, production experience with Databricks.
Strong proficiency in PySpark and Spark SQL, including performance tuning for partitioning, joins, shuffles, and skew handling.
Hands-on Delta Lake experience, including ACID transactions, schema evolution, time travel, MERGE and CDC patterns, and table optimization.
Experience designing medallion (bronze/silver/gold) architectures and applying dimensional modeling and data warehouse design principles on a lakehouse.
Experience building and orchestrating pipelines with Databricks Lakeflow Jobs (Workflows) and Lakeflow Declarative Pipelines (Delta Live Tables), including data quality expectations.
Working knowledge of Unity Catalog for governance, lineage, and fine-grained access control, plus an understanding of data security and compliance best practices.
Strong SQL skills, including designing and optimizing complex queries in Databricks SQL.
Experience with at least one major cloud platform—AWS, Azure, or GCP—as it relates to Databricks, including storage, networking, and identity and access management.
Strong problem-solving skills and the ability to debug complex data and pipeline issues.
Excellent communication and collaboration skills.
Preferred Qualifications
Databricks Certified Data Engineer Associate or Professional certification.
A Git repository or personal portfolio demonstrating relevant proficiency.
Experience with Databricks Asset Bundles, Terraform, and CI/CD for data pipelines.
Experience in SaaS, technology solutions, or the transit and transportation industry.
How Success Will Be Measured
Success will be reflected in a data platform that teams can rely on, understand, and use responsibly, including:
Production pipelines are reliable, tested, monitored, and meet agreed data freshness expectations.
Datasets are governed in Unity Catalog with clear ownership, lineage, and appropriate access controls.
Stakeholders have access to reliable data assets they trust.
Databricks compute and storage costs are understood, monitored, and continuously optimized.
Why Join Transit Technologies?
Join a growing transportation technology company where your work supports the services communities rely on. You’ll collaborate across Product and Engineering, build the data foundation for products and operations, and help teams make better use of information that supports mobility.
At Transit Technologies, you’ll have meaningful ownership, opportunities to deepen your platform and data engineering expertise, and the chance to improve how data is governed and used across the organization. If you’re energized by building dependable systems that help people and teams make informed decisions, we’d love to have you help shape what comes next.
Confidentiality
During your employment, you may receive or have access to confidential information. You’ll be expected to respect and protect non-public customer and business records, along with any other information Transit Technologies classifies as confidential.
Transit Technologies is an equal opportunity employer. We value diverse perspectives and are committed to creating an inclusive environment where talented people can do their best work.
Why you should join our team . . .
•At Transit-Technologies, we hire team members who can take initiative and ownership of their role and are dedicated to finding new clients and enhancing the experience of existing ones. Our work is extremely fast paced and never the same from day to day, and our team members appreciate the autonomy to manage their daily workload and contribute to the success of our company. Our sales team members work with amazing software solutions that have a great impact on the transportation industry providing service to their communities every day. Our team members find that the experience they gain helps them grow in their technical expertise and overall sales presentation skills, contributing to their overall professional development.
•Transit-Technology is committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee based on race, color, religion, creed, national origin or ancestry, sex, physical or mental disability, veteran or military status, genetic information, or any other legally recognized protected basis under federal, state, or local laws, regulations, or ordinances.