Databricks Architect

We are proud winners of the Best Place to Work awards in 2025 and 2026. Aviato Consulting, founded by ex-Googlers, specializes in Google Cloud solutions. We combine deep technical expertise with the open, fun engineering culture of Google minus the bureaucracy.

What's in it for you?

• Build the "Next" Tech: Work at the intersection of enterprise big data and cloud innovation, leveraging Databricks alongside advanced Google Cloud data services to build robust, AI-ready data foundations.
• Elite Engineering Culture: Work alongside ex-Googlers and cloud experts. We prioritize clean code, high velocity shipping, and technical excellence over politics.
• Pure GCP Playground: Gain deep access to Google Cloud's modern data and AI ecosystem (BigQuery, Vertex AI, Dataproc) to integrate unified, lakehouse architectures.
• Verified Happiness: Join a team objectively recognized as a "Best Place to Work" for two years running. We take culture as seriously as we take our architecture.
• ESOP: Share in our success with our employee option plan.

Role Description

• Lakehouse Architecture: Lead the end-to-end design and realization of highly scalable enterprise modern data platforms utilizing Databricks on Google Cloud Platform (GCP).
• Unified Data Management: Implement Delta Lake and Unity Catalog architectures to secure, govern, and audit multi-cloud and hybrid data assets seamlessly.
• Data Engineering & Performance Optimization: Design optimized ETL/ELT pipelines using Delta Live Tables (DLT) and fine-tune Photon engine performance to minimize processing latencies.
• Google Cloud Infrastructure Integration: Seamlessly integrate Databricks environments with core Google Cloud components, including Google Cloud Storage (GCS), BigQuery (via BigQuery-Databricks connector), and IAM for granular workspace access management.
• Production Governance: Ensure strict reliability by building Infrastructure as Code (IaC) deployment pipelines using Terraform to spin up workspaces, clusters, and security policies dynamically.
• AI/ML Grounding Foundation: Collaborate with AI teams to design structured feature stores and high-performance data streams that power Retrieval-Augmented Generation (RAG) and downstream Vertex AI models.

What You'll Bring to the Table:

• Proven Databricks Expertise: 3+ years of architectural hands-on experience designing, scaling, and managing enterprise Databricks workspaces.
• Google Cloud Competency: 2+ years of experience engineering data solutions specifically on Google Cloud Platform (GCP).
• Certification Requirement: A relevant Google Cloud Certification (e.g., Professional Data Engineer or Professional Cloud Architect) is a must-have within 1 month of hiring.
• Core Technical Stack: Expert-level skills in PySpark/Spark SQL, Delta Lake, Python or Scala, and writing modular Terraform code.

Bonus Points:

• Official Databricks certifications (Databricks Certified Data Engineer Professional or Databricks Certified Solutions Architect).
• Deep experience migrating heavy on-premises Apache Hadoop infrastructure or legacy data warehouses directly into a Databricks-on-GCP Lakehouse environment.
• Hands-on knowledge of real-time streaming architectures using structured streaming or Pub/Sub.

Our Core Values:

We operate with radical transparency, believe in rigorous teamwork , prioritize continuous excellence and growth, and deliver exceptional value as dedicated client partners.