Data Solution Architect (Databricks & Application Integration)

Company Description 
Lumen Solutions Group Inc. is a technology consulting Services company based in Florida. We provide a wide array of experienced business and IT professionals supporting clients from solution design to implementation and support. We specialize in professional IT consulting services, IT Staffing, Business/IT Strategy, Business Process Blueprints, Enterprise Architecture, and Enterprise Transformation. 
 
Job Role: Data Solution Architect (Databricks & Application Integration)
Job Location: Washington DC (Remote)
Job Type: Long Term Contract
 
JOB SUMMARY:
We are seeking an experienced Data Solution Architect to lead the strategic architecture, integration, and governance of an enterprise Databricks Lakehouse platform. This is a highly visible architecture role where you will define enterprise standards, design scalable integration frameworks, and serve as the technical authority connecting Databricks with enterprise applications, APIs, and business systems.
 
Key Responsibilities
Solution Architecture & Enterprise Integration

• Design end-to-end solution architectures using Databricks Delta Live Tables (DLT), Structured Streaming, and enterprise orchestration frameworks.
• Architect integrations between the Databricks Lakehouse and downstream enterprise applications, APIs, microservices, and BI platforms.
• Define enterprise data governance, lineage, and quality frameworks using Unity Catalog and DLT Expectations.
• Create scalable architecture blueprints that align business objectives with modern cloud data solutions.

Enterprise Standards & Technical Leadership

• Establish enterprise-wide architectural standards, reusable design patterns, and engineering best practices.
• Develop secure platform frameworks in collaboration with cloud infrastructure and platform engineering teams.
• Lead architecture reviews, provide technical mentorship, and ensure engineering teams follow enterprise architecture principles.

Platform Optimization & DevOps

• Architect performance optimization strategies including:
  • Photon
  • Z-Ordering
  • Liquid Clustering
  • Liquid Partitioning
• Design enterprise CI/CD strategies across Development, Test, Stage, and Production environments.
• Drive Infrastructure-as-Code (IaC) and deployment automation using Azure DevOps, GitHub Actions, Git, and Terraform.
• Optimize cloud performance while maintaining cost efficiency (FinOps).

Required Qualifications

• 8+ years of experience in Solution Architecture or Enterprise Data Architecture.
• Extensive hands-on experience designing enterprise solutions on the Databricks platform.
• Strong expertise with:
  • Databricks
  • Delta Lake
  • Delta Live Tables (DLT)
  • PySpark
  • SQL
  • Structured Streaming
• Deep understanding of Medallion (Bronze, Silver, Gold), dimensional, and relational data modeling.
• Experience designing enterprise CI/CD pipelines and Infrastructure-as-Code using Git, Azure DevOps, GitHub Actions, and Terraform.
• Proven ability to collaborate with engineering teams, infrastructure teams, business stakeholders, and executive leadership.
• Excellent communication, architectural governance, and technical leadership skills.

 
Lumen Solutions Group Inc is an equal opportunity employer. All qualified applicants will be considered for employment without regard to any legally protected status.