We are seeking a skilled and experienced Solutions Architect to lead the design and implementation of our Databricks project within a cloud computing environment. The ideal candidate will have strong expertise in Databricks, cloud computing, and data engineering. You will work closely with cross-functional teams to create scalable, efficient, and secure solutions that meet business objectives and technical requirements.
Top 3:
10+ years as a Solutions Architect (especially with Cloud Platforms; AWS or Azure)
Experience in Data Engineering/ETL/Data Storage
Aptitude with Databricks and/or AI Projects
Key Responsibilities:
Solution Design and Architecture: Develop comprehensive solution architectures that leverage Databricks and cloud computing technologies to meet business goals and project requirements.
Data Engineering and ETL: Design and optimize data pipelines, ETL processes, and data storage solutions using Databricks and cloud services such as AWS, Azure, or Google Cloud.
Performance Optimization: Monitor and optimize the performance of data processing tasks, databases, and infrastructure within the Databricks platform.
Collaboration and Communication: Work closely with data engineers, data scientists, and cloud architects to ensure seamless integration of Databricks solutions within the broader cloud environment.
Security and Compliance: Implement security best practices and ensure compliance with industry standards and regulations, such as data encryption, access control, and audit logging.
Troubleshooting and Support: Diagnose and resolve issues related to data processing, analytics, and cloud infrastructure within the Databricks environment.
Documentation: Create and maintain detailed documentation of solution architectures, designs, and configurations for reference and team collaboration. Innovation and Best
Practices: Stay up to date with emerging trends and technologies in Databricks, cloud computing, and data engineering. Continuously improve existing solutions and explore innovative approaches.
Preferred Qualifications:
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Proven experience as a Solutions Architect or similar role, with a focus on Databricks and cloud computing projects.
Strong understanding of Databricks, including data engineering, data science, and machine learning capabilities.
Expertise in cloud platforms (e.g., AWS, Azure, Google Cloud) and their services such as data storage, compute, and networking.
Proficiency in programming languages such as Python, R, Scala, and SQL for data processing and analysis. Experience with Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation.
Excellent problem-solving and analytical skills, with a keen attention to detail. Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Relevant certifications (e.g., AWS Certified Solutions Architect, Databricks certifications) are a plus.
Contact: nbielinski@judge.com
This job and many more are available through The Judge Group. Find us on the web at www.judge.com
