Azure Databricks Data Engineer (IBM DataStage & SSIS)

Job Type: Full-Time (Long-Term) Location: Remote (Preferred: US Time Zone Overlap) Duration: Long-Term Opportunity About the Role We are seeking an experienced Azure Databricks Data Engineer with a strong background in IBM DataStage, Microsoft SSIS, and modern cloud-based data engineering. This is a long-term, full-time opportunity for someone who can design, migrate, optimize, and support enterprise ETL/ELT data pipelines. Required Skills • 5+ years of experience in Data Engineering • Strong hands-on experience with Azure Databricks • Expert in PySpark and Spark SQL • Experience with Delta Lake, Unity Catalog, and Azure Data Lake Storage (ADLS) • Strong experience with IBM DataStage • Strong experience with Microsoft SSIS • Experience migrating ETL workloads from DataStage and SSIS to Azure Databricks • Advanced SQL development and query optimization • Experience with Azure Data Factory (ADF) • Experience with Git/Azure DevOps and CI/CD • Understanding of data warehousing concepts and dimensional modeling • Strong debugging and performance tuning skills Preferred Skills • Unity Catalog governance and security • Delta Live Tables • Databricks Workflows • Airflow or other orchestration tools • Python scripting • Experience with Oracle, SQL Server, Teradata, or Snowflake • Knowledge of data validation and reconciliation techniques Responsibilities • Design and develop scalable ETL/ELT pipelines in Azure Databricks. • Migrate existing IBM DataStage and SSIS jobs to Azure Databricks. • Optimize Spark workloads for performance and cost. • Build and maintain data ingestion frameworks. • Collaborate with business and technical teams to deliver high-quality data solutions. • Troubleshoot production issues and implement long-term fixes. • Follow best practices for data governance, security, and code quality. Qualifications • Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience). • Excellent communication skills. • Ability to work independently in a remote environment. • Strong problem-solving and analytical skills. Employment Details • Full-Time • Long-Term Project • Competitive compensation based on experience • Immediate start preferred If you have deep expertise in Azure Databricks, IBM DataStage, and SSIS, and are looking for a long-term opportunity with enterprise-scale data engineering projects, we’d love to hear from you.