Contract Remote Bellevue, WA
Lead Data Engineer (ex T-Mobile)
Are you an experienced data engineer particularly strong with building high throughput data pipelines, Vectr, and Cribl? We need someone we can consider a lead data engineer for a long contract supporting a large data engineering initiative for a major enterprise (ex T Mobile environment is a plus).
Job Title: Lead Data Engineer
Location: Remote (Bellevue, WA)
Duration: Long Term
Email: shaheen.p@e-solutionsinc.com
Must have Skills Vectr Cribl Azure Data Factory (ADF) Databricks (PySpark) ETL/ELT Architecture & Development
📝 Job Description (Longest Possible with SEO Detailing)
We need a lead data engineer with working knowledge of Vectr, Cribl, Azure Data Factory (ADF) and Databricks (PySpark) to construct and/or optimize the delivery of robust data analytics pipelines in a high traffic enterprise environment.
The ideal candidate will have prior cumulative experience working with T-Mobile data ecosystems and/or in large environments within the telecom industry.
Your responsibilities
will include managing and overseeing data engineering projects from inception to completion, designing and implementing sophisticated frameworks for data integration, and constructing and maintaining cloud-based ETL and ELT Processes. To facilitate data movement, maintain data integrity, and provide quality data throughout the company, you will partner with various departments.
Key Responsibilities
Build and maintain data pipelines using Azure Data Factory and Data bricks.
* Design and implement workflows for data ingestion, orchestration, and transformation.
* Use Cribl and Vectr for data engineering observability and routing.
* Design `cloud-compliant big data frameworks`.
* Build and maintain frameworks for automation to monitor data pipelines and enhance operational efficiency.
* Collaborate with the DevOps, Cloud, and Analytics Engineering teams to meet the Data Engineering requirements.
* Implement operational best practices for continuous integration and continuous deployment, monitor performance for enhancements, and optimize costs.
* Maintain quality, governance, and compliance with best practices for data engineering.
* Assist junior data engineers work.
Required Technical Skills
Strong relevant experience with Cribl and Vectr.
* Technical expertise on Azure Data Factory (ADF) and Azure Databricks, Proficiency in PySpark, and distributed computing, and parallel ETL pipelines.
* Good understanding in Azure Data Services, and Data Lakes, Delta Lakes, Lakehouse Architecture.
* Experience in designing and implementing scalable data models (real-time and near real-time data ingestion).
* Understanding of API integration, metadata management, orchestration, automation, and workflow.
* Ability to analyze system logs Troubleshoot failures of pipelines, optimized data processing.
Preferred Qualifications
Experience and/or knowledge of T-Mobile enterprise platforms and/or data engineering in telecom domain
* Knowledge of Kusto/KQL, Event Streaming (Kafka), Log Analytics
* Strong knowledge/experience in Cloud Architecture, DevOps and CI/CD
* Excellent analytical and communication and leadership skills
How to Apply
If you or someone you know would be a great fit,
please send a resume to >>>[shaheen.p@e-solutionsinc.com]
