About the Role
Data Ingestion and Integration:
- Design and implement efficient data ingestion processes from various data sources into the Azure data platform.
- Collaborate with cross-functional teams to understand data requirements and ensure data quality and reliability during the ingestion process.
Data Validation and Transformation (ETL):
- Develop robust data validation and transformation workflows (ETL) to ensure data integrity and consistency.
- Utilize Azure Data Factory, Apache Airflow, and other relevant tools to orchestrate complex data workflows.
Data Governance and Compliance:
- Implement data governance practices to ensure data security, privacy, and compliance with industry regulations and company policies.
- Collaborate with the data governance team to enforce data quality standards and data lineage tracking.
Data Analysis and Reporting:
- Work closely with data analysts and data scientists to support data analysis initiatives and create actionable insights from the data platform.
- Develop data models and structures optimized for analytical and reporting purposes.
Azure Data Platform Management:
- Manage and optimize the Azure data platform, including Azure Synapse, Azure Data Lake Store Gen 2, CosmosDB, and other components.
- Utilize Apache Airflow for workflow scheduling, monitoring, and orchestration.
Data Architecture and Strategy:
- Contribute to the data platform's strategy and architecture, ensuring scalability, flexibility, and alignment with business objectives.
- Participate in design discussions and provide technical expertise to guide data-related decisions.
Documentation and Knowledge Sharing:
- Maintain comprehensive documentation of data processes, architecture, and solutions.
- Share knowledge and best practices with team members to foster a collaborative and learning-oriented culture.
5+ years of proven experience as a Data Engineer, with a strong focus on modern big data activities and Azure data technologies.
5+ years of hands-on experience with Azure Data Catalog/Purview, Azure Data Factory, Azure Synapse, Azure Data Explorer, Azure Data Lake Store Gen 2, CosmosDB, and other relevant Azure data services.
Proficiency in Apache Airflow for workflow management and orchestration.
Solid understanding of data modeling, data warehousing, and ETL concepts.
Familiarity with data governance principles and practices.
Proficiency in SQL and scripting languages (e.g., Python, PowerShell) for data manipulation and automation.
Experience working with large-scale data processing and distributed computing frameworks is a plus.
Strong problem-solving and analytical skills with an attention to detail.
Excellent communication and collaboration skills to work effectively with cross-functional teams.
About the Company
Futluz Tech (https://futluz.com) is a Web Engineering Expertise. We are a team of professionals who are passionate about web technologies. We are reputed for our expertise in developing new and innovative ways to use technology to support our customers in their businesses. We extend the existing teams of Fortune 500 companies and also become the product development shop for startups. Established in 2012, we empower the talent to explore their fullest potential with creative and challenging full-stack development opportunities. Rest assured of above-industry CTC, family health insurance, food allowance, provident fund and yearly bonus.