Sr. Data Engineer - Toro Technology Center India
Responsible for facilitating the capture, ingestion and transformation of data that provides data assets to drive business decisions.
Job Duties & Responsibilities*:
- Lead the design and development of scalable and efficient data pipelines, focusing on data integration, transformation, and loading (ETL) processes.
- Assist in Architecting and maintaining data warehouses, data lakes, and data marts on cloud-based platforms, with a primary focus on Snowflake.
- Mentor and provide technical guidance to junior data engineers, fostering a culture of continuous learning and improvement.
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and ensure data solutions align with business objectives.
- Leverage your deep understanding of the business to identify opportunities where data and analytics can help solve complex problems and drive strategic initiatives.
- Implement data modeling, transformations, and orchestration using dbt to create a unified and reliable data layer.
- Oversee the management and optimization of existing data pipelines, ensuring data quality, performance, and reliability.
- Develop and maintain documentation for data engineering processes, standards, and best practices.
- Proactively identify and address data engineering bottlenecks, performance issues, and data quality challenges.
- Stay current with emerging technologies and industry trends in data engineering and analytics.
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- 8+ years of experience in data engineering, with a proven track record of designing and implementing complex data solutions.
- Strong expertise in data warehousing and cloud-based data platforms, with a focus on Snowflake.
- Proficiency in ETL tools, particularly Fivetran, and experience with data orchestration and transformation using dbt.
- In-depth knowledge of SQL and database design principles.
- Programming skills in Python, Java, or similar languages.
- Experience with version control systems (e.g., Git, Dev Ops) and Agile methodologies.
- Excellent problem-solving skills and the ability to lead and mentor a team.
- Strong communication and collaboration skills, including the ability to work with cross-functional teams and stakeholders.
- Experience with data governance, data security, and compliance best practices.
- Familiarity with data visualization tools like Domo or Power BI.
- Knowledge of distributed computing and big data technologies (e.g., Hadoop, Spark).
- Certification in cloud platforms like AWS, Azure, or Google Cloud.