VAANI
VEDA
Back to the List
Location
Noida/Nagpur
Employment Type
Experienced Professionals
Experience Level
3-5 Years
Education
B.tech, MCA, BCARole Summary
As a Senior Data Engineer, this position requires deeper skills and hands-on experience on one of the Data management products such as Microsoft Fabric, Snowflake or Databricks. You are expected to assist our clients in conceptualising, implementation and management of Data platforms. Furthermore, it is important to have competencies in Data models and related architectures, visualisation, governance, training AI models and tuning AI applications. Knowledge of creating synthetic data is preferred.
Job Description
- Data Modeling & Architecture: Expertise in designing and developing scalable data models in Snowflake/Databricks, including relational and dimensional principles.
- Data Migration & Pipelines: Proven experience in data platform transformation, migrating data from various sources to Snowflake/Databricks and developing efficient ETL pipelines using SQL, Python, and ETL tools.
- Performance Optimization: Strong skills in performance tuning and optimization for data models, queries, and pipelines, including partitioning and data compression.
- Data Governance: Knowledge of implementing data security, compliance, and governance policies within data solutions.
- Machine Learning (ML): Solid understanding of ML and deep learning algorithms, including data preprocessing, feature engineering, and model evaluation using frameworks like TensorFlow, PyTorch, and Scikit-learn.
- MLOps: Hands-on experience with ML lifecycle management, experiment tracking, and workflow automation using tools like MLflow and Apache Airflow. Experience with MLOps platforms such as AWS SageMaker, Azure ML, Google Vertex AI, or Databricks is a plus.
- Data Storage: Practical experience implementing and managing data lakes with Delta Lake.
- Containerization: Proficiency with Docker for building portable data and ML solutions
- Database Management: Ability to design database objects, monitor performance, and provide technical support.
- SQL Proficiency: Advanced SQL skills for data manipulation and querying in Snowflake/Databricks.
Key Skills
- Data Engineer
- Data Modeling
- Data Architecture
- Performance Optimization
- Data bricks
- Snowflake
- Machine Learning
- MLOps
- SQL
Benefits
- Wellness Program
- Paid time off