Responsabilidades e atribuições
Come work for a large global financial and insurance products company!
This is your chance !!
Start a successful career in a renowned company in the international market!
Great opportunity!
Global insurance and asset management company seeks a responsible, organized, dynamic and team-oriented person
- The Senior Data Engineer is responsible for designing, building, and optimizing scalable data platforms and pipelines that support analytics, business intelligence, machine learning (ML), and AI-driven solutions
- This role partners with data scientists, AI engineers, architects, and business stakeholders to deliver trusted, high-quality data products using Databricks, cloud technologies, and modern data engineering practices
- The position also serves as a technical leader in enabling enterprise AI and Generative AI initiatives through robust, secure, and governed data platforms
- Key Responsibilities:Design, develop, and maintain scalable data pipelines and data products using Databricks, Spark, Python, and SQL
- Build and optimize batch, streaming, and real-time data integration solutions from enterprise and third-party data sources
- Implement Databricks Lakehouse architectures utilizing Delta Lake and Medallion design patterns
- Develop and maintain data products that support analytics, predictive modeling, machine learning, and Generative AI applications
- Collaborate with Data Scientists and AI Engineers to prepare, transform, and govern data for AI and ML use cases
- Design and implement feature engineering pipelines and support ML lifecycle processes
- Develop data solutions that support Retrieval Augmented Generation (RAG), vector search, semantic search, and LLM-based applications
- Optimize Spark jobs, SQL workloads, and data processing frameworks for performance, scalability, and cost efficiency
- Implement data quality, observability, lineage, governance, and monitoring capabilities
- Ensure compliance with data privacy, security, and responsible AI standards
- Contribute to CI/CD, Infrastructure-as-Code, and DataOps practices across the data platform
- Mentor junior engineers and promote engineering best practices across the organization