Be part of the Technoperia community.
Senior Data Engineer (Databricks / Spark)
We’re expanding our data team and looking for a Senior Data Engineer to design, build, and optimize scalable data platforms using modern data technologies.
The role focuses on building robust data architectures within the Databricks ecosystem, including advanced data pipelines, governance frameworks, and integration with external data systems. You will play a key role in transforming complex data into reliable, high-performance solutions that support analytics, AI, and business decision-making.
You’ll work closely with engineering, product, and AI teams to design data systems, enable real-time and batch processing, and ensure data is accessible, secure, and production-ready.
Location: Hybrid
Company: Technoperia
Engagement: Full-time
Minimum Requirements
• 5+ years of professional experience in data engineering or a related role• Strong proficiency in Apache Spark (SQL, Python, or Scala)• Hands-on experience with the Databricks platform and ecosystem• Experience with Unity Catalog for data governance and access control• Experience designing and managing Databricks Workflows• Practical experience working with Databricks Feature Store• Strong understanding of Databricks control plane and data plane architecture• Experience provisioning and managing data workspaces with structured schemas and catalogs• Hands-on experience with data integration using APIs, agents, or modern connectors• Experience with Delta Sharing, Data Federation, or MCP-based connectors• Solid understanding of data governance, RBAC, and multi-tenancy architectures• Experience building scalable data ingestion pipelines (batch and streaming)• Strong problem-solving skills and ability to design scalable data solutions• Comfortable collaborating in cross-functional teams and communicating technical concepts clearly
Nice to Have
• Experience designing or working with RAG (Retrieval-Augmented Generation) data pipelines• Understanding of parsing, chunking, embeddings, and metadata management• Experience building Text-to-SQL (Text2SQL) or “talk to your data” systems• Familiarity with data evaluation and quality frameworks• Experience working with AI/ML data pipelines or supporting AI applications• Exposure to cloud platforms such as AWS, Azure, or GCP• Experience with modern data product architectures and domain-driven design