Data Engineer in Trivandrum | ITJOBCELL

DATA ENGINEER
  • 0 Applied
  • 34
  • Trivandrum
  • 3 - 5 Years
  • Not disclosed
  • Data Engineer
  • 5 Days ago
Job Description
Brief Description Key Responsibilities Data Pipeline & Lakehouse Engineering Build and maintain scalable ETL/ELT pipelines to ingest data from clinical trial management systems and third-party vendors. Manage and optimize the Databricks Lakehouse architecture, including the implementation of the Medallion Architecture (Bronze, Silver, and Gold layers). Perform expert-level SQL development and performance tuning on SQL Server 2016. Transition legacy batch-processing jobs into modern, event-driven, or request-response API patterns to ensure data is accessed, not copied. API-Centric Integration Development Design and deploy robust APIs that allow our Databricks Lakehouse to consume data directly from Medidata, Salesforce, Workday, Certinia, and NetSuite. Build API endpoints that enable these enterprise systems to query the Lakehouse for real-time clinical insights and financial metrics. Implement Databricks Unity Catalog as the governance layer to manage and secure these cross-system API connections Customer Data Access & Sharing Develop and maintain the API suite used by our customers to access their clinical data. Implement Databricks Delta Sharing to provide customers with secure, direct access to live data tables without the need for traditional ETL or file transfers. Create comprehensive API documentation and developer portals to facilitate seamless data consumption by customer systems. Data Modeling & Analytics Enablement Develop and maintain data models within the lakehouse to support advanced analytics and clinical reporting. Partner with analysts, AI engineers, and data scientists to curate datasets. Data Governance, Quality & Security Assist in the design and implementation of data quality and monitoring solutions. Work within Microsoft Purview to map data lineage across API boundaries, ensuring transparency in how data is accessed across the organization. Ensure all API integrations meet strict security standards, including OAuth2, OpenID Connect, and industry-specific compliance like GxP and HIPAA. Monitor API performance and latency to ensure that data access remains as fast as needed. Create and maintain documentation for data lineage, schemas, and pipeline logic. Required Qualifications Bachelor’s degree in Computer Science, Information Systems, or a related technical field. Must have at least 3-5 years of professional experience in data engineering, data warehousing, or systems integration with a proven track record of proficiency. Strong proficiency in SQL, with specific experience in SQL Server 2016 environments. Hands-on experience with Databricks, including Delta Lake, Unity Catalog, and Delta Sharing. Demonstrated ability to build ETL pipelines using traditional tools (such as SSIS) or modern methods (such as Azure Data Factory, dbt, and/or Lakeflow). Expert-level experience building and consuming RESTful APIs using Python, C#, or Scala. Hands-on experience with the API ecosystems of major platforms including Salesforce, Workday, and NetSuite. Thorough understanding of data modeling principles, including dimensional modeling and relational design. Experience managing data within cloud storage environments like Azure Data Lake. Clear understanding of zero-copy architecture and how to use APIs and data virtualization to provide system-to-system visibility without duplicating underlying datasets. Familiarity with Microsoft Purview and/or Unity Catalog for metadata management.
Skills
Preferred Skills Experience working within the Life Sciences or Clinical Research (CRO) industry. Familiarity with clinical data standards such as CDISC or Medidata. Proficiency in Python for data processing and automation tasks. Experience with version control systems like Git and CI/CD deployment workflows.

Suggested Jobs

Way.com — America’s dominant automotive super app, powering every mile for over 10 million customers—from auto insurance and parking to EV charging and more. Leveraging cutting-edge AI, machine learning, and advanced data analytics, we deliver innovative, personalized solutions that transform car ownership. Featured by Bloomberg and ranked 48th on Andreessen Horowitz’s Marketplace list of fastest-growing companies worldwide and recognized as the top Product in Insurance by UnitQ, we’re making car ownership easier, more affordable, and more rewarding. Job Title: Sr. Node JS and React JS Developer Work Arrangement: On-site Experience : 6 - 9 years Employment Type: Full-time Role Overview We are seeking a Senior Node.js & React.js Developer with strong hands-on experience in building scalable, high-performance web applications. This role requires technical leadership, deep problem-solving skills, and ownership of end-to-end feature delivery while mentoring junior engineers. Key Responsibilities Architect, design, and develop scalable backend services using Node.js Build robust, reusable, and responsive UI components using React.js Own end-to-end development of features from design through production deployment Design and maintain RESTful and microservices-based APIs Ensure application security, performance, scalability, and reliability Conduct code reviews and enforce engineering best practices Mentor junior developers and provide technical guidance Collaborate with Product, UX, QA, and DevOps teams Drive technical decisions and participate in architectural discussions Troubleshoot complex production issues and perform root-cause analysis

Proficiency in Linux,Windows 2008 and 2012, Windows 8, 10 Client OS’s, Apple Macintosh operating systems- yes Network: DNS, WINS, DHCP, TCP/IP, RIP v1/ 2, IGRP, EIGRP, OSPF, Routing, DHCP, Web traffic management, Iptables, squid, Url- yes Filtering, LAN Design and Implementation, WiFi access management, Network issue-yes Knowledge in Web CMS hosting, troubleshooting. security patching will be a plus- Knowledge in Database administration - mysql , sql server Knowledge in Web server Administration: Apache, IIS. Knowledge in configuring Nginx will be a plus Knowledge in Virtualization. Cloud Server Administration and clustering knowledge will be a plus. Version control: Git, Subversion Configure, Troubleshoot Email servers and relays Troubleshooting hardware issues & software issues Provide technical support for both hardware and software issues Securing data in office network Continuous Integration server management Server Security: Hardening, Deny Hosts, Security hardening web servers, CMS update and security .patching. Track all assets inside office Upgrade systems and processes as required for enhanced functionality and security issue resolution

Full Stack Developer (.NET with React JS) Job Description: The primary responsibility will be to develop the different layers of our applications, and to coordinate with the rest of the team working on different layers of the infrastructure. A commitment to collaborative problem solving, sophisticated design, and quality product is essential. • Hands on experience in Microsoft technologies – C#, .NET Core , ASP.NET, MVC, Linq, SQL Server. • Hands on experience in client-side development using React Library. • Familiar with API development using JSON for Mobile and Web. • Hands on experience in designing web application for high performance. • Strong design, coding and debugging skills. • Working knowledge of Microsoft design patterns, development practices, application blocks, tools. • Should be confident, self-driven with a lot of initiative, and should have the zeal and energy to quickly ramp-up on upcoming technologies. • Hands on experience in using AI tools such as Claude, Cursor etc in developing and testing applications using above mentioned technologies.