Lead Data Engineer
Job Description Summary
COMPANY BACKGROUNDFounded in 1897 and headquartered in Franklin Lakes, New Jersey, Becton Dickinson (BD) is a medical technology company that serves healthcare institutions, life science researchers, clinical laboratories, industry and the general public. BD manufactures and sells a broad range of medical supplies, devices, laboratory equipment and diagnostic products. It employs nearly 65,000 people serving more than 190 countries throughout the world.
The company's customers include healthcare institutions, science researchers, clinical laboratories, the pharmaceutical industry and the general public. BD was one of the first companies to sell U.S.-made glass syringes. It was also a pioneer in the production of hypodermic needles.
Becton Dickinson operates through three worldwide segments:
BD Medical
Medication Management Solutions
Medication and Procedural Solutions
Pharmaceutical Systems
BD Life Sciences
Biosciences
Integrated Diagnostic Solutions
BD Interventional
Peripheral Intervention
Surgery
Urology and Critical Care
BD Core Values
We do what is right
We act in alignment with our Company’s high ethical standards and protect our Company's reputation, always. We are honest and trustworthy. We speak openly when we have concerns or questions.
We are authentic
We remain true to our Values. We are humble, sincere, transparent and explicit in our intentions. We serve others and guide them to a shared purpose.
We are all accountable
We take personal ownership and responsibility for BD decisions, actions and outcomes, and reliably deliver on personal and professional commitments.
We improve every day
We continuously raise the bar. We relentlessly improve our ideas, products, solutions, services, and processes, to drive the transformation of healthcare, globally. We are curious and never stop learning.
We help each other be great
We support and respect one another, challenge ideas, embrace feedback and work together for the good of our customers, the Company and patients.
Job Description
Position Summary
- 7 years of experience working in data engineering role.
- Expertise in Databricks, with hand-on experience in data transformation using PySpark and Spark SQL.
- In-depth knowledge on Azure Data Factory, Azure Data Lake, Delta Lake, Azure SQL, Azure Blob Storage.
- Comprehensive understanding of ETL and big data principles, including Hive and the Spark framework.
- Experience in troubleshooting and optimizing Spark on Databricks.
- Apply medallion architecture to design and develop data warehouses that support efficient analytics. Ensure data is organized, clean, and easily accessible for reporting purposes.
- Experience with developing solutions on cloud computing services and infrastructure in the data and analytics space.
- Hand-on experience with various file formats, including CSV, JSON, XML, XLS and PARQUET.
- Ability to formulate complex SQL queries and a solid grasp of Data Warehouse principles.
- Knowledge with DevOps and Agile project methodologies, with the ability to implement requirements using Databricks and Azure Data Factory.
- Experience in version control systems such as Git/Bitbucket.
- Familiarity with SAP, MS Azure, and Power BI is a plus.
- Strong work ethic, flexibility to changes in work direction as the project develops and ability to work at an abstract level and gain consensus.
- Passionate about Agile software processes, data-driven development, reliability, and experimentation.
- Self-motivated with strong problem-solving and learning skills.
- Excellent communication, listening, and influencing skills.
- Experience working on a collaborative Agile product team.
Educational Background
- Bachelor’s in information technology or computer science
- 7-12 Years
Job Responsibilities
- Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL and Data Engineering principles and business goals.
- Work with Data Engineering Technical and Functional Lead, SMEs and Business Stakeholders to Provide Data & Analytics solution and support by leveraging Data Engineering standards and guidelines using Azure Databricks and ADF.
- Solve complex data problems to deliver insights that helps the organization's business to achieve their goals.
- Create data products for analytics and data scientist team members to improve their productivity.
- Design the solutions for multiple large data warehouses in Azure cloud environment utilizing the parallel architecture and appropriate technology stack.
- Perform various proof of concepts to test the ideas and technology capabilities and subsequently drives these concepts into real solutions.
- Work with various business units to identify the requirements and build corresponding data models and data pipelines.
- Advise, consult, mentor and coach other data and analytic professionals on data standards and practices.
- Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
- Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering to improve the organization's productivity as a team.
- Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
- ETL and SQL
- Databricks, Azure Data Factory.
- GIT/Bitbucket
- Power BI or similar reporting tool.
- Critical Thinking Skills
- Behavioural Skills
- Soft Skills
- Leadership Skills
Desired / Additional Skills & Knowledge (Not essential to the job but will be an advantage to possess)
- Working experience on Microsoft Azure cloud platform
- Power BI
Any additional Information (Specially if needed for Quality or legal purposes)
Required Skills
Optional Skills
.
Primary Work Location
IND Bengaluru - Technology CampusAdditional Locations
Work Shift
Recommendto a friend
Approveof CEO
"Purpose driven company where associates work every day to make healthcare better. A lot of great initiatives going on to make BD the best MedTech company in the world."
Anonymous, Franklin Lakes, NJ