CEdge has an opportunity for a Azure Big Data Specialist. This role is located at Bangalore, Karnataka, India.. If you are ready to work alongside World Renowned Technology experts, and carry the skills below, this is the opportunity that will inevitably take your career to unbelievable levels!
Responsibilities: -
- We are looking for a Data Engineer to join our growing team of analytics experts.
- The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
- The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
- Should have good hands on implementing Incremental/Delta loads.
- Develop and Support activities of development in Projects and Automation solutions for customers
Deliverables Expected: -
The following shall be the deliverables
a. Updated requirements document / Detailed Bug Analysis report
b. Concept document (wherever applicable)
c. Design document (for all features)
d. Test specification document
e. Source code
f. Review report
g. Test report
h. Filled review checklists
i. Traceability matrix
j. User manuals and related artifacts
k. Filled pre-delivery checklist (PDC)
l. Release Note & release mails
Skillset: -
Skills: - Azure SQL/T-SQL, Azure Data Factory, Azure Function apps, Azure Blob, Azure Databricks, Unity Catalog, Microsoft Purview
Responsibilities:
- Overall, 7 – 8 years of experience with a minimum 5+ years of relevant professional work experience
- Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
- Work together with data analysts to understand the needs for data and create effective data workflows.
- Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake
- Utilizing Azure Data Factory to create and maintain ETL (Extract, Transform, Load) operations using ADF pipelines.
- Hands-On Experience working on Data Bricks for implementing Transformations and Delta Lake
- Hands-On Experience working on Serverless SQL Pool, Dedicated SQL Pool(Synapse analytic).
- Use ADF pipelines to orchestrate the end-to-end data transformation including the execution of Data Bricks notebooks.
- Should have experience working on Medallion Architecture
- Experience working on CI/CD pipelines using Azure DevOps
- Attaching both ADF and ADB to DevOps
- Creating and managing Azure infrastructure across the landscape using Bicep
- Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
- Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
- Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.
- Good to have exposure on Power BI, Power Automate
- Good to have knowledge on Azure fundamentals
Desirable skills: -
- Good ability to anticipate issues and formulate remedial actions
- Sound interpersonal and team working skills
- Sound Knowledge of unit testing methodologies and frameworks
- Should be able to work independently
- Good communication skills
WHAT’S IN IT FOR YOU?
WHO ARE WE?
CEdge Software Consultants is an innovative IT consulting firm, and a strategic business partner. We offer IT solutions to Federal and State government, as well as Commercial Enterprises throughout the United States & India. Our main objective is to create an integrity-based culture that takes pride in working as a collaborative team that focuses on growth and is driven by the desire to provide purely ethical services for both our clients and teammates.