Our Course

DATA ENGINEERING

ABOUT THIS COURSE

Course Description: Data Engineering

Overview: In our Data Engineering course, we equip students with the essential skills and knowledge to design, build, and maintain robust data systems. As data continues to drive decision-making in organizations, understanding how to manage and optimize data pipelines is critical.

Teaching Approach: Our course blends theoretical foundations with hands-on experience, fostering a comprehensive learning environment. We employ a mix of lectures, practical workshops, and real-world projects to ensure students can apply their skills effectively.

THE COURSE INCLUDE

CURRICULUM

  • Overview of Data Science 🌐
  • Key Roles & Responsibilities 🧑‍💼
  • Essential Tools & Technologies 🛠️.
  • Career Path in Data Science Fields 🤑
  • Roles in Data Science Field.

Introduction to SQL

  • What is DBMS and RDBMS, difference between them and why do we need to know these fundamentals
  • What is Normalization, types of norm forms and when to use what
  • What are different keys in RDBMS
  • What are different types of schemas

Creating Database

  • Create a Database in MySQL
  • SQL Data Types
  • Create Table in SQL
  • SQL INSERT INTO Statement
  • SQL UPDATE Query - SQL UPDATE Statement

Clauses in SQL

  • SQL Query Execution Order
  • From Clause in SQL
  • SQL WHERE Clause
  • SQL GROUP BY
  • SQL HAVING Clause
  • ORDER BY in SQL
  • SQL Aliases

Filtering in SQL

  • SQL Operators
  • AND & OR Operators in SQL
  • Not Equal in SQL
  • SQL BETWEEN Operator
  • NULL Value in SQL
  • Case Statements

Joins and Subqueries

  • SQL JOINS (INNER, LEFT, RIGHT, and FULL Join)
  • Self Join in SQL
  • Types of Subqueries

Aggregation and window functions in SQL

  • Aggregate Functions in SQL
  • Group by Multiple Columns in SQL
  • Rank functions (RANK, Dense Rank and Row number)

    SQL Constraints

  • SQL PRIMARY KEY
  • SQL FOREIGN KEY
  • UNIQUE Constraint
  • SQL CHECK Constraint
  • Cascade in SQL

    Advanced Topics

  • Views
  • User defined Function
  • Indexing

Data Types and Variables

  • Integers, Floats, Strings, Booleans
  • Type Conversion
  • Variables and Assignment

Basic Operators

  • Arithmetic Operators
  • Comparison Operators
  • Logical Operators

Control Structures

  • Conditional Statements (if, elif, else)
  • Loops (for, while)
  • break, continue, and pass

Basic Data Structures

  • Lists
  • Tuples
  • Sets
  • Dictionaries

Functions

  • Defining and Calling Functions
  • Arguments and Return Values
  • Local and Global Variables
  • Functions (continued)

Lambda Functions

  • *args and **kwargs
  • Decorators
  • Generators

File Handling

  • Reading and Writing Files
  • Working with Directories
  • Exception Handling during I/O

Error and Exception Handling

  • try, except, finally
            • Custom Exceptions

Module 1:Introduction to Big Data and Cloud Computing 🔍📊

  • What is Big-Data and Types of Data.

  • What is Cloud Computing?

  • Types of Cloud deployment models

    • Private Cloud

    • Public Cloud

    • Hybrid Cloud 

  • Types of Cloud services

    • IaaS – Infrastructure as a Service

    • PaaS – Platform as a Service

    • SaaS – Software as a Service🔄🔢

 

  • Create a Storage account
  • Types of Storage accounts
  • Create a ADLS account
  • Load data to ADLS
  • Read and write Data to ADLS
  • Configure Backup and Disaster Recovery

Module 3: Introduction to Azure 📚💻

  • Create an Azure account
  • Overview of Azure portal.
  • Subscription
  • Resource Group
  • Blob Storage, Data Lake Storage
  • Azure Data Factory
  • Azure Databricks
  • Azure Key Vaults
  • Azure Logic Apps

Module 4: Azure Data Factory

  • Introduction to Azure Data Factory
  • Components of Azure Data Factory
  • Integration Runtime (IR)
  • Azure Auto Integration Runtime
  • Self Hosted Integration Runtime
  • Azure SSIS Integration Runtime
  • Linked Service
  • Datasets
  • Pipelines and Activities in pipelines
  • Copy Data
  • Delete
  • Stored Procedure
  • Get-Metadata
  • Lookup
  • For Each
  • IF Condition, Switch
  • Until
  • Wait
  • Fail
  • Data Flow
  • Set Variable
  • Append Variable
  • Databricks Notebook
  • Execute Pipelines
  • Triggers
  • Schedule Trigger
  • Tumbling Window Trigger
  • Storage Events
  • Parameters in linked servers, datasets, pipelines, Triggers
  • Monitor Jobs
  • Send Failure notifications using Logic Apps
  • Manage credentials using Azure Key Vault
  • Introduction to Spark
  • Overview of Spark Architecture
  • RDD Vs DataFlow Vs Dataset
  • Transformations & Actions 
  • Introduction to DataBricks
  • Create Databricks Workspace
  • Create Clusters
  • Create Databricks Notebooks
  • Databricks File System (DBFS)
  • Create, copy, move les within DBFS 
  • Handle multiple les and folders
  • Archive les in DBFS 
  • Databricks Utilities (dbUtils) 
  • File system
  • Secrets
  • Notebook 
  • Widgets

 

3 Months

90+ Learning Hours

Tool Box

5+ Assured Interviews

Who Should Take this Course?

Graduates and Postgraduates
Fresher’s
Working Professionals
No Prior Knowledge is required

What Are The Roles Can You Apply

See Yourself In One Of These Roles?

Tools & Technologies

THE TEACHER

YUGANDHAR

“I’m Yugandhar, a Data Engineering trainer with 9 years of experience. Teaching the Data Engineering course is a great experience. I enjoy helping students learn how to build and manage data pipelines, work with cloud platforms, and handle big data. My focus is on making complex topics easy to understand, and I love seeing students gain the skills they need to succeed in data engineering.

SUCESS STORIES

R. Kiran

Enrolling in the Data Engineer Course was the best decision I made for my career. The curriculum was well-structured, covering everything from data storage solutions to cloud computing. The hands-on projects were especially helpful in giving me practical experience. I feel confident in my new role, and I’ve already started applying the concepts I learned. Highly recommend it!

Shek Aisha

I have always had an interest in data, but I had no idea where to begin. This course provided me with the ideal foundation, from knowing SQL databases to mastering tools like Apache Spark. The professors were very educated and helpful. The course content was current with industry standards and I now have the skills to get my first data engineering position. I appreciate it and strongly recommends Glass Konnect institute who looks for Top Data Engineer Course.

P. Rajesh

As someone coming from a software development background, I found the Data Engineer Training incredibly useful. It was challenging but rewarding. I learned how to build and manage data pipelines, work with big data technologies, and leverage cloud platforms like AWS. I’m now able to confidently apply these skills in my job. The real-world projects were a great addition to the course!

M. Priya

I have taken this course to expand my skill set in Data Engineering Online Course, and it exceeded my expectations. The instructors explained complex topics in a clear and understandable way. I particularly appreciated the focus on cloud computing and big data technologies. The course gave me the confidence to pursue new job opportunities, and I’m already seeing the results.

Pricing

Affordable Pricing Packages

Online Batch

Basic Package

online batch is a virtual training session where you can join and learn in real-time from anywhere

What's included?

*Terms and Conditions apply

Offline Batch

Regular Package

offline batch at Glass Konnect offers in-person software training at our physical location in Hyderabad.

What's included?

*Terms and Conditions apply

Need a custom pricing plan?

REGISTER NOW !

We're here to help you!

Please enable JavaScript in your browser to complete this form.
Marketing email consent
× Chat With Us