- Home
- Courses
Our Course
DATA ENGINEERING
ABOUT THIS COURSE
Course Description: Data Engineering
Overview: In our Data Engineering course, we equip students with the essential skills and knowledge to design, build, and maintain robust data systems. As data continues to drive decision-making in organizations, understanding how to manage and optimize data pipelines is critical.
Teaching Approach: Our course blends theoretical foundations with hands-on experience, fostering a comprehensive learning environment. We employ a mix of lectures, practical workshops, and real-world projects to ensure students can apply their skills effectively.
- Certified
- 90 Days
- 50 to 60 Students
- 150 Batches
THE COURSE INCLUDE
- Real Time Projects
- Job Assessment
- Mock Interviews
CURRICULUM
- Overview of Data Science
- Key Roles & Responsibilities
- Essential Tools & Technologies .
- Career Path in Data Science Fields
- Roles in Data Science Field.
Introduction to SQL
- What is DBMS and RDBMS, difference between them and why do we need to know these fundamentals
- What is Normalization, types of norm forms and when to use what
- What are different keys in RDBMS
- What are different types of schemas
Creating Database
- Create a Database in MySQL
- SQL Data Types
- Create Table in SQL
- SQL INSERT INTO Statement
- SQL UPDATE Query - SQL UPDATE Statement
Clauses in SQL
- SQL Query Execution Order
- From Clause in SQL
- SQL WHERE Clause
- SQL GROUP BY
- SQL HAVING Clause
- ORDER BY in SQL
- SQL Aliases
Filtering in SQL
- SQL Operators
- AND & OR Operators in SQL
- Not Equal in SQL
- SQL BETWEEN Operator
- NULL Value in SQL
- Case Statements
Joins and Subqueries
- SQL JOINS (INNER, LEFT, RIGHT, and FULL Join)
- Self Join in SQL
- Types of Subqueries
Aggregation and window functions in SQL
- Aggregate Functions in SQL
- Group by Multiple Columns in SQL
- Rank functions (RANK, Dense Rank and Row number)
SQL Constraints
- SQL PRIMARY KEY
- SQL FOREIGN KEY
- UNIQUE Constraint
- SQL CHECK Constraint
- Cascade in SQL
Advanced Topics
- Views
- User defined Function
- Indexing
Data Types and Variables
- Integers, Floats, Strings, Booleans
- Type Conversion
- Variables and Assignment
Basic Operators
- Arithmetic Operators
- Comparison Operators
- Logical Operators
Control Structures
- Conditional Statements (if, elif, else)
- Loops (for, while)
- break, continue, and pass
Basic Data Structures
- Lists
- Tuples
- Sets
- Dictionaries
Functions
- Defining and Calling Functions
- Arguments and Return Values
- Local and Global Variables
- Functions (continued)
Lambda Functions
- *args and **kwargs
- Decorators
- Generators
File Handling
- Reading and Writing Files
- Working with Directories
- Exception Handling during I/O
Error and Exception Handling
- try, except, finally
- Custom Exceptions
Module 1:Introduction to Big Data and Cloud Computing
What is Big-Data and Types of Data.
What is Cloud Computing?
Types of Cloud deployment models
Private Cloud
Public Cloud
Hybrid Cloud
Types of Cloud services
IaaS – Infrastructure as a Service
PaaS – Platform as a Service
SaaS – Software as a Service
- Create a Storage account
- Types of Storage accounts
- Create a ADLS account
- Load data to ADLS
- Read and write Data to ADLS
- Configure Backup and Disaster Recovery
Module 3: Introduction to Azure
- Create an Azure account
- Overview of Azure portal.
- Subscription
- Resource Group
- Blob Storage, Data Lake Storage
- Azure Data Factory
- Azure Databricks
- Azure Key Vaults
- Azure Logic Apps
Module 4: Azure Data Factory
- Introduction to Azure Data Factory
- Components of Azure Data Factory
- Integration Runtime (IR)
- Azure Auto Integration Runtime
- Self Hosted Integration Runtime
- Azure SSIS Integration Runtime
- Linked Service
- Datasets
- Pipelines and Activities in pipelines
- Copy Data
- Delete
- Stored Procedure
- Get-Metadata
- Lookup
- For Each
- IF Condition, Switch
- Until
- Wait
- Fail
- Data Flow
- Set Variable
- Append Variable
- Databricks Notebook
- Execute Pipelines
- Triggers
- Schedule Trigger
- Tumbling Window Trigger
- Storage Events
- Parameters in linked servers, datasets, pipelines, Triggers
- Monitor Jobs
- Send Failure notifications using Logic Apps
- Manage credentials using Azure Key Vault
- Introduction to Spark
- Overview of Spark Architecture
- RDD Vs DataFlow Vs Dataset
- Transformations & Actions
- Introduction to DataBricks
- Create Databricks Workspace
- Create Clusters
- Create Databricks Notebooks
- Databricks File System (DBFS)
- Create, copy, move les within DBFS
- Handle multiple les and folders
- Archive les in DBFS
- Databricks Utilities (dbUtils)
- File system
- Secrets
- Notebook
- Widgets
3 Months
90+ Learning Hours
Tool Box
5+ Assured Interviews
OTHER COURSES
Who Should Take this Course?
What Are The Roles Can You Apply
See Yourself In One Of These Roles?
Tools & Technologies
THE TEACHER
YUGANDHAR
“I’m Yugandhar, a Data Engineering trainer with 9 years of experience. Teaching the Data Engineering course is a great experience. I enjoy helping students learn how to build and manage data pipelines, work with cloud platforms, and handle big data. My focus is on making complex topics easy to understand, and I love seeing students gain the skills they need to succeed in data engineering.
SUCCESS STORIES
R. Kiran
Enrolling in the Data Engineer Course was the best decision I made for my career. The curriculum was well-structured, covering everything from data storage solutions to cloud computing. The hands-on projects were especially helpful in giving me practical experience. I feel confident in my new role, and I’ve already started applying the concepts I learned. Highly recommend it!
- Data Engineer
Shek Aisha
I have always had an interest in data, but I had no idea where to begin. This course provided me with the ideal foundation, from knowing SQL databases to mastering tools like Apache Spark. The professors were very educated and helpful. The course content was current with industry standards and I now have the skills to get my first data engineering position. I appreciate it and strongly recommends Glass Konnect institute who looks for Top Data Engineer Course.
- Data Engineer
P. Rajesh
As someone coming from a software development background, I found the Data Engineer Training incredibly useful. It was challenging but rewarding. I learned how to build and manage data pipelines, work with big data technologies, and leverage cloud platforms like AWS. I’m now able to confidently apply these skills in my job. The real-world projects were a great addition to the course!
- Data Engineer
M. Priya
I have taken this course to expand my skill set in Data Engineering Online Course, and it exceeded my expectations. The instructors explained complex topics in a clear and understandable way. I particularly appreciated the focus on cloud computing and big data technologies. The course gave me the confidence to pursue new job opportunities, and I’m already seeing the results.
- Data Engineer
Online Batch
Basic Package
online batch is a virtual training session where you can join and learn in real-time from anywhere
What's included?
- Fee details
- Program Fee ₹ 70,000
- 24/7 Full Support
*Terms and Conditions apply
Offline Batch
Regular Package
offline batch at Glass Konnect offers in-person software training at our physical location in Hyderabad.
What's included?
- Fee details
- Fees ₹ 80,000
- 24/7 Full Support
*Terms and Conditions apply
Need a custom pricing plan?