Implement Data Engineering Solutions using Microsoft Fabric
Course number: CGIFabric40 - 4 days (weekdays or on-demand)
This course covers methods and practices to implement data engineering solutions by using Microsoft Fabric. Students will learn how to design and develop effective data loading patterns, data architectures, and orchestration processes. Objectives for this course include ingesting and transforming data and securing, managing, and monitoring data engineering solutions. This course is designed for data professionals with some data integration and orchestration experience.
Prerequisites
- Learners should also have experience at manipulating and transforming data with one of the following programming languages: Structured Query Language (SQL), PySpark, or Kusto Query Language (KQL).
Target Audience
This audience for this course is data professionals with experience in data extraction, transformation, and loading. The course is designed for professionals who need to create and deploy data engineering solutions using Microsoft Fabric for enterprise-scale data analytics.
Certification
Microsoft Certified: Fabric Data Engineer Associate
Exam
Exam DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric
Accreditation
Post class completion, students may appear for the Implementing Data Engineering Solutions Using Microsoft Fabric exam.
Course Content
- Understand Dataflows Gen2 in Microsoft Fabric
- Explore Dataflows Gen2 in Microsoft Fabric
- Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
- Module assessment
- Understand pipelines
- Use the Copy Data activity
- Use pipeline templates
- Run and monitor pipelines
- Module assessment
- Prepare to use Apache Spark
- Run Spark code
- Work with data in a Spark dataframe
- Work with data using Spark SQL
- Visualize data in a Spark notebook
- Module assessment
- Get started with an Eventhouse
- Use KQL effectively
- Materialized views and stored functions
- Module assessment
- Explore end-to-end analytics with Microsoft Fabric
- Explore data teams and Microsoft Fabric
- Enable and use Microsoft Fabric
- Module assessment
- Explore the Microsoft Fabric lakehouse
- Work with Microsoft Fabric lakehouses
- Explore and transform data in a lakehouse
- Module assessment
- Prepare to use Apache Spark
- Run Spark code
- Work with data in a Spark dataframe
- Work with data using Spark SQL
- Visualize data in a Spark notebook
- Module assessment
- Understand Delta Lake
- Create delta tables
- Optimize delta tables
- Work with delta tables in Spark
- Use delta tables with streaming data
- Module assessment
- Understand Dataflows Gen2 in Microsoft Fabric
- Explore Dataflows Gen2 in Microsoft Fabric
- Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
- Module assessment
- Understand pipelines
- Use the Copy Data activity
- Use pipeline templates
- Run and monitor pipelines
- Module assessment
- Describe medallion architecture
- Implement a medallion architecture in Fabric
- Query and report on data in your Fabric lakehouse
- Considerations for managing your lakehouse
- Module assessment
- What is real-time data analytics?
- Real-Time Intelligence in Microsoft Fabric
- Ingest and transform real-time data
- Store and query real-time data
- Visualize real-time data
- Automate actions
- Module assessment
- Components of Eventstream
- Eventstream sources and destinations
- Eventstream transformations
- Module assessment
- Get started with an Eventhouse
- Use KQL effectively
- Materialized views and stored functions
- Module assessment
- Get started with real-time dashboards
- Organize and filter dashboard data
- Dashboard management and optimization
- Module assessment
- Configure Activator for your data
- Create rules in Activator
- Configure actions in Activator
- Module assessment
- Explore end-to-end analytics with Microsoft Fabric
- Explore data teams and Microsoft Fabric
- Enable and use Microsoft Fabric
- Module assessment
- Understand data warehouse fundamentals
- Understand data warehouses in Fabric
- Query and transform data
- Prepare data for analysis and reporting
- Secure and monitor your data warehouse
- Module assessment
- Explore data load strategies
- Use data pipelines to load a warehouse
- Load data using T-SQL
- Load and transform data with Dataflow Gen2
- Module assessment
- Query data
- Use the SQL query editor
- Explore the visual query editor
- Use client tools to query a warehouse
- Module assessment
- Monitor capacity metrics
- Monitor current activity
- Monitor queries
- Module assessment
- Explore dynamic data masking
- Implement row-level security
- Implement column-level security
- Configure SQL granular permissions using T-SQL
- Module assessment
- Understand Continuous Integration and Continuous Delivery (CI/CD)
- Implement version control and Git integration
- Implement deployment pipelines
- Automate CI/CD using Fabric APIs
- Module assessment
- Understand monitoring
- Use Microsoft Fabric Monitor Hub
- Take action with Microsoft Fabric Activator
- Module assessment
- Understand the Fabric security model
- Configure workspace and item permissions
- Apply granular permissions
- Module assessment
- Understand the Fabric Architecture
- Understand the Fabric administrator role
- Manage Fabric security
- Govern data in Fabric
- Module assessment
- Configure Activator for your data
- Create rules in Activator
- Configure actions in Activator
- Module assessment
Live Online