Microsoft Fabric Data Engineer
dp-700
5 days
Interested in a private company training? Request it here.
Not ready to book yet? Request an offer here.
Ingest Data with Dataflows Gen2 in Microsoft Fabric
Data ingestion is crucial in analytics. Microsoft Fabric's Data Factory offers Dataflows for visually creating multi-step data ingestion and transformation using Power Query Online.
- Understand Dataflows Gen2 in Microsoft Fabric
- Explore Dataflows Gen2 in Microsoft Fabric
- Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
- Exercise - Create and use a Dataflow Gen2 in Microsoft Fabric
Orchestrate processes and data movement with Microsoft Fabric
Use Data Factory pipelines in Microsoft Fabric
- Understand pipelines
- Use the Copy Data activity
- Use pipeline templates
- Run and monitor pipelines
- Exercise - Ingest data with a pipeline
Use Apache Spark in Microsoft Fabric
Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data at scale.
- Prepare to use Apache Spark
- Run Spark code
- Work with data in a Spark dataframe
- Work with data using Spark SQL
- Visualize data in a Spark notebook
- Exercise - Analyze data with Apache Spark
Get started with Real-Time Intelligence in Microsoft Fabric
Analysis of real-time data streams is a critical capability for any modern data analytics solution. You can use the Real-Time Intelligence capabilities of Microsoft Fabric to ingest, query, and process streams of data.
- What is real-time data analytics?
- Real-Time Intelligence in Microsoft Fabric
- Ingest and transform real-time data
- Store and query real-time data
- Visualize real-time data
- Automate actions
- Exercise - Explore Real-Time Intelligence in Fabric
Use real-time eventstreams in Microsoft Fabric
Microsoft Fabric Eventstreams is a technology for ingesting and transforming real-time streams of data.
- Components of eventstreams
- Eventstream sources and destinations
- Eventstream transformations
- Exercise - Ingest real-time data with Eventstream in Microsoft Fabric
Work with real-time data in a Microsoft Fabric eventhouse
Microsoft Fabric provides a scalable and flexible store for real-time data.
- Get started with an eventhouse
- Use KQL effectively
- Materialized views and stored functions
- Exercise - Work with data in a Microsoft Fabric eventhouse
Introduction to end-to-end analytics using Microsoft Fabric
Discover how Microsoft Fabric can meet your enterprise's analytics needs in one platform. Discover the capabilities Fabric has to offer, understand how it works, and identify how you can use Fabric for your analytics needs.
- Explore end-to-end analytics with Microsoft Fabric
- Data teams and Microsoft Fabric
- Enable and use Microsoft Fabric
- Knowledge Check
Get started with lakehouses in Microsoft Fabric
Get started with lakehouses in Microsoft Fabric
- Explore the Microsoft Fabric lakehouse
- Work with Microsoft Fabric lakehouses
- Explore and transform data in a lakehouse
- Exercise - Create a Microsoft Fabric lakehouse
Use Apache Spark in Microsoft Fabric
Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data at scale.
- Prepare to use Apache Spark
- Run Spark code
- Work with data in a Spark dataframe
- Work with data using Spark SQL
- Visualize data in a Spark notebook
- Exercise - Analyze data with Apache Spark
Work with Delta Lake tables in Microsoft Fabric
Tables in a Microsoft Fabric lakehouse are based on the Delta Lake technology commonly used in Apache Spark. By using the enhanced capabilities of delta tables, you can create advanced analytics solutions.
- Understand Delta Lake
- Create delta tables
- Optimize delta tables
- Work with delta tables in Spark
- Use delta tables with streaming data
- Exercise - Use delta tables in Apache Spark
Ingest Data with Dataflows Gen2 in Microsoft Fabric
Data ingestion is crucial in analytics. Microsoft Fabric's Data Factory offers Dataflows for visually creating multi-step data ingestion and transformation using Power Query Online.
- Understand Dataflows Gen2 in Microsoft Fabric
- Explore Dataflows Gen2 in Microsoft Fabric
- Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
- Exercise - Create and use a Dataflow Gen2 in Microsoft Fabric
Orchestrate processes and data movement with Microsoft Fabric
Use Data Factory pipelines in Microsoft Fabric
- Understand pipelines
- Use the Copy Data activity
- Use pipeline templates
- Run and monitor pipelines
- Exercise - Ingest data with a pipeline
Organize a Fabric lakehouse using medallion architecture design
Explore the potential of the medallion architecture design in Microsoft Fabric. Organize and transform your data across Bronze, Silver, and Gold layers of a lakehouse for optimized analytics.
- Describe medallion architecture
- Implement a medallion architecture in Fabric
- Query and report on data in your Fabric lakehouse
- Considerations for managing your lakehouse
- Exercise - Organize your Fabric lakehouse using a medallion architecture
Get started with Real-Time Intelligence in Microsoft Fabric
Analysis of real-time data streams is a critical capability for any modern data analytics solution. You can use the Real-Time Intelligence capabilities of Microsoft Fabric to ingest, query, and process streams of data.
- What is real-time data analytics?
- Real-Time Intelligence in Microsoft Fabric
- Ingest and transform real-time data
- Store and query real-time data
- Visualize real-time data
- Automate actions
- Exercise - Explore Real-Time Intelligence in Fabric
Use real-time eventstreams in Microsoft Fabric
Microsoft Fabric Eventstreams is a technology for ingesting and transforming real-time streams of data.
- Components of eventstreams
- Eventstream sources and destinations
- Eventstream transformations
- Exercise - Ingest real-time data with Eventstream in Microsoft Fabric
Work with real-time data in a Microsoft Fabric eventhouse
Microsoft Fabric provides a scalable and flexible store for real-time data.
- Get started with an eventhouse
- Use KQL effectively
- Materialized views and stored functions
- Exercise - Work with data in a Microsoft Fabric eventhouse
Create Real-Time Dashboards with Microsoft Fabric
Real-time Dashboard is a Real-Time Intelligence capability in Microsoft Fabric that you can use to create real-time data visualizations.
- Get started with real-time dashboards
- Advanced features
- Real-Time Dashboard best practices
- Exercise - Get started with real-time dashboards
Introduction to end-to-end analytics using Microsoft Fabric
Discover how Microsoft Fabric can meet your enterprise's analytics needs in one platform. Discover the capabilities Fabric has to offer, understand how it works, and identify how you can use Fabric for your analytics needs.
- Explore end-to-end analytics with Microsoft Fabric
- Data teams and Microsoft Fabric
- Enable and use Microsoft Fabric
- Knowledge Check
Get started with data warehouses in Microsoft Fabric
Understand the key components and design considerations for implementation of data warehouses in Microsoft Fabric.
- Understand data warehouse fundamentals
- Understand data warehouses in Fabric
- Query and transform data
- Prepare data for analysis and reporting
- Secure and monitor your data warehouse
- Exercise - Analyze data in a data warehouse
Load data into a Microsoft Fabric data warehouse
Explore the process of loading data into a warehouse in Microsoft Fabric.
- Explore data load strategies
- Use data pipelines to load a warehouse
- Load data using T-SQL
- Load and transform data with Dataflow Gen2
- Exercise: Load data into a warehouse in Microsoft Fabric
Query a data warehouse in Microsoft Fabric
Learn how to query a data warehouse in Microsoft Fabric using different tools.
- Query data
- Use the SQL query editor
- Explore the visual query editor
- Use client tools to query a warehouse
- Exercise: Query a data warehouse in Microsoft Fabric
Monitor a Microsoft Fabric data warehouse
A data warehouse is a vital component of an enterprise analytics solution. It's important to learn how to monitor a data warehouse so you can better understand the activity that occurs in it.
- Monitor capacity metrics
- Monitor current activity
- Monitor queries
- Exercise - Monitor a data warehouse in Microsoft Fabric
Secure a Microsoft Fabric data warehouse
Learn the key concepts and strategies for protecting sensitive data in Microsoft Fabric data warehouses.
- Explore dynamic data masking
- Implement row-level security
- Implement column-level security
- Configure SQL granular permissions using T-SQL
- Exercise: Secure a warehouse in Microsoft Fabric
Implement continuous integration and continuous delivery (CI/CD) in Microsoft Fabric
Learn the key concepts and strategies for implementing continuous integration and continuous deployment (CI/CD) in Microsoft Fabric.
- Understand Continuous Integration and Continuous Delivery (CI/CD)
- Implement version control and Git integration
- Implement deployment pipelines
- Automate CI/CD using Fabric APIs
- Exercise: Implement deployment pipelines in Microsoft Fabric
Monitor activities in Microsoft Fabric
Monitoring helps you gain visibility into the health of your data systems. Monitoring Hub in Microsoft Fabric collects and aggregates data from Fabric activities and Microsoft Fabric Activator helps you take actions when patterns or conditions are detected in streaming data.
- Understand monitoring
- Use Microsoft Fabric Monitor Hub
- Take action with Microsoft Fabric Activator
- Exercise - Monitor Fabric activity in the Monitor hub
Secure data access in Microsoft Fabric
Learn the key concepts and strategies for securing data access in Microsoft Fabric.
- Understand the Fabric security model
- Configure workspace and item permissions
- Apply granular permissions
- Exercise: Secure data access in Microsoft Fabric
Administer a Microsoft Fabric environment
Microsoft Fabric is a SaaS solution for end-to-end data analytics. As an administrator, you can configure features and manage access to suit your organization's needs.
- Understand the Fabric Architecture
- Understand the Fabric administrator role
- Manage Fabric security
- Govern data in Fabric
This course covers methods and practices to implement data engineering solutions by using Microsoft Fabric. Students will learn how to design and develop effective data loading patterns, data architectures, and orchestration processes. Objectives for this course include ingesting and transforming data and securing, managing, and monitoring data engineering solutions. This course is designed for experienced data professionals skilled at data integration and orchestration, such as those with the DP-203: Azure Data Engineer certification.
This audience for this course is data professionals with experience in data extraction, transformation, and loading. DP-700 is designed for professionals who need to create and deploy data engineering solutions using Microsoft Fabric for enterprise-scale data analytics. Learners should also have experience at manipulating and transforming data with one of the following programming languages: Structured Query Language (SQL), PySpark, or Kusto Query Language (KQL).
