Microsoft Dynamics 365 Community’s Post

Transcript

In this session we are going to look at how we can use EntityUtil to create entities in the lakehouse database, also known as the replica database that is created by SYNAPSE Link when you are using the Spark pool to convert the files into delta parquet files. This session builds upon previous recordings that have explained EntityUtil and also how to create entities in a serverless database, also known as a virtual data warehouse. Today we will introduce EntityUtil and discuss how you go about and create those complex entities in the lake database. Finally, once again, there are resources to EntityUtil at the back of this presentation. In this example, we will look at using EntityUtil in the context of the Lake database or replica database that is created via SYNAPSE Link and the Spark pull jobs. We will manually create a new database schema and then use EntityUtil to create the complex entities as views within the new database schema. If you would like to review the introduction to EntityUtil and an overview of the prerequisites and how to recreate the view schemas from a tier 2 environment, please see the earlier Dynamics Bites recordings in this series. Now let's look at how you can use EntityUtil with the Lake database. We are going to start the demo by creating a new schema within the replica database or the Lake database that is being used. Now we're going to look at EntityUtil. We are going to use, as mentioned, EntityUtil to create the complex entities within the database, the Lake database that's created via the SearchLink profile and the Spark jobs. Now, the first component to this is that we need to specify the target server name and the target schema that we'll be using, database schema that we'll be using. So we specify these within the configuration file as well as obviously the target server name, which is again the Azure SYNAPSE workspace. So before we go ahead and create the complex entities within the replica database, one thing to recall is that the inherited tables currently are not being materialized within or via SYNAPSE Link. Therefore, we need to create them first so this EntityUtil is enhanced so that again you could specify the derived tables that you want to create and then you can run step five. Step five will create those inherited tables or derived tables in the target schema within fabric or as in this case, within the serverless replica database. So let's enter five and run this particular script. Now, in this scenario we are missing two tables, so therefore we'd need to go through and into the manage tables, select the tables that are missing and export them via SYNAPSE link. So once those tables have finished being converted into delta parquet format, we can rerun EntityUtil in step five to create the inherited tables. Once that has been completed, we're now able to again run EntityUtil, but this time we are going to create the views within this replica database. So let's hit run step two and then once that has run, we can in this case leverage SQL Server Management Studio to see all the views that have been created and we can test them to ensure that we are getting all of the expected results. We can access the EntityUtil PowerShell script from GitHub using the following URL thank you for your time today.