As I began learning Biml, I developed my original metadata model to help automate as much of my BI development as I could. This model still works today, but as I work with more file based solutions in Azure Data Lakes, and some “Big Data” solutions, I’m discovering it’s limitations. Today I’d like to talk…
Tag: Biml
Data Warehouse Efficiency
How quickly do you get from the business coming to you with “we need a data warehouse” to delivering that warehouse? If you’ve sat through any Biml talk, you’ve undoubtedly heard stories of thousands of staging packages being generated per hour. You may have even heard tales of source systems being analyzed in hours, rather than…
SSIS Parameters and Sensitive Information
One of the questions I get when teaching others how to use Biml is how do you deal with sensitive information like usernames and passwords in your Biml Solution. No one wants to leave this information in plain text in a solution. You need access to it while interrogating your sources and destination connections for metadata….
Biml Solutions and Limited Rights
Handling source system metadata changes automatically are pretty easy with BimlScript. There are several solutions available online check here, here, and here. Recently, a client brought up a scenario that put a kink in the usual solution. The client supported multiple tenants, and they wanted to segregate the tasks of handling the metadata changes from…
BimlExpress Directions for the Interrogator
The Biml Interrogator demo was designed to show Biml Developers how to extract useful metadata from sources that do not natively support it. Originally it was designed for delimited text files and Excel files, but it could be used for other sources with a little work. My demos walk you through the different steps you’d…