Introduction There’s a ton of data on the Internet. Some of that data is really easy to download and extract that data into a relational database. Data that comes in CSV, JSON or maybe even a database backup. Unfortunately, not all of that is as easy to get at. What we do in the only…
Category: Microsoft SQL
Biml and Oracle Connections
Everyone who knows me, knows I’m a Microsoft data platform professional. I do prefer their solutions over most other solutions. I know there have been a few times when I’ve shocked my coworkers when I’ve suggested Couch, Redis or some other NoSQL solution as a solution to a particular problem. The one that you’ve never heard me…
SQL Azure and Azure Active Directory: Part Two
After getting AD Password Authentication working with my Azure SQL server, I moved on and set up a local Active Directory domain on my home network. I don’t think this is something every data professional should try and tackle. I count myself extremely fortunate to have made friends with IT professionals outside the data space, and…
SQL Azure and Azure Active Directory
f you’ve been working with Azure in the last few years, you’ve noticed there is a relatively new feature that’s supposed to make identity management easier with your Azure solutions: Azure Active Directory (AAD). This feature does work with Azure SQL Servers and Azure SQL Databases. But it may not completely plug and play. In…
Manipulating SSIS Executables with PowerShell
Welcome back to my mini-series on Powershell, SQLPSX, and the awesome things you can do with your packages through POSH. You can catch up by reading this, this and this. You’ve got all that, right? Good! Now, do you have a clone of my ManageETLDemo on your machine? Is it up to date? Great! In…
PowerShell, SSIS Packages and Writing Variables
Last time, I introduced you to SQLPSX. Then we spun through our SSIS packages looking for a specific variable. That’s where I started my PowerShell managing SSIS journey. After I was able to spin through all my packages and see that some of my packages weren’t following the “standard”, I need to go into several…
PowerShell Management for Your SSIS Packages
In addition to working on my database sharding presentation I’ve been working on upgrading an ETL framework. In learning this new framework I dug into the business logic as to what the framework was trying to load, looked into all the auditing that was currently captured, and I looked for gaps when packages didn’t perform…
Migration to Windows Azure SQL Database:Step 4 and 5
Now that you’ve completed analyzing your current database, and worked through that list of items that won’t work with Windows Azure SQL Database (WASD), it’s time to begin testing your new solution. Testing begins with setting up your test instance of WASD, and loading your test data, then you point your application to that new…
Migration to Windows Azure SQL Database: Step 3b
Last time I walked you through how to see if your database will work with Windows Azure SQL Database (WASD) using the Migration Wizard on Codeplex. It’s an easy tool to learn to use, and it answers the question what won’t work if I migrate to SQL Azure. It will even help you perform the…
Migration to Windows Azure SQL Database: Step 3
As promised we’re going to dive into the details on how we would actually migrate the database from your on premise server to Windows Azure SQL Database. We’re going to go over how to do this with the SQL Database Migration Wizard. I’ll be honest, going forward we only use SQL Server Data Tools (SSDT), because you get…