Skip to content

shannonlowder.com

Menu
  • About
  • Biml Interrogator Demo
  • Latest Posts
Menu

Month: January 2009

SQL301-ETL With SSIS, Part 4

Posted on January 27, 2009 by slowder

We’re back to our ETL with SSIS project, and today we’re going to pick up with transforming the data from our raw format to the final destination for our contact data.  So far we’ve scanned a directory for files matching a certain pattern.  After finding a file matching that pattern we set up some variables,…

Continue reading

SQL 102 – UNIQUE INDEX

Posted on January 26, 2009February 9, 2011 by slowder

Ok, you understand how to create an INDEX.  You understand the differences in CLUSTERED and NONCLUSTERED indexes.  Did you know you could index a view? You can.  But before you start adding indexes, just like you would for a table, you’ll have to create an UNIQUE CLUSTERED INDEX on that index.   The reason for that…

Continue reading

SQL 301-ETL With SSIS, Part 3

Posted on January 21, 2009 by slowder

Ok, so in our SSIS package we currently have all our variables set up, we have a for each loop that will look in a certain folder for all files matching a certain file pattern.  Inside that loop we have a script that will build our archive path and error paths.  Next we need to…

Continue reading

Code to Write Code

Posted on January 16, 2009May 10, 2011 by slowder

I’ve read “When you start writing code that writes code for you, you’ve moved up from a beginner to a professional.” Today I’d like to walk you through an example of where learning to write this kind of code pays off. At my we have a table that defines a hierarchy. Each level on the…

Continue reading

Server 2008 Firestarter Event

Posted on January 15, 2009February 9, 2011 by slowder

The SQL Server 2008 Firestarter event is a 1/2 day, free event for SQL Server developers and administrators. You’ll be able to learn about the newest features in SQL Server 2008, and how you can leverage them to improve your existing applications. Developer topics will include the new features in T-SQL. including the new data…

Continue reading

Get Rid of the Duplicate Records

Posted on January 14, 2009May 10, 2011 by slowder

Time after time I’ll get a table that has duplicates in it and I have to clear out all the duplicate entries while leaving a distinct set of records. There’s a couple of ways to solve the problem. Today I want to take you through my standard fix. Script the source table out to a…

Continue reading

SQL 301 – ETL With SSIS, Part 2

Posted on January 12, 2009March 31, 2011 by slowder

In my last post on SSIS, I started you into developing an ETL solution with SSIS.  I walked you through setting up your solution, renaming the package, and setting up the variables we would use during the rest of these lessons.  Today, we’ll pick up with a Foreash Loop Container. In most case, you’re going…

Continue reading

SQL 102 – CLUSTERED vs. NONCLUSTERED Indexes

Posted on January 9, 2009February 9, 2011 by slowder

Previously, I covered the basics of creating an index using CREATE INDEX.  Today, I’m going to dig a little deeper.  I’d like to teach you the difference in an CLUSTERED versus a NONCLUSTERED index.  If you learn nothing else, know that a CLUSTERED INDEX physically orders the table, a NONCLUSTERED INDEX creates another “table” and…

Continue reading

70-433:Good, Better, Best Index Selection

Posted on January 5, 2009September 27, 2011 by slowder

With SQL Server 2008, you’ve got some additional tricks you can pull off with indexes.  With 2005 you could INCLUDE columns in your index, now with 2008 you can also create indexes with a WHERE clause.  This means you can limit the number of rows in your NONCLUSTERED indexes. By limiting the number of rows…

Continue reading

SQL 301 – ETL With SSIS, Part 1

Posted on January 2, 2009April 5, 2011 by slowder

I’ve discussed SSIS on this site before, but I’ve heard the feedback, you want real world examples. So, I decided to use the business case I address most often using SSIS, and that’s Exchange Transformation and Load.  Let’s dive right in to this problem.  You receive a file via FTP from a vendor every day. …

Continue reading

Recent Posts

  • Docker-based Spark
  • Network Infrastructure Updates
  • Docker and Watchtower
  • Delta Sharing – Data Providers
  • SQL Server to Databricks Profiler

Recent Comments

  1. slowder on Data Engineering for Databricks
  2. Alex Ott on Data Engineering for Databricks

Archives

  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • October 2018
  • August 2018
  • May 2018
  • February 2018
  • January 2018
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • June 2017
  • March 2017
  • February 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • August 2013
  • July 2013
  • June 2013
  • February 2013
  • January 2013
  • August 2012
  • June 2012
  • May 2012
  • April 2012
  • March 2012
  • February 2012
  • January 2012
  • December 2011
  • November 2011
  • October 2011
  • September 2011
  • August 2011
  • July 2011
  • June 2011
  • May 2011
  • April 2011
  • March 2011
  • February 2011
  • January 2011
  • December 2010
  • November 2010
  • October 2010
  • September 2010
  • August 2010
  • July 2010
  • June 2010
  • May 2010
  • April 2010
  • March 2010
  • January 2010
  • December 2009
  • November 2009
  • October 2009
  • September 2009
  • August 2009
  • July 2009
  • June 2009
  • May 2009
  • April 2009
  • March 2009
  • February 2009
  • January 2009
  • December 2008
  • November 2008
  • October 2008
  • September 2008
  • August 2008
  • July 2008
  • June 2008
  • May 2008
  • April 2008
  • March 2008
  • February 2008
  • January 2008
  • November 2007
  • October 2007
  • September 2007
  • August 2007
  • July 2007
  • June 2007
  • May 2007
  • April 2007
  • March 2007
  • February 2007
  • January 2007
  • December 2006
  • November 2006
  • October 2006
  • September 2006
  • August 2006
  • July 2006
  • June 2006
  • May 2006
  • April 2006
  • March 2006
  • February 2006
  • January 2006
  • December 2005
  • November 2005
  • October 2005
  • September 2005
  • August 2005
  • July 2005
  • June 2005
  • May 2005
  • April 2005
  • March 2005
  • February 2005
  • January 2005
  • November 2004
  • September 2004
  • August 2004
  • July 2004
  • April 2004
  • March 2004
  • June 2002

Categories

  • Career Development
  • Data Engineering
  • Data Science
  • Infrastructure
  • Microsoft SQL
  • Modern Data Estate
  • Personal
  • Random Technology
  • uncategorized
© 2023 shannonlowder.com | Powered by Minimalist Blog WordPress Theme