If you’ve ever read any of my exposed series, well… Look for a fairly unbiased approach to things.   Oh and hopefully the Education team doesn’t come back screaming at me. ;)   And as always, in the best of my ability I bring you the… Disclaimer!

Disclaimer:  The following information is not under NDA, is not one persons opinion but rather that collected from others through interviews, emails, discussions under which none of us are sharing any proprietary data about the Class or the Exam.    I tread the line closely so read on!

Okay, I normally only Post-Mortem or expose an Exam, or a Class, but not too often do I get the liberty to expose the two together! With that being the case I want to start by educating you a little bit about this designation, certification and beyond so you don’t feel the need to go to multiple sources to learn it!

Okay this little chart stripped from the Brochure basically tells you:

• To prepare for the E20-001 exam you should take the Information Storage and Management 5 day course # MR-1CP-STF
• To prepare for the E20-018 exam you should take the Virtualized Data Center and Cloud Infrastructure 5 day course: MR-1CP-NPVICE

At this point I’d like to give you a little color on these particular courses and the respective requirements around them, etc.     First of all, unlike the VCP or other similar type exams, these courses are NOT required in order to sit the exam.   I wanted to make sure you understand that you CAN sit the exam cold.

(Yes I did sit the E20-001 Exam cold and passed – Industry experience has its advantages)

There is an AMAZING book which covers the content of the E20-001 course and exam – the ISM Book I’m not sure if I have a copy at all but I’ve heard from those who have used it is an excellent learning and educational aid!  So if you’re a self-studier this is definitely an EXCELLENT tool for you to use.

Because the E20-001 is a pre-requisite to sit/pass the E20-018 exam I wanted to ensure it got a little coverage, which I think is sufficient at this point :)   For what it is worth, if you have been in the industry a fair amount of time working with SANs, NASs, and other Information Storage Management stuff you should do fine, but ensure you are prepared, E20-001 is the cost of ENTRY beyond that comes the BIG GUNS!!!

Tell us about the Virtualized Data Center and Cloud Infrastructure course

Okay, okay guys I will.   Here it goes, the full in depth analysis of the VDC and Cloud course.    (Education folks, watch out this isn’t all from me either;))

I want to start by telling you very clearly and concisely that there is some GREAT content in the books, material, and other information provided both in the written as well as the lecturer (Your results may vary depending upon instructor)  Though irrespective of who your instructor is, the content in the book will stay the same and will be relevant to the Class, Cloud, VDCs and the Exam.   With that said, I need to differentiate a few things with the course pre-reqs

• According to the course materials we strongly recommend you have the following Certifications or knowledge/experience:
• Cisco Certified Design Associate (CCDA) – I bet CCNA would apply as well but I think that’s focused in the other exam/course
• VMware Certified Professional (VCP)
• Certified Information Systems Security Practitioner (CISSP)
• The EMCISM is required for the EMCCA Certification – I mentioned that above, so that’s not a surprise.
• Oh, and ITIL/PMP is NOT mentioned but those of you who are will find yourself wondering why not ;) (Not for content, but for presentation)

With THIS particular data points expressed I’d like to break you down into two groups:

Generalist/Novice/Acolyte:

If you fall into this area, maybe you have one or more of the certifications above or work in various cross-disciplines.  The courseware will VERY much apply to you.  You will want to pay attention, take rigorous notes; really get the best out of the networking, the instructors, the homework, read, read again, even do some labs to ensure you not only UNDERSTAND it, but you are fully committed to the material you are learning.   For what that is worth, the information is VERY general to the industry, Best Practices with a ‘little’ emphasis on some specific EMC technologies, but otherwise 70%+ of the material on the exam is of a VERY general nature.  The book should be your best friend and will be the answer to your success when it comes time to sit the exam and in life! :)

Guru/Expert/Ninja/Buddha/#IWroteTheExam:

Hey guys, how are you doing.   You know who you are.   You hold all of the certifications above or really have the information down solid.  Heck, you might have taken those exams 10 or more years ago; or even written some of the exam material in those times.   You also happen to be the same kind of folks who have helped write and spec the standards for where we are today; Chances are I know each of you personally. (grin).    Yea…  You won’t last in the class.  I’m sorry.   I’m totally supportive of you, completely in fact (You probably wrote your own internal cloud strategy for your business which is inline with the exam, or for your consultancy)  Definitely not going to survive in the class room.  You’ll say “Err, this is just lecture, I can read the book myself… err, I can write this book while I’m at it!)   I’m not being negative, I see your kind every day…. leave the class because you’re bored, not learning anything and at this point just want to ensure that you have what is REQUIRED to sit and pass the exam.    Good luck guys, you will DEFINITELY want to read the Exam section because that’ll make the difference of success and WTF?!?   

Whoa! Wait a minute! Isn’t that a massive generalization? Either you’re a student or a teacher? … No not really.   Seriously.    If you find yourself arguing with the teacher that they’re wrong and you cite evidence often referring to a presentation you’ve given at a conference? Yea… You’ll do fine :)

Now, I’d like to segue way a moment to some of the directly shared thoughts from an attendee of the course.  We’ll call him B (Not like B from Gossip Girl!)

B’s take on the Virtualized Data Center and Cloud Infrastructure Course

“B” is a Technical Manager in mid-size enterprise.   Experienced in implementing VMware over the years with EMC Storage, HP Servers, Cisco Networking.   Longtime expired member of the CCNA/CCDA club and recent VCP and EMCISM credential holder.   With the stated pre-reqs B felt it might be a stretch from his qualification but not too much of a concern  (If this sounds like you, you’re in good company!)

• Class started with going over pre-reqs, with CISSP added to the list; was surprised ITIL wasn’t there as discussed earlier
• Two classes were merged so each section was alternated between two instructors.   As the course is 95% lecture didn’t feel that mattered.
• The volume of content for the class is 2” thick of slides which unfortunately restricts discussion time available over 5 days.
• Module 1 leads you into an Introduction to Cloud Computing  – If you instructor reads this module to you verbatim – STOP THEM!!!
• Module 2 covers the VCP, ISM ad CCDA related material – Very much a review of the Pre-reqs – should be consolidated to focus on goals
• Module 3 kicked off VDC Design – This is where the meat of the course is, requires proper time to digest and discuss properly
• Module 4 focused on Governance, Risk and Compliance (Interesting Chapter) but due to time was rushed as was Managing Virtual Environments
• Module 5 focused on Cloud Services and Summary modules (Had to leave early so missed it)
• There is nothing earth-shattered in the course but there is a lot of GOOD Material!
• The labs are too vague leaving you spending more time trying to figure out what you’re supposed to do instead of discussing solutions

B’s Summary of the course

In summary, it’s a good course to show EMC’s "journey to the cloud".  I’d prefer less focus on the pieces (modules 1-2) and more focus on how to put the pieces together (modules 3-6).  The labs need refined to give more guidance so we can spend more time applying the knowledge rather than wondering what the designers of the course had in mind.  Given that this was the first class (I believe), I’d love to see how it changes over the next few sessions.

Well guys, what do you think of B’s take on the course?   I think his assessment was fairly accurately representation of what was going on, and equally what you might expect out of the class in its early stages.   To tell you the truth it can ONLY get better from this point.   I only briefly paraphrased what B had to say to preserve the original message but also not to call him directly unless he wants to be named :)  

Curious what the course looks like on the other side of the fence?   Here is the summary and breakdown from “Jerome” who’s been doing this for awhile!

Jerome’s take on the Virtualized Data Center and Cloud Infrastructure Course

I had the chance to attend the "Virtualized Data Center and Cloud Infrastructure" course put on by EMC this week.  Below are my thoughts.

Certification Track

This course is part of the EMC Cloud Architect track – EMCCA.  This course specifically is designed to prepare for the E20-018 certification test, which is a Specialist level certification.  The Expert level material and test have not yet been released, and are expected later this year.

Focus

The EMC Cloud Architect Track is designed to help enable customers adopt a cloud maturity model.  This consists of a move from physical data centers to Virtual Data Centers (VDCs), from VDCs to full Operationalization of virtualization, and from there to IT as a Service.  This course was specifically focused on the physical to VDC phase of the transition. 

Material and Presentation

This course is a lecture only course.  There was no hands on material or lab time.  What labs were included in the course were small group discussions only.  EMC has tried to make this a "generic" cloud course that is "open" to all technologies, but it is heavily slanted towards their view of the world.  The course uses the following outline, I have added the EMC translation in parenthesis:

• Virtualized Data Center and Cloud Introduction (Private Clouds and ITaaS model)
• VDC Architecture (V+C+E products, convergence)
• Designing for Virtualized and Cloud Environments (Best Practices for Virtualization – VCP stuff)
• Governance Risk and Compliance (RSA and Archer)
• Managing Virtualized Environments (IONIX)
• Cloud Services (Service Provider models)

Exam

The exam is a 60 question test, with 63% required for passing (38 correct answers).  The practice exam on the EMC Education website is decent, and a good barometer of your chance to pass the exam, though the practice was about 20% easier than the real exam.  I would say that the real exam questions were written fairly poorly, and were often difficult to understand.  They would describe a scenario, but then it seemed they would give up half way through and ask only a tangentially related question.  I think that it was a result of attempting to keep the exam mostly generic, rather than focused on EMC technologies.

Recommendation

In general, I found the course to be very much in alignment with our message and focus, and as a result I felt it was a very easy set of material.  The only new sections to me were a few of the VDC maturity definitions and the GRC models.  Because of that, I felt the instructors moved much too slow.  I also found that the instructors were professional trainers, not SMEs on cloud computing, so they offered little value other than moderating the course.  I ended up leaving mid-way through the second day, and just reviewing the course material on my own, and was able to pass the test on Thursday, even though the course runs through Friday.  If you feel you need a little more preparation, I would recommend the VILT, rather than the full course. 

Okay, no his real name is not Jerome I decided I would use that name as a tribute to Jerome from Flight of the Conchords, especially how Jerome was being so constructive with his feedback So what this is providing you is two assessments of the course; FWIW.. I agree with both, grin :)

CXIs take WTF?!?

Yea, I think I made it fairly clear in the earlier points.    But if I had a few things I want you to do and know; KNOW the material, if you’re confused read it again, understand it, deep.    Focus on your weaknesses in the areas which are defined in the class and be true and honest to yourself, because albeit Rihanna and Eminem may love the way you lie… well the Exam will NOT be so nice.  . . . Speaking of which!

Tell us about E20-018 Virtualized Infrastructure Specialist Exam for Cloud Architects!

Okay, Okay, you begged enough!   Firstly, let me tell you I cannot tell you what is ON the Exam, what is IN the exam or anything ABOUT the exam. We cool? ;)    Yea, but just because I cannot provide you those specifics and by now I think you know a few things about me…. here is what I can tell you.

Remember what I said above about PREPARING.  KNOWING the content from the Class, Books or material LISTED as being on the exam?  Yea, I wasn’t messing around.  Seriously! DO THAT. KNOW THAT. DO IT ALL!   But what would this matter or mean if you didn’t take a few sliding comments from those of us who have taken the exam.    I talked to Jerome after he took the exam to see how he felt about it; his take?

Jerome: The test was very hard, but that was only due to the language of the questions and the structure.

Me: Hated that test.

Whoa Whoa Whoa! Christopher! That isn’t very constructive! What about being constructive with your feedback?!?! Yea, hi, I’m still here.. I’m still WRITING THIS! ;)     I don’t remember if I’m supposed to say this or not but since the exam is already out, published and I’ve taken it… I’ll go out on a limb thinking I can talk about it.   Yea, I’ve seen SOME of the content before the exam came out.  I reviewed the questions for validity, truth, honesty, integrity… The kind of standard I started to see so wonderfully come out of Microsoft (I know the entire Microsoft Learning Team, so I know the commitment they have to Exam Integrity THESE days instead of days gone past where questions were insane)   I’d like to say that this exam took the PAGES upon PAGES of comments I’d have on a few word question to heart when it came time to publish the exam to stand behind as backing for the questions.   Yea, I thought that for OTHER exams I would EXTENSIVELY provide EXTREMELY constructive feedback on. [I’m not shy about telling you what is wrong, why it is wrong, how others will perceive it, and what steps you can take in order to correct….]   Also sometimes there are release schedules… or my voice isn’t LOUD enough, or I didn’t cover enough of a user base of questioning to make an impact outside of my SME area I was initially focused on reviewing.    None the less, to Jerome’s point of the language of the questions and the structure; how things were poorly worded, or to quote me “I hated that test”  

I’m VERY good at taking tests (I teach classes on how to take exams ;)).  I’ve passed more exams than most will in their lives, and respectively I’ve probably failed more exams than most people will take including their entire academic career ;)     I can wholeheartedly say that you better STUDY for this exam.   KNOW your material and know how to cut through the treacle which is going to be offered up as questions.   The answers are right, the questions are a little confusing and the ones which are not can be VERY specific.    I prepared for the exam by using the Practice Test – I was getting 100% consecutively and I felt confident.   Yea, once that exam started up that melted away!    Definitely study, study, study! Prepare! 

Summary on Class and Exam!

For the first Industry Certification focused on Cloud with an Exam AND a course; that is a major undertaking to start with, and honestly to tell you the truth I think EMC did a great job of it.   Obviously you may take some of my comments above as extremely critical (Hey, I’m extremely critical!) but it’s because I care.     They’re definitely taking things to new levels, I’m not even sure what other organization in the industry could assault such an undertaking other than Microsoft (And that would be HEAVILY MS biased, Hey I love you but it’s true) and most “independent” third parties, well we all know that their Exam would come out looking like absolute trash and they wouldn’t really have the vehicle or mechanism to go about delivering and driving it successfully.   No definitely considering all of that and what we expect so heavily from ourselves, and our industry, EMC has done an absolute bang up amazing job!   

Hopefully I haven’t scared you away from taking this course and the exam.   If you know your stuff, you better prep, if you are new to the whole game you’re going to learn A LOT OF MATERIAL.   In a way the course will take you through a compressed CCNA/CCDA/VCP/CISSP/EMCISM courseware all compressed into a few days of time and then you need to assimilate that into your head and go take a test!    If anything you should have an honest reflection of what to expect (I highly encourage your feedback if you agree, disagree or WTF on anything I’ve said)   Together we move mountains, so let’s not make mountains out of molehills, that’s how the Cloud works.   Together. :)   Oh and Good Luck, I don’t say this often on exams, but you will NEED it. *love* :)

OMG! It is THAT time of year again! Are you going to EMC World?  This is definitely the MUST attend event of the year!  (Seriously, you have no idea :))

However, my first call to action for you guys.. is to try to make sure you’re getting hooked up with the FREEBIES if you know you’re going to be going anyway!

A basic chart breaking down what you’re looking at when it comes time to register:

Conference Registration Rates and Breakdowns:

So I decided to take as best of a dive as I could into what these “Special Gifts” are, just to get an idea of what incentive you have to book early (and often?!)

Early Bird Registration Gifts:

Booking your hotel:

Within the Venetian Resort you have the option to select your room to be within the Venetian Tower or the Palazzo Tower. Both towers are equal distance to the conference center. To secure a special conference rate be sure to reference EMC World if you chose to make a phone reservation. All room blocks expire on April 14, 2011.

I cannot emphasize enough because I know a lot of you guys… wait until the day OF the show to book your hotel rooms :)   All Room blocks (at these two hotels) will expire on April 14th, 2011 for this rate.   So just take that to heart when it comes time to book and buy your tickets :)

This is going to be quite the OMG WTF AMAZING EMC World on record, far greater than you can imagine.  And it will ALSO be in Vegas, so if that means a lot to you, further mad crazy times – But in all seriousness, the type of content, the audience, the community, EVERY instance of the value which will come from this event.. this is a MUST attend EMC World.  You think records were broken at our Launch Event on January 18th?  Well, you haven’t seen nothing yet? (Is that grammatically correct?!? :))

What, who, why, Justify to my boss! –

What – (2011 Conference Topics and beyond!)

• Backup, Recovery and Archiving
  Business Continuity and Disaster Recovery
  Cloud Computing
  Content Management and Archiving
  Enterprise Applications and Databases
  Mainframe Platforms
  Partner Solutions
  Security and Compliance
  Storage and IT Management
  Technology Directions and Innovation
  Tiered Storage and Automation
  Virtual Infrastructure

Who – (Meet, Greet, Network, Learn)

• Learn directly from EMC engineers, customers, and partners at 500+ breakout sessions. EMC World’s comprehensive agenda includes keynotes, lectures, live demonstrations, hands-on workshops, and birds-of-a-feather sessions.

Did I mention I’m going to be there?! :) And definitely seek me out and I can hook you up with other like-minded individuals, or others who are either doing what you WANT to do, or have already done it and you can share best practices (No, not marketing fluff, but actual real customers, engineers and beyond, networking seeds networking! :))

Why – (Content, Content, Content)

• Challenge your expertise with offerings including tutorials, business tracks, technical training, and developer sessions ranging from novice to expert.

Are you a novice looking to seed your knowledge? Excellent.  Are you an expert, guru, ninja, and you find that no one understands you? Go yell at engineers! (That’s what I do ;))   This is the perfect opportunity whether you’re at the top of your game or just getting involved in the industry.   No stone unturned, you will be able to enhance your knowledge, take things to a new level and become an even greater champion than you already are today! (Champions ARE made just by attending EMC World)  Literally, seek me out and I’ll make sure you’re getting the MOST out of your entire experience – I do it at every show I attend. ;)

Justify to my boss – (Whoa, this is in Vegas, my boss won’t approve that!)

I haven’t seen an official write up ‘slick’ on this yet, so I am writing this FOR you.  I’ve had to do this in the past for past events (VMworld, Microsoft TechEd, Past EMC Worlds, TEC, etc)   You go to your management and you scream “I want to learn, I want to educate myself in order to better drive value into the environment, I need to network with my peers, and see the up and coming and be PART of the future instead of waiting for us to eventually get there”.   Yea, but this is what your management sees. “Jim wants to go to Vegas for a week, blah blah blah conference”  

Do you find yourself in this situation?  If so, let me know (And let others know) I’ll try to make sure you have the right resources to help PROVE this out in your environment.  Whether you’re an EMC Customer today, or one in the future; this will be the value of a life time.   If you spent the entire time in sessions never meeting a single person you will gain benefit and an experience which will pay dividends in your home environment; step outside that shell a little bit and all of a sudden you will become a champion unlike that you’ll ever have seen!  

Do not hesitate to educate! I’ll personally call your management if you’d like and help them understand the value (I’ll get whoever your local account team is involved just to make sure I’m not blindsiding them ;))   But seriously, now is the time to SAVE, as well as to LEARN!   Hop to it!

So, good luck, enjoy and lets all meet up in Vegas for what will be an experience of a life time, this is ground breaking in every possible fashion!  

Today I was cleaning up my mailbox when I came across some BLASPHEMY about Exchange! Okay, not blasphemy per se, but I continually hear from folks who are being incorrectly told “Exchange cannot be virtualized”.  I’m not exactly sure who started this ‘trend’ but that’s neither here nor there!   So I did a little digging [and you know, digging for me tends to turn into a blog post ;)]  And I came across not only some AMAZING Material! But I also want to make sure you’re following up on regularly posted updates from a Rockstar who’s clear focus is on Exchange!

These are two very SHORT and to the point, giving you the high-lights letting you know what is required to kick things off and something you can hand up to mgmt! So it’s great to not spend a lot of time trying to figure out what it’s saying!

One thing I’d like to bring particular attention on these papers is that these are not EMC Papers, but are in fact co-branded collaborations by Microsoft, EMC and others (the one below was Microsoft, Cisco and EMC, and some of the others involve Dell and Brocade) but either way, Microsoft was directly involved in their creation as opposed to ‘slap a tag on it’

STOP THE PRESS! (vicki vale!) – Check out this paper though!  It is definitely longer! 84 pages!  Filled with raw technical example, use cases, all that jazz! Great must read paper and not just words! Lots of pretty pictures!  Yes it is Hyper-V but that cmon, this was co-branded Microsoft.. :)  And note: Published October 2010! So Vicki Vale did get one thing right!

Okay fine! Here is another paper! This one is a little older but I know you wouldn’t let me get away without giving you some VMware love! So here is one, with less pretty pictures!

Alright, one more then! This one was from August – not a whitepaper only a basic Reference Architecture, but I found it to be pretty damn cool looking!

Okay, enough of these (albeit amazing papers!) With no further adieu I’d like to introduce you to Dustin Smith! I’d tell you all about him, but Brian interviewed him here so you can find out all about how he’s an MVP, MCM and so many other things!

So, Dustin has his own blog where he talks almost exclusively about Exchange (okay, I think it’s all about Exchange, but whatever! this is MY BLOG! ;))

Exchange In the Private Cloud is definitely a must check out blog if you care anything about Exchange, or have to deal with it!

I’d like to highlight a few of his blog posts here for you to check out:

• Yes, Exchange Server is being virtualized!
  • Within EMC, our entire 40,000+ user infrastructure is virtualized on Exchange Server and the organization as a whole is moving towards virtualization of most all applications. Most all of the infrastructures we design and showcase within our Proven Solutions are geared toward virtualization, either with VMWare vSphere or Microsoft Hyper-V. See my previous blog post on what we recently did with the Tested Exchange Solutions Program case with Cisco and Microsoft where we showcased 34,000 users on Microsoft Hyper-V with Cisco UCS blade servers and EMC Unified Storage.
• EMC Whitepaper, Exchange Tested Solutions Program
  • What we are showcasing in this whitepaper is a result of our joint solution development with Microsoft and Cisco that was deployed and tested in Microsoft EEC labs in Redmond. In the whitepaper you will find the reference architecture for 32,400 users across a three site Exchange DAG scenario leveraging Microsoft Hyper-V, EMC NS480 Unified Storage, and Cisco UCS B-series blade servers along with analysis of testing results and key best practices on virtualizing Exchange Server 2010 on Hyper -V on EMC Unified storage and Cisco Unified Computing System.
• Exchange 2010 Backups? I don’t need any stinkin backups?!?
  • I think overall, the backupless/Exchange Native Data Protection option certainly brings a new element to the Exchange 2010 architecture discussions and different options for providing recovery when bad things happen. VSS based options (hardware and software based) are  still heavily used options to protect Exchange data that have been popular since the Exchange 2003 days and have increased with features and functionality into Exchange 2010.
• Getting Exchange Server 2010 into the Private Cloud
• Yes, EMC can do Exchange for SMB too

So, there are some teasers there of just some of the content that Dustin is putting out (There is obviously more.. but I’ll let you do the reading up on it! It’s definitely worth reading! – How so though, I just discovered Dustin TODAY and I’m sharing him with you a few hours after that point, So, yea I consider that to be pretty compelling :))

I want to leave you with links to all of the resources I mentioned above, so you can forth to gain access to the WP’s I mentioned and others I didn’t include pictures for!

• Virtualizing Microsoft Exchange 2010 with Confidence
• Business Continuity for Microsoft Exchange 2010 Enabled by EMC Unified Storage, Cisco Unified Computing System, and Microsoft Hyper-V
• Microsoft Exchange 2010: Zero-Data Loss Virtualization and Replication
• Microsoft Exchange 2010 Efficiency, Flexibility, Performance, and Availability at Scale Enabled by EMC Symmetrix VMAX, Virtual Provisioning and VMware vSphere
• EMC Virtual Infrastructure for Microsoft Exchange 2010 Enabled by EMC Symmetrix VMAX, VMware vsphere 4, and Replication Manager
• 15-Minute Guide – Extending the Capabilities of Microsoft Exchange Server

There are so many more than just these links alone – I actually was surprised on how much content there was at www.emc.com/exchange ! – So check it out, and as always let me know if I can help you in a particular way :)

Whoa, wait a minute, cut that track, Yo Dre.. What is this?!? A Rap Video by the vSpecialists?!?

Yea, seriously, this IS a Rap Video! Albeit sure you’re saying “Wow, isn’t that Circa Chicago Bears in the mid 1980’s with the superbowl shuffle?!” And I would go so far as to say.. The bears were rockstars at that time were they not?    This is simply a further reference to just how far these guys go the extra mile, both in their ability to get things actually done (as they say so in there) but a testament what each of these individuals do.   When they’re not busy doing their actual jobs, or studying or taking exams, or writing blog posts, or writing chapters for the next greatest Virtualization book you’ll be buying… or traveling all over the place, OR building out LABS and testing out things in every possible configuration and publishing the results..

Well… when all of that is said… and all of that is done.    They make rap videos! :)

I hope you enjoy it! The Production quality of this is absolutely AMAZING! I saw it on a big screen and I was floored at how well it was done (I always judge for production quality before I even look at content.. and the content is crazy good times ;))

Hey guys, the other day I was having a conversation with a friend of mine that went something like this.

How did this all start you might say?!? Well, contrary to popular belief, I am a STAUNCH NetApp FUD dispeller.  What that means is, if I hear something said about NetApp by a competitor, peer, partner or customer which I feel is incorrect or just sounds interesting; I task it upon myself to prove/disprove it because well frankly… People still hit me up with NetApp questions all the time :) (And I’d like to make sure I’m supplying them with the most accurate and reflective data! – yea that’s it, and it has nothing to do with how much of a geek I am.. :))

Well, in the defense of the video it didn’t go EXACTLY like that.   Here is a little background on how we got to where that video is today :)   I recently overheard someone say the following:

What I hear over and over is that dedupe rates when using VMware deteriorate over time

And my first response was “nuh uh!”, Well, maybe not my FIRST response.. but quickly followed by; “Let me try and get some foundational data”  because you know me… I like to blog about things and as a result collect way too much data to try to validate and understand and effectively say whatever I say accurately :)

The first thing I did was engage several former NetApp folks who are as agnostic and objective as I am to get their thoughts on the matter (we were on the same page!) – Data collection time!  

For Data Collection… I talked to some good friends of mine regarding how their Dedupe savings have been over time because they were so excited when we first enabled it in the first place (And I was excited for them!)   This is where I learned some… frankly disturbing things (I did talk to numerous guys named Mike interestingly enough, and on the whole all of those who I talked with and their data they shared with me reflected similar findings)

Disturbing things learned!

Yea I’ve heard all the jibber jabber before usually touted as FUD that NetApp systems will deteriorate over time in general (whether it be Performance, whether it be Space Savings) etc etc. 

Well some of the disturbing things learned actually coming from the field on real systems protecting real production data was:

• Space Savings are GREAT, and will be absolutely amazing in the beginning! 70-90% is common… in the beginning. (Call this the POC and the burn-in period)

• As that data starts to ‘change’ ever so slightly as you would expect your data to change (not sit static and RO) you’ll see your savings start to decrease, as much as 45% over a year
• This figure is not NetApp’s fault.  Virtual machines (mainly what we’re discussing here) are not designed to stay uniformly the same no matter what in accordance to 4k blocks, so the very fact that they change is absolutely normal so this loss isn’t a catastrophe, it’s a fact of the longevity of data.

• I found that particularly disturbing because after reviewing the data from these numerous environments… I had the impression VMware data would account for much more!   I saw a 50TB SAN only have ~2TB of data residing in Data stores and of that only 23% of it was deduplicating (I was shocked!)
• I was further shocked that when reviewing the data that over the course of a year on a 60TB SAN, this customer only found 12TB of data they could justify running the dedupe process against and of that they were seeing less than 3TB of ‘duplicate data’ coming in around 18% space savings over that 12TB.    The interesting bit is that the other 48TB of data just continued on un-affected by dedupe.   (Yes, I asked why don’t they try to dedupe it… and they did in the lab and, well it never made it into production)

At this point, I was even more so concerned.   Concerned whether there was some truth to this whole NetApp starts really high in the beginning (Performance/IO way up there, certain datasets will have amazing dedupe ratios to start) etc. and then starts to drop off considerably over time, while the EMC equivalent system performs consistently the entire time.

Warning! Warning Will Robinson!

This is usually where klaxons and red lights would normally go off in my head.    If what my good friends (and customers) are telling me is accurate, it is that not only will my performance degrade just by merely using the system, but my space efficiency will deteriorate over time as well.    Sure we’ll get some deduplication, no doubt about that!  But the long term benefit isn’t any better than compression (as a friend of mine had commented on this whole ordeal)    With the many ways of trying to look at this and understand I discussed it with my friend Scott who had the following analogy and example to cite with this:

The issue that I’ve seen is this:

Since a VMDK is a container file, the nature of the data is a little different than a standard file like a word doc for example.

Normally, if you take a standard windows C: – like on your laptop, every file is stored as 4K blocks.  However, unless the file is exactly divisible by 4K (which is rare), the last block has just a little bit of waste in it.  Doesn’t matter if this is a word doc, a PowerPoint, or a .dll in the \windows\system32 directory, they all have a little bit of waste at the end of that last block.

When converted to a VMDK file, the files are all smashed together because inside the container file, we don’t have to keep that 4K boundary.  Kind of like sliding a bunch of books together on a book shelf eliminating the wasted space.  Now this is one of the cool things about VMware that makes the virtual disk more space efficient than a physical disk – so this is a good thing.

So, when you have a VMDK and you clone it – let’s say create 100 copies and then do a block based dedupe – you’ll get a 99% dedupe rate across those virtual disks.  That’s great – initially.  Netapp tends to calculate this “savings” into their proposals and tell customers that require 10TB of storage, that they can just buy 5TB and dedupe and then they’ll have plenty of space.

What happens is, that after buying ½ the storage they really needed the dedupe rate starts to break down. Here’s why:

When you start running the VMs and adding things like service packs or patches for example – well that process doesn’t always add files to the end of the vmdk.  It often deletes files from the middle, beginning, end and then  replaces them with other files etc.  What happens then is that the bits shift a little to the left and the right – breaking the block boundaries. Imagine adding and removing books of different sizes from the shelf and making sure there’s no wasted space between them.

If you did a file per file scan on the virtual disk (Say a windows C: drive), you might have exactly the same data within the vmdk, however since the blocks don’t line up, the block based dedupe which is fixed at 4K sees different data and therefore the dedupe rate breaks down.

A sliding window technology (like what Avamar does ) would solve this problem, but today ASIS is fixed at 4K. 

Thoughts?

If you have particular thoughts about what Scott shared there, feel free to comment and I’ll make sure he reads this as well; but this raises some interesting questions.   

We’ve covered numerous things in here, and I’ve done everything I can to avoid discussing the guarantees I feel like I’ve talked about to death (linked below) so addressing what we’ve discussed:

• I’m seeing on average 20% of a customers data which merits deduping and of that I’m seeing anywhere from 10-20% space saved across that 20%

• Translation: 100TB of data, 20TB is worth deduping reclaiming about 4TB of space in total; thus on this conservative estimate you’d get about 4-5% space saved!
• Translation: When you have a 20TB data warehouse and you go to dedupe it (You won’t) you’ll see no space gained, with a 100% cost across it.

• With the EMC Unified Storage Guarantee, that same 20TB data warehouse will be covered by the 20% more efficient guarantee (Well, EVERY data type is covered without caveat)   [It’s almost like it’s a shill, but it really bears repeating because frankly this is earth shattering and worth discussing with your TC or whoever]

For more great information on EMC’s 20% Unified Storage Guarantee – check out these links (and other articles I’ve written on the subject as well!)

• EMC didn’t invent Unified Storage; They Perfected it
• EMC 20% Unified Storage Guarantee: Final Reprise
• EMC Unified Storage Capacity Calculator – The Tutorial!
• EMC 20% Unified Storage Guarantee !EXPOSED!
• EMC Unified Storage is 20% more efficient Guaranteed!

I won’t subject you to it, especially because it is over 7 minutes long, but here is a semi funny (my family does NOT find it funny!) video about EMCs Unified Storage Guarantee and making a comparison to NetApp’s Guarantee.   Various comments included in the description of the video – Don’t worry if you never watch it… I won’t hold it against you ;)

Be safe out there, the data jungle is a vicious one!   If you need any help driving truth out of your EMC or NetApp folks feel free to reach out and I’ll do what I can :)

SPOILERS!!!

Read the rest of this entry »