Re: IFS Deduplication

[John Jones <chianime@xxxxxxxxx>]

> From an IFS perspective, consider using the i to backup a group of Windows
PCs.  Using deduplication in the IFS would mean that, for 10 Windows 7
machines, there'd be just one set of Win7 files taking up disk space.  One
set of commonly used apps, etc.  If you average PC build has 50-70GB of OS
& apps before you get to the data, across 10 machines that would save
potentially 450-630GB of space.

It may not improve backup times though.  That would depend on whether the
deduping algorithm can run faster than straight up disk writes.

Using another example, look at JDPeopOracle EnterpriseOne.  Each time you
do a package build (which generates the app code) it chews through a few GB
of disk writing out new spec files and whatnot.  There will often be just
minor differences from build to build meaning that a dedupe algorithm that
was based on sectors/clusters and not entire files/objects would radically
reduce disk consumption over time.

On Sat, Feb 9, 2013 at 7:01 AM, <rob@xxxxxxxxx> wrote:

> Just how often do you think you have data duplicated in the IFS that you
> would want deduplicated?  For example if I do a CRTDUPOBJ of the IIM file
> into a test library that is, in effect, duplicating something from
> /qsys.lib/prod.lib/iim.file
> to
> /qsys.lib/test.lib/iim.file
> What would deduplication do in this case?
>
> Or do you want deduplication to only work on stream file directories?
>
> IBM has something like this with Domino and DAOS.  In which case Marketing
> Dude sends out an email with PowerPointFromHell.ppt as an attachment in an
> email to 100 people in the company it stores one copy as a separate file
> (.nlo) in a different directory and every email just links to that file.
> Of course, as I type this up I'm in the process of bouncing one such
> Domino server to diagnose file corruption of these .nlo files and/or their
> links.  (Oops it just died with a "Panic" error.)
> What's a little corruption when it saves a serious load of disk space? :-(
> And if I try to OS copy one mail file from one server to another it
> doesn't know where the links are but you learn to deal with stuff with
> alternate methods.
>
>
> Rob Berendt
> --
> IBM Certified System Administrator - IBM i 6.1
> Group Dekko
> Dept 1600
> Mail to:  2505 Dekko Drive
>           Garrett, IN 46738
> Ship to:  Dock 108
>           6928N 400E
>           Kendallville, IN 46755
> http://www.dekko.com
>
>
>
>
>
> From:   Matt Olson <Matt.Olson@xxxxxxxx>
> To:     Midrange Systems Technical Discussion <midrange-l@xxxxxxxxxxxx>,
> Date:   02/08/2013 05:49 PM
> Subject:        RE: IFS Deduplication
> Sent by:        midrange-l-bounces@xxxxxxxxxxxx
>
>
>
> Interesting, looks like it's a standard Xeon PC appliance with a crazy
> amount of processing power (40 cores).
>
> Perhaps they'll implement something like this at the software level
> directly into the OS in V8R1.
>
> Pretty neat feature to have without the SAN cost's.
>
> -----Original Message-----
> From: DeLong, Eric [mailto:EDeLong@xxxxxxxxxxxxxxx]
> Sent: Friday, February 08, 2013 4:39 PM
> To: Midrange Systems Technical Discussion
> Subject: RE: IFS Deduplication
>
> Well, IBM does have deduplication product offerings, but not free...  For
> the most part, I see references to this product: IBM ProtecTIER
> Deduplication Services...
>
> https://www-304.ibm.com/partnerworld/wps/pub/overview/HW21Z
>
> Looks like an appliance based solution, I think.
>
> -Eric DeLong
>
> -----Original Message-----
> From: midrange-l-bounces@xxxxxxxxxxxx [
> mailto:midrange-l-bounces@xxxxxxxxxxxx] On Behalf Of Matt Olson
> Sent: Friday, February 08, 2013 4:04 PM
> To: midrange-l@xxxxxxxxxxxx
> Subject: IFS Deduplication
>
> Does the IFS implemented in V7R1 have built in data de-duplication like
> files on a Windows Server 2012 file share can now have since data
> de-duplication is built into the new Windows Server 2012 OS?
>
> If so, how can we activate it?
>
> Matt
> --
> This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing
> list To post a message email: MIDRANGE-L@xxxxxxxxxxxx To subscribe,
> unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/midrange-l
> or email: MIDRANGE-L-request@xxxxxxxxxxxx Before posting, please take a
> moment to review the archives at http://archive.midrange.com/midrange-l.
>
> --
> This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing
> list To post a message email: MIDRANGE-L@xxxxxxxxxxxx To subscribe,
> unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/midrange-l
> or email: MIDRANGE-L-request@xxxxxxxxxxxx Before posting, please take a
> moment to review the archives at http://archive.midrange.com/midrange-l.
>
> --
> This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing
> list
> To post a message email: MIDRANGE-L@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/midrange-l
> or email: MIDRANGE-L-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/midrange-l.
>
>
> --
> This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing list
> To post a message email: MIDRANGE-L@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/midrange-l
> or email: MIDRANGE-L-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/midrange-l.