Linux Clustering: Building and Maintaining Linux Clusters

/LQX[&OXVWHULQJ%XLOGLQJDQG0DLQWDLQLQJ/LQX[&OXVWHUV &KDUOHV%RRNPDQ

3XEOLVKHU1HZ5LGHUV3XEOLVKLQJ )LUVW(GLWLRQ-XQH

,6%1SDJHV

/LQX[&OXVWHULQJ%XLGLQJDQG0DLQWDLQLQJ/LQX[&OXVWHUVSURYLGHV/LQX[XVHUVZLWK LQIRUPDWLRQDERXWEXLOGLQJWKHLURZQ/LQX[FOXVWHUIURPWKHJURXQGXS,WJLYHVEHVW SUDFWLFHVKHOSIXOKLQWVDQGJXLGHOLQHVDERXWEXLOGLQJRQHVHUYHURUKXQGUHGVRIVHUYHUVDWD OHYHOWKDWDGPLQLVWUDWRUVDWDQ\H[SHULHQFHOHYHOFDQXQGHUVWDQG

)URQW0DWWHU 7DEOHRI&RQWHQWV $ERXWWKH$XWKRU

)URPLQVWDOODWLRQRIWKHDLUFRQGLWLRQLQJDQGSRZHULQWKHGDWDFHQWHUWRDOWHUQDWLYHILOH V\VWHPVWRWKHILQDOSURGXFWLRQUXQWKLVERRNSURYLGHV\RXZLWKHYHU\WKLQJWKDW\RXQHHGWR NQRZ/LQX[&OXVWHULQJ%XLGLQJDQG0DLQWDLQLQJ/LQX[&OXVWHUVZDONV\RXWKURXJKWKH LQLWLDOGHVLJQDQGVHOHFWLRQRIWKHEHVWSRVVLEOHW\SHVRIFOXVWHUVDVZHOODVFRYHULQJ PRQLWRULQJWRROVDQGSURYLGLQJIRUGLVDVWHUUHFRYHU\1RWRQO\GRHVWKLVERRNSURYLGH LQIRUPDWLRQRQSDUDOOHODQG%HRZXOIW\SHFOXVWHUV&KDUOHV%RRNPDQJRHVLQWRGHSWKRQKLJK DYDLODELOLW\FOXVWHUVORDGEDODQFLQJDQGSURYLGHVDGYLFHIRUZULWLQJ\RXURZQGLVWULEXWLQJ DSSOLFDWLRQVDVZHOO,QFRUSRUDWLQJEHVWSUDFWLFHVDQGFXWWLQJHGJHDSSURDFKHV%RRNPDQ SURYLGHVVWHSE\VWHSDQGWULHGDQGWUXHPHWKRGVRIEULQJLQJXSD/LQX[FOXVWHUWR SURGXFWLRQOHYHO

/LQX[&OXVWHULQJ%XLOGLQJDQG0DLQWDLQLQJ/LQX[&OXVWHUV &RS\ULJKW‹E\1HZ5LGHUV3XEOLVKLQJ

$OOULJKWVUHVHUYHG1RSDUWRIWKLVERRNPD\EHUHSURGXFHGRU WUDQVPLWWHGLQDQ\IRUPRUE\DQ\PHDQVHOHFWURQLFRU PHFKDQLFDOLQFOXGLQJSKRWRFRS\LQJUHFRUGLQJRUE\DQ\ LQIRUPDWLRQVWRUDJHDQGUHWULHYDOV\VWHPZLWKRXWZULWWHQ SHUPLVVLRQIURPWKHSXEOLVKHUH[FHSWIRUWKHLQFOXVLRQRIEULHI TXRWDWLRQVLQDUHYLHZ /LEUDU\RI&RQJUHVV&DWDORJ&DUG1XPEHU 

,QWHUSUHWDWLRQRIWKHSULQWLQJFRGH7KHULJKWPRVWGRXEOHGLJLW QXPEHULVWKH\HDURIWKHERRN¶VSULQWLQJWKHULJKWPRVWVLQJOH GLJLWQXPEHULVWKHQXPEHURIWKHERRN¶VSULQWLQJ)RUH[DPSOH WKHSULQWLQJFRGHVKRZVWKDWWKHILUVWSULQWLQJRIWKHERRN RFFXUUHGLQ 3ULQWHGLQWKH8QLWHG6WDWHVRI$PHULFD 7UDGHPDUNV

$OOWHUPVPHQWLRQHGLQWKLVERRNWKDWDUHNQRZQWREH WUDGHPDUNVRUVHUYLFHPDUNVKDYHEHHQDSSURSULDWHO\FDSLWDOL]HG 1HZ5LGHUV3XEOLVKLQJFDQQRWDWWHVWWRWKHDFFXUDF\RIWKLV LQIRUPDWLRQ8VHRIDWHUPLQWKLVERRNVKRXOGQRWEHUHJDUGHGDV DIIHFWLQJWKHYDOLGLW\RIDQ\WUDGHPDUNRUVHUYLFHPDUN :DUQLQJDQG'LVFODLPHU

7KLVERRNLVGHVLJQHGWRSURYLGHLQIRUPDWLRQDERXW/LQX[(YHU\

HIIRUWKDVEHHQPDGHWRPDNHWKLVERRNDVFRPSOHWHDQGDV DFFXUDWHDVSRVVLEOHEXWQRZDUUDQW\RIILWQHVVLVLPSOLHG

7KHLQIRUPDWLRQLVSURYLGHGRQDQDVLVEDVLV7KHDXWKRUVDQG 1HZ5LGHUV3XEOLVKLQJVKDOOKDYHQHLWKHUOLDELOLW\QRU UHVSRQVLELOLW\WRDQ\SHUVRQRUHQWLW\ZLWKUHVSHFWWRDQ\ORVVRU GDPDJHVDULVLQJIURPWKHLQIRUPDWLRQFRQWDLQHGLQWKLVERRNRU IURPWKHXVHRIWKHGLVFVRUSURJUDPVWKDWPD\DFFRPSDQ\LW 3XEOLVKHU

'DYLG'Z\HU

$VVRFLDWH3XEOLVKHU 6WHSKDQLH:DOO

3URGXFWLRQ0DQDJHU *LQD.DQRXVH

0DQDJLQJ(GLWRU .ULVW\.QRRS

$FTXLVLWLRQV(GLWRU

'HERUDK+LWWHO6KRDI 'HYHORSPHQW(GLWRU 1DQF\6L[VPLWK

3URGXFW0DUNHWLQJ0DQDJHU .DWK\0DOPORII

3XEOLFLW\0DQDJHU 6XVDQ1L[RQ

6HQLRU(GLWRU 6KHUL&DLQ

&RS\(GLWRU

&ULV0DWWLVRQ ,QGH[HU

*LQQ\%HVV0XQURH

0DQXIDFWXULQJ&RRUGLQDWRU -LP&RQZD\

%RRN'HVLJQHU

/RXLVD.OXF]QLN &RYHU'HVLJQHU

%UDLQVWRUP'HVLJQ,QF &RYHU3URGXFWLRQ $UHQ+RZHOO

&RPSRVLWLRQ

-HII%UHGHQVWHLQHU

7KLVERRNLVGHGLFDWHGWR(WKDQ0D\KHJURZXSQRUPDOO\DQGZLWKRXWWRR PDQ\LVVXHV /LQX[&OXVWHULQJ%XLOGLQJDQG0DLQWDLQLQJ/LQX[&OXVWHUV $ERXWWKH$XWKRU

$ERXWWKH7HFKQLFDO5HYLHZHUV $FNQRZOHGJPHQWV

7HOO8V:KDW"JH@WKHQ :HQHHGWRDVVXPHKRVWLVUHDOO\GRZQ$VVXPH IDLORYHUVHTXHQFH VELQLIFRQILJHWKKRVWQHWPDVNQHWPDVNXS

HFKRKRVWLVGRZQ3OHDVHFKHFNLPPHGLDWHO\!ELQPDLO VKRVWLVGRZQXVHU#KRVWFRP HOVH VHFRQGSLQJUHWXUQHGDYDOXH:KHZ  HOVH  IL GRQH

7KHVFULSWVKRXOGEHDEOHWRUXQLQWKHEDFNJURXQGDQGPDLOWKHGHVLJQDWHGXVHULIDFRQQHFWLYLW\SUREOHP RFFXUV7KHVFULSWFDQHDVLO\EHDGDSWHGWRSLQJPRUHWKDQRQHKRVWLI\RX¶UHFUHDWLYHHQRXJK /RDG%DODQFLQJ8VLQJ'165HFRUGV

$TXLFNDQGGLUW\ZD\WRHQDEOHORDGEDODQFLQJFDQEHDFKLHYHGZLWKVLPSOH$UHFRUGVLQ'16$OWKRXJKLW SUHVHQWVLWVHOIDVDGLUW\KDFNHQDEOLQJWKHVDPHQDPHZLWKWZRRUPRUHGLIIHUHQW,3DGGUHVVHVGRHVRIIHUD PHDVXUHRIORDGEDODQFLQJDOEHLWOLPLWHGLQVFRSH7KHVDPHHIIHFWGRHVQRWZRUNKRZHYHUZKHQHQDEOLQJ GLIIHUHQW,3DGGUHVVHVLQHWFKRVWV 7RLOOXVWUDWHZHKDYHWKHIROORZLQJ]RQHHQDEOHG

>URRW#PDWUL[QDPHG@FDW]RQHGQV  =RQHILOHIRU]RQHFRP  #,162$]RQHFRPSRVWPDVWHU]RQHFRP VHULDO UHIUHVK UHWU\ H[SLUHVHFRQGV  PLQLPXPVHFRQGV ,116QV]RQHFRP ,116QV]RQHFRP KRVW,1$ KRVW,1$ KRVW,1$

,QWKLVH[DPSOHHDFKKRVWFDUULHVWKHVDPHGRPDLQQDPH\HWWKH$UHFRUGSRLQWVWRDGLIIHUHQWDGGUHVV 3LQJVRIWKHPDFKLQHVKRZWKHIROORZLQJ >URRW#PDWUL[QDPHG@SLQJKRVW

3,1*KRVW]RQHFRP IURP E\WHVRIGDWD >URRW#PDWUL[QDPHG@SLQJKRVW 3,1*KRVW]RQHFRP IURP E\WHVRIGDWD >URRW#PDWUL[QDPHG@SLQJKRVW 3,1*KRVW]RQHFRP IURP E\WHVRIGDWD >URRW#PDWUL[QDPHG@SLQJKRVW 3,1*KRVW]RQHFRP IURP E\WHVRIGDWD

$V\RXFDQVHHLW¶VQRWDIRROSURRIVLWXDWLRQEXWLWGRHVRIIHUVRPHPHWKRGRIORDGEDODQFLQJEHWZHHQKRVWV

$OWHUQDWH)LOH6\VWHPV

7KHVHFRQGH[WHQGHGILOHV\VWHPH[WZDVGHYHORSHGE\5HQp&DUGDVDQDOWHUQDWLYHWRWKHILUVWILOHV\VWHP GHULYHGIURP0LQL[$OWKRXJK/LQX[VXSSRUWVPDQ\GLIIHUHQWILOHV\VWHPVH[WUHPDLQVWKHGHIDXOWIRUPRVW GLVWULEXWLRQV0DQ\YHQGRUVKDYHLPSURYHGRQWKHGHIDXOWILOHV\VWHPWRRIIHUIHDWXUHVVXFKDVMRXUQDOLQJ YROXPHPDQDJHPHQWQHWZRUNEORFNILOHV\VWHPVDQGVKDUHGGLVNILOHV\VWHPV([WGRHVQRWKDYHWKHVH IHDWXUHVEXLOWLQ

-RXUQDOLQJ)LOH6\VWHPV

(QWHUWKHMRXUQDOWKHPRVWSRSXODUDOWHUQDWLYHPHWKRGWRNHHSWUDFNRIWKHILOHV\VWHP'HSHQGLQJRQWKH LPSOHPHQWDWLRQMRXUQDOLQJILOHV\VWHPVXVHGLIIHUHQWPHWKRGVEDVHGRQDGDWDEDVHWRNHHSWUDFNRIILOH V\VWHPGDWD:KDW¶VVRDWWUDFWLYHDERXWMRXUQDOLQJILOHV\VWHPVLVWKDWIVFNLVQ¶WQHHGHG,QWKHHYHQWRID V\VWHPFUDVKWKHORJVIURPWKHGDWDEDVHFDQEHUHSOD\HGWRUHSUHVHQWWKHGDWDDWWKHWLPHRIDFUDVK7KLV PHWKRGWHQGVWREULQJWKHV\VWHPXSWRDFRQVLVWHQWVWDWHPXFKIDVWHUWKDQDILOHV\VWHPUXQZLWKIVFN KRZHYHULWGRHVQ¶WGRDQ\WKLQJVSHFLDOIRUGDWDUHOLDELOLW\$ODUJH5$,'GHYLFHWKDW¶VXVLQJH[WPLJKWWDNH VHYHUDOKRXUVWRJRWKURXJKIVFNFKHFNVDOWKRXJKZLWKWKHDGGLWLRQRIDMRXUQDOLQJILOHV\VWHPQRFKHFNV DUHPDGH$OOZULWHVDUHPDGHDQGSOD\HGEDFNIURPWKHMRXUQDOZKLFKUHVXOWVLQDERRWWLPHRIRQO\ PLQXWHV 'LIIHUHQWMRXUQDOLQJILOHV\VWHPVDOVRKDYHVXSSRUWIRUV\QFKURQRXV,2LQFUHDVHGEORFNVL]HVXSSRUW LQWHJUDWLRQZLWK1)6TXRWDVXSSRUWDQGVXSSRUWIRUDFFHVVFRQWUROOLVWV$&/V  1HWZRUN)LOH6\VWHPV

1HWZRUNILOHV\VWHPVPDQDJHWRWDNHRQHRUPRUHGHYLFHVDQGDSSHDUWRWKHVHUYHUDVRQHORJLFDOYROXPH 7KHWULFNKHUHLVWRIRROWKH26LQWRWKLQNLQJWKDWWKHYROXPHLVDORFDOO\DWWDFKHG5$,'RUFOXVWHUHGGHYLFH 7KHQHWZRUNILOHV\VWHPQDWXUDOO\VKRZVVRPHSHUIRUPDQFHORVVGXHWRWKHQHWZRUNRYHUKHDG

1HWZRUNLQJIRU&OXVWHUV

1HWZRUNLQJLVDQHVVHQWLDOSDUWRIFOXVWHULQJ&RPSXWHUVMXVWFDQ¶WWDONWRHDFKRWKHURQWKHLURZQWKDW ZRXOGEHFUHHS\3DUDOOHOQHWZRUNVQHHGDGHGLFDWHGQHWZRUNLQJHQYLURQPHQWZKHUHLQFRPSDULVRQTXLWHD IHZORDGEDODQFHGGLVWULEXWHGDQGHYHQVRPH+$VROXWLRQVDUHGHVLJQHGRYHUD:$1HQYLURQPHQW7R EHWWHUXQGHUVWDQGWKHUHODWLRQVKLSEHWZHHQWKHQHWZRUNDQGWKHFOXVWHUZHQHHGWRXQGHUVWDQGQHWZRUN LVVXHVDQGKRZWKH\DIIHFWFOXVWHUFRPPXQLFDWLRQV$OWKRXJKZHZRQ¶WJHWLQWRDGHWDLOHGH[SODQDWLRQRI 7&3,3DQGQHWZRUNLQJDFXUVRU\H[DPLQDWLRQLVSURYLGHGKHUH 7KH26,1HWZRUNLQJ0RGHO

7KH,QWHUQDWLRQDO2UJDQL]DWLRQIRU6WDQGDUGL]DWLRQ,62 DQLQWHUQDWLRQDOERG\FRPSULVHGRIQDWLRQDO VWDQGDUGVERGLHVIURPPRUHWKDQFRXQWULHVFUHDWHGWKH2SHQ6WDQGDUGV,QWHUFRQQHFWLRQ26, PRGHOLQ RUGHUIRUGLIIHUHQWYHQGRUVWRGHVLJQQHWZRUNVWKDWZRXOGEHDEOHWRWDONWRHDFKRWKHU7KH26,PRGHO ILQDOO\VWDQGDUGL]HGLQLVEDVLFDOO\DUHIHUHQFHWKDWVHUYHVDVDJHQHUDOIUDPHZRUNIRUQHWZRUNLQJ

,WZDVQ¶WXQFRPPRQWRILQGYHQGRUVDERXW\HDUVDJRZKRSURGXFHGFRPSXWHUVWKDWGLGQ¶WKDYHWKHDELOLW\ WRWDONWRRWKHUYHQGRUV$ORQJZLWKFUHDWLQJRSHUDWLQJV\VWHPVDQGPDLQIUDPHVWKDWZHUHUDWKHUSURSULHWDU\ WKHFRPPXQLFDWLRQVRIWKHWLPHZHUHPRVWO\SURSULHWDU\DVZHOO,QWKH%ULWLVK6WDQGDUGV2UJDQL]DWLRQ SURSRVHGWRWKH,62WKDWDQLQWHUQDWLRQDOVWDQGDUGIRUGLVWULEXWHGSURFHVVLQJEHFUHDWHG7KH$PHULFDQ 1DWLRQDO6WDQGDUGV,QVWLWXWH$16, ZDVFKDUJHGZLWKSUHVHQWLQJDIUDPHZRUNIRUQHWZRUNLQJDQGWKH\ FDPHXSZLWKD6HYHQ/D\HUPRGHO7KH2ULJLQVRI26,KWWSZLOOLDPVWDOOLQJVFRP([WUDV26,KWPO 7KLV PRGHOLVVKRZQLQ)LJXUH )LJXUH26,1HWZRUN/D\HUGLDJUDP

7KHWRSOD\HU/D\HU6HYHQLVWKH$SSOLFDWLRQ/D\HUDQGLVZKHUHWKHHQGXVHUDFWXDOO\LQWHUIDFHVZLWKWKH FRPSXWHULWVHOI/D\HU6HYHQHQFRPSDVVHVVXFKDSSOLFDWLRQVDVWKHZHEWHOQHW66+DQGHPDLO

/D\HU6L[WKH3UHVHQWDWLRQ/D\HUSUHVHQWVGDWDWRWKH$SSOLFDWLRQ/D\HU&RPSXWHUVWDNHJHQHULFGDWDDQG WXUQLWLQWRIRUPDWVVXFKDVWH[WLPDJHVVRXQGDQGYLGHRDWWKLVOD\HU'DWDWUDQVODWLRQFRPSUHVVLRQDQG HQFU\SWLRQDUHKDQGOHGKHUH /D\HU)LYHWKH6HVVLRQ/D\HUKDQGOHVGDWDE\SURYLGLQJDPHDQVRIWUDQVSRUWIRUWKH3UHVHQWDWLRQ/D\HU ([DPSOHVRIDSSOLFDWLRQVWKDWXWLOL]HWKH6HVVLRQ/D\HULQFOXGH;:LQGRZ1)6$SSOH7DONDQG53&

7KH7UDQVSRUW/D\HU/D\HU)RXUSURYLGHVHUURUGHWHFWLRQDQGFRQWUROPXOWLSOH[LQJWUDQVSRUWFRQQHFWLRQV RQWRGDWDFRQQHFWLRQVPXOWLSOH[LQJDOORZVWKHGDWDIURPGLIIHUHQWDSSOLFDWLRQVWRVKDUHRQHGDWDVWUHDP  IORZFRQWURODQGWUDQVSRUWWRWKH1HWZRUN/D\HU

/D\HU7KUHHWKH1HWZRUN/D\HULVUHVSRQVLEOHIRUWUDQVPLWWLQJGDWDDFURVVQHWZRUNV7ZRW\SHVRISDFNHWV DUHXVHGDWWKLVOHYHOLQFOXGLQJGDWDSDFNHWVDQGURXWHXSGDWHV5RXWHUVWKDWZRUNRQWKLVOHYHONHHSGDWD DERXWQHWZRUNDGGUHVVHVURXWLQJWDEOHVDQGWKHGLVWDQFHIRUUHPRWHQHWZRUNV

/D\HU7ZRWKH'DWD/LQN/D\HUWUDQVODWHVPHVVDJHVIURPWKH1HWZRUN/D\HULQWRWKH3K\VLFDO/D\HU7KLV OD\HUKDQGOHVHUURUFRQWUROUHOLDELOLW\DQGLQWHJULW\LVVXHV7KH1HWZRUN/D\HUDGGVIUDPHVWRWKHGDWDDQG DGGVDFXVWRPL]HGKHDGHUFRQWDLQLQJWKHVRXUFHDQGGHVWLQDWLRQDGGUHVV7KHOD\HULGHQWLILHVHDFKGHYLFHRQ WKHQHWZRUNDVZHOO

7KHERWWRPOD\HU/D\HU2QHRUWKH3K\VLFDO/D\HUVHQGVDQGUHFHLYHVLQIRUPDWLRQLQWKHIRUPRIRQHVDQG ]HURV7KHFKDUDFWHULVWLFVRIWKLVOD\HULQFOXGHVSHFLILFDWLRQVIRUVLJQDOYROWDJHVZLUHZLGWKDQGOHQJWKDQG VLJQDOLQJ

0DQ\GHYLFHVRSHUDWHDWGLIIHUHQWOHYHOV7KHKXEZKHQFDEOHGRQO\DPSOLILHVRUUHWUDQVPLWVGDWDWKURXJK DOOLWVSRUWV,QWKLVZD\LWRSHUDWHVRQO\RQ/D\HU2QH+RZHYHUDVZLWFKRSHUDWHVRQ/D\HUV2QHDQG7ZR DQGDURXWHURSHUDWHVRQ/D\HUV2QH7ZRDQG7KUHH7KHHQGXVHU¶VZRUNVWDWLRQZRXOGW\SLFDOO\KDQGOH /D\HUV)LYH6L[DQG6HYHQDOWKRXJKWKHYHUVDWLOLW\RI/LQX[FRXOGDOORZLWWRKDQGOHPXFKPRUH  7KHSRLQWRIKDYLQJVXFKDOD\HUHGDSSURDFKLVVRWKDWWKHGLIIHUHQWDVSHFWVRIQHWZRUNLQJFDQZRUNZLWK HDFKRWKHU²\HWUHPDLQLQGHSHQGHQW7KLVDOORZVDSSOLFDWLRQGHYHORSHUVWKHIUHHGRPWRZRUNRQRQHDVSHFW RIDOD\HUZKLOHH[SHFWLQJWKHRWKHUOD\HUVWRZRUNDVSODQQHG:LWKRXWWKHVHOD\HUVWKHGHYHORSHUZRXOG KDYHWRPDNHVXUHWKDWHYHU\DVSHFWRIWKHDSSOLFDWLRQLQFOXGHGVXSSRUWIRUHDFKOD\HU,QRWKHUZRUGV LQVWHDGRIMXVWFRGLQJDVLPSOHJDPHWKHGHYHORSPHQWWHDPZRXOGQRWRQO\KDYHWRFRGHWKHJDPHLWVHOIEXW DOVRWKHSLFWXUHIRUPDWVWKH7&3,3VWDFNDQGKDYHWRGHYHORSWKHURXWHUWRWUDQVPLWWKHLQIRUPDWLRQ :K\LVOHDUQLQJWKLVVRLPSRUWDQWIRUFOXVWHULQJ")LUVWRIDOOLWDLGVLQWURXEOHVKRRWLQJ.QRZLQJZKHUHWKH SUREOHPOLHVLVWKHPRVWLPSRUWDQWVWHSWRVROYLQJWKHSUREOHP(YHU\WURXEOHVKRRWLQJPHWKRGQHHGVWRVWDUW VRPHZKHUHDQGE\JRLQJRYHUWKH26,PRGHO\RXFDQHDVLO\GLDJQRVHZKHUHWKHSUREOHPOLHV%\LVRODWLQJ HDFKOD\HU\RXFDQWUDFNGRZQSUREOHPVDQGUHVROYHWKHP 1HWZRUN7RSRORJ\

'LIIHUHQWW\SHVRIFOXVWHUVQHHGGLIIHUHQWW\SHVRIQHWZRUNWRSRORJLHVGHSHQGLQJRQWKHIUDPHZRUNLQYROYHG $+$QHWZRUNPLJKWQHHGPRUHDWWHQWLRQWRGHWDLOUHJDUGLQJVHFXULW\WRPDLQWDLQXSWLPHWKDQDGLVWULEXWHG FRPSXWLQJHQYLURQPHQWRUDSDUDOOHOFOXVWHULQJVFHQDULR 3LFWXUHWKHIROORZLQJ+$VFHQDULRLI\RXZLOODVVKRZQLQ)LJXUH$QDWLRQZLGHEDQNKDV3RLQWVRI

3UHVHQFH323 LQWKUHHFLWLHVDFURVVWKH8QLWHG6WDWHV(DFKFLW\KDVLWVRZQFOXVWHUZLWKLWVRZQGDWDEDVH DQGHDFKLVFRQQHFWHGGLUHFWO\WRWKH,QWHUQHWIURPLWVRZQFLW\EXW\HWHDFKFLW\KDVWRKDYHDFFHVVWRWKH RWKHU¶VGDWD+RZLVWKLVEHVWDFKLHYHG"7RSRORJLHVKDYHWREHFOHDUO\WKRXJKWDERXWLQDGYDQFH&RQVLGHU WKHWRSRORJ\RIFOXVWHUVVSUHDGDFURVVD:$1IRULQVWDQFH )LJXUH+LJKDYDLODELOLW\DFURVVWKH:$1

,QWKLVVFHQDULRWKUHHVLWHVDUHFRQQHFWHGRYHUWKHSXEOLF,QWHUQHWZLWKDILUHZDOOIRUVHFXULW\7KLVLVQ¶WWKH PRVWHIIHFWLYHPHWKRGRIDFKLHYLQJKLJKDYDLODELOLW\EXWLW¶VDFRPPRQVFHQDULR

2QHZD\WRJRDERXWUHGHVLJQLQJWKLVVFHQDULRLVWRUHPRYHWZRVDWHOOLWHFLWLHVIURPWKH,QWHUQHWDQGFRQQHFW HDFKRIWKHVHFLWLHVWKURXJKGLUHFWIUDPHUHOD\WRWKHLQWHUQDOQHWZRUNWKHUHE\GURSSLQJWKHILUHZDOOIURP WZRRIWKHVDWHOOLWHRIILFHV$QRWKHUDSSURDFKZRXOGEHWRLPSOHPHQWDORDGEDODQFHGQHWZRUN323VFRXOG HDVLO\EHSODFHGLQNH\ORFDWLRQVDFURVVWKHFRXQWU\VRWKDWFXVWRPHUVFRXOGKDYHUHODWLYHO\ORFDODFFHVVWR WKHILQDQFLDOGDWD%XWEHFDXVHWKHGDWDKDVWREHV\QFKURQL]HGEHWZHHQWKUHHFLWLHVLQUHDOWLPHWKH EDQGZLGWKLQYROYHGZRXOGEHWUHPHQGRXV $SDUDOOHOFOXVWHUVWLOOQHHGVDQHWZRUNGHVLJQDOWKRXJKRQHWKDWLVPXFKVLPSOHULQVFRSH%HIRUHIDVW HWKHUQHWWRWKHGHVNWRSDQGJLJDELWHWKHUQHWIRUVHUYHUVZDVWKHFRPPRQVWDQGDUGK\SHUFXEHVZHUHWKH SULPDU\PHDQVIRUGHVLJQLQJKLJKSHUIRUPDQFHFOXVWHUV$K\SHUFXEHLVDVSHFLILFPHWKRGWROD\RXWD SDUDOOHOFOXVWHUXVXDOO\XVLQJUHJXODUHWKHUQHW7KHWULFNWRGHVLJQLQJDK\SHUFXEHZDVWKDWHDFKFRPSXWHU ZRXOGKDYHWRKDYHDGLUHFWQHWZRUNFRQQHFWLRQWRHDFKRWKHUQRGHLQWKHFXEH7KLVZRUNHGZHOOZLWK VPDOOHUFXEHVDOWKRXJKWKHVL]HRIWKHFXEHZDVVRPHZKDWOLPLWHGGXHWRWKHDPRXQWRIQHWZRUNFDUGVWKDW FRXOGILWLQDQ\RQHFRPSXWHU/DUJHUFOXVWHUVUHTXLUHGPHVKHGGHVLJQVZLWKKXEVWRVXSSRUWHDFKQRGHDQG WKHUHTXLVLWHPXOWLSOHFRQQHFWLRQV1HHGOHVVWRVD\WKH\¶UHTXLWHPHVV\EHFDXVHRIDOOWKHLQWHUPHVKHG FDEOLQJ:LWKWKHDGYHQWRIIDVWHWKHUQHWDQGJLJDELWHWKHUQHWDVLPSOHPDQDJHGRUXQPDQDJHGVZLWFKZLOO WDNHFDUHRIPRVWRIWKHEDQGZLGWKSUREOHPV2IFRXUVH³WKHIDVWHUWKHEHWWHU´LVWKHJHQHUDOPRWWRVREH VXUHWRFRQVLGHUWKHQHWZRUNZKHQEXGJHWLQJ\RXUFOXVWHU 6HUYLFHVWR&RQVLGHU

$ORQJZLWKWKHSK\VLFDOGHYHORSPHQWRIWKHFOXVWHUDQGWKHQHWZRUNWRSRORJ\GHFLGLQJZKLFKVHUYLFHVWR HQDEOHLVWKHQH[WVWHSWRZDUGDILQLVKHGFOXVWHULQJVROXWLRQ$OWKRXJKPRVW/LQX[GLVWULEXWLRQVRIIHUDFFHVV WRDOOWKHVWDQGDUGVHUYLFHVOLVWHGLQHWFVHUYLFHVWKHV\VWHPDGPLQLVWUDWRUKDVWRGHWHUPLQHLIWKRVH VHUYLFHVDUHDSSOLFDEOHWRWKHLUHQYLURQPHQW ,QDKLJKVHFXULW\HQYLURQPHQWWKHV\VWHPDGPLQLVWUDWRUPLJKWKDYHQRFKRLFHEXWWRWLJKWHQGRZQWKHVH UHVRXUFHV7KHPRVWFRPPRQZD\VRIGLVDEOLQJVHUYLFHVLQFOXGHUHVWULFWLQJDFFHVVWRWKHPWKURXJKWKH ILUHZDOOE\VHWWLQJXSDQLQWHUQDOQHWZRUNRUE\XWLOL]LQJKRVWVGHQ\DQGKRVWVDOORZ7KRVHVHUYLFHV WKDWDUHDFFHVVLEOHWKRXJKLQHWFDQEHFRPPHQWHGRXWLQHWFLQHWGFRQI

,W¶VQRVXUSULVHWKDWWRHQDEOHZHEVHUYLFHV\RXKDYHWRNHHSDFFHVVWRSRUW²DQGLI\RX¶UHJRLQJWR HQDEOHZHEVXSSRUWRYHU6HFXUH6RFNHWV/D\HU66/ ,QDGGLWLRQZKDW\RXDOVRKDYHWRNHHSLQPLQGZKHQ GHVLJQLQJ\RXUFOXVWHULVDFFHVVWRWKHEDFNXSGHYLFHVZKHWKHURUQRWWRDOORZ66+WHOQHWRUIWSDQGVRRQ ,QIDFWLW¶VDJRRGLGHDWRWRWDOO\GLVDOORZWHOQHWDFURVVWKHHQYLURQPHQWDQGUHSODFHLWZLWKVHFXUHVKHOO1RW RQO\GRHVWKLVDOORZVHFXUHORJLQVEXWDOVRVHFXUHIWSWUDQVIHUVIRULQWHUQDORIILFHXVH)73VHUYHUVVKRXOG VWLOOXVHUHJXODUIWSRIFRXUVHEXWRQO\IRUGHGLFDWHGVHUYHUV .HHSLQJS3RUW@>O&RQILJ)LOH@>L'LUHFWRU\@>G/HYHO@>UY@

)RUH[DPSOH

OEGQVOOEBGQVERRW

VHWVXSORDGEDODQFLQJE\XVLQJWKHFRQILJXUDWLRQLQWKHOEBGQVERRWILOH8VLQJWKHRWKHURSWLRQVDOORZV \RXWRVSHFLI\DOWHUQDWH'16SRUWVDOWHUQDWHQDPHGERRWILOHVDQGORJGLUHFWRULHV OEGQVEYDUQDPHGQDPHGERRWOHWFOEBGQVERRWL?YDUWPSU

7KLVXVHVWKH'16ILOHQDPHGERRWZLWKWKHFRQILJXUDWLRQILOHOEBGQVERRW

7KH±LVZLWFKWHOOV(GGLHWRXVHWKHDOWHUQDWHORJJLQJGLUHFWRU\YDUWPS 7KHUVZLWFKUHVWDUWVWKHVHUYHULIVRPHWKLQJKDSSHQV &RQILJXULQJWKH+773*DWHZD\

$IWHUWKHHQKDQFHG'16SRUWLRQLVFRPSOHWHGLW¶VWLPHWRFRQILJXUHWKHQH[WSRUWLRQRIWKH(GGLH0LVVLRQ QDPHO\WKHHQKDQFHG+773JDWHZD\IVVKG@WKHQ FSVVKGHWFLQLWG FKPRG[HWFLQLWGVVKG OQVHWFLQLWGVVKGHWFUFG6VVKG OQVHWFLQLWGVVKGHWFUFG.VVKG HOVH  IL UHERRW (2' 7HPSRUDU\6WDUWXS6FULSW,QVWDOO&RPSOHWH  0DNHWHPSVFULSWH[HFXWDEOHHQGVFULSW 

FKPRG[DHWFUFG6WHPSVFULSW

7KLVSURJUDPLVFDOOHGDIWHUWKH.LFNVWDUWVFULSWVWDUWVWKHSRVWLQVWDOODWLRQ7KLVVFULSWLQVWDOOVLWVHOI LQHWFUFGVRWKDWLWLVFDOOHGXSRQDWUHERRW$IWHUWKHV\VWHPLVUHERRWHGWKHVFULSWLVFDOOHGDQGVWDUWV UXQQLQJLQVWDOOVRIWZDUHIURPDWKLUGVHUYHU$IWHUWKHVFULSWLVGRQHLWUHPRYHVLWVHOIIURPHWFUFGVR WKDWLWGRHVQ¶WJHWFDOOHGIRUDQLQVWDOOHDFKWLPH ,QWKHSUHYLRXVVFULSWWKHLQVWDOOBVVKFDQDOVREHSODFHGVWDQGDORQHDORQJZLWKWKHRWKHULQVWDOOVFULSWV 7KLVDOORZV\RXWRFDOO\RXURZQVFULSWVIURPWKHUHRULQFOXGHWKHPLQWKHPDLQLQVWDOOVFULSWZKLFKHYHU ZRUNVEHWWHU'LVDVWHU5HFRYHU\EHFRPHVPXFKHDVLHUZKHQ\RX¶YHJRWDSODQ *KRVW,PDJHV

$VZLWK.LFNVWDUWLPDJHVLWPLJKWEHHDVLHUWRUHLQVWDOOWKHHQWLUHRSHUDWLQJV\VWHPUDWKHUWKDQGLDJQRVLQJ HUURUV