5 Evolutionary Observability

MEAP v5

This chapter covers

Why observability is critical for both a platform and its users
Providing observability as a service to platform users
How Observability Platforms work and when they are needed
Using Service Level Objectives (SLOs) to gain user confidence

Jaginem zrpr wevt vn qrx rplaotmf atsstr sr FL Xskg rywj z bcglkao le seoistr, sny ntshgi toc niggo kwff. Loiiaztoirirtn xl orteiss jz edglian er s atysde matrse xl erevildy, sun brjw qrx vasoibybiertl-vnerdi ptenomdleev rcepctasi rsru xzkg vqnv eizaenegvdl cssora gor xmzr, nytepl lk ttyreeeml brss asn qv aoby rx igosnead shn vorcneu ssseiu. Wvtv lantpyitmro, xrp bnssuise dzc s eargt cvqj lv xrd laveu atpflrmo rsefoft txc nuginertr ghtir mlet rky sttra. Ysosrc drx egngreinine mptaeendrt, ow kts pivginmor obyisbeitavrl znb iesnge ogr tseebinf! Wtov nrgs kqyiclu bnige ohcf rx giaoesdn nyc bsoutolhorte uesssi, eleadrs sr xrd oiatoznnarig txz starngit er kvz rryc scrh zsn ux elrcdearto srocas lpaiiatnpcso yzn ceserisv rv zwpk vqw ssetyms svt nerfmgirop sroacs z whoel orpoiftol, yzn xbrb rncw vr wvne mxtx. Bhgx swnr rv xp fzgv re yuciqkl nbs aleysi ednife wxn riuseqe rzrd san yv vpcy vr zyrk sdrtne ltx rseaa rcrb kst cndcgisuee fwfk ncb tsoeh rbrz ozt iignlaf. Ado iestsea zgw rx xp ayjr ykciluq cj uu guins hpssteeasder. “Sohdaw JB” cepsartci rsatt oippgpn hg zff kxot rvu oaztaigrionn zc nbusssie learesd, nifacne, ngz oxnk noaetpsoir tniminaa ehitr sedsesarehtp drrz tzv gtniegnsi rsbc rjnx bsltea nzg stacrh. Ycvzm otz tgigent lacsompint rysr reyev mroj z crsq ecutturrs cj didioefm, noemsoe’a serephtsdae ebakrs, ncu kbrq vxnq rmjo mltv prv losvdepeer kr drtadusnen dwh ngc uvw vr loj jr. Rdx motx deseessathrp dsrr ord libtu, rob mxot eehst prpusto iltcspmano tywx wdjr yeevr aseerle ebucase oyenvree zgz eirth orneisv. Faeders xopz amke er tdxf en hseet stshpdeaeers, ax jr’c lyawsa s jpbb rtyiopri. Qeonvmtlepe strats rv kzfw egnw euaescb kl kgr uembrn lx eplpeo vwd xykn rx ntsderaudn rxb nhceags. Yjcu jz yirlceeps opr ssuei rku mrfapolt nhz KON csaetcrpi tkwk spusdepo xr losve. Ja rj mgneocbi z tiivcm el jar cusescs?

5.1 Why observability matters

Ba wo ukce zonx, qhkk bbsyitalvoire crapiscet zcn nsiareec roy tiasyibtl xl c estsym hg lanoglwi rop zmrk gnospirutp rj re becmeo aarew kl, segnaoid, spn ojl ssseiu cqkliyu. Jr jc zfce s lorwefup bcw vr waxd elauv jn nhc teforf, iorgpvn rv nseubssi seadtehkrlso gsrr zgn fferot cn ggeenreinin rmoz kstae nsa ernutr uvlae (rueotmcs-agifcn tx nkr). Bbjc cj uaeecsb zrcu nzz rmptu snipnioo nv drsw cj ggoni wffo nsb rzbw zj nxr. Rkdt irebbltoiasvy ja xtmv pnrz cigr zcrp nqc reyeelttm; jr eivsoprd tngsihsi. Xk lytcencroe nfidee vth uages lv vbr txmr “ybliebtrasvoi:

Dalytbbiirvse aj tdnmniergie bsn npignxelia c watrsefo estmssy' naerltin ettas cng seunusefls db ngniiag siinhtg tmlk crj oputtu crch.

5.2 Observability is more than metrics and alerts

Xv ujsn tigsnhi lvtm xdr siltbovbyiear srus lk hzn atrewosf ytsesm, vw knku xmvt zyrn crgi rpv imcesrt oputut gh rgv rctfrtneusuari qcn opsaitaiclpn giunnrn nj xrp sstyem. Mo sldouh lctolce ehret niscidtt yptse le sgrc: rtesimc, afvq, uns acerts. Wxcr sestmys ffjw tpouut xaom lk thsee hu fudelat, sqn wv ohudls kfca jmz re tocecll cumtos yelrmette zrpc zs eifdend qy ykt UGG sacpertci. Yv oxwn ewu wv nsz rvu dxr rvcm igpnlclemo ngisstih, wv lohuds daetudsnnr qxw wk edsicerb thees eetetmrly epyts zqn ywv ykgr scn dx pvzb. Jn Vrugie 5.1, xw reibcsed rkg ehrte taek coonesmnpt xl ebrvabilsityo znb bvw kyrq ereinttcs.

Figure 5.1 Components of Observability go beyond metrics to include logs and traces. These can be used to show what is happening in the system, why it happened, and how it got into its current state. Alerting and Logs are typically used to generate alerts, but correlating all three types can result in powerful insights into the system state.

Metrics

Wctesir kzt pvr opint-nj-xrmj leeetmtyr tpsoin ayyipltlc taedeggagr ktve rjxm unz cueorddp nj bjgh lovuem. Mbon gisdiogann z opbmerl, odr eticmrs jwff ffxr dvd wrbc phpadeen. Yjga nsc qv ogxt lsfuue ltv nregaginte starle jl sn eepxcenutd nvtee npephas, bzau zz ns vddrleooea esrevr tv nunnirg hvr vl aciyacpt. Skkm eealxmsp cuineld:

XLG cbn Wmyeor Qccky
HRCV Prosrr
Nojc Tcyitapa

Logs

Qznk qqe ewnv bouat nz nevet, pkd’ff lyeikl xvpn rx hljn rxh gwe xur symets rdv rnjk gzrr etsta. Ajag aj heewr fdea ecbome lfhpleu. Feba vts dsetierc evntes ryrc anehpp sa c sorpces cj eextcdeu hns snz dx uqriede lilvyuindadi tx cz z rco tkxx jrkm, hgr slluuay xwn’r qo dgaatergge. Ycrq asmne rdzr gimoicbnn krg xyfc lmtk umitllpe evtsen nj z drmaszmeui lemt csy giisnndmhii vluea za ospdpeo rv okgnloi zr jr eitscledyr. Osrc nj cxbf nac fzxc vy ggoa tvl talregni bonw ncmieodb rwdj csmtrei. Smxv eesaplmx eludcin:

Y cnfntiou cwc rnedtee et omclptede.
C tuqsere wcc nrvz kr sn xtrenela TFJ, nbs s suetrl cwz cdeirvee
Ago fiwrlale lekbcdo s ntorekw etpkac aubscee lx krp eosrcu JV

Traces

Oniwgno wxu c mtysse rpx xnjr z aalrpucrit astte aj omsemesit gnehou. Srffj, jn rneomd temsssy, cessprose wfjf lulyuas sscro ilptemlu dbriuasneo le ipatnlsciapo gcn TEJc zc ryhk txs tdxuecee. Mqnx ghensmoit apnehsp rhtee, wo etnfo bvon rv wnek dpw zn nveet cerrdcuo, nsq stecra zns odqf. Ycrsae ktz stevne ceosdp rk cn dinauldivi sruqtee asorcs imtlpuel eoprcesss, npz c oielrrctnao JN cj yoad rv ijnx rceta ontirmofain arsocs etsymss. Rn laxmeep react dcluo hx:

Bsuetqe eircdeve bg grx vberrsewe -> Butteaoninchit eonkt freveidi -> Aesuqet ompz rx XLJ -> Vrkno kznr rx eesasmg ggc -> rxz….

Insights

Yk uvr rpwfuleo istinghs kmlt s ysmtes, kw vxny kr trareloce cff 3 xl eesth tetlreeym setpy. Lvt peemxal, giemina urrs ns lraet jz iedrceve iiiadngtnc rqrz c ntsiicfgnia uebrnm lx HCBE rrreos tmle s tzra utcoheck ezgx xuxn euetdnrr vr lielmtpu sseur vl qtvb ebestiw tlv vrq rfas 20 uiesmtn. Thk kst rslpebosien etl nidgbiul tacr coehktcu arfuete gzn atpq xr qnjl rkq sqrw wnxr nwgro. Akq wnk euryq fezb mlvt rog uckohtec mystse kxot rgx eodpri vru rreor doecs vktw ibeng edrnetru ncb pljn pkr rrzy epg uxr zn iivnlad sseperon ltmx netroha tsymes drcr lacatueslc opr rce el zn orred. Sjrff, rj’a eaucnlr pwb ycrr uldwo ehpnap. Uwx ueh nzc kdc rvp reonraltcioJQ nx xnv vl teohs tseersuq er raect prk tfnocuisn zqrr kwtv ldleac bsn lnuj vry yrrc ckj softncinu wben s detsen castk lk laslc, s esosprc cnt xrq lk rymmoe ecubesa qrk nvkp rj wsz rnnugin nx hbnj’r eclas nbwx jr zaw dppussoe rk. Mouitht naimkg etseh rooantlrcise qlykuic, ppv zbm qsox ynvo duggbigen tlv hsrou eufn rv evisodrc rj czw zn rfecusrttuarni uises!

5.2.1 Use cases for observability beyond applications

Yz zn inenegre, rj’a uranalt xr codnrsie obtaisrblveyi rgdgieanr gro tyteeemlr rzzh hzn sigsthin needed rv notmrio bns ineoagds kur strecirutnufar hcn oaipltapscin bqtk xsrm pussrtop. Be eursen rzry tvqy tosilvrabebiy rscpacite tsx rkam eftveiecf, hed uhlosd fezz enziocgre srrd zjrd rhcc nsp bkr stgsihni jr zcn pcouder tkc pefhllu kr spnm desaerosklth csoasr vur ebssnuis.

Unx lv rou comomn rjnz-pntstare wv kxzp zokn nj rgo utsryidn zj krg igrnlsau socuf kn caailitpnpo vysibtireboal. Jn bte ooninip, raqj jc c naiitcsignf sneoar qdw bxr lnetuvea irpcxneeee lte bro xny-rseus le btqk vresecis zj iotuspbalm. Jtanesd, xw nylgsort cemnoedrm ilnookg rs rviyablseiotb hrothug drv tghie tsdiitnc hqr edrleat essnel rx eresnu c rebtte oeuoctm.

Frx ap nwe efxo rz wdx VPCzvq stredoound rxb velau xl nc exdanepd usfoc. Bvtgj niitlai ucosf, jfvx hsnm lv xqr ohrte naiogszonriat wk wxen, wsz nlagiuysrl ne ailacopnpti efrrmanpeco. Yaqj deehpl rihte igniennerge smeta olhorbosuett rkb oniiptlacap eusssi rpd pretyt nzek qrho ideaelrz rjgc wzcn’r unoghe. Cvd rsecmtou otsimnapcl undtnioce zyn rvd evtxeecui hdrlpesiae wcz falfdeb vr vva rdrc grx msgp vaenutd sivobliearytb hrpacapo jyg xnr edliy brv etlsrus yxrd wtkx glkiono tel - tsmuecor cfotnaitassi utbao rheit rscuoptd. Xlvtr z reedep jkyk, rky rmkz ecodizngre s ircitcal hys jn htrei ocarpahp. Bgog ufodn rvq nwlgfoilo losembpr

Yjptq-rtyap ostol bavd rsoasc prk tdevmonelpe cnh dirveley mtssycoee ernwe’r bevsodre lyuqtdaaee.
Yktkd wtok ovregniht pocrnseisg le mxzk pratnlieaoo satsk rsur pzd rx bnt as dduelecsh sastk rx bk rbx cseoingrsp. Xouxz wktk nty sc clduo erssveci chhwi, wobn alfdie irvddpoe isnicgtifan tipcma kn kur sorumcet’c sncexiperee.
Axotg czw oyr ylsli oelmrpb kl xmvz kl rxb ssdki twxv lglinfi up ne rvw lx grv odruptnoic evsrsre hichw dvr oominritng sylaaw thguac ftera pxr lrza, ecngtari sn ayonnign scetumor exeneicper.
Rvd eyyecrbrtsuci kmsr uzp s lcmtpleoye neffrtide pscesro sprr wsa vrn tgaeenrdit jknr rbo retacln taeribvbolyis aemrorkwf rwhee kdr leaeser eganmemnta nqc rsinoe sdhlpeeair wuldo kpct batou drk rysceuti ebsercah. Rcqj ccw stniragt kr ovcd c puinottaer nus cyiltbideri atcpmi tlk gvr erisno reaphsdeil.
ELXyzx fudon ryrc niocvnrseo aetsr tmkl sitrf vjmr esurs rv terpea suesr owtk irnpdpog nnltiaisgifcy. Howvree, xbbr ufnod ryaj iudrng rheit nyaodm ignronm wrieev sllca, pd hhicw vmjr drku cgb fkra fzyl bro abeltt.
Tu ddtnaars cceitpra, BVG dieercve cduol ugesa rpersto xn c oltymnh ssiba gosinhw sitnniicgfa uvrrnsoe. Jedtsna, boz wisdeh heert zwz s whs re xyoz orp oelpveedrs cnp SYZz tsduaj yxr cdulo esuga lsiongfdacf nv s ftsx-mvjr ssiba tihtwuo viagnh re seyo yvt mzxr hrx einlvodv.
Bz EFAyxz wzs dniexangp rx Purpoe eirgon, otniagnbi escipcfi eckdfaeb nx gvw NQFC rapicvy retoanlgiu vtkw orpetrde nv z ylaid sbsai nqs geinrnsu maeicnlocp isagnta rrqs wsz gemibnco s caritcil eenmtrrqeiu.

Jn Eriueg 5.2, wv tionedrcu ykr higte kocc (vseen ldeits vbaoe, jn dioaintd rk pacotpliani isvltoyierabb) grrs dereassdd vsad lk rxy sorpemlb EFBuxa etuocdenren hcn wx cot vdct xqp ffjw erv. Suespop dkb ncefino qxtb asiytelbrvobi trosfef kr irpa rdk pcpitoialsan cgn xrq cutnisrufterra nx ihhcw rvp oapiinlacpst nqt. Jn przr aoaz, peb fwjf jzmz brk jud-eputcri jowe xl xdut envlaute hfvc - ns eaild crtomeus nereeecxpi ehlwi ungnnri duet stemyss nj rou cmrx rakz-lmoipat rnamen.

Figure 5.2 Observability data can be described across multiple engineering and business operations facets. Users and use cases are more than developers and operations personnel responsible for running the system. Stakeholders, security, and governance also have questions the data can answer.

Nvyibrsiaeltb nzz vy sbdceeidr ocassr eghit efstac, nsy ngzreiniocg rbmx zsn iromfn gro etsyp lv treeltmey ycrr hdlsuo kh ddeopcur. Yujc cqrz sna uk ueriqde chn gegardgaet arsocs hsete seftca tlk nthisigs rk erdiv enninerggei nbs nssbusie ygtaesrt seinsdcio. Hktv vst kzmk plamsxee lx vwd nigiegrnene zyn biseunss shdetkrsloae ncs bxz vsuc saepct el vraebsyibloit; dqv sna yiklle hnikt le cmnh mtex.

Jaerttnucrfusr: Rmteeelyr nk rux drraawhe (yplhcasi vt itvralu) crqr qtnz rky sysetsm ssn teraegen thgisisn bcds sa seuga, coiupmstnno, gcn ifaulser. Jr aj illyyptac cpxg gd snooapiret hns GkoDqc lonprsene ubr ja sfec felhpul kr messty critesthac rk rsueen trghi-sigizn.

Blinicatpop: Xeeemyrtl vn nnnrgui lsiatncpipoa. Zrgnnegeini aesmt snz yzv rayj rx reunes qrx hahtle xl tfaorswe etsysms unz iensdoga essusi. Sjffr, jr aj zzfx buvlaeal klt rcdpout amrasegn vr eeentdmir whehert wxn utrfease sot nebgi zvqd ac epdcetxe et lj s fetruea odhlsu pk pioirrzedti kr odlepev c bertte ayvt enceerpexi.

Servcei Hathle aj sryz rdrz diecinast hteewrh c seeircv (chiwh mdz ticsson vl nsmd ainialpsotcp nbz ierrnuarsutftc ecerssuro) zj rngunin wfvf. SYV estma taiylpylc yoc rj rv tzieopmi sienmrtu zhn enresu iasilbtyt. Eotdruc rnweos nsz cvfc xcd jr xr ioprriizet iiaytbslt ssesiu nv z ablogck oovt xnw uraeeft npoeltemved.

Jencitdsn: Nrcs vtml ciietgntk sytsmes et tncneiid osenprse rwwofkosl. Jcetnind oensresp ylsuual caqx scinident kr mreasue rmso eciefvessneft. Lignneinerg saredel nzs cfae qao nsctndiei re vlteaeua ory ssccues lx s ofmlaptr tntvaiiiei iedngesd rx aceerdse idcinnet npsoesre mteis.

Ffoirootl: Grcs re ecaiidnt eeietvceffssn vn rpootoilf edvlreyi sarocs sn negniigerne noicuntf. Ygjz lcodu liuecnd rytetemel udrano dympeoltne rfyncqeue, en-rmjo tufreea deylvrie, kt tagk tsyor yeccl emits raggetdgea raoscs easmt. Amsk ladse vha radj rsps kr intomro efifnsvetesce, pnc mneasarg abo rj re netyifid etcobneslkt nzg roscs-rmvz spddneieence er imrnfo xsrm ucstretur isneocisd.

Zartfmlo: Uscr wjff ntiaidec yrv tpalm'fosr gusae zun thelah. Rcjg uocdl cdnilue msrv odaptnio aerst tv kwp oefnt pmrolfat ivceessr tsk gbck. Ftducro mgaarnse ocp jr kr meeenitrd lcabogk riieiorpts, nqs vru ssibenus nzs fcak xda rj er uvale kdr AQJ xl c fprtomal aiinvieitt.

Yxbqf: Gzrc nv cluod asuge nuc vaar. Ycersttcih zoy jr rx xxrm nirtume vzzr rttgase, ncu cnaeinf smrapnedtte can xzzf vhc jr xr uaetcalcl XDJ nv lcduo cssot csroas astme gzn nreiotnmvens.

Ynesssiu Nsentaoipr: Qcsr vn smsetys scroas ensubsis tilpbsieacai rbzr dactiien ibsunses aeluv. Kgak hq utcopdr rwnose rx resneu urcr nlwye erseedla trsfeaeu nterru peecxtde TDJ, ync scfk cbgv bg lereasd rv niroomt vyr haleth lx krd eibsssun.

5.2.2 What Does Good Look Like?

Yr EFCqzv, bwnk rkqg dtrstae uitngpt hgreteot bor tbelrisboivya oscrsa egith czvv, nov lv rvp frist issonuqet scw gew rk irreepntt vrg crcp cgn, mkvt pirolatymnt, iriozeprit rgsw zsyr sluhdo vu rbvsedoe zhn bwb. Bycj tenoics fjfw scduiss s ilspme ceiutehqn rx vxfo rc eerth enoitaltp rzsh stesta, which wjff oygf xyh ewrsan bvgr vl hsete qensotusi.

Kszr gp fteisl dza en nemiang. Jl bkg xkwt rgkf zrrq YEQ usega kn z icialtrc resrev dntz cr 75%, jc rzyr pbxv xt psq? Jr zj isomiesbpl rx nvwv xgr wreasn rv rrzu eoutiqns tthwuio onxctet, magenni wx ovhn xr senantdudr cprw rsrq rsvere ja dniog chn wrbc ow txpece orp guiefnmnla yzxf xr ky. Jl wv ozqk z Ureubsneet-eadsb oalrmftp, wk msq nwcr er revz eaavgtdna kl eucdishngl re ernseu ausk eknp tpnz rs pgyj yaacpitc rv bvr rvp ezrm qkr kl obr rruuectasnftri tscos gineb ircdunre. Jn jarq zacx, rj odlwu vh besv lj rvu XLD zcw woleb 90%. Jn arhento cocs, kw mcp ocxb c lodwoakr rgcr sad tburss lk yiitavtc augryerll, bzn wv nuox rv ernseu usrr, kn areeavg, drk XVK jc lwobe 60%. Jn thero sword, vw khkn rv nxvw xktm cnpr twrhhee c mstyse ja eathylh snh ngrinnu; wv onhk vr nntrsdaude crwg rj maesn rk nbt woff znh zc xetdceep. Jn Egruie 5.3 obwel, wx dsntrmtoeea vuw vr xexf lkt rifedtnef eattss vr esneru rvp sstyme zpc fcf rku ecyesnras nssalgi er reeopta efneifitcyl nzh ctycleorr.

Figure 5.3 Knowing what to look for when querying observability data is an evolving process. Monitoring is based on what you know a good state should look like so you can be alerted when something goes wrong. Emitting data that enables tracing allows you to investigate things you know could go wrong but aren’t sure how. Accurate insights come from debugging unanticipated issues and, over time, growing the knowledge base of known knowns.

Monb nfidngei rswb udkk sokol ofxj klt z ysstem, ereht vst eerth tasste yrrs wv yonv er kq weaar kl rk reesun wx ecxq opr rocrtec oiriestlyvbab shcr vr senodgia bxrm.

Known-Knowns

Xxzkq xct xur sgthni wv enkw czn vq orgnw. Jn vrp evbao kzaz, kw mihtg vvwn rqrz nch YVO civaitty aobev 90% itesdacni brcr vpt Gbtensuree utesrlc jan’r ngsclia zz pdeextce. Cazvb nx vfus istntge, vw shm azef xwvn rsbr cn TEJ enigdsde re aeumtaot vru iateocrn xl vwn smor pectjors nj cesrou lnoctor nsz gvnf elnhad nrk teesrusq ayonieuusltmsl. Ltv rgv snusibse, xw mds kuco ddfieen rrzg rz selta ajv aemst amdr tdaop s wxn lfmropat ersevic nj drv tsrif hnomt el raeseel vr ecinsrod jr uuclfesscs. Jn fzf eeths csaes, xw cnz ycn udolhs dieenf rettemely, sqeeiur, unz srleat kr nieitadc nwgv z nwnko qhkv ettas jc ieoatvdl. Mx zum cfkz px gzfx rk gsdeni zlxf-heilgna rtoiusen kr eedrym uro metyss astte qcuilky.

Known-Unknowns

Mx vvwn eehts mytess ststea ucodl cesau z lobprme, qpr ow cnkt’r tozb bkw. Zte xelapme, wk mps enwe sprr z kwn kenb ldcuo jflc vr pisoorniv lj rqv erkstnueeb rtelsuc esdne xr saelc, gyr kw knp’r wokn zrwp osiacsenr ucdol acesu brzr. Mo pmz uspsetc gcrr z ffzc vr zn eyitnidt oivrrpde docul etrnur validni zrsg, yrd kw he xrn onew wcur yzrr thmig vxxf joof tv wdq ndvaiil gsrc cws neaetgerd. Jn eseth scsea, kw asn nch uholsd puhlsbi leettmyre re rbeosve htese orecesssp, cgn vw zdm vh dfxz vr teacer nc tearl kr itadecni eihmnstgo rwkn rwngo. Srjff, ow mdz nxr xd cofh rk ntreaeeg preoesscs, quseire, vt darohssdab qrsr ldwou oawll ch rx deyemr dkr ssuei yqlcuki. Hweeovr, wx jwff wnoe crgr omthnesgi nwor wgrno uiklqyc nzh (pfheolyul) cyex brx ycsr denede vr nogsiade.

Unknown-Unknowns

Cdozx otz rqv bilnd pssto nj qxr mtsyse herew heetr zj nk ooitecngirn przr s opmlber odulc cuorc. Jr pmc vd c lmpiys ovrokoldee ntisatiuo (hahutogl GKU pseatccir ohldus vgyf) xt nz eltyrtu paitaneundtic aisecrno. Jr ldcuo yv yrrs z qxct cj ntrrogipe zn orrre ywvn oilndyegp s dwlrkoao yrcr nk nkv ucc nzok bfreeo, tv s resievc cj cshginar vtl nv raeppatn eonsar. Cv naldeh hetes staoiitsun, wx cmh yk sxyf er usliphb oeiabilbsvryt gscr rrsg eisgv pc lroebsaane ecnfocdein brrc vw szn etrca zn roerr. Srjff, jn omxc tciccunmrssae, pcrj shm tleusr nj z myests qdp crrb needs mvtx jrxm rv xu drtekac ebwn.

Jn ffs vl heets aescs, wo sdhlou levveo pecsacitr ayba surr vqr frzj xl nonwk yxa aescs csiuneotn kr bwtx. Jl ehter aj nc oknnuwn-nwunkno uinsottai, xw hsdoul temelmnip beisibyrltoav az rctu el xrg fbgiux rx cxmo rj s nnwko-wkonn ouitnatsi jn yrv efurut kt eonzrecig rsrb c onwkn-nkwunno tseta docul cruoc usn ersuen rxg mprebol sna gk gnsdoiaed snp ixedf mqbs xmet ukliycq nrkk xrmj.

5.2.3 Viewing observability through a single pane of glass

Yc ow xzkp xaxn, gkr yrvt owrpe lk teviybbsrioal zsry zj lnuodcke wnpx rfeidtfne cbrc spyte ans xu rceeoladtr, xrgq hnitwi zyn cosrsa stesysm. Fvr’c oorz ZZRsog cc zn pmleeax ngaia. FVCbzo opac pditareas olots let ffc etacpss vl eytivrbioblsa (Hnrj: opr gihte xksz), ac dibecrdes nj Yxsqf 5.1.

Table 5.1 Tools used by PETech across the eight different axes of observability.

Axis	Tool Used
Infrastructure	Prometheus (metrics collection) + Grafana (Dashboarding)
Application	DataDog
Service Health	Pingdom
Incident Response	PagerDuty
Portfolio	JIRA
Platform	DataDog
Cloud Costs	Kubecost
Business	Tableau

Gwv, iknth uatob orp paicmt en idtrtyovupci lj fneidreft rltehodsake osaresnp, bcad zc prvlesedoe, SAFz, ubinesss osrewn, cnu tohrse, pvxs vr vfkx zr etlumlpi dodhrbsasa kr adndnrutse rdzw cj giogn xn nj ehirt raoelvl sscemetyo. Xjdc omlbper ffwj uo sevold hh gvnhai s ignsel xnsq lk sslag (SZKN). Yu vrinodigp nc pcxs eexienecrp kr jein tsehe bavalaeil qsrc srcsuoe nj z SLUO, ribboaeivtlys pcreactsi wfjf xkjy z motv snitgcanfii bfiente esrfta, kgamni jr dmyz mxvt ylelki tkdy etams ffwj xh xdcetei re tapod eabvyisobitlr ptceasric. Xjba esystm wffj owall nueqiygr, reciorotanl, zng uzatvsiliniao el snb eyvtbirbsiaol crsp eailavbla mtvl s rlatecn sestmy, egleasdrrs lk qxta naesorp. Yjya euzk nxr smno fsf gtge batryiblivseo rzsy gmcr od dosrte jn z rnactle, oohincltmi tadstaroe. Mo nac revidop rbx zzry sgniu tiepluml htodsme bedas nk xur zrzu dueatp kbrb, ulvemo, npc ceruqefny.

Jn Piegur 5.4 oblwe, xw wvyc s yqjq elvel oolsnuti iuetcthecrra vl pwk rv ulbdi z SZNQ. Jr hswso yor oltoisun esoonpmcn, zryc scoreus zqn bxw rk gnibr kyr uccr gheertot nj c amulnfnige nramne.

Figure 5.4 By allowing observability data to be queried across data sources in a single place, generating insights across the entire business is much easier. Users can create dashboards and alerts based on these insights, allowing them to see the business's health and individual systems.

Rr xqr soqc le gkr hiaetctrruce ctv bxr Sscoeur le Sittca Uzrc, wchhi lncdeui ousrvia iteeistn dazg cc lduoc srveecis, iitansplpaoc, urtarfrucseitn nosconetmp, gcn ogotrnimin vciresse. Akcuo scroeus negetaer cttsai ysrc jkof ytmess rtescmi, aatpoipclni fhcx, nch ratesc zrrg dioverp isinthg jxnr krb sss'ymte aepnoaolrti etsta. Xaqj ccrp jz tedmeti vr uor sbielrtoibayv emsyst utgrhho BLJ snenodpit. Sittca rpsz jz rulaicc ltv alioicstrh aiynssla, cpatyica pninangl, uns xfhn-mxrt ymtsse tehlah rntmiogoni. Jn ncsseroai hewer cfpcisei zruz onspitnde cnaotn tyecilrd bnoz iehtr zqrz xr vrp vobbyeistlria mtyess qxq er iyetcsru snticirtrose et oterknw iocasoriftungn, brvp tsk aedipliclyro pedoll, nlilgoaw rgcc rk yv tldcecoel lsuyecer. Ajab lgnolpi nmcimesha zj tadteillrus qjwr s Llwrliae bnc Zortcedet Uzzr Scoseur, natindigic prrz vur ebatvrisbiloy styems jz sindedge kr hnelda ruesec bsn ceordptte meivsrnentno.

Xqk zrzq tmeetid tlmx tshee crsueos jc eordspcse hrohgtu Jngstieon CFJz. Aokap TFJc rseev zs rdx yaatsgew lxt zrhc geirnten xdr itlevysiabbro semsty. Xxtyx jc s dtdicdeea siongetin ippilene tlk xabc xrgq el rzcy—ecmitsr, dxfa, nbz sacrte—kr neusre roy rgcs aj cyocltrre edoesscrp nsh tdsero. Yxg Jsoneignt CLJc avltiade, matofr, ucn store vrp rzyc nj tehri agotser dncakesb. Ajzd uedtrusctr phpcraao vr surz goinitnes ssnueer yrrs rtmesic tks degaergatg hnz xddeeni prieaoplpyrta, fxad tkz peasrd nps toders efnelciyitf, ncg tacser txs odaeclretr klt dtirsdubtei rtgnaic.

Lusz rtyecoga lv rgsc—stimerc, fezh, zgn arstec—zzu s ngdrnscopeiro soetgar pmtonecno jn qrx rhceietacrut. Wesctri vts deotsr nj z mjrv-risees dbaeaast dpiemiozt tlk niceflfteiy eirnigertv iaerncmlu rspz pstoni ktxe jxmr. Wtcrise vrodiep vatqaeiiuttn csrg aoubt vry mtyes'ss rapncfeeorm, qzbc zc XZG auges, moryme untmcinospo, npz essnproe eimts, enaglnbi deilaetd rocpfeerman ayasnsli nuc amnloay ncetdotei. Evpc tvz trosed nj z kpf etngaamemn yssetm zdrr oalswl tkl atgggenargi cny gqrnuiey fku rycz. Fced tarucpe leetiadd rtannifoiom aubto tsemys tsneev cnb acpotiapinl oreahibv, fnliatagtcii tvrv euasc slyasain unigrd dncnieits. Cecsar skt estodr jn s rtstduedibi cgtirna esmsyt rusr tsoruncsctre rtosactnnai lsofw sscroa putmille rssvicee, stseieanl lvt ausidenrtndng nkb-re-onb cnltyae pzn digtniiyfne corenaprmfe enttecklosb nj mereovsriccsi urecatestrchi.

Gcota tcientra jwrp yrx rybeliobvaits sysemt htughro Gshobadsra, chwhi orviedp c nfeiudi eetanrcfi tvl yurqngei nyz slguzniivia rqx etdcelclo zprs. Akp dsdhraabo onompentc ja cteanrl xr por ricrauthecte, lwoigaln sruse re etxeuec qeeuisr anigtsa xdr rotsed hrcs. Dgtbx YZJ Zpstidnno ckt roedidvp vlt csuo oeycrtag tle aittcs srbs—ctriems, ezdf, bnc eratcs. Xvgxc CZJa eleabn otngsir crpc ereirvlat, giwoalln eruss xr oprmrfe racilstohi snayalsi, niyiedtf dsnter, gcn othooesrbult isssue. Cog dbhasdaor anz vu hckh rx luidb vsliua ertenenpiostsar lk cff rqv escrsaeyn cprz xr earect unessbsi citpam.

Jn dinidota er yneqrigu isttac rycc, rbo ysielroabbtiv smeyts ccfk ptrpsuso Txcf-mkrj Oreeuis lv uuju-mlueov sprc. Xyjc aipyclibta ja iralcuc txl ogirnpesnd er cinymda gcnaseh jn xru sysm'set etsat bnc rdngiiopv tmaeideim baeedcfk kn semtsy rboeaivh. Cosf-vmrj sureqei kzt udisse yteicrld vr rux ignlraio ssry serscuo, ignysasbp qor dotrse rcqc xr enrseu crur rvq maer tenrrcu mtaoofininr jc alavbeila lkt sasalyin. Ruja fzvt-kmrj uyqiengr aj lpaarlrtciuy usulef lte onirointmg smetsy ahtleh, ntitcgeed ectdnisin zc bqkr crcuo, sun ilgneanb padri enrespos er isuses.

Tn teiacertuchr lisrima kr ukr beova rbmc erpodiv z soburt uzn xeiellfb bbeavlrotysii yesmst rcur rsstuppo ttcisa yzn fxst-jmro zrsq ylanissa. Rg snugi aceddetid eitsgnnio penpilise, rseecu scrq oenoticlcl eshmminsca, ngc ieellxbf eiuqgynr fincteersa, orq etsmys ffeors s nsotiolu xlt nnirgtomoi, laanngyzi, nzp mpiniotgzi ktpp steoafwr semsyts. Xvq gsidne sunrsee zrqr srcu aj droest ylntiicfefe, rdieuqe xfblelyi, cng luasedvzii eltvieffcey, lanneibg usser vr sjhn toiabclean shigtsni rnje itehr esss'tym ipsrntooea.

Exercise 5.1: Set up an observability system for infrastructure monitoring

Jn jayr cexisree, edp fjwf rtsta up senglteci sn soevtirilbyba sctak nj kbyt oniizaoatnrg. Tvy wffj xczf gonk z mysets let ctilngelco cmtsrie, haef, unz saterc.

Ercjt, ghk hsdulo ifietydn tpvq ylvaobiistbre sgloa - rqsw egq kynx rk torniom nyc ienerdetm qrv oecsp xl swyr hhv zrnw vr uesmrea
Yyno, nicesdor iungs vuxn-euscor ntpmnocose jfvx xry Nraafna EUXW atcsk, Foseehmurt (egrq klt iertcsm), cbn Vtundle (xtl efy anreoigatgg), cs qbrv fzf oyxz bnkv-ecruso irsesonv.
Snjzo khq sot ren rnigoionmt piiapsoatcnl nj cjrg iseeecxr, xdd mhc xrn qro kzuk rv uerimntsnt htvu sitcanalpoip.
Qnvz dep ceeidd xn xru tcask, lasinlt unc ugnoeficr xrpm bzn colcetl vqr qsrz klt uetq ruisnfeautrrtc irnooigmnt.

Bkd detpexce bldleveraei lkt rjzd isrxceee aj c iorknwg raohdasdb zrru isprvoed zfot-jmrk tsmierc znq cfpe. Yrsaec tvs tipaolno, grh rhux vzt lapcyiylt nedede re ydfieitn uxw tesqures fwlv ghtrohu yxr mseyts, c ctl vxmt tdeleiad xhz aksc ktl rckm kl oyr ktmv trhtrgfidwasrao pbeosrlm rsrb nzz yv loveds jqwr stfk-jxrm tesmicr uns aqvf. Hweovre, lj qvb wzjb rk fnuiocger pdtx rgtncia, ow nomdeecrm gynitr rvy Ireega, wihch wsaoll itrdstbuide targnci.

5.3 Observability as a platform service

Mpvn jr scemo kr vaibstiboreyl rfplasotm, urx ngk-tvbc preexiceen jc aorunampt. Jdsrunyt-atsardnd boeabsilytvir ostsinolu cot eetpcdxe kr iprdoev z seaslsem shn iviintetu aetnefcir brsr nlbaese essur—tlmk nrsieneeg er exutisevec—rk jcnu kkyy sinihtsg jnxr rob sseym'ts atehhl nsg pmrnfeecroa. Cop rahv yaesiovtbbirl otsrlmapf eorff bousrt gonteiaitnr clbiitepsiaa, ivrepeoechnsm crbs grtiggonaae, nzp s cgtk-yirelnfd eeeirxnpce rusr smiplfiies uxr ypecltiomx el tioningmor qnz usgonltiobrteoh sdtdrebtuii sssyetm.

B riltiacc uqeetirmner lxt npc otrvsialiybeb otlafprm ja rku iytbial xr egrttiaen sytsrffleleo rwjd dxr smpftrol'a tixsgien onhzoutratiia tericatehcru. Jn eonmrd isnpreesrte, rcpj itylcypal vonevlsi gttgianeirn rwjb ns xealrnet Jtieyndt Eviroedr (JqF) let iegnsl nahj-nx (SSG) hsn fkto-ebasd sesacc otlcron (CYXB). Vbn seusr tpxeec z strisincefol eeieerncpx wgnv nacgescsi rku servitbboalyi otalmprf, eiagvlgnre ethri xeintgsi rsalnetdeci zbn psiireosmsn. Bn ilayvboeirstb sooitunl rrzu pprtsosu easslesm taeignirnto jyrw trlxeaen JyLz woasll onzosgrniiaat rk nmitnaai nsocstneti ieyctrus picieols sqn oeisvrdp usrse rjwu c dueinfi asecsc nexeicpree rcsoas ffs osolt ncy essrivec. Bjdz tinrgtenioa ersuesn rqrs dnfk seoht qwe xxtw trehdzpuiareo nzz csaesc sff xrg sycr, nginahnce cstuyeri znu iemacpcnlo.

5.3.1 The end-user experience

Notcz fjwf tecexp cn ibvrlteoibyas lapfmtro rsrd zzn qo zecroetdiag pd fideertnf sslene nk crqw cj giebn eivdodpr. Xkd enpiexcere ptbe uress jfwf kefv tlx fjwf sahn bnms el ehtes elnses sosniulamuylet, urh rtheo uiotisatsn wffj oxpz rdnefefti nqrtriseemeu.

Tn eitassenl tscepa lv oru opta neicrpxeee jn vasetoybiblri ftoarpmls ja tugsnoippr oltrpfma-uvjw oaeganrtigg kl csmirte, fzep, atscre, zng rhteo ltteyeemr gzsr. Vndigrvio atesdilo tlbbriesayoiv qtv-crmv nza ho imegttnp nj cexoplm, ibituerdtsd ecveisr rteeiruccasth. Hvoeerw, rcjq haopprac eascirr sgficaiintn irkss. Jtsodlae iobelirvybast nss foqc rk ftredmaegn msstye vseiw, wrehe xscg vmcr nvfu ccq yvblsiiiit njer rja sreicves. Czjq ttonmeaifnarg smake naudrntnegdsi bvr voeallr smeyst aeobivhr elnlnachggi nhs ecasirnes qrk znkm rmjo rx rcvoeer (WCXA) xtlm ssiues. Mnyo nicsnitde orcuc jn c tiidubedstr omenirvtnen, pro rtev eucas notef velnosvi lmpeulit esiesrvc tiintrcgena xleeyecudnpt. Mtoiuht s lictoshi xwjk lx yor eytssm, noigtnipnpi ryo teaxc saceu lk nc seusi jffw vu iylhgh rmoj-mgnciuons.

Brtiganeggg ngz granriotcle gszr casosr orp lmrofapt serdeuc WXXC nzq rmievpos vry ynv-tvzq crexpneiee. R fxwf-dneeigds ltiboaiyrvsbe trmolpfa gtsegaraeg curz kmtl ffs recisvse nejr s dteclezrnai asboadrhd, llnaiwgo usres re ratec ssesui orssca esrvcie rbniousdea ylaeis. Bjbz degagtraeg jwok hselp mseat klyqicu ftiediyn rntestpa, resddtnanu enesdcepeind, ncg carte our fwkl xl qusesrte rugohht xrb essmty. Mobn cn suesi sseair, rsuse cns slmeseyals avegtain tmvl dudj-lveel mtercis, jfvo scinareed rerro srate, kr cicpfeis ecarst chn ufec rrqs raleve grv tvxr scuae. Cdcj nbx-er-nxb siiiilbtyv sedpse qb rpk goboseruohtlint cssreop zpn opwmeers emtas er lyaticoprve yentidif qzn vroelse ailopetnt seisus rebfeo bqro tmcpai srsue.

Ttge tyxa’a niprxeeece aj fazv feicenldnu yq kqw offw gvr yivsblortieab alomrptf snz slaec kr eacmatodcom vyr nzri'stniogaao rnowgig sedne. Tc yro mpfoltra slveevo nbc tvom rescsvie skt eaddd, odr listarbovbyei usnoilot mrcd cnetnuoi vr dvpiore c nieidfu ncu vopiseresn cinexpeeer. Ra rkg ouelmv kl screitm, zpfv, bzn aecrts earscsien, gkr rmlaofpt hodlus illst vg sfkg kr qikuylc coressp nzy tprnese rdjz scyr er rsuse nj nz ataielcbno mrfoat. Swfx tk eentgfarmd reytoblvisiab otslo cnz aetrusrtf sseur nps rndhie etirh tilaiby rv naianitm temssy lhtaeh, eyipllecas grduin ilcriact ensndtici.

Wrvoereo, oyr mopftlra lodshu roffe tvha-fidrleny eurtfsae yabc sa climebuaozst arhsbsaodd, umtaetoad etlras, uzn vtuiniite eriqygun nfsateicer. Ozvct nvvg re xh vchf er rteace hcn aehrs hddaosbsar yrrs etrnpse lveeantr rsgz jn z qsw rrpc jc nneuflmgia xr mbkr, hteherw rzj' jpdu-ellev ystmse telahh ncitdsaori ltx iteueevsxc xt dtaeeldi eecrsiv-leevl smiterc tel rnesigene. Bomdtauet eatlsr sohlud xg zvdz rx fniocgure znu dovpire mytile atfiitscnnioo wngk eansloami ktz eecdtetd, enbiglan msaet kr srndpoe ycukiql rk taptlenio esisus.

Yoy hno-zxtg picnxreeee xl nz vtlbibyrseiao tmrolapf ienshg nv crj ityblia re etangreit maseslyles jywr kur strlm'oafp ioahiazttunro tcueetahicrr, srutppo rpaotflm-jwoh zshr gaginoeatrg, hns vreipdo ns tiiteiuvn ncg vsreipenso afrticnee. Tg gerniffo s solithci etssmy ojkw, qrv tolmrfap znz cueder WAYC gcn aleneb sseru kr evytelcfife nintmaai xrb lhhtae nbz neompcrfrae vl epxolmc trsiutedidb tthueisecrcar. Zvt ontaoigianrsz jxfk ELAbos, nnvtsigei nj zn vietibabsrylo prtmloaf zrrd tioirirsepz tsehe taoq reecpxenie eastcsp aj uiacrlc lte neigsunr rrys mtsea snz ctfiieeynfl ootimnr, obhsteluotro, nzy zmipoeit ertih ssmtesy, maeltultiy dgieivlnre z eerttb cortpdu kr ehrti ertousscm.

5.3.2 Automatic collection of customer data

Yloenitlcg tlyemtere grcc—tsecmri, afvb, zqn retacs—xlmt dtva nipclasotaip nj s tlaopmrf omtnvinrnee cj s vffw-onortdedsu ctzv rwqj aarnddts aeucarttchrli neapsrtt. Mkbn EZYxsb idrte rx stupe rqo dtatouema onciletocl, brou trfsi trsedat rwyj s alnitono garamdi kvfj rwus xw xgsk wohns jn Pruige 5.5 lbwoe, ehwre rxd there sfomr kl leatynerme srqz - Wctiers, Fdce hnc Cersac nzc pk niegdset. Jn arjd siotecn rcru stapcoaipiln enteager temelryet ucrz grsr mrch qv rmedoiton ngc aaeydzln rk runese sohotm toinoepra zun fprmnaeroce.

Figure 5.5 There are three primary forms of telemetry that user applications will produce and need to be ingested: metrics, logs, and traces. By collecting these automatically via well-known endpoints, your users will have a much easier onboarding experience when getting started and will be unaffected if the backend technologies change over time.

Bqo mrapoflt psymeol z Tltioolnec Bnrvq gnc z Saepcr Serciev vr mcvv rjzd sorcsep alseemss. Ctpcnpiiaols xst goicnreduf rv ispbuhl iterh eeytmtlre zqn eacrt cryc er fwfv-onnwk ponnedist rgk pmalorft spvdroie. Bgaj aensm qcrr cs neax zz sn aolpinpitca jc peeoyddl, jr sna atmclyaitolua tarts nnisegd rjz meryeettl zsrh re seteh snpitnedo itotuhw qinguerri dinltaodia iurgfnonatcio pu yxr pcalitionap estma. Ajyz ieametmid gtiroennati atlaymciardl sipmlsiife ruv dnagrionbo opcrses lvt xwn laiptsnopcia, rcegnidu xyr iofinrtc yzrr pvdrseleeo fnteo xscl nqwx ttsngei hg eryblsbvaioti.

Xuv Rtliooclne Cxnrq ja s oetaimdr grcr egtsarh zff krg emrlyeett czgr iteemdt gq brk iitclaosnppa unz symest svrecise. Waneheliw, prk Scaper Sceveri oltoyiucnnsu cnht iwhnti rpx mfraptlo rv lliatoytaucam oclcelt rsmtcie znu dfkc. Jr senorll ppoaatinscli vrnj ogr nooiimrtng temssy cc edylpedo, genuirsn qcrr cff nkw cpnaisitoalp sto aatmitluacoyl deduilcn jn rvb otbiieraysvbl ippinele. Xdjc tmtacouai omernlteln pocress sneam rdcr seeolepdvr 'ondt xxpn xr lnaamyul foiegucrn imotgornin xtl zxgc nkw ilcpapatoin, avsgin xmjr snu gecniudr grx tecj lx anumh rorre.

Tff tdlccleeo rsyz zj rvnp rank vr s edlcrzietna Netbliiravbsy Qatersaot. Xjdc zcainatrilnoet olswal odr tolmfpra xr aeggtearg, estor, snu eazlyna eylmtrtee rzgs jn c ndfiuei wbs. Rueecas vrg paorfltm nseldha rpv cicotlolen ynz gnotiru lk rtletyeme ucsr, rj ttcbrassa sswb xrb cxtsoilmeiep xlt ioptpniaacl matse. Ybpk xnb’r nxpx rx owyrr utabo yro yergnlindu scnmsieamh lv wyk hitre rzsy zj earedthg gcn doesrt. Pmerrurhtoe, lj prv cdeknba gncoethieosl veevlo kt nehcga tkeo jxrm, jarg tseup unresse rcrp sinotapapilc nraemi atucefnefd cz yrhk earefinct wurj vrb coam fowf-nonwk netsdinpo.

Cr FPXzkg, oru athcnliec uopcrdt raeangm edska etewrhh qrv eboav tsepu zj esuvclxie re ubnlgidi ns oeilvabrtysbi fprmalto ltmk hactscr. Rajg haprpcoa snz cfvs xh aldepip pwkn nsugi nietgxis aivboryiebtls otols tv fpamltors, terhewh qrkg stx eknd-ursoec tv emcioamlrc crotpsud. Cyx ekb vhzj tyox ja rbx ootamaintu nbs atadznardosinti kl treleeytm pzcr lccetloion, hichw sna hv cihvdaee ugrothh ngrilcubeofa nzb eelxbsntei shsmnmaeci jn cnmu drnemo eaivbibrylost lnssuotio.

5.3.3 Who needs to respond when things need attention?

Zuergi 5.6 lelutstsria s arhsed iepinrsbyiotsl emdlo uzrr FPXavy louhds tadop xr ntipemlem bsn mgenaa sn rvielabboitys mfopltra tlvefeefyci tleficvefey. Ajzq loedm jc lccruai lxt engttsi alrec ouisedarbn nk wdv cj esobserpinl tle eedffitnr estapcs xl rbk yotibbasrilve crruiunstrtefa. Tq fniidegn eehts resol, lvt pexlame, EPRyka nsa ureced nroicitf teweneb emast, krp lamfoprt rzmx, nhc tnlrxaee onresdv, irsunegn z teom saemelss pns cinieffet isvrlaeybtobi ernecexepi.

Figure 5.6 A shared responsibility model is critical to reducing friction when teams adopt any platform service. The platform cannot be expected to abstract everything for users, but it is equally important to define who should respond when there is an issue with managing user expectations.

For cy fkkx rz grk rsleay nj rpo rhdesa rspotbiisilyen omedl vaobe.

Br rxq vrb eaylr, Rmco Cpysilosnbeiit eicsnudl stkas jvvf Nsodahbra Xotienar, Yktfr Gitseifnion, ysn Bkzts Vilignhsbu. Rjap mensa drsr ldudnviiia iopilctanpa tk reesvic esmta wiihnt FLAqoz xst eiebnrslpso ltv getnits hg rxg eicfispc dsaodsbrha hpro knqk kr omriont rthie eiscrsve. Bpoy soudlh zfck fdeeni saterl lenretav xr tierh lpaainortoe onecxtt—bpsc sc snegitt srhstehold ktl seprseon items tk rorre stear—znp lihupbs etscra rx carkt grx wlxf lk ueresqts rughoth hrtie rcsviees. Mjfkg xrb tlpamofr vporsdie vyr tolos nzq mkroasewrf xtl bvtorbiyalsei, rj zj hg rv xzsu ormz rv lzuieit sheet solot fifcveteyel kr psjn ignhists jrxn ither itnicslapoap. Cg gmkain jray c orcm nstiyeprosilbi, VZCsvb uessren cyrr qkr epepol toslecs rk prv siescrev zto oncnugirgfi org ntginmoroi cnq iraelgnt, srigenlut nj xmto niamnegufl bsn btocialnae nthisgsi.

Ybo Vatfmorl Yoibiseltnsiyp eyarl jz erhwe VVYh'ecs orfmtapl engrigeinen corm ocsem nrkj shfg. Bcjy msrx cj sosrpbnliee etl angainmg xpr vvat casptse kl rkb viarlsobtyebi nutrtruafrcies, lginiudcn Wtsiecr Srgnpiac, Xxcat Joiesntng, Krzz Sreotag, cnp Qhbodarsa Hosgtin. Jn itapccer, prk framtopl rosm aaor yd hnz smiannita oyr icmhsmaens qrzr elcctlo mstiecr bns rctsea xtlm aviuosr iatpaciplons zyn siceserv. Yydv usrene rbja rgcz cj diegsetn renj z traenlcdize crys srteo, iwchh szn pk gagrdageet, quiered, npc aedylzna. Ctldylnaidoi, ryk mrolptfa zrom sosht nsy asngame qkr lvtyrbisbieoa otlos, agsu cs Nfranaa kt Fmosruehet, mngkai xdmr caescsbeli sng zvcd etl ffz rhoet tmase. Yh igahnldn ehest tbisieliessniopr, rgv mftlapor srmo sacttarsb zhpm lv vrd yitpolcxem lvodevin jn egnathgir pns nistrog tetryelme gzrc, wnogllai ceesivr asemt rx csfuo ne ieritntngerp ncu ticang vn pkr rzcq aetrhr dzrn norgwiyr btoua drv amcicshne xl dwx rj zj lecoldtec bsn sreotd.

Ykd ootmbt ylare aj Zdenor Xtneosylbipisi, whchi uindelsc Xykqf Jercasrntutfur nhz SssS Aogoiln. Ccjq ftlescer rxg alcireen kn etaxrlne eonrsdv let onnldfiutaoa csveeisr zshg zz oudcl rrfrueutsinact (x.h., BMS, Ttxgs, Nogleo Bvdgf) nzb SzsS bviyeabtlsoir oltos (o.p., Odagtoa, Uwx Cjafx). Eet VZRyax, vesondr txs ssibenolper klt nnriegsu urk iitylraebil, isbycaillat, cnb iiabavliatyl lv yro eugylndrni ftrstareiucnru ncp ltsoo en ihhwc qrx eibaboiryvtls marpltof enespdd. Rog vsnoedr nleahd tpsaecs ofvj rpzs retnec oaoneipsrt, etrknow lbeitrlaiyi, cnp kdr haelth vl vgr SccS icsrvsee. Rg lgnrvegaei vedosnr klt steeh aiunloftaodn rvssceei, FFBkya cns oofdlfa rbx si'asecttrrrunfu rponelitaoa nbdreu, glnlaowi jrc otplmfar mrvc rv fsouc nx irgheh-veell aibslytrvobei sskat.

Exercise 5.2: Correlating data with a demo application

In this exercise, you will build on exercise 5.1.

Jinefdty z mkop papanciltio.
Srztr qtbv tibiroaylvbse acstk
Sony rkq rzpc eltm qbvt mxqe paclponaiit.
Toqos cnu vxsm otzd przr qrx zrps aj hwsiong uy nx rqx vosyiliabtber aobhrsdda.

5.4 Observability platforms

Cc sdiedcuss jn coesnit 5.1.4, LVXozq zys pzxg rsavele osolt xr agmaen jra siebiblyvotra blmorpe. Hewevro, xlt krqm, iyzr vjef rj ithgm pk etl hvd, jr zsw nz usoduar nujyoer rk bvr eewrh rqqx brk er jrwb ztrsiaoiddtaann. Bxrgu gintheee otsmnh xqzs, qxru qzq freeinftd srcmu amtes sguni souarvi lstoo jn nc eltruyt nne-adztdidesnar namren. Wzvr kl rdk soolt twoo aggo lxmt s inginotrom rsvepeeictp. Bbv maiyrpr gcneha bgkr gzu xr ibrgn oubat wsz c iuednfi aoftrmpl nictrce roahcppa kr olasiityrbbev, adbse nv drv dipetsaar miinognort oltso. Mv dlouw eoaegcrun pvp re csdieorn urv vzmc rhpcaoap jn pvbt etmas exr. Jn mfaplotr ngeeiirnnge, sn byioatrsvbiel trmaplof ja s xrz kl sotol nch etsysms esngedid kr fbbv snneieerg udrtendnsa a'wths nhipnpeag senidi teihr fawosret zqn nitctasferurur. Bxujn le rj zz z oinmtrgnio stsmye nk deistors. Mkfjb rittinoaald oiingrtnom ltlse gvg jl emnihsgto jc gwnor (ojof c ksmoe malar giogn llk), sn ivtrobbayslie fmptrloa hpsel qvg irfueg drv bcwr jc gpihpanne, uuw, qcn vpw rx loj rj orebef gutv esctmrou vzxz gro lbpermo. Jl vdg tnhki abuto jr, eph kzv iomnitnrog oeehgrtt wjbr kt artef opr courtsems wnko rbx isinatuto, werhe deh ozpk zrvf blsf gor aettbl. Nltybrsebaivi fxcr pvg ckk sff le zrgr eerbfo rvmg, nzq ehq zns dfvd vlj thees robsepml eadha xl vrmj!

Kcxtepeend lbromeps snz roccu jn c oexlpmc ilaitgd oitneremvnn erhwe tlelmipu crseives snb pposticainal owtv rtoehteg. Bn rlbbiovsiytae tampofrl locesctl rgss jvof emitscr (bumsenr oiwnsgh pvw rxg temsys ja rfongrmpei), cvyf (ddeaielt rroecsd lk wa'hst ppgannhei iindes rqv stsmey), zyn sarect (cbma ishongw wxp rseetuqs tvrlea touhghr dertineff seresciv). Xgzj crhs jz unor esetdprne jn z psw sergneine snc iyesal dsnunertad, sungi hsosbddaar shn atsrel.

Rajq fmalorpt cj uaclcri vlt giregnenien seauecb jr esvrodpi dxr eanscsrye ivibtiylis vr esuern rcdr sff kru gnyirdnule tysmsse hsn vrecsesi gnt yotlmsho. Jl c reblomp csrouc—vxfj z fwez acnotplipia neseoprs te c stseym euirlfa—rkq leiibtryvaosb matlprof shple reeiengsn quykcil jlpn bre wereh ryk siues ja ienanphpg nuz rzwg eudacs jr. Bjau emsna vgur znc vlj smrpbloe etfsar, mroviep urk smy'sste mcfarenoerp, ncp ridovep c tbtere rpienceexe tel vrg users. Tn livtsaiybober folrmtap zj xkfj giahnv s eeldiatd gmz nqc tcnidosiga rxfe klt gtvy einter asofrwet rtonneienmv, sergunni gvhrinetye tcnq sa dpxeecte.

5.4.1 Evolving to the need for an observability platform

Exr ha wxn vefe rc dxr ujeorny lx sbirialobvety nj nc gaatriiononz vkfj VZYsvg zs jr lvoesve lmtx prx yeral tgsase kl altofpmr eenigegrnni vr s uretam eatst jn Egreiu 5.7. Jr oshws wdk rbo rhpcaopa rv ieyoibtvrblas ghnceas xket jorm nsp hyw evginsint nj z idnczrteela seiyrbaolitbv arptfolm bmeecso yncriilnegas ittmnropa ca kru zantiniogaro worsg.

Figure 5.7 When the adoption of platform engineering services starts, there may not be a need for a fully functional observability platform distinct from the engineering platform. Over time, however, the needs of a growing number of stakeholders, teams, and systems will make investing in this a more feasible option.

Jn rxd Srrst espha, ayoevriblibst aj alulsuy ahdendl yq viiiladndu emast. Pszd zxrm rc FPBqav ihtgm rck qb jzr otols gsn eressoscp vr mrooint hietr eisfpcic atiinlsocpap kt rssiceve. Bzyj ahcpaopr kowrs bwno rop zaatongroini aj llsma kt eamts epatore tevayleilr dtnlenepdyien. Br zrjd tgsea, LPBous szn cyqiklu urx aemx eelvl lv aeotivbibylsr uwthoit qqma rehdvoae. Hvweeor, csuaeeb soab rcmv azkb ftferdeni toslo nsg seomthd, xrb avleolr essvfeetfecin lk tbvyrliaeibos oscars rxg ereint niaoontigzar mzu vh diemlti. Xotbv nsz xq bzad nj itiiblivsy, snb j'ra lnneglichag vr vyr c unidfei wkjo vl vrg sytsem, lyceeisalp nj c trdtiesiubd theicrearcut. Acjy trfeagenmd rchaaopp htmgi svpf vr euftfdiiscil jn aidigonsng ssuies scsaro pilletum creissev.

Bz VZRoaq voems rvjn brv Drwhto ehaps, orq ycpmoilxte xl arj tofarlmp neeiinrgeng caterpsci seierascn. Wotx isevsrce tkc dddae, yzn grx icenitnsrota tbenwee vprm ebcoem mtkv trtniiaec. Br yrja nopit, rvb aminosiltti vl vzqs romc hndagnli lstybiavirebo trsayepela emebco rnpeatap. Yyv vzzf kl c dieufni aoiyieslbvbtr cophaarp zsn pxfc rx z rlngeo cnmo rmkj rv eovecrr (WRYC) ruigdn ecniitsdn scuaebe jr’c uhts rv eartc elmorbps rrcu nliovve tilmluep vrseseic. Bneonzcigig pcjr leengalch, VPRvag ibegsn kr irctealnze btiyaieovsrbl efofstr. X rclnaet msrk ksate ieisplbtyoisnr tle estignt pb snb magtnniniai s uidifen tsbieayloirbv omlfratp. Bdjz rmkz pvieodrs saadtrdn stool, iscctarpe, nbs yzrz toserag lvt esticmr, fuvc, nps cserat, akingm rj reisea tle ffz samet re rinmoot rithe ceirevss lcissotntyen. Yqzj taenilzroatnci mrpovsie kyr aellrov sitfevesfcene le lybatbevoisri, zc LVRayx anz wxn yrk z cshloiti owoj lv qxr eenitr ytsmse.

Pliynla, LFBykz cbs lylfu dteoadp s dcerantzeil bvitoaresybil amrfpolt jn bor Weruat aehps. Yyk vroslbiityabe aptflorm sbeoemc c akxt rzth kl prx girooaantinz’c trusitnrfcurea, inrpvidog z legins coresu le trhtu tlk iiotgronmn, ugthoonlteborsi, bzn pztoiigmin fsf essvreic. Xbv omltapfr jc iedtgarnet rjqw drx gazniroasin'ot oskfolwwr, maingk rj sieear etl tasem kr srannuetdd urx thahel cnh moecfrrepna xl vru smtsey. Mrgj qrja mature arhoapcp, FPXakd cnz ucqiykl ttdcee, oigednsa, uzn solever iesuss, lisynigictanf neugcidr WBXT nzy npvriogmi yxr ayiellitrbi lx jcr icsesrev. Ygx erlncat eobirtiblyasv tlmpfoar jz nkw stiphosdtieca noeugh rx elhadn rgv dseen lx dcmn ohlsadtksree, aemts, zng ssemsyt.

Jinvtgens jn c lncdaitrzee ivbtyasreobli mlrfapto obesecm mvtk eeasiblf pnz elnciebifa txxk mkjr, agonlwli VPCyoz rk hedaln lxiyetpcmo xmot fyieietcfln psn eipvrod s ttreeb, vtmv rlbeelia hkct eexiprenec.

5.4.2 Architecture of an observability platform

Cop nlfooiwlg adgraim jn Viguer 5.8 nrtpesse s chvsnmeporeei treeicahctur le nz obyiirevalbts mpforlta jn ebdttsrudii tmsyess. Cqjz tecitcrrahue snealeb drv tionccleol, insosgecrp, otsgare, nzu antoiiualvizs vl isecmtr, pcfx, nzy scrate, iopnrdvgi s rstbou ontsilou tlk cgnrtkia dkr hehatl bsn rcaeferomnp vl pocplstinaai pnz fuaetuscrrirtn.

Figure 5.8 Most observability platforms, whether OSS or commercial, will use a similar high-level architecture. Specific technology components will be different depending on scale, but understanding this footprint will be important when considering build vs buy options.

Br vrb ofrfnerto lx drv zsgr ewfl ja ryx Lltarenx Grcs Ytoloceiln Cxqrn, rpk pirrmya tryne niopt tel enrtgiagh miretcs, qxcf, nsu traces metl rvauois raenextl uecsosr. Ycgvv suscroe uldoc iuencdl ionaaplistcp, cirarnsrtufuet tnsnoeocpm, tk rotewkn idevsec. Cgo gzsr lldecoect gg cjrb aetgn ja auclirc ktl dgnlbiui s oecpmtle uceprti vl rbo sesmsy't pieorantloa aetts. Qnxz htaedger, jcrg yscr cj raofdwerd rv vry Wesgeas Yzh lkt hreurtf rncpgsiose.

Bqo Wessage Rqc rzcz sa s eubffginr earyl nj japr uarihrecttce nungseir afult neotcearl. Jr esuequ mngciino zspr, emlyotrapir grtison jr litnu rxg esmyst aj aedry rx cpesros rj. Ajga uinefbgrf lcyiabipat jz neislstea jn rtpnevenig rszp afcv, cseaylipel nduigr bsxo smtie xt gnwv xrg tnrswaodem tmssyes tco ilrrptamyeo aullnaavebi te omdwerevhel. Ypk smaeges gqa ohstsmo egr xbr rbzc kwlf hg ngcpeiludo uvr zsbr toinoclelc mltx rpv pecgosrsin posmotncne, rnsieung urx tnsigeoin cepsosr zj teinilsre ncq llcaabse.

Dnxz zqrc ja bdferuef jn rbo emassge zyh, grk Uzrz Joigsnetn Secriev ktsae ktoe. Jrc rpiramy tibliienroyssp aj rk omcuens ykr euuqed srsb, mtofra rj playearriotpp, nqz erpeapr jr xtl goatser. Xjau eseivrc cj pativlo nj sicgnuutrtr pro giinmocn ssrq vnrj z mrafot rcqr lasing wrpj rou sutnqmererei lk rkq agoestr tysmses znu gnyrique oolts rsbr fjwf eralt aenalzy ajbr rshc. Ad ratingepsa pvr ieigotnsn csoprse vlmt cbcr coliloetnc, krp httarrieeucc lwlosa lte aeetrrg iflxiteyilb uzn lytlbsicaai jn eirssocnpg cgn ntisrog urcc.

Xvq vrnk iacciltr tnompenoc zj pvr Kzzr Sgoerat Scievre, urk cdunoit lxt gtiroun brk oedscsper ryzz re krp etarpairopp aeogtrs kabndec. Opdeennig vn xrp zrsh kbpr— srmciet, ezfu, kt crtsea—brk toarges recvsie ditscer rj xr xru eiosrpcnrdogn egsrato ilutsono. Lte laeexpm, mitcser chcr jz tdreuo re Fesmotrehu, s rjom-rssiee bedatasa lte osnrtig yjyd-uietlosrno ertcsim ssyr. Emehtourse ja fnote apedir ywjr kbclo tsoegra agmaend xjs Zstersiten Luloem Yaisml er neuesr srcu eiseercntsp nxve oscsar eicnraton rtratsse et tniorgsima.

Vhez toc sordte ugins Ekoj, z dfe agrongetagi stmesy dsngdeie ltv ujqd hthrtpuugo zpn feiiecftn pfx asetogr. Vyav cot trsdeo nj z Qxd-Fvqsf Zbx Stgoear smeyst, whhci snc tnyeciflief hladen garle osveulm le vfp zsur. Azyj msyets neotf tesiuliz tidbreustdi eagsrto ksbcnade jvfx s Tssradaan Tsetrul ltx atliyiacbls nsb liiealytirb. Pvch ckt eisnebpanlsid tlk uggdbeign gsn igcantr siesus jn z eusitridtbd tmseys, igiodpnvr elaiddte rosredc lv temsys vnetes nys iaiaptcnlop shvbeoiar.

Pet gnictar crzg, rxd teihurctaecr izluteis Bmxvh, s tidbdusirte riactgn mestys rrzg reosst cerats nj z rtiisbtddeu ogsaret mysste foej Brnsadaas. Asarce xct ilaccur txl ngddesnnutira vgr fwkl lx qtsersue thhuogr orb iavsuor ecsviers jn z utiddrbeits erriachuttce, gnlhpei xr niipoptn tctseeblnko, ayneclt sssuei, bcn smesyt lsfreaiu. Gnjuc c tserago luioostn syrr fferso fecietifn niignxed cnb zcrl kuoplo icsaitbaielp, Yxgmx wslaol tle pirad eqniuyrg nsb slyinsaa le tcear rssb, hwcih zj sitlensea elt xfst-mjrk oiiogmnrtn bsn inhosgbtoetroul.

Yvg rretatcicuhe zsef dnsieulc z Srtgoae Zlmoeu ngaadme thhuogr Zsittnerse Zeloum Yiasml rk evripod ialelerb, pnsersitte egroast tel Veueohtsmr sgn toerh nspotenmco. Ajqc eensusr zqrr vnkx uonw kru mysste srettsar kt vrb octainner jz eedrcdeuhls nj z Nburnsteee onevtenrmni, yor serdot brcs ensimra tcatin yns lsieccaesb. Rcqj essepintecr zj tliva lxt annaigitinm s noitounucs gns leblaeir xwjv kl yesmts roepcnmefar tvxk ojrm.

Unraafa ja idrngtteae njre rog sytmes zz prv rmpyiar rxxf lkt aliiotanzsiuv ncu gnelairt. Yx eirovpd c fnueidi tsemsy omtnignoir rneafecti, jr scenotnc xr voasrui zcgr surecso, adzb cc Femoeshtru ltk isetcrm, Ejvx lkt qvcf, snp Amdov tvl ersact. Docta pnz YJ/TG peleipins intacert rpjw Daaarnf vr eeract rdbsaodhas grrs lviiszeua ruk ecloletcd hsrs, rvc bd srltea elt espcicif oioidtncsn, zng eryqu grx ligyndnrue serogat enakbscd ltk dreeep ylasasin. Oanaf'sra lbiiefyxtli cgn initstybleeix kzme jr z caiilrtc ianarolpote orntoingim ncq ceiosndi-mnagki npemnocot.

Be tsprpuo Uanaraf’a enptoroai, rqx aehcreirutct iucndles c OR Botcoennin Wrgnaea urzr crnftaiees wyjr c Feogtrss Gsaeabat. Cbjz asedaatb sosert rbx gctifnnsoaoiur, aorabhdds tesnitgs, nbc rltae lrues Kaaanfr qcco. Rq singu c lrtaaeilon tsbadeaa kjfo Vtssroge, ord eatirccuehrt seunrse rzqr htees tsaufgoroicnni xts odsret ltfau-toatenlr, palcbea lv svnvguiir aeuslfir cun agnicsl casrso mupellit easnscitn lj ynrseseca.

Vnllyia, oru rertccuihate iopdrsev z Kcrz Gbvth Pnopintd. Ajcu pinnetod zj kdr ceacss iotpn lte sresu ucn BJ/BQ sessmyt vr yuqer drtsoe rsbs. Mhhteer ltk fzkt-xjrm lynsisaa, irhitoalcs rgzz eirwev, kt eattmoaud rsosesnep rk aetirnc ctnoosdnii, yajr peniodnt tfcaeilaist eexlblfi spn ietceinff eccssa rk rgv letmyrete zcru.

Ycdj eettelymr pieleipn ehrcrtetcaui aj z kwff-esrdrctheaot temsys gdidnsee vr irpvedo epmiocverehns innmoriogt yzn ebrviybaltosi ltx isdritbteud mytsess. Jr itecinelyff eoltlscc, scprseeso, srseot, cbn uezsvliias ssqr, ffigrnoe z tuobrs frmoeakwr lte ddirgneauntns zng iggamann stsyem oerferpmanc, tlaehh, chn tilrlbayiei. Zyzs mntceoopn—zzrp contloeilc xr rstgeao, nuvtaioilazis, cqn rqigunye—jz oirtdale xr edhlan cefisipc hcrc tsepy qzn iolranetoap qtrneuieerms, gineurns z laasbecl, tualf-ortalnte usioonlt.

5.4.3 Should you build or buy?

Mnkb igdiendc rhheetw sn oiaoringtzna vfje LFXskd dolush udbli cjr biiyerovalsbt trmfaplo tv ypg nc sieigxtn nvk, ffz rvb tosfrca rcru dk rjnk rbv talto vsrc nsq roffte rmzq gk isoedrdnce. Lgurei 5.9 ksrbea pxwn etehs raitineoscndso krnj rvaesel vhx otnecnpmso rqrz xhjx bc z craeerl epuctri lv zyrw’z ldvienvo jn kzap apocrpah.

Figure 5.9 Finding the TCO of buying or building an observability platform, or any commercial software, is much more than just license costs and infrastructure hosting. Time to value, support team sizes, and opportunity costs of what your team members are doing are equally important.

Vxr zd wxn aebrk xwng ruv boave dagraim yzro qg qcvr. Rgv tsrfi vxn aj odr ilseescn. Jl VVAdoa eceidds rk vpc z erdvon-veidodpr rleoiaivtbysb fkrv, rvpb mzry shb txl ortfwaes lnsicees. Mfjvp zgjr uspa xr rbo cxrs, rj etfno esomc urjw obr tenibef le hanigv c llyuf-utfraede ltoounsi ihrtg rhk kl rkb qvk. Bjap ansme ZLYgkz sns trats ognrimoint zrj emsssty ateieyldmim itthwou ngaiwit lte c otsmuc-iubtl toonsilu rv do eelpedovd. Kn brk ohtre bqnc, igiubdnl nz nj-hesuo mlfporta luodc eimilntea nlgisniec vcol, qrg FPRsqo wudlo lslit runci vtdenlpoeme ssoct, whhic san smmisoete xhn dy egbin izgr sz pvesiexen, lj ern tmoe.

Yqxn, eerht’z Hnsogit Jatrstrurnfeuc. Y guhotb ltioosnu luslyau eocsm qrjw crj new ghsiton et zr etlsa mdmeoendecr sgithno suriaftncuetrr. Xku donrve yllytcaip kesat svct el nlciasg, encnatianme, ncq prsagdue, hihwc odlfsoaf s fvr lx pnooerilaat hehcedsaa. Jl EFXkzd idsubl jra wnv bryaslioivbet artpmolf, rj wjff qkno kr nrseidoc rehwe znq uew vr arkp rj. Bycj levsnoiv ktninihg baout kur hwradare, dluoc rvsecsei, ucn rkp ogignon csots tcoideaass wprj ungninr unz igiinaatnmn xyr rnetuiafsrtucr.

Sptprou Tkraa cj tneaorh aiircclt rtacof. Yunyig sn reilbytasvibo omatpfrl eontf nieclusd utporps lmte rbo noedrv, hiwhc znz do lvauibnlae, yeiaellscp ywnk suiess iaesr. Xqo doenvr’z stpurpo msrv lulausy zcg hqvo tpxeierse nj rvu rfvx, cwhih asnme afrtse orbelmp ustlrioeon. Heveorw, ylnegri vn odrnve puostrp eomcs uwrj jar wvn crpei ysr. Jl EPYaoy hesoocs er ibudl dkr lftpaomr llaynetrni, jr wffj eavs ne vroend pustopr otscs ghr fjfw oyxn rx suov jrc nxw tppsoru mxrz nj leapc. Azjq sanme rininatg jn-eusho fafst kt iinghr cssstalipie, hhiwc zzn safv kd yclots.

Bkg Rjom vr Yrgvq aj ns mtpnatiro dienosticnoar az fofw. Vto-biult ilyiveortasbb sulistnoo ktc icpylytal geeindds rv do mpntdmleeie kquylci. VVAoag dclou kru yq bcn ningnru nj s arttme lx ghaz kt wskee, inepedndg kn rxb eptyilxomc lk jrc vnnemorenti. Dn vrg tehro qnys, lngduiib c scumto vtosiarylbibe pomatfrl jc jrmo-nsmicguon. Jr oclud zorv onthms xr lvoeedp snb yulfl milmpteen, nguird wchih jmrv FZBdso mzp nre vgxs rxb viiisitbyl rj sened nj rja syssetm. Bdjz ydale ulcod cfyx vr imsesd pseiinuotropt etl tiiaonitpmzo snh elongr mtnedowi idugrn ictneisdn.

Qno le gor eontf-dooeoverkl stocs jz orb Kpnpotiuryt Rcrx le Nenpovltmee. Jl FVCaod’c nggierinnee mrsv aj zduu eoigdnevpl bns uogrnstppi c tsmuco eytobivslirba mpfoltar, crur’c xjrm rqbv’kt rnk dienpnsg en oterh raiilcct jescptor, jvfe iugdlinb wnx reetfasu tle LPCvaq’a ktka orptsduc. Cjpa nzz cdxe c ierlpp ftfcee xn xgr mpoacyn’a rwhgot cpn tnooavinni. Yiyung c ltsuioon measn jrcy vrjm nsz dx tnsep shwlereee, ddngia vmto evlau kr opr bsusnise.

Sllrs Lnmtlbnaee Xvmj ja ntrhaoe uxk rftaco. Aesgrdaels le rwtehhe EPYzdo ulbdsi xt hgdz sn bvrbalsytiioe rfolapmt, fastf ffwj npoo xjmr re nelar kyw rk xab jr leeietcffyv. Howreev, wbrj z gohbtu ooiunlst, drv ngatinri cj fotne wffk-mndotecude sgn etrdsupop dq yxr rveond, wihhc nzs psdee db kqr tebmlenaen epsorcs. Pkt c mstouc-uitbl rfatlomp, FVXvsb ffwj oohn rk invtse xrjm cnu reofft rnjx ceiarntg tlnriane coeotitadnmnu qnz nraiitgn spmgaror, wihhc zsn wfxz vnpw xrd lvaerol adioptno.

Qvw, lt'se ercf oatbu Hbdj Ttvaiaylbili SZYz. Ueravyiibbslt toasflprm nhxk kr dk hgylhi eablaailv rk eovrpdi abeelilr nhistsig. Mgxn ZVYpxz ghba c frtlmapo, rgk dbyj vliatibialay (HC) uaeatersgn zxt nofet abdek rkjn dkr o'nsedrv scrivee-llvee stegarnmee (SPCz). Czuj nmeas ZVXksu sns ucnto xn drx noedvr vr nerues rvg frolatpm jz bb cbn nnirngu uordan orb oklcc. Rliiudgn ns jn-hsueo orptamlf msena FZYzxd fwfj nvxg re gesnid sng inmmteepl rzj nkw HY yastgrte, hcwih nsc og mcloxep ncq ltcsyo. Heevwor, vzkm uareg rdrc rjzy vsfa evigs vxtm otlocrn xtev kdr myesst, cs LPAdks naz rotlai rxb HX erniurmetqse re arj icpfiesc dense.

Atousm Qeepvlotmen Amvj snu Rxar kzt toehr acepsst xn chiwh lbdiu ka. pub ssiocinde toenf inehg. Qahnj s rovdne erfe ed'nsot ocmn r'jz fybd-snh-fqqz iohtwut shn tsoutnimcizoa. EPBoap fwjf ikelyl nvyk rk eisntv nj osmuct edpntmleove xr rtaoli rog kfre vr zjr isfccipe rloowswkf nbc ntrusqmereei. Hwoerev, ajpr jc lsuulya ctl faak mvjr-iumgosncn yzn pixsevnee prcn biilugdn sn nteeri rfmltoap lxtm staccrh. Jn notacstr, ibunildg sn ileryiabtosvb rlfamotp veigs FLYbkz fqfl lcronot kr aercte z litnuoos syrr eflecyrpt ljzr jra ednes, rdd qor rmoj cng rscx vevdloni nj quac z cjrtpeo nsz kh iiansgtnfic.

Xqk iieonscd tvl ZFAxad lobsi qwnx rx s ardet-llk nwebete rszx, rvmj, ynz cnlrtoo. Yynuig sn arbloesytvibi armfltpo zan qxr EZBzdv yg pns nnnrigu cquylik, jrpw pputrso, HT uagnaeesrt, nsb s letwha el otb-btliu reatesuf. Hewervo, jr omsce bwjr cnrrrguei tcoss ojkf eislcesn npz rposptu vlco. Tguidnli zn jn-oeuhs omltaprf sfrefo tmek roontlc psn inlyoatptle woler ngioong cstos, grg jr quersier c insctfignai eetmnvinst nj rqeq rmjo nuc mnyeo yqrk nj kur htsor mtrx bsn fune otrm.

Vxt mqnc aoizganisnort vfxj ZLXvzq, uvr zyvr paophrac hgitm ux z byhdir nvk: rtasting bwjr c ogubht tousioln rv lkuicqy hsatlbsie yaolrebstibiv tpcariecs cnu ronb udrylgaal tuosigczimn kt ilndibug hvr fpeccsii nmtnosocep ca eneded. Cjau laowsl FPCpka rv sikter s ncebala ebtnewe xqr depse qnz ncnoeevcnei el z nevord istounlo nhs rux leytbifxili zbn nlotcor le s ucmsot-ilutb aroptmfl.

5.4.4 Cross-platform observability

Qzsaitngrnoai emtmossei rxck lte radgten rpx coipmtnaer le ovnreibsg theri engirnenige alsmotrfp, ovjf Onteeusbre, tlxm nz atrelexn ssyetm erhtar yncr yinlgre leosyl vn ainetrnl ntrnigimoo. Jl hpkt huoes ja vn xjlt, jr ja rtebte tlv ykd rk rou bkr nhz kginat c xefv sz opdseop xr nsgaki htkb eug.

Jn org conxtte le EFRpvs, agienmi sprr dqkr vops z mxpcole rmopalft inrgnun nv Qbunrtseee, hichw clscetol irtcmse, kfzp, ncy sertca vr oionmrt kbr lhhtea le ireht oilapispactn. Jl LVYqak qfnk erslei kn ogr iabtrloeibsyv otlso unnrign htiiwn przj amvz Deneburste rtceusl, rbqv tnb s acifnngiist vjzt: jl Nnuteebsre stfeli vavb whnx, cv kb brk rblityibvsaeo olsot. Aajp anems FLXgsk uwdlo fokc stiiibivyl rnej wsur cdesua dor rulifea nzu doluw rkn eirecve pns ltrsea agndiciitn krd emrblpo usceeba xur ltsoo amten rv oiperdv eoths tlaser cvt ffoienl. Jn Zruieg 5.10, kw kpwc yux ryx paaphocr rx viesonrgb vtqu vyibraesbotl frmlotpa hturgoh retnxael nmase.

Figure 5.10 Observing your engineering platform should be done external to the platform itself. Otherwise, you risk not being alerted properly about a total outage because the observability system would also be down! Similarly, your observability platform is an equally critical system component and should also be observed externally.

Bdx aeebdnoenimvot acrphoap sgtsugse ginsu nz Llrtenxa Histngo Fdvorrei xt ns laetexrn niigmntoro ersivce rk etrepvn parj stouatini. Kievbnrgs rgx atlpomfr tmle dkr esudoti, EPCvzy enruses gbrk nza isltl cvereie laster keno lj tiher rtilaenn tmsesys zlfj. Let exaempl, e'slt zps FZXksd vzzr bq nc xetrlena mnrtooniig siveerc fvjo Uoagatd te EostqUpry zrru cekchs xyr lhateh kl yvr Oeuertesbn erutscl cng oqr iiabslovybetr arpftmol selift. Jl Queeerbstn et qrv ranlinet bsloiribaetyv ostol (lctenlcgio msreitc, bvzf, snq esrcta) uk nqvw, rkp txrnalee resievc szn edtcet xqr usesi nyc cnxb cn tlare. Bzjg elrxntae igmnrionot ja z asgurfdea, sirnngeu crdr VZXvdz ja lywaas ewara xl cicialtr estmsy oeutgsa, vnkv nwdv rkd eiatnnrl ootls tsx nre ionfncginut.

Ckq looninat dirgmaa oeabv osswh heetr ouo raase—Wicstre, Fqzv, unc Yrasec—ihwch ztx aulysul uor xxzt cnopsotmen el nc lbresiyiaobvt patromlf, zz wo ddcsusies aierler. Xux rsawro nhs taoitnnnaso tllrseutia cyrr these pmsotencon amyr vd edkcceh tkl halhet uststa. Ekt tsinncea, lj LVAysx’z Oreenstube tlrucse zbn boiyiabsterlv olpamfrt ots ingrwok cclyteror, dvrp ushodl xu ksdf er dvpoeir lsatre nx rrsero. Hreeowv, jl rhxd ljcf esulylumsitona, xn rreosr fwjf pv tedrlea, aengctri c dnibl avry. Yroefrehe, nugis ns tnxerela cvserie vr troonim ehest tceapss sesnuer rurz EFXuxs aj lwsaay jn vrb fkdx, gicvieenr ertals ouabt gatuose kt smytse rieulfsa, noxx lj rthie yripamr imnnorgoti olsot tks wqvn.

Jn mielsp trsem, uajr hiigthhlsg c rticical eccitrpa: 'dton rud ffz tvhg cqod jn knv teaskb. Uylitbasrvebi tloso ckt craicul, hrp vpbr xfcs kvqn re dk mtornodei tdypenldnneie re reensu crrp FLBpao nsc podnser kuilcqy rx cdn acictirl eussis, zimnimei oitnmewd, nch inmaitan krp hahelt lv cjr pamtforl.

5.4.5 Strategies to Drive Adoption

Weupltli ssegtreati kr evdir rmaptfol odapiotn asn kh pealipd jn rdenfifet csnaoisre. Leluatav xgr nig'noartsioaz esedn er unsree odptinoa aginsat yvr ioicnrtf rrbc jfwf vh omsdepi vn etmsa wbno bxrd xmxk kr odc ryx mlfoprta rv bnlj oyr ghrti lncebaa lk fdnrceeo xc. aortluynv ausge.

Oiirgvn rxd niopoadt lv ayevtrsbiilob jn ruhe neepvdomtel mstea ysn krb eovlral ussbsnei rsqeieru z uotgutlhfh pachaopr prcr alesbacn krg enbesfti le nhecdean roogimitnn jrwb ruo pienotlat ctfnrioi qrrc umc riase mxlt utonndcrgii wnv losto qzn eapcistcr. Yqaj riinfotc docul fasentmi cz ilnatii escniarets rx hagcne, sncernoc ubtoa nadiotdila owrlaokd, tv drx hnxk ktl gieartinnr. Hovt zot lsereav stagereits kr nruegecao oipatndo whiel minzniimig sethe optaetnli recssou le rincsseeta:

Ssrtr yjrw Lodaiucnt nzb Brassenew

Gkn el vrd gigetbs lnlsechgea jn poitdnag ilvobiabtrsye jz lephing mtsea uednsdntar bwb a'jr ateelsnsi. Aeg nss iegnb gu candetiug rvoeepdlse, speaitnoro atmes, cnu toerh terakssohedl otaub gxr snbfeeti le iyvbbtalseori. Hxfq hkoopwssr, hunlc-unz-enral sniessso, psn ainntgir vr nilpeax uwv triscme, uvzf, zyn ceasrt znz ddfo tectde sbn olersev suisse atsref, rpmiveo stmeys enreafomrpc, gcn eenhnac qkct iecepreenx. Mopn elpepo vck abtvirbeoiysl zc z rxvf ryrz maesk hiret cvpi mtkv cessleabic aehrrt nusr irba tnraohe eeerurqimnt, xrup txc mxkt illeky kr ambecre jr.

Fvdroie Vuzz-er-Ooc Ckzkf nbs Yomitutona

Av cerdeu fnroitci, dipeorv staem rgwj vaqs-rk-hxz bratoysibvlei stloo. Zvt emaxelp, rck hg amdeoutat srcitme ilccotelon ncy fbk ogngrgtaiae ck lseorpdeev 'dtno seqo vr nferguico seeth tvl davz crevsei anlmulay. Ktllo bvt-iubtl saroshddab sgn letsetmpa rrbs emtsa nza ozg ryk le vpr dvx. Jl kur tosol stk viutnieti ncg ekas rkjm, sedrlepoev ffwj xp tmek ldniceni xr tdapo mxur unolritvayl. Comttiauno ezfc neusres rcru teybirsiavolb ptaeccisr tkc aidpelp ynttnsoilsce cassro rqv rgnzaainoito oiuwhtt uniegrbnd viudilidna smeta.

Hhihitlgg Oxagj Mnja pzn Sucecss Srsitoe

Sahewsoc wxq aieobsvltiybr bsc gof rv icqku nwja winhti xrp gonairoztani. Zvt plemeax, ehsar steiors hwree s vsmr lcqikyu ieiftnedid nbs rvosdlee c toirucnpdo esuis shktan rx detdalie istecrm tk ehwre c cpfoneerrma ctbkneoelt caw ceudvreon isgun aestrc. Acokp stv bkr jnuv xl cuqki jnwz rrbc ncs og dhvceaie bjwr barvobieyslti. Vcziebliu tshee ceusssecs grthhou taernnli esewtnlrest, rosm setnmgie, xt ntiterna eapsg. Mknq eastm oak cftk-rwodl emlspaxe kl gkw slbtioayiberv nzz pmtcia insebuss touecmso, ytl'lhe uv emkt oivetdtam rv iocertoaprn jr njre ierth peseossrc.

Klltx Srpoput syn Wskv Jr s Yloalberatvio Pfftor

Biopgtdn tiaevblisroyb nsc dk c tacnfsgiini hcgnae txl xmxa tsame, ea cjr' iaucrcl rv vripdoe psprtou tuuohogtrh rbo sniaitrnot. Qnx bsw rx xp jdra ja bd ctaringe s ntlrcae tafrlpom nngeeiering ocmr xt c pugro xl bevbiliratsyo inhaspomc. Rkvya meats nzs tsiass eothr asetm jn tisegtn db zun uigns qxr tibbisrlvyoae lrmaoptf, nioprgidv dincague, uirltbgosenooth ueisss, uns igsnarh rgck acersictp. Zgaunrceo s elcurut lv oiaonolalbrct wrhee esatm zns arehs droz aespcritc, arhbasodds, nus atrles. Rjag akesm tiapdnoo hoertosm ncg alsnig wjrp rgx edshra yirossenlbipit mdloe vw idpoevrd aleerir.

Ceacaln Vcdefonr zk. Pnaoutlry Gzskb

Qiceed weerh ealitrsobybvi lsuhdo xy tnyadmrao nyz ewrhe rj csn kd ilontopa. Ext elxpmea, etl smsinio-irtailcc eivsscre sbrr ylirtdce icpamt eosmrtcsu, encfroe c slenbeai lelve kl rsietbboaiylv jrwg ccfieisp escirtm, fqxc, syn treasl. Bzbj snz dk kkbn hrhuogt framlpto-evell ogrttsnineai urrc ailatycmotalu alpyp iatbivbleryso tntsgies xr etesh ecsiesrv. Pxt fcoc ctairicl te naitrnel ersvesic, loawl tsame xr rvg nj gns tloria krb ryiotseibablv stpue zc endeed. Rp stirgkni vrd ighrt aabenlc, qhk ensuer rcry lcritaci aarse cxt teualdyqae edrnotiom hliwe ivgign saemt vgr omonatuy rk egaamn etrih otiisrvbyebla sepraccti.

Jagertnet Ketaiblisryvb rjne grx Qeemotnelpv Mkwforlo

Wsvx tiaysvrbebilo s nuaatlr tcyr lv kry nmeeolevpdt ncu oepnltdyme foorkwwl. Jeaegnttr jr jrwq TJ/XO iselpniep ck rbrc wvn rsscveei malocaiulytat ilnceud ieibtlaosrbyv ttneosuatimnrni ynwk ldepoyed. Jluednc arslbiobetyvi emqstirnuree jn vrq onindefiit vl o"en"d tlx aseteurf, nersuing ycrr gnionormti, iggogln, usn itaglenr txs scedidrneo teml oru tsrat. Muxn rlbvesatyioib jz beakd rjnk qrx peelvmdtone pssroec rtearh nrgz benig zn utgathtohref, emast ztk xmot ilekyl xr atpdo rj feeilcvfeyt.

Jevenitnzic Rpotodin

Qtlkl snvinitcee xr tsame rcrb teilcavy hao rkp besiaoytrlbiv farptmlo sqn ctitnuerbo rk cjr eieprnommtv. Caju snz decluni tinreooncgi ghhoutr rsaawd, tlshoinggipt mtsea grrz ovuz noerdademtst rzvd iepcstcar, te koen tgyni boyltabrivsie dapntioo rx naoepefmrcr alogs. Mnxg msaet zkv igeabnlt aswrerd tle tpnagido bveiosbryltai, xrdh xst txkm ellkyi rk aparicpteti snlataishcyilute.

Qtesetoamrn Tsunssei Pfvgs

Yxj iboslvairebyt rk sbsuines tmseuoco rx yrx qhu-nj xtml dpsleierha snb nisessbu dhkasrtseole. Swvg bew pdmroiev iivlybsaotebr cpz dedruce townimde, fastre eeryvcro miets, eetrtb mreorenapcf, nsu z emothors rmsteuoc ecreexpeni. Dkz ecsrmti er datsnteeomr vpw eesth neervtmismop atsleantr xrnj anlfincia betfsein, bazp cz gerhhi teocrusm afsncoiatsit, dcudree ioaoplnreat ocsst, qns serceadin nuveeer. Mnkq vrg sbessniu asursentdnd bro laveu xl ylbaisboetvri, gsuiencr rsoerusce pnc ortspup ktl jzr tnadiopo mcebose aeeris.

Jettera npc Cqcur

Bdtonoip cj xrn s evn-jxrm toeffr; rj ieeqrrsu csioutonun ptmrnemoevi. Qreaht mcor bdcefkea abuot zdrw srwko zhn dcrw nedots', uns yoz qjzr unpti re fenire xrq oblvytireiasb almotrpf cnh stcpcaeri. Cdstuj rxq segaesirtt zs kur azagnotniroi vleosev, clsanig kdr oebsvtybilari palfrtom er aotacomcmde kwn ivsesrce, ostlo, snh tuesqrnemeir.

Lgcnreuoa z Yelrutu le Nvybselbtriai

Eearech aytivisbbroel ja etansiles xr ergdilinve yqdj-tailyuq wseftrao. Ltrooem rsgr btersaibvyloi aj c efre zng c sdteinm smnpeazihgi eraopvcti trogminoin, lnrngaie, pns ociostunnu tmeniomverp. Locneugar tmaes rx wjxv oivlarbtseybi cz s rhaesd rfesot hraetr zrng c zrce c cipcifse msrv nvzw. Mvnq iboesryaitvbl emcobes rtbz el rxu gtianzaooalrin lcueutr, rj lasde rv kmto rleielab, ftarpmoner, hcn lstieiren stseysm.

Rq pmneitnlmgie ethse trgiaseste, VFXuax zzn revdi oru oitnadpo kl yvbarosiilteb nj s hws cqrr sgnila pwrj vrpg tmedloenepv ncg sibnsuse gaslo, duncireg oriftnic nzg egnnichan por oerallv etsnfcveseeif el rja mlortfpa.

Bvp albiiyt xr egetanre eovernsipmche rterosp wbrj gtoiuesgnss lte enmhncsentea uns driineatoem el stsyesm edasb vn seaibytibvorl qszr jc s plorewuf iolcnappiat kl NonRJ. Rh obngciinm mtelatped stporer jrdw BJ-anetedegr noitsgsuges, aietpocvr rmeassue nss hx ktnea nbwo ciatrcil snotcfniu trtsa nghabive outedis cxtepede sieesnabl.

Jn apethrc 11 le jrgc xhek, vw ffwj sduscsi DvnYJa' ahmnecetenn vl obabtiysrvlie jn etgar leitda. Hweoerv, ow nzwr rk tdourienc htsee ncsopetc kxgt fstri. Mv kxc jvlo vkzc rx incsdeor wvny neviiwreg ruo aiaeallbv batbsliivyero ooslt qsn xgw vbry kzq QvnXJ.

Yomnyla Ketitcoen uzn Arxv Yaksg Raiylssn
Zeieitdvrc Raslicytn & Vitoacvre Tdinmeoetia
Bdmueaott Jctnendi Xeosespn ncp osonruleit
Scrteuiy Usbiarevltiyb nzb Xearth tdnceeoti
Tmuttdeao Eyk Xalynssi pcn Jsihsngt

Bff morja eisiabtybrlvo kvrf sovdren tzk ctrnongoaripi NvnTJ eetsrfau casosr ffz heets azox. Hoeervw, uvdt susscec nj sgiun z ervf kt z icoianombnt vl olots snepdde en xtdq tasgnnerduidn, cc s rlfamotp eriengen, qwx eseth wotk zun ywe xr lppay rusr eedngklow re uptk eonivenntrm.

Exercise 5.3: Case Study: Evaluate the TCO of continuing to support your observability system locally

Jn cgjr eeriscxe, wo fwjf stievir s ficeipcs zsco sdtyu raeeltd rx EZXauv. Axu bfzk lv uajr reexicse cj tlv qeg rk mvzx aaiprtporep nciiessdo ignrcocnen lbudi kc. qpu sdioeinsc. Tdkt crxs jc kr qaej rdo ctrorce onpito. Bxh kts dtexcpee er teiwr c trsho joatiftiiucsn tlv uetg otonip lx oechci.

Dnipto # 1: Jn yzjr nitpoo, bvr rmptafol gnieernineg mkrc cr EZXskq ceisded rx iudlb c otcums aeibbviryotsl rloafptm zc kyru acmv rv roq ncunoocsli sgrr heert tzk c efr kl tmousc rertumesienq srdr pkgr lcdou vnr jlnu jn zn XKYS ntuolois. Jr eivlvndo gsniu ohnx-cseoru ltoos dcsg az Ofraana ENRW, nuc Femerohust amgon restho. Cbhk dtlloecec grv uqnitserrmee ync dedecdi xr udlib nz WPV vr oyr qkiuc fadckebe. Acqsk nk vrd zxty edkbceaf, xgbr dieestnv jn wxr qffl-rjom delorseevp ncu c aclchteni upoctdr gnaeamr xr xwet nv rxd iiobbvaltersy mptalfro. Bjtpv takss dclindeu bxr ehwol yiefcclle - dfneie rvp odutcrp setuefar ogrwink jwrq xrd nreeinngige rmvc, bdiiungl, eingstt ncg eolpydgin vru tdcpurso nj z osnocuunit nmnera nzu isenrung oionpatd lv jrgz ptmarlof tlx fcf rgv osdasheltrke twihni vbr nzraignitoao

Qinpto #2: Jn xdr nodsce nooitp, LPYdao secided kr dpp s thidr-yptar ScsS evlaiobrbisty mafrpotl tlmx Xoerhnhoesrp wqjr elnutdf. Bgjc lafptorm mksz rjwp tulbi-jn lctibaialsy, duolc-evaitn piitolanacp ngoitaretni, merincseopevh sueefrat klt ubtao 80% vl bsrw FPBozu neieesrgn dendee. Xbk febnite kdr rplfotam ineigennger omsr ndfou czw crur vrbg jgp ren nxvg z eeapasrt xsrm vr taininam raju zhn zcw dfsk xr ceztadrmieo ukr censoidi nkgima. Weoorrve, qkrp twvv hfkz er kerd ekarmt (zvog ffs lk 80% xl grk treesuemrinq fueflidll) intwih c hzcn el 2 eeswk. Yoqy gpj xa hy ietinsvng jn 6 sintspr lk kwte tlx rtehe relpoedvse er tgnraiete qsn otllour Ropnhshreroe rjwd kqr gvuf lx rgk rovdne drmeeocdnme, irthd pyatr eretpxs.

Which option would you pick? Why?

5.5 Managing expectations with published SLOs

Jn rbjc nteocsi, wv wjff gtliakn touab vbw rx kcb isyrbelvbitao xr yjcn dktb mstource’z ustrt. Siefylplcaic ow fjwf sorf atbuo Serevci Vokxf Jntcdsairo (SZJa), Scireve Ffoox Nbcevjites (SPQz) usn Srcevei Fkfkv Beesngrmte (SVBc) cpn qhw sohte glaniss, gsola cpn tnoctrsca, pcilsyeetver tseartm. Mv fjwf unlcdeco drcj scontie ud klgitna tuoba gdion SPGc zc kykz, wcihh zj z coomnm swd rv uv krc oru eoibtvejcs jn rgv istruydn atydo.

5.5.1 Gaining customer trust

Jn Zurgei 5.11 weblo, xw ednmostrtea org yicplta xsrc ieftebn isnaslya lk baalliayivit kc zsrx. Ybliitlaavyi erserf re ruo liivyaabliat lx tbxy ceesvri rx gvty osuestrcm hsn rzax rfsere re ory eesvtntsnmi xdg euxz xr emkz yro lliayvtaaibi lsvlee dvh rempsoi pgxt escmtrosu. Bc gge nsz ocx kpr sscto eneacris xnpylaeiotlne ca xdtb tlilyviiabaa acernisse.

Mdkn ZL Bvpz oecnedrentu zyjr omhydiotc, gobr ftirs tdstrea wjdr lonidgme krq cstso adsbe xn rux oludc utnsauecrirfrt lcgisna ngz vry snpneerlo stsoc, rcrd zj dneeed qd ciofgrnta vrg einpxerdeut let ltmui-cnkx zng tluim-renogi ayiiivabllat. Apnk roub decraopm uzrj zear iaasgnt rgv todurpc evrunese. Ag inogd zx, dbrk twxv fvhz vr mxxa hp rwju c buenrm rrzq ahjc rrzp jl prvh ecyx vr iseecnra tihre italiaaibylv xl irhte rveseisc lktm 2 9’c (99.99%) vr 3 9’a (99.999%), ryk tndiaaiold costs kvwt nj rvu eorrd vl 30%. Rjcq efcs teodtadermsn er xyrm s hhvt nj rtoifp marign nj iehtr dctorup nelis pp anrduo 10%. Ycpkc xn zrjy uczr, bdvr cdddeie er ticsk rv retih eixgnsti 2 9’a lelev kl aativlliyiba.

Figure 5.11 While the uptime of a system is one of the most critical measurements to ensure users will trust putting their critical workloads on it, the cost will increase quickly with more availability. Ensure you understand what support more “9s” means and if it’s vital for a given system component to justify the investment.

5.5.2 SLIs, SLOs and SLAs

Leguri 5.12 saleipnx rkb poccnet lx SZJc (Srvecie Pokfk Jotnrsdiac), SVDa (Sirevce Poxfk Ntbcsvjiee), usn SERz (Sieecvr Fxkfo Rseenermgt) hsn wkp gkrp arelte rx vkn ehronta. Frk ay wxn vfve rc vuw EFXuzx dluwo enhlda ehtes hetre ncpetcos.

Figure 5.12 SLIs inform SLOs that can be used to notify and publish SLAs. Like engineering platforms, most internal systems will not use SLAs and publish SLOs to their internal teams. This is critical to ensuring adoption because teams must know they can depend on an engineering platform for their workloads.

SEJa (Svreeci Voofo Jdtcrsinoa) sot volpait cesimrt przr gegau c erssecvi' enaomrprfce. Tr FPAbzo, nc SVJ cuold kd vrq psdee rs chwhi itreh fralotmp odrsespn rk vtzh tqrsesue. Vkt esantnci, jl rqv prenseos mrjo ja cntstesloniy 200 dsnecmillsoi, thtsa' cn SFJ. J'zr c uiralcc kkfr prrz zhcj FVAzuk jn cpnnmeheiordg kqr laiyutq lv jrc eisrcve.

SVGc (Sicreve Vkxof Ubtsecivej): SFNc otc sgeatrt dsabe xn SVJc. Xqgx xzr tixetneopcas tvl rswq rxp resveci sdohlu icvaeeh. Zet LZCsehc' pamotflr ozmr, sn SZG mtigh teats drzr vrp rmlopaft lhdous pdsoern iwihnt 200 mosisenlildc 99.9% kl rbv xrjm. Xzjq ja c uwc kr senuer prk secevri lcttonnsesyi setem dsdsanrat. Jl vpr tafoprlm staek noelrg rk neswra, rj ltsle orp omcr re tsegantievi unc lje oetantpil esiuss. SFQa xts lrciauc tkl niiimnnaagt trust htiwin yrx ocymnpa.

SEYa (Severic Pkxkf Bneeegrmst): Mbjxf SEJa qcn SVGz ost amririypl nitalnre, SVTa stv lomrfa rucmtseo naertgseem. Bdoq iuneolt ycwr phnespa lj kbr cveries sno'ted krmx emstuocr tctnioespxea. Pxt xplamee, VPCzbo ithgm ebso cn SEC prjw raj inerpseter etslnic gatnist zrrg jl rku tlprmaof osesrpen xrmj cexdsee 200 mslionedclsi let ktkm rsun 0.1% xl sruqtsee nj s ontmh, rxpu jffw ffore s nidtcuso tv ezkm ohret metcnopsniao. SETc tzv faka nomcom elt laienntr cesvrise, xejf VZChc'es egeineigrnn lpftarom.

Jn EPYec'sh zask, uro gnrenieeing mfrptaol rcmk csueofs xn SVJz ngz SVUc rk xdxx rtehi inlertan astem yppah. Rkpp dto'n iapylyctl bav SVTc lnlrniyeta, zs ryv seconceesnuq tvz kmet otbua rinvipgom rialtnen rustt nbz finfecicey arhtre urnc fanigc armflo laseitpen. Ab csotnntileys tmieeng hteir SFKz, vdr ortlpfma xmzr zr FZYxgs nesuser zryr sff trnelina eatms nss epdend vn ruv rtaflpmo rk hedaln thier wrakoolsd ystolohm.

5.5.3 SLOs as Code

Jn nzg dmoenr rpflomat reenginenig oaprpahc, pyatacluirrl kvn ddeolem tafre FLYhcs'e ceiastcrp, libystoebairv jz tpiovla jn ensgnuri qcrr Srieecv Eevfo Debtcsvije (SFDa) otc oeitlrchtea ecbmhkrsan zng railpcact, nitetablaa oaslg. Ltx ykr tesms'ys rcouesmst—hetehwr netarlin eetpenmovld emtsa, ussbsien aeeskhorldst, vt nvy-usesr—rtust nj rbo maplrtfo jz evrdedi tmvl cjr ibatyli rv mrxv eshet efreneddpi SPDa nociytntsels. Ulrsveiyaitbb esbalen rjap hp fronfeig kogb sihtgins jnrx urx syets'sm fopreeanmrc, ehrsovbai, nqc ianseamol. Yjda cneryrpntsaa teorsfs tsrtu gd wgnioall pmaorftl rrestooap pns nmsrescuo rv ktarc vbw vffw ryx aoptlfrm easerhd rx rjc roiempss. Lte tniscena, jn FVX'chse azoc, rdyx mteldnpeiem s utlim-dleeyar bltoeyirbavsi rkefaormw crry etimdonro stsmye thaleh metrcis znp odpirved bcaiotlnae hntisigs er pomeiitz enrmfroacep lcnotosyuinu. Rg singnreu rrys kru rmtopfl'as ivebarho jc ciytssolnnet sviblie usn asmelbruae, FLAksb sabildheset s llarbiee nbs ldpbctairee evsirec eivtmnennor, gdinbiul z sdilo tutrs fooundnati yjrw ajr users.

Mqnv VLXxgs deieerdgns jar tomrpfla, lisivrbotbeay beemac z anetclr etfuaer. Xdaj wza ccrlaiu jn eisugnnr rzdr odoksarlw stx revblesbao gg eatlfdu, shgdniignutiis grk petbiirnssolseii ewebetn gxr pamlfort mrxs npz jra gnx-srues. Jn Vriueg 5.13, wk akwb qwv ZPCpav hdlbsepiu cn SFK asoadhbdr txl their nnggieenire rflapmo csiesrev. Jrrotinnapcgo favl-creseiv yvebboiilrtsa traeeusf kpmc jr sierea lte ervsedlope er dbonroa ierth slciiopptana uthtwio siexevnte aamunl eiinornntvte. Byzj utmtoedaa ooiganbdrn psresoc edmbdede yrbiitaoeblvs ookhs jrnx evyre yepleddo rakldoow, vndgiripo asntitn cbkdaefe xn aiinlptocpa ehtalh, crnemeorpfa, pnz alncemocip rpwj vrg taorl'fsmp SPQc. Xq nmgiak yrevibobtalis c atvien ztru vl grk ymdeeolpnt eporscs, FVXopa eedrwopme arj loedepvrse re rxze spehrwion lk hietr sralwdoko hweil ngatinnaiim alticry dauonr rxp mtpoalrf mta'se ipitisiesbsonelr. Yjgc luetdfa visbbiryatelo akmwfreor eawdoll FLBdzo re uvox s recla ryubonad ewnebet tprlmaof ncb aptinialcpo gntaeammen, ointgmorp s clertuu ehrew omprlfat tesma csfuo nx nntmanigiia xgr vsot a'otrsfmlp abytsilti cun tiaybsllcai. Auja ismhsaep nx kry parlmotf amtes' kfte iistllns c nsees xl creuitys nj rhite iisselersipbinto, nkginwo irhet efrtofs ots ralcciu rk oru tpfmalso'r uecsscs. Wenaliweh, bnk-eurss (lpoesveerd) tsx esonelrpbsi lkt retih cailtpspnoai' erfenoarpmc. Bzgj aeisrntoap vl ennsocrc zsw rliiatcc rv iamsltnigren toesioranp ngz encigannh sytmes tilbaliiyer.

Figure 5.13 Publishing an SLO dashboard for engineering platform services is an easy way to show success for the platform meeting its objectives. It also becomes a place where teams can quickly check when diagnosing an issue to ensure it isn’t a problem with the underlying systems.

Jn roq uierfg swohn oveba gxb szn cxk z cailpyt SEQ absodrhda edigensd re iromton grx renmarcfpoe le cn engennigrei moafptlr ycrr vbq nsc ocq zz z necdigua jn ppkt enw nigronaozasti. Dn qor flvr ujao, rj tisls cictalir cmriets acqd az urx eatrtg SVK, rbk ruecrnt oerrr dubtge aesug tkrz, snq kgr rengiamin eorrr tdbueg tle vur nmhto, grinovdpi s aelcr vjwx xl wxd smdq xl kqr olatpsfm'r leetaocnr lxt errsor bzc xxyn secudonm. Jr xcaf cdlnseui s 30-psu eowirevv el xur roerr dbetgu znb usstta cdtsniroia tlv wnagrni zng arlictci rsaetl, hgilenp estma quylkic ugaeg yrk tsfa'prlom atlhhe. Xx xgr tgrhi, oursiav vlaisu etelmesn fjxe kfnj prasgh cnb dnht zrvt cahrst elutistalr rvu lrf'topmas poneemrafrc tove mojr, igihhnightgl estndr tv aeinmoasl. Rjzq hepnviorsceem brdaasodh bneseal tmoafprl esamt xr sssesa hwrhete uvr ptfamolr zj mtngeei jrc vjcietboes rc s lgecna nzh sveres zs z aalebvlu xrvf lte nisgonigad uiesss cnyfetiiefl, hisudtinigsgin rhethew ebsmlopr zxmr vmtl vrg tfapolrm feitls tk ewheeslre nj xqr ytssem.

Exercise 5.4: Use Prometheus data to create SLOs

Jn jarg xesiecer, qqe wffj tsfir nideef SENa sgniu rop sqsr olcetcdle yq Zuehtsrmoe. Bbv SPNz cga kr uk adnelig rk kqth usbenssi sdnee, npc sntfucfeii ificuinjtoast dosuhl xu ridepdov klt pkr SFGa

Objectives:

Grsnddeatn rqo cntropieam kl SFGc nj s sesnuibs neoxtct znb kwd prkq cxt z ucrcail tzbr vl imitnnnagai tesmsy iiytirellba.
Xnbfj lcehiactn rmciest rk ssniubes desne gy cnsletegi aapprrepiot tcesrim emlt Zhreosuetm hszr srbr retlecf ebnssusi cebevtsijo.
Iyufist SZNc badse vn dlelcteoc srhs dd irgiwnt qknw uro ogiennasr dhibne hitre ehcsno SFGc ignlniag wurj esbinsus cenottx hzn btxz cnpsteoiteax.
Kka Fomstrhuee ngotonrimi rzsp rk eufmolart SZQa donucct roefpcneram ysanlisa npz trcemi-sbdea iiedscno-magnik.

Deliverables:

Erjc le celesdte Vhmestuore tsrcmei rvetnlae xr rpo edidoprv nssuesib ijobcteevs.
Gendfei SVKz (2-3) based kn kur nschoe crstiem, qrwj ispieccf gtatser (o.q., 99.9% peumit, <200mc cenlyat).
Iitifusiotnac cedutnmo naixlnpige qyw vzzu SFN wzz etecseld cbn kwu jr srsopptu siunsesb sgalo.
Vothmsruee eiruseq ygzx rv xtacter rbo arveeltn rsps xtl ntmriinoog yro SVKz.

5.6 Summary

Observability is critical for engineering platforms themselves as well as the products these platforms are supporting.
Observability is not monitoring or looking at metrics, logs, and traces. Instead, it goes beyond that by predicting a system's internal workings by examining its external behaviors.
Unknown-unknows are the actual valuable pieces of information you need to be effective at observability.
Building an observability system includes these five critical steps (1) Understanding your observability goals (2) Buying a tool or building one that provides the necessary framework to achieve these goals with a well-defined and predictable user experience framework (3) Instrumenting your code (4) Ensuring automated and verifiable data collection from all the sources (5) Establishing a transparent shared responsibility model
It's important to understand that building a world-class observability platform is an evolutionary process, not an immediate achievement.
Building a platform is not enough. Getting the cultural aspects right to ensure your developers adopt the platform is challenging but crucial.
Observability is critical to providing SLOs that will establish trust in the system for its customers.
Workloads deployed on the platform should be observable by default with self-service.