rgnet-wiki/pages/SeattleWastinPoP.md

23 KiB
Raw Blame History

Seattle Westin PoP

RGnet, LLC.
c/o FiberCloud
2001 6th, Suite 1809
Seattle, WA  98121
FiberCloud Support <support@fibercloud.com>
206 777 9988
24x7@ccom.net 206-854-3444 and 206-353-5558

RGnet rack 
  Suite 1809
  Cabinet C2

GreenHouse tie-down to Verio Backbone - Rack 204 Panel 9 Port A6
   r03.sttlwa01.us.bb so-1/1/0

NTT
USID 278679
r05.sttlwa01.us.bb Gi100/0/0/15
WAN IPs on your side:
165.254.106.18/30
2001:418:0:5000::12/126

SIX 1G to USC
RGnet.SW3.SEA eth1/46
RGnet.1809.CAB.C02.P1.1/2
GHD.1809.CAB.D04.P1.M3
GHD.19FMMR.RR.405.3.M3
SIX.19FMMR.RR.506.7.D3

SIX 1G to r1
RGnet.Juniper.Ge-0/0/1
RGnet.1809.CAB.C02.P1.3/4
GHD.1809.CAB.D04.P1.M4
GHD.19FMMR.RR.405.3.M4
SIX.19FMMR.RR.506.7.E3

SIX 10G to Arrcus sixa.rg.net
RGnet.  sixa.rg.net.Ge-0/0/1
RGnet.1809.CAB.C02.P1.5/6
GHD.1809.CAB.D04.P2.F4
GHD.19FMMR.RR.1001.3.F4
SIX.19FMMR.RR.901.9.A4

SprintLink 1G to r1
RGnet.Juniper.Ge-0/0/2
RGnet.1809.CAB.C02.P1.7/8
GHD.1809.CAB.D04.P1.M5
GHD.19FMMR.RR.405.3.M5
Sprint.19FMMR.RR.604.5.A5 (9/10)

Rack Physical and Wiring

Physical Hosts and Wiring

hostname switch ipmi oob oobname pwr rack Model
pwr1.sea.rg.net s0.16 2.x? 43
sw4.sea.rg.net s3.47 1.07 sw4 1.1 41 Cisco Nexus-3064
rcuss0.rg.net s0.23 N/A 1.08 rcuss0 1.2 40 Redstone
vm3.sea.rg.net s4.20/s4.22 s4.18 1.01 vm3 0.2 39 SuperMicro SuperServer 6019U-TRT
r2.sea.rg.net s4.36 & s4.47 1.16 sixa 1.8 & 2.02 38 Arrcus Delta 9020S DNX aka sixa.rg.net
rip.psg.com s4.32 s0.28 1.04 rip 0.3 36 NOW VIRT ON VM4 Supermicro 5015M-NTRB w/ Super PDSMU
vm2.sea.rg.net s0.41/s0.31 s0.6 1.14 vm2 2.7 2.1 34-35 SuperMicro AS-2022G-URF 2RU Chassis
psg.com s0.13 s2.12 1.05 psg 1.5 33 (see below)
seattle01.mux.peering.usc.edu s0.11 0.20 31 Supermicro Ethan Katz-Bassett ethanbkb@gmail.com
sw3.sea.rg.net s0.47 1.01 sw3 0.7 27 Cisco Nexus-3064
sw0.sea.rg.net s3.48 1.06 sw0 0.4 26 Cisco WS-C3750G-POE-48
o1.sea.rg.net s0.15 0.04 o1 2.4 24 Cisco 2511
pwr2.sea.rg.net s0.10 21
atlas0.sea.rg.net s0.19 20.5
raid0.sea.rg.net s0.27 s0.03 0.15 raid0 0.6 19 SuperMicro 5018R-WR
vm1.sea.rg.net s0.34/s0.30 s0.33 vm1 1.2 16-17 (see below)
vm0.sea.rg.net s0.26/s0.29 s0.39 1.09 vm0 2.5 15 Supermicro - w/ X7DWU
pwr3.sea.rg.net s0.18 x.3 13
pwr0.sea.rg.net s0.12 11
o0.sea.rg.net s0.05 1.13 o0 2.6 10 Cisco 2511
r0.sea.rg.net s0.35/46 0.06 r0 0.8 & 3.7 7 Cisco ASR1001 commissioned 2018.02.02
r1.sea.rg.net s0.17 0.02 r1 2.1 & 3.1 5-6 Juniper M7i

Removed

Removed from Rack

hostname switch ipmi oob oobname pwr rack Model
dum0.sea.rg.net s2.23 s2.24 1.10 dum0 1.1/1.2 42 Supermicro - w/ PDSMi/PDSMA
work1.psg.com s1.11 1.11 work0 3.7 39 decommissioned 2015.07.20
bgp.nu s0.07/17 37-38 Paul Southworth pwsouth@gmail.com
sw2.sea.rg.net s0.48 1.02 sw2 0.7 27 Cisco WS-C3750G-POE
sw1.sea.rg.net s0.01 1.07 sw1 ?? 25 SMC SMC8024L2
r2.sea.rg.net s0.14 s2.14 0.09? r2 2.8 7 Cisco 1001
r0.sea.rg.net s0.03 0.01 r0 0.1 & 3.4 2-4 Cisco 7206g2 decommisioned 2018.02.02

vm[0-3].sea.rg.net Ganeti Cluster

vm0.sea.rg.net:/root# gnt-node list
Node           DTotal DFree MTotal  MNode MFree Pinst Sinst
vm0.sea.rg.net  10.9T  6.6T 125.8G 115.5G 54.8G    12     7
vm1.sea.rg.net   5.9T  2.2T  70.7G  60.3G 46.6G    10    11
vm2.sea.rg.net   5.5T  3.5T  94.4G  63.8G 72.9G    11     7
vm3.sea.rg.net  10.9T 10.2T 125.8G  95.4G 49.4G     7     1

BackChannel

net 10, drdb Ports for vm[0-3]

Switch Port Host Ether IP Address
sw0 29 vm0.sea eth1 10.0.0.100
sw0 30 vm1.sea eth5 10.0.0.101
sw0 31 vm2.sea eth1 10.0.0.102
sw4 22 vm3.sea eth1 10.0.0.103

Hosts on vm0/1/2/3.sea.rg.net / 147.28.0.14/15/16/29

The Guest VMs

Instance Primary_node Secondary_Node MaxMem DiskUsage IP_Address SysAdmin
adrilankha.hactrn.net vm1.sea.rg.net vm0.sea.rg.net 4G 260G 147.28.0.19 Rob Austein sra@hactrn.net
archive.psg.com vm1.sea.rg.net vm0.sea.rg.net 1G 100G 147.28.0.8 Randy Bush randy@psg.com
atlas9.sea.rg.net vm1.sea.rg.net 2G 16G 147.28.0.36 Randy Bush randy@psg.com
atlasvm.sea.rg.net vm1.sea.rg.net 2G 8G 147.28.0.33 Randy Bush randy@psg.com
build-u.rpki.net vm1.sea.rg.net vm2.sea.rg.net 1G 100G 147.28.0.28 Rob Austein sra@hactrn.net
cache0.sea.rpki.net vm2.sea.rg.net vm0.sea.rg.net 1G 100G 147.28.0.84 Randy Bush randy@psg.com
cb.rg.net vm0.sea.rg.net 4G 128G 147.28.0.44 Randy Bush randy@psg.com
cc.rg.net vm0.sea.rg.net 4G 128G 147.28.0.45 Randy Bush randy@psg.com
chezrandy.x0.dk vm2.sea.rg.net 2G 200G 147.28.0.56 Phil Regnauld pr@x0.dk
dataviz.org vm0.sea.rg.net vm31sea.rg.net 8G 64G 147.28.0.22 John Ellson john.ellson@gmail.com
gogs.rg.net vm3.sea.rg.net vm0.sea.rg.net 2G 64G 147.28.0.10 Randy Bush randy@psg.com
hans.rg.net vm0.sea.rg.net vm2.sea.rg.net 3G 250G 147.28.0.42 Hans Kuhn hak@flyingpoodle.com
hiroshima.bogus.com vm1.sea.rg.net vm0.sea.rg.net 3G 250G 147.28.0.82 Hans Kuhn <hak@flyingpoodle.com
jitsi.rg.net vm1.sea.rg.net vm0.sea.rg.net 2G 32G 147.28.0.50 Randy Bush randy@psg.com
julian.rg.net vm2.sea.rg.net 2.0G 16.0G 147.28.0.57 Julian Del Fiore delfiore@unistra.fr Cristel Pelsser pelsser@unistra.fr
nagasaki.bogus.com vm0.sea.rg.net vm1.sea.rg.net 4G 250G 147.28.0.81 Joel Jaeggli joelja@bogus.com
netsrv.sea.rg.net vm1.sea.rg.net vm2.sea.rg.net 1G 200G 147.28.0.7 Randy Bush randy@psg.com
nlring.sea.rg.net vm2.sea.rg.net vm1.sea.rg.net 2G 32G 147.28.0.89 Randy Bush randy@psg.com
okui.psg.com vm0.sea.rg.net vm1.sea.rg.net 1G 1001G 147.28.0.25 Patrick Okui pokui@psg.com
pfs.sea.rg.net vm3.sea.rg.net 1G 8G 147.28.0.32 Randy Bush randy@psg.com
pws0 vm2.sea.rg.net vm1.sea.rg.net 4G 100G 147.28.0.52 Paul Southworth pwsouth@gmail.com
pws1 vm1.sea.rg.net vm0.sea.rg.net 8G 500G 147.28.0.53 Paul Southworth pwsouth@gmail.com
r1.securerouting.org vm1.sea.rg.net vm2.sea.rg.net 2G 100G 147.28.0.131 Sam Weiler weiler@watson.org
rcuss-build.rg.net vm3.sea.rg.net vm2.sea.rg.net 64G 128G 147.28.0.170 Rob Austein sra@hactrn.net
rcuss-mgt.rg.net vm3.sea.rg.net vm2.sea.rg.net 2G 32G 147.28.0.169 Randy Bush randy@psg.com
rfd.sea.rg.net vm0.sea.rg.net 3G 32G 147.28.0.10 Clemens Mosig clemens.mosig@fu-berlin.de
rip.psg.com vm3.sea.rg.net vm2.sea.rg.net 4.0G 32.1G 147.28.0.39 Randy Bush randy@psg.com
rip1.psg.com vm2.sea.rg.net vm1.sea.rg.net 1G 36G 147.28.0.31 Randy Bush randy@psg.com
shout.rg.net vm1.sea.rg.net vm2.sea.rg.net 1G 16G 147.28.0.38 Randy Bush randy@psg.com
tamias.rg.net vm0.sea.rg.net vm2.sea.rg.net 2.0G 17.0G 147.28.0.80 Randy Bush randy@psg.com
turing.sr-ix.com vm2.sea.rg.net vm3.sea.rg.net 2G 256G 147.28.0.17 Tom Jennings tom@sr-ix.com
valid.rg.net vm0.sea.rg.net vm2.sea.rg.net 8G 200G 147.28.0.30 Matthias Wählisch m.waehlisch@fu-berlin.de
vault.sea.rg.net vm3.sea.rg.net 1G 8G 147.28.0.2 Randy Bush randy@psg.com
work0.psg.com vm0.sea.rg.net vm1.sea.rg.net 4G 100G 147.28.0.37 Randy Bush randy@psg.com
xmpp.rg.net vm1.sea.rg.net vm3.sea.rg.net 1G 36G 147.28.0.6 Randy Bush randy@psg.com
zoe.dns.gh vm2.sea.rg.net vm1.sea.rg.net 1G 200G 147.28.0.23 Joel Jaeggli joelja@bogus.com
zzyzx.sigpipe.org vm0.sea.rg.net vm1.sea.rg.net 2G 100G 147.28.0.13 Michael Elkins melkins@sigpipe.org

vm0.sea.rg.net Hardware

vm0.sea drives, numbered left to right

From for i in a b c d; do smartctl -a /dev/sd$i | egrep 'Model|Serial|Capacity'; done

Bay Model Serial
0 WD6002FFWX-68TZ4N0 NCGW1TVV 2016.09.24
1 WD6002FFWX-68TZ4N0 NCGWP5SV 2016.09.24
2 WD6002FFWX-68TZ4N0 NCGWD6NV 2016.09.24
3 WD6002FFWX-68TZ4N0 NCGX7MTV 2016.09.24

vm1.sea.rg.net Hardware

Cisco R210-2121605W - part 74-7341-02 - serial QCI1549A9AY

  • Effectively: 72GB RAM, 4TB datastore1, 8 cores
  • UCS C210 M2 Svr, 2x E5640, 2x4GB, SAS Expand, 1PS
  • 2 x 2.66GHz Xeon E5640 80W CPU/12MB cache/DDR3 1066MHz
  • 4 x 16GB DDR3-1066MHz RDIMM/PC3-8500/quad rank/Low-Dual Volt
  • 2 x 4GB DDR3-1333MHz RDIMM/PC3-10600/dual rank 1Gb DRAMs
  • LSI 6G MegaRAID 9261-8i card (RAID 0,1,5,6,10,60) - 512WC
  • 8 x 500GB 6Gb SATA 7.2K RPM SFF hot plug/drive sled mounted
  • Intel Quad port GbE Controller (E1G44ETG1P20)

vm1.sea.rg.net Disk Drives

From megacli -PDList -aALL | egrep 'Coerced|Inquiry'
also use sudo smartctl -a -d sat+megaraid,8 /dev/sda
megacli -PDList -aall | egrep '^(Slot|Firmware)' is also useful
megacli -PDList -aALL | egrep 'Inquiry' | awk '{print $3}' | cut -c1-8

LUN Serial Model Size
01 9XF0VD4E ST9500620NS 464.7 Gb
02 9XF0TQ93 ST9500620NS 464.7 Gb
03 9XF0VCK3 ST9500620NS 464.7 Gb
04 9XF0WE31 ST9500620NS 464.7 Gb
05 9XF0WEYZ ST9500620NS 464.7 Gb
06 9XF0VDFF ST9500620NS 464.7 Gb
07 9XF0VBXF ST9500620NS 464.7 Gb
08 9XF1YZBY ST9500620NS 464.7 Gb
09 9XF0TL1A ST9500620NS 464.7 Gb
10 9XF31KKG ST9500620NS 464.7 Gb
11 9XF0WDD2 ST9500620NS 464.7 Gb
12 9XF0VRFD ST9500620NS 464.7 Gb
13 9XF21BHB ST9500620NS 464.7 Gb
14 9XF0WCVD ST9500620NS 464.7 Gb
15 9XF0TQ80 ST9500620NS 464.7 Gb
16 9XF0VR81 ST9500620NS 464.7 Gb

Drive Bays from Cisco Install Manual

HDD_01 HDD_02 HDD_03
HDD_04 HDD_05 HDD_06
HDD_07 HDD_08 HDD_09 HDD_10 HDD_11
HDD_12 HDD_13 HDD_14 HDD_15 HDD_16

vm2.sea.rg.net Hardware

SuperMicro AS-2022G-URF 2RU Chassis

vm2.sea.rg.net Disk Drives

From megacli -PDList -aALL | egrep 'Coerced|Inquiry'
also use `vm1.sea.rg.net:/home/randy# sudo smartctl -a -d sat+megaraid,8 /dev/sda
smartctl 6.4 2014-10-07 r4002 [x86_64-linux-3.16.0-7-amd64] (local build)
Copyright (C) 2002-14, Bruce Allen, Christian Franke, www.smartmontools.org

START OF INFORMATION SECTION

vm2.sea.rg.net:/home/randy# megacli -PDList -aALL | egrep 'Coerced|Inquiry'
Non Coerced Size: 1.818 TB [0xe8d088b0 Sectors]
Coerced Size: 1.818 TB [0xe8d00000 Sectors]
Inquiry Data:      WD-WCC6N3FVKC2SWDC WD2002FFSX-68PF8N0                  81.00A81
Non Coerced Size: 1.818 TB [0xe8d088b0 Sectors]
Coerced Size: 1.818 TB [0xe8d00000 Sectors]
Inquiry Data:       MK0251YGKB56HAHitachi HUA723020ALA640                 MK7OAA10
Non Coerced Size: 1.818 TB [0xe8d088b0 Sectors]
Coerced Size: 1.818 TB [0xe8d00000 Sectors]
Inquiry Data:       MK0251YGKB4N2AHitachi HUA723020ALA640                 MK7OAA10
Non Coerced Size: 1.818 TB [0xe8d088b0 Sectors]
Coerced Size: 1.818 TB [0xe8d00000 Sectors]
Inquiry Data:       MK0251YGKB58LAHitachi HUA723020ALA640                 MK7OAA10
Non Coerced Size: 2.728 TB [0x15d40a3b0 Sectors]
Coerced Size: 2.728 TB [0x15d400000 Sectors]
Inquiry Data:       MJ1311YNG6XEVAHitachi HDS5C3030ALA630                 MEAOA5C0

Model Family: Seagate Constellation.2 (SATA) Device Model: ST9500620NS Serial Number: 9XF0VD4E LU WWN Device Id: 5 000c50 03fb7cdd0 Firmware Version: CC02 User Capacity: 500,107,862,016 bytes [500 GB] Sector Size: 512 bytes logical/physical Rotation Rate: 7200 rpm Form Factor: 2.5 inches Device is: In smartctl database [for details use: -P show] ATA Version is: ATA8-ACS T13/1699-D revision 4 SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Sun Mar 3 20:41:38 2019 UCT SMART support is: Available - device has SMART capability. SMART support is: Enabled

LUN Serial Model Size
0 WCC6N3FVKC2SWDC WD2002FFSX-68PF8N0 1.818 TB
1 MK0251YGKB56HA MK7OAA10 1.818 TB
2 MK0251YGKB4N2A MK7OAA10 1.818 TB
3 MK0251YGKB58LA MK7OAA10 1.818 TB
4 MJ1311YNG6XEVA MEAOA5C0 2.728 TB

2021.08.19 LUN0 drive MK0171YFK3TVGA removed

vm3.sea.rg.net Hardware

SuperMicro SuperServer 6019U-TRT

vm3.sea drives, we guess numbered left to right

From for i in a b c d; do smartctl -a /dev/sd$i | egrep 'Model|Serial|Capacity'; done

Bay Model Serial Capacity Installed
0 HGST HUS726060ALE610 K1J48AGD 6TB 2017.08.17
1 HGST HUS726060ALE610 K1J2PTND 6TB 2017.08.17
2 HGST HUS726060ALA640 AR11001EV17LLB 6TB 2020.05.01
3 HGST HUS726060ALE610 K1J46RHD 6TB 2017.08.17

psg.com

SUPERMICRO AS-1012G-MTF 1U Rackmount H8SGL-F mobo

From for i in 0 1 2 3 4; do smartctl -a /dev/ada$i | egrep 'Model|Serial|Capacity'; done

LUN Model Serial Size
0 WDC WD2000F9YZ-09N20L0 WD-WCC1P0469969 2TB
1 WDC WD2005FBYZ-01YCBB1 WD-WMC6N0F1F8SD 2TB

WDC WD2000F9YZ-09N20L0 WD-WCC1P0648270 removed from ata1 2017.04.09

WD-WCC1P0654846 replaced on 2017.03.04

raid0.sea.rg.net

raid0.sea.rg.net Drive Bays

From for i in {0..3}; do smartctl -a /dev/ada$i | egrep 'Model|Serial|Capacity'; done

LUN Model Serial Capacity Date
0 WDC WD60EFRX-68L0BN1 WD-WX41DA5F88N9 6tb 2018.12.09
1 WDC WD60EFRX-68L0BN1 WD-WX11D363T2Y5 6tb 2018.12.09
2 WDC WD60EFRX-68L0BN1 WD-WX11D3678XTL 6tb 2018.12.09
3 WDC WD60EFRX-68L0BN1 WD-WX41D75LN9KC 6tb 2018.12.09

rip.psg.com

PDSMU with a Xeon and 4GB RAM

LUN Serial Model Size
0 9QE7MXMC ST3250820NS 250G
1 WD-WMC5C0D5MXU1 WDC WD2000F9YZ-09N20L1 01.01A02 2TB
2 9QE7MY84 ST3250820NS 250G
3 WD-WMC5C0E2C2L0 WDC WD2000F9YZ-09N20L1 01.01A02 2TB

Switches

name mfr model ip sddress
sw0.sea.rg.net Cisco WS-C3750G-48PS 147.28.0.253
sw3.sea.rg.net Cisco Nexus3064 48x10GE +4 147.28.0.239
sw4.sea.rg.net Cisco Nexus3064 48x10GE +4 147.28.0.238

Remoived

sw1.sea.rg.net SMC SMC8024L2 147.28.0.252
sw2.sea.rg.net Cisco WS-C3750G-24PS 147.28.0.246

Miscelaneous Data

Spare Drives

spares in westin
HGST H3D30003254S YNG1E3ZC 3TB
Seagate ST31000528AS 6VPCVN1Y 1TB
Seagate ST3750640A8 3QD06D5B 750G
HGST 118032816 YFJLBZ5A 2TB

r1.sea gigether pic left to right

LAN copper
unused copper
six copper
unused fiber sfp
Westin NTT/Verio 100baseFX
PSG-STTLWA01-FE-VDR001 (199.238.113.9)
r05.sttlwa01.us.bb.gin.ntt.net.
1000 LX
Westin NTT/Verio OC3
PSG-STTLWA01-OC3-VDR001 (129.250.11.41)
r02.sttlwa01.us.bb.gin.ntt.net
SM IR

FastEthernet5/6 is up, line protocol is up (connected)

Hardware is C6k 100Mb 802.3, address is 00d0.0135.840a (bia 00d0.0135.840a) Description: AX: PSG - local wire

Westin OC3c sprint facility # 10038527

SprintLink noc 800-232-6895
noc@sprint.net

FiberCloud tie-down to Sprint in MMR - Rack 303 Panel 1 Port L2 Single Mode

Router Topology

[200511.westin.jpg]

New Switching

[180802.arrcus-sea.jpg]

2021.08.19