# Ashburn DC2 PoP

```
Sandbox, cage 2020, rack 102
c/o Equinix DC2
21715 Filigree Ct
Ashburn, VA 20147
noc@equinix.com (or ask ERC support@equinix.com folk to escalate to
                 primary on-call NSE)
+1 888 892 0607 equinix 24x7

CURRENT CONTACTS LIST: (2022-05-13)
 Muhammad Waqas Bin Tariq <mwaqas@equinix.com>
 Bheem Lal Nethikar <bnethikar@equinix.com> 571 232 7728
```

## PoP Diagram

![221028.ashburn.jpg](../pics/221028.ashburn.jpg)

## To Do
* connect route views transit

## Circuits

### SprintLink

* Sprint sl-st21-ash: POS 9/0/6
* which is pre-wired to the Patch Panel in bay 2/1
* Single Mode Fiber
* port 17-18 in the Ashburn cage 1490
* A-Side Patch Panel/Module/Port: PP:0103:25916||9
* Z-Side Customer and Cage Number: SPRINT DC2::01490:SPRINT
* Z-Side Cabinet Number: 0102
* Carrier Circuit ID(if applicable): Randy Bush
* Z-Side Patch Panel/Module/Port: PP:0102:605||17
* Cable ID: 792604  should be used to reference that patch cable

### o0.iad

* o0 IP into Equinix Management Network
* port 20 of Louie's 3Com switch in the next cabinet over
* o0.iad.rg.net: 206.223.132.86/26
* gateway: 206.223.132.65

### Route Views
* Circuit ID 20438058 in cage 2020 is Route Views to IX

## Equipment

* sw0 is a Cisco WS-C3750G-24PS
* o0 is a Cisco 2621 (MPC860) processor (revision 0x102) w/ 61440K/4096K
* r0 is a Juniper MX240 for the moment on loan from warren
* r1 is a Juniper Mx80 gift from IETF
* Equinix Power Strip aka Leviton
* [photo from 2020.02.18](https://photos.app.goo.gl/aTaqAXH1C14CNbbG8)

## r0.iad.rg.net  Juniper MX240 from warren
```
randy@r0.iad> show chassis hardware 
Hardware inventory:
Item             Version  Part number  Serial number     Description
Chassis                                JN11544AFAFC      MX240
Midplane         REV 07   760-021404   ABAA3443          MX240 Backplane
FPM Board        REV 03   760-021392   ABBA1738          Front Panel Display
PEM 0            Rev 01   740-022697   QCS0931C044       PS 1.2-1.7kW; 100-240V AC in
PEM 2            Rev 03   740-022697   QCS1243C071       PS 1.2-1.7kW; 100-240V AC in
Routing Engine 0 REV 07   740-015113   9009006841        RE-S-1300
CB 0             REV 05   710-021523   ABBA1993          MX SCB
FPC 2            REV 16   750-022765   XM0320            DPCE 20x 1GE + 2x 10GE R
  CPU            REV 03   710-022351   XM4341            DPC PMB
  PIC 0                   BUILTIN      BUILTIN           10x 1GE(LAN)
    Xcvr 0       REV 01   740-011613   PFF29VR           SFP-SX
    Xcvr 9       REV 02   740-011613   PGP5559           SFP-SX
  PIC 1                   BUILTIN      BUILTIN           10x 1GE(LAN)
  PIC 2                   BUILTIN      BUILTIN           1x 10GE(LAN/WAN)
  PIC 3                   BUILTIN      BUILTIN           1x 10GE(LAN/WAN)
Fan Tray 0       REV 01   710-021113   XB1539            MX240 Fan Tray
```

## r1.iad.rg.net  Juniper MX80 from IETF
```
randy@r1.iad> show chassis hardware 
Hardware inventory:
Item             Version  Part number  Serial number     Description
Chassis                                E4642             MX80
Midplane         REV 06   711-031594   YP5258            MX80
PEM 0            Rev 04   740-028288   UH01164           AC Power Entry Module
PEM 1            Rev 04   740-028288   WF04755           AC Power Entry Module
Routing Engine            BUILTIN      BUILTIN           Routing Engine
TFEB 0                    BUILTIN      BUILTIN           Forwarding Engine Processor
  QXM 0          REV 05   711-028408   YL0286            MPC QXM
FPC 0                     BUILTIN      BUILTIN           MPC BUILTIN
  MIC 0                   BUILTIN      BUILTIN           4x 10GE XFP
    PIC 0                 BUILTIN      BUILTIN           4x 10GE XFP
FPC 1                     BUILTIN      BUILTIN           MPC BUILTIN
  MIC 0          REV 22   750-028392   YJ7317            3D 20x 1GE(LAN) SFP
    PIC 0                 BUILTIN      BUILTIN           10x 1GE(LAN) SFP
      Xcvr 0     REV 01   740-011614   PJ717AP           SFP-LX10
      Xcvr 1     REV 01   740-031850   G1908083802       SFP-LX10
    PIC 1                 BUILTIN      BUILTIN           10x 1GE(LAN) SFP
Fan Tray                                                 Fan Tray
```

## Rack Physical and Wiring

| hostname              | switch        | oob      | oobname | pwr           |  RU  |                           |
| :-------------------- | ------------- | -----    | ------- | ------------- | ---- | ------------------------- |
| r1.iad.rg.net         | s0.28         | o0.36    | r1      | pwr0-1 pwr1-1 | 9-10 | Juniper MX80		|
| r0.iad.rg.net         | s0.21         | o0.33    | r0      | equinix       | 7-8  | Juniper MX240 (warren)    |
|          		| s0.12         |     	   |         |        	     | 	    |               		|
| fiber patch panel     |               |          |         |               | 5-6  |                           |
| vm0.iad.rg.net        | s0.02         | o0.XX    | vm0     |               | 3    |                           |
| ipmi.vm0.iad.rg.net   | s0.14         |          |         |               | 3    |                           |
| o0.iad.rg.net         | s0.01/02      | vm2.usb  |         |               |      | Cisco 2621 (MPC860)       |
| sw0.iad.rg.net        |               | o0.37    | s0      |               |      | Cisco WS-C3750G-24PS      |
| vm1.iad.rg.net        | s0.06         | o0.38    | srv0    | 0.3           |      |                           |
| pwr0.iad.rg.net       |               | o0.41    | pwr0    | equinix       |      |                           |
| pwr1.iad.rg.net       |               | o0.43    | pwr1    | equinix       |      |                           |
| vm2.iad.rg.net        | s0.07         | o0.35    | vm2     | 0.4 & 1.2     |      |                           |

## Removed

| hostname              | switch        | oob      | oobname | pwr           |  RU  |                           |
| :-------------------- | ------------- | -----    | ------- | ------------- | ---- | ------------------------- |
| cypress.shrubbery.net | s0.03 & s0.13 | o0.35    | cypress | 0.4           |      | removed 2022.08.28 |
| akkht.hactrn.net Eth0 | s0.11         | o0.11    | sra     | 0.1           | 2    | removed 2022.08.28 |
| akkht.hactrn.net DRAC | s0.12         |          |         |               | 2    | removed 2022.08.28 |
| r1.iad.rg.net         | s0.23         | o0.34    | r1      | equinix       |      | Cisco 7206-G1             |
| emu.machshav.com      | s0.08         | o0.40    | emu     | 0.2           |      | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
| emu-2.machshav.com    | s0.09/10      |          |         |               |      | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |


## Ethernet Ports

| hostname         | main ether | ipmi     | drbd    |
| :--------------- | ---------- | -----    | ------- |
| vm0.iad.rg.net   | sw0.02	| sw0.14   | sw0.15  |
| vm1.iad.rg.net   | sw0.06	| ---	   | sw0.16  |
| vm2.iad.rg.net   | sw0.07	| sw0.13   | sw0.17  |


### Hosts on vm0/2.iad.rg.net / 198.180.150.8/10
```
vm0.iad.rg.net:/root# ./do-stat 
Node           DTotal DFree MTotal MNode  MFree Pinst Sinst
vm0.iad.rg.net   8.2T  7.4T  78.6G  7.0G  71.3G     5     9
vm2.iad.rg.net   3.6T  2.2T 188.8G 99.1G 165.2G     9     5

Instance                       Primary_node   Secondary_Nodes Disk/0 Memory
bbgp.rg.net                    vm0.iad.rg.net vm2.iad.rg.net   32.0G   2.0G
bbte.rg.net                    vm2.iad.rg.net vm0.iad.rg.net   32.0G   2.0G
bozanicfamily.com              vm2.iad.rg.net vm0.iad.rg.net   34.0G   1.0G
khatovar.hactrn.net            vm0.iad.rg.net vm2.iad.rg.net  250.0G   4.0G
m2.machshav.com                vm2.iad.rg.net vm0.iad.rg.net  125.0G   8.0G
netsrv.iad.rg.net              vm0.iad.rg.net vm2.iad.rg.net    8.0G   1.0G
ns1.machshav.com               vm2.iad.rg.net vm0.iad.rg.net   32.0G   2.0G
pfs0.iad.rg.net                vm2.iad.rg.net vm0.iad.rg.net    8.0G   512M
pfs.iad.rg.net                 vm2.iad.rg.net vm0.iad.rg.net    8.0G   1.0G
ran.psg.com                    vm0.iad.rg.net vm2.iad.rg.net   32.0G   4.0G
rgnet.anycast.censurfridns.dk  vm2.iad.rg.net vm0.iad.rg.net   50.0G   6.0G
srv0.iad.rg.net                vm2.iad.rg.net vm0.iad.rg.net   64.0G   2.0G
tor0.iad.rg.net                vm2.iad.rg.net vm0.iad.rg.net   36.0G   4.0G
usbeacon2.iibex.auckland.ac.nz vm0.iad.rg.net vm2.iad.rg.net   36.0G   1.0G
```
| Hostname                       | IP Address     | Owner and Email           |
| :----------------------------- | -------------- | ------------------------- |
| bbgp.rg.net			 | 198.180.150.15| Randy Bush &lt;randy@psg.com&gt;      |
| bbte.rg.net			 | 198.180.150.60 | Randy Bush &lt;randy@psg.com&gt;      |
| bozanicfamily.com              | 198.180.150.5  | Randy Bush &lt;randy@psg.com&gt;      |
| khatovar.hactrn.net            | 198.180.150.30 | Rob Austein &lt;sra@hactrn.net&gt;       |
| m2.macshav.com                 | 198.180.150.45 | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
| netsrv.iad.rg.net              | 198.180.150.13 | Randy Bush &lt;randy@psg.com&gt;      |
| ns1.machshav.com               | 198.180.150.41 | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
| pfs0.iad.rg.net                | 198.180.150.3  | Randy Bush &lt;randy@psg.com&gt;      |
| pfs.iad.rg.net                 | 198.180.150.6  | Randy Bush &lt;randy@psg.com&gt;      |
| ran.psg.com                    | 198.180.150.18 | Randy Bush &lt;randy@psg.com&gt;      |
| rgnet.anycast.censurfridns.dk  | 198.180.150.12 | Phil Regnauld &lt;pr@x0.dk&gt;      |
| srv0.iad.rg.net                | 198.180.150.1  | Randy Bush &lt;randy@psg.com&gt;      |
| tor0.iad.rg.net                | 198.180.150.9  | Randy Bush &lt;randy@psg.com&gt;      |
| usbeacon2.iibex.auckland.ac.nz | 198.180.150.52 | Etuate Cocker &lt;ecoc005@aucklanduni.ac.nz&gt; |


## vm0.iad.rg.net Hardware

- [Supermicro SYS-6016T-URF with X8DTU-F mobo](http://www.supermicro.com/products/system/1U/6016/SYS-6016T-URF.cfm)
- Power-A&B - UL24-3#24

### vm0.iad.rg.net Disk Configuration
```
vm0.iad.rg.net:/root# tw_cli info c0

Unit  UnitType  Status         %RCmpl  %V/I/M  Stripe  Size(GB)  Cache  AVrfy
------------------------------------------------------------------------------
u0    RAID-5    OK             -       -       256K    8381.87   RiW    ON     

VPort Status         Unit Size      Type  Phy Encl-Slot    Model
------------------------------------------------------------------------------
p0    OK             u0   3.63 TB   SATA  0   -            WDC WD4003FRYZ-01F0 
p1    OK             u0   3.63 TB   SATA  1   -            WDC WD4003FRYZ-01F0 
p2    OK             u0   3.63 TB   SATA  2   -            WDC WD4003FRYZ-01F0 
p3    OK             u0   2.73 TB   SATA  3   -            HITACHI HUA723030AL 
```

Four drive bays seem to be numbered 0-3 left to right

### vm0.iad.rg.net Disk Drive Serial Numbers

From `sudo smartctl -a -d 3ware,$i /dev/twl0`

| Unit | Model                   | Serial          |                      |
| ---- | ----------------------- | --------------- | -------------------- |
| 0    | WD4003FRYZ-01F0DB0      | VBHVEUTF        | new as of 2023.05.17 |
| 1    | WD4003FRYZ-01F0DB0      | V1JVGGHG 	   |                      |
| 2    | WD4003FRYZ-01F0DB0      | V1KW63UG        | new as of 2023.08.09 |
| 3    | HITACHI HUA723030ALA640 | YVHPV0LA        |                      |

* 2023.05.17 replaced p0 K7G9TG6L with VBHVEUTF
* 2022.05.18 replaced p1 WDC WD3000FYYZ-01UL serial WD-WCC130121922
* 2023.08.09 replaced p2 WD3000FYYZ-01UL1B0  WD-WCC130095709


## vm2.iad.rg.net Hardware

* Dell R630  GLY2W52  express code 36155548982
* iDRAC8, no KVM :(
* iDRAC tools - [racadm tools for DRAC8 download the latest here](https://dl.dell.com/FOLDER07423496M/1/DellEMC-iDRACTools-Web-LX-10.1.0.0-4566_A00.tar.gz).  use `racadm getsysinfo`
* [Link for how to download in the future](https://www.dell.com/support/kbdoc/en-us/000177791/poweredge-how-to-gather-an-idrac-log-using-racadm#1)
* [Documentation for racadm](https://dl.dell.com/Manuals/all-products/esuprt_software/esuprt_remote_ent_sys_mgm[…]ssis-mgmt-cntrllr-v1.25-pwedge-vrtx_reference%20guide_en-us.pdf)
* Part number from Dell for iDRAC8 license is 385-BBHP
* [How to import and export a license with iDRAC7 or iDRAC8](https://www.dell.com/support/kbdoc/en-th/000145345/poweredge-how-to-manage-an-idrac-license-via-the-web-interface)
* 3ware Inc 9750 Controller

### vm2.iad Disk Drives

`for i in a b c d; do echo $i; smartctl -a /dev/sd$i | egrep '^(Device Model|Serial)' | cut -c 19-60; done`

| LUN  | Serial          | Model               | Size |
| ---- | --------------- | ------------------- | ---- |
|  a   | S6PNNS0T602439V | Samsung SSD 870 EVO | 2TB  |
|  b   | S6PNNS0T602496T | Samsung SSD 870 EVO | 2TB  |
|  c   | S6PNNS0T604993A | Samsung SSD 870 EVO | 2TB  |
|  d   | S6PNNS0T604995Z | Samsung SSD 870 EVO | 2TB  |


## PDUs

```
BayTech RPC is accessed via serial from o0.iad.rg.net as pwr0/1
You will face RPC> prompt.  Type
  CONFIG
  ON x
  OFF x
  REBOOT x
```

### pwr0.iad.rg.net
```
1)...r1.iad-left
2)...unused
3)...vm1.iad.rg.net  
4)...vm2.iad.rg.net  
5)...sw0.iad.rg.net  
6)...vm0.iad.rg.net  
```

### pwr1.iad.rg.net
```
1)...r1.iad-right    
2)...vm2.iad.rg.net  
3)...unused          
4)...unused          
5)...vm0.iad.rg.net
6)...o0.iad          
6)...unused          
```

---

## vm1.iad.rg.net Hardware  DECOMMISSIONED

 **[SuperMicro AS-1022G-URF 2RU Chassis](http://www.supermicro.com/Aplus/system/1U/1022/AS-1022G-URF.cfm)**

- [H8DGU-F Motherboard](http://www.supermicro.com/Aplus/motherboard/Opteron6000/SR56x0/H8DGU-F.cfm)
- [Two 12-core AMD Opteron 6344 Abu Dhabi 2.6GHz](http://products.amd.com/en-gb/OpteronCPUDetail.aspx?id=819&f1=&f2=&f3=Yes&f4=&f5=&f6=&f7=&f8=&f9=&f10=&f11=&)
- [Crucial 128G 8 x 16GB 240-Pin DDR3 SDRAM ECC Registered DDR3 1600 (PC3 12800) Server Memory](http://www.crucial.com/usa/en/CT16G3ERSLD4160B?)
- [LSI MegaRAID SATA/SAS 9260-4i 6Gb/s PCI-Express 2.0](http://www.lsi.com/products/raid-controllers/pages/megaraid-sas-9260-4i.aspx)
- [Four Western Digital RE WD3000FYYZ 3TB 7200 RPM 64MB Cache SA T A 6.0Gb/s 3.5" Enterprise Internal Hard Drives](http://wdc.com/en/products/catalog/)

## vm1.iad.rg.net Disk Drives

From `megacli -PDList -aALL | egrep 'Coerced|Inquiry'`

| LUN  | Serial             | Model              | Size     |
| ---- | ------------------ | ------------------ | -------- |
| 0    | WD-WMC130D9JJJZWDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
| 1    | WD-WMC130D1CT76WDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
| 2    | WD-WMC130D2MZFVWDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
| 3    | WD-WMC130D2MZFVWDC | WD3000FYYZ-01UL1B2 | 2.728 TB |

---

2023.08.09