# Ashburn DC2 PoP

```
Sandbox, cage 2020, rack 102
c/o Equinix DC2
21715 Filigree Ct
Ashburn, VA 20147
noc@equinix.com (or ask ERC support@equinix.com folk to escalate to
                 primary on-call NSE)
+1 888 892 0607 equinix 24x7

CURRENT CONTACTS LIST: (2024.07.02)
 Muhammad Waqas Bin Tariq <mwaqas@equinix.com>
 Tarkesh Patel <tpatel@equinix.com>
```

## PoP Diagram

![221028.ashburn.jpg](../pics/221028.ashburn.jpg)

## To Do
* connect route views transit

## Circuits

### Cogent

A-side
IBX: DC2
Cage: 2020
Patch Panel: PP:0103:25916
Ports: 11/12 (these were new ports)

* Cogent
    * GigabitEthernet0/2/1/8.rcr22.iad01
    * description CUST-W GIGE ^RGnet LLC^ ID:3-001717104 PT:3-001717104
    * AS 174
    * ipv4 address 38.88.248.236/31
    * ipv6 address 2001:550:2:1::22/127
* RGnet/PSGnet
    * r2.iad-eno1
    * AS 3927
    * ipv4 address 38.88.248.237/31
    * ipv6 address 2001:550:2:1::23/127

### o0.iad

* o0 IP into Equinix Management Network
* port 20 of Louie's 3Com switch in the next cabinet over
* o0.iad.rg.net: 206.223.132.86/26
* gateway: 206.223.132.65

### Route Views
* Circuit ID 20438058 in cage 2020 is Route Views to IX

## Equipment

* sw0 is a Cisco WS-C3750G-24PS
* o0 is a Cisco 2621 (MPC860) processor (revision 0x102) w/ 61440K/4096K
* r0 is a Juniper MX240 for the moment on loan from warren
* r1 is a Dell 630 running FRR
* Equinix Power Strip aka Leviton
* [photo from 2020.02.18](https://photos.app.goo.gl/aTaqAXH1C14CNbbG8)

## r0.iad.rg.net  Juniper MX240 from warren
```
randy@r0.iad> show chassis hardware
Hardware inventory:
Item             Version  Part number  Serial number     Description
Chassis                                JN11544AFAFC      MX240
Midplane         REV 07   760-021404   ABAA3443          MX240 Backplane
FPM Board        REV 03   760-021392   ABBA1738          Front Panel Display
PEM 0            Rev 01   740-022697   QCS0931C044       PS 1.2-1.7kW; 100-240V AC in
PEM 2            Rev 03   740-022697   QCS1243C071       PS 1.2-1.7kW; 100-240V AC in
Routing Engine 0 REV 07   740-015113   9009006841        RE-S-1300
CB 0             REV 05   710-021523   ABBA1993          MX SCB
FPC 2            REV 16   750-022765   XM0320            DPCE 20x 1GE + 2x 10GE R
  CPU            REV 03   710-022351   XM4341            DPC PMB
  PIC 0                   BUILTIN      BUILTIN           10x 1GE(LAN)
    Xcvr 0       REV 01   740-011613   PFF29VR           SFP-SX
    Xcvr 9       REV 02   740-011613   PGP5559           SFP-SX
  PIC 1                   BUILTIN      BUILTIN           10x 1GE(LAN)
  PIC 2                   BUILTIN      BUILTIN           1x 10GE(LAN/WAN)
  PIC 3                   BUILTIN      BUILTIN           1x 10GE(LAN/WAN)
Fan Tray 0       REV 01   710-021113   XB1539            MX240 Fan Tray
```

## Rack Physical and Wiring

| hostname              | switch        | oob      | oobname | pwr     | RU   |                           |
| :-------------------- | ------------- | -----    | ------- | --------| ---- | ------------------------- |
| r1.iad.rg.net         | s0.5          | o0.36    | r1      | 0.1 1.1 | ???? | Dell 630/FRR              |
| r0.iad.rg.net         | s0.21 s0.12   | o0.33    | r0      | equinix | 7-8  | Juniper MX240 (warren)    |
| fiber patch panel     |               |          |         |         | 5-6  | (equinix)                 |
| vm0.iad.rg.net        | s0.02 s0.14   | o0.XX    | vm0     | 0.6     | 3    | SuperMicro SYS-6016T-URF  |
| o0.iad.rg.net         | s0.01/02      | vm2.usb  |         | 1.6     |      | Cisco 2621 (MPC860)       |
| sw0.iad.rg.net        |               | o0.37    | s0      | 0.5     |      | Cisco WS-C3750G-24PS      |
| vm1.iad.rg.net        | s0.06         | o0.38    | srv0    | 0.3     |      | SuperMicro AS-1022G-URF   |
| pwr0.iad.rg.net       |               | o0.41    | pwr0    | equinix |      | BayTech RPC               |
| pwr1.iad.rg.net       |               | o0.43    | pwr1    | equinix |      | BayTech RPC               |
| vm2.iad.rg.net        | s0.07 sw0.13  | o0.35    | vm2     | 0.4 1.2 |      | Dell R630 GLY2W52         |

## Removed

| hostname              | switch        | oob      | oobname | pwr           |  RU  |                           |
| :-------------------- | ------------- | -----    | ------- | ------------- | ---- | ------------------------- |
| cypress.shrubbery.net | s0.03 & s0.13 | o0.35    | cypress | 0.4           |      | removed 2022.08.28 |
| akkht.hactrn.net Eth0 | s0.11         | o0.11    | sra     | 0.1           | 2    | removed 2022.08.28 |
| akkht.hactrn.net DRAC | s0.12         |          |         |               | 2    | removed 2022.08.28 |
| r1.iad.rg.net         | s0.23         | o0.34    | r1      | equinix       |      | Cisco 7206-G1             |
| emu.machshav.com      | s0.08         | o0.40    | emu     | 0.2           |      | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
| emu-2.machshav.com    | s0.09/10      |          |         |               |      | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |


## Ethernet Ports

| hostname         | main ether | ipmi     | drbd    |
| :--------------- | ---------- | -----    | ------- |
| vm0.iad.rg.net   | sw0.02	| sw0.14   | sw0.15  |
| vm1.iad.rg.net   | sw0.06	| ---	   | sw0.16  |
| vm2.iad.rg.net   | sw0.07	| sw0.13   | sw0.17  |

| hostname         | main ether | ipmi     |
| :--------------- | ---------- | -----    |
| r0 .iad.rg.net   | sw0.25	| sw0.12   |
| r1 .iad.rg.net   | sw0.05	| sw0.3    |


### Hosts on vm0/2.iad.rg.net / 198.180.150.8/10
```
vm0.iad.rg.net:/root# ./do-stat 
Node           DTotal DFree MTotal MNode  MFree Pinst Sinst
vm0.iad.rg.net   8.2T  7.2T  78.6G 46.8G  55.2G     7     9
vm2.iad.rg.net   3.6T  2.0T 188.8G 24.2G 165.4G    10     4

Instance                       Primary_node   Secondary_Nodes Disk/0 Memory CPUs
bbgp.rg.net                    vm0.iad.rg.net vm2.iad.rg.net   32.0G   2.0G    1
bbt2.rg.net                    vm0.iad.rg.net                  64.0G   4.0G    1
bbte.rg.net                    vm2.iad.rg.net vm0.iad.rg.net   64.0G   4.0G    4
bozanicfamily.com              vm2.iad.rg.net vm0.iad.rg.net   34.0G   1.0G    1
khatovar.hactrn.net            vm0.iad.rg.net vm2.iad.rg.net  250.0G   4.0G    1
m2.machshav.com                vm2.iad.rg.net vm0.iad.rg.net  125.0G   8.0G    1
netsrv.iad.rg.net              vm0.iad.rg.net vm2.iad.rg.net   32.0G   2.0G    1
ns1.machshav.com               vm2.iad.rg.net vm0.iad.rg.net   32.0G   2.0G    1
pfs0.iad.rg.net                vm2.iad.rg.net vm0.iad.rg.net    8.0G   512M    1
pfs.iad.rg.net                 vm2.iad.rg.net vm0.iad.rg.net    8.0G   1.0G    1
prox.rg.net                    vm0.iad.rg.net                  64.0G   8.0G    4
r2.iad.rg.net                  vm0.iad.rg.net                  32.0G  16.0G    4
rgnet.anycast.censurfridns.dk  vm2.iad.rg.net vm0.iad.rg.net   50.0G   6.0G    2
sox.rg.net                     vm2.iad.rg.net                  64.0G   8.0G    4
srv0.iad.rg.net                vm2.iad.rg.net vm0.iad.rg.net   64.0G   2.0G    1
tor0.iad.rg.net                vm2.iad.rg.net vm0.iad.rg.net   36.0G   4.0G    3
usbeacon2.iibex.auckland.ac.nz vm0.iad.rg.net vm2.iad.rg.net   36.0G   1.0G    1
```
| Hostname                       | IP Address     | Owner and Email           |
| :----------------------------- | -------------- | ------------------------- |
| bbgp.rg.net			 | 198.180.150.15 | Randy Bush &lt;randy@psg.com&gt;      |
| bbt2.rg.net			 | 198.180.150.61 | Cristel Pelsser &lt;cristel.pelsser@uclouvain.be&gt;
| bbte.rg.net			 | 198.180.150.60 | Cristel Pelsser &lt;cristel.pelsser@uclouvain.be&gt;      |
| bozanicfamily.com              | 198.180.150.5  | Randy Bush &lt;randy@psg.com&gt;      |
| khatovar.hactrn.net            | 198.180.150.30 | Rob Austein &lt;sra@hactrn.net&gt;       |
| m2.macshav.com                 | 198.180.150.45 | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
| netsrv.iad.rg.net              | 198.180.150.13 | Randy Bush &lt;randy@psg.com&gt;      |
| ns1.machshav.com               | 198.180.150.41 | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
| pfs0.iad.rg.net                | 198.180.150.3  | Randy Bush &lt;randy@psg.com&gt;      |
| pfs.iad.rg.net                 | 198.180.150.6  | Randy Bush &lt;randy@psg.com&gt;      |
prox.rg.net			 | 198.180.150.53 | Randy Bush &lt;randy@psg.com&gt;      |
| r2.iad.rg.net                  | 198.180.150.122| Randy Bush &lt;randy@psg.com&gt;      |
| rgnet.anycast.censurfridns.dk  | 198.180.150.12 | Phil Regnauld &lt;pr@x0.dk&gt;      |
| srv0.iad.rg.net                | 198.180.150.1  | Randy Bush &lt;randy@psg.com&gt;      |
sox.rg.net			 | 198.180.150.55 | Randy Bush &lt;randy@psg.com&gt;      |
| tor0.iad.rg.net                | 198.180.150.9  | Randy Bush &lt;randy@psg.com&gt;      |
| usbeacon2.iibex.auckland.ac.nz | 198.180.150.52 | Etuate Cocker &lt;ecoc005@aucklanduni.ac.nz&gt; |


## vm0.iad.rg.net Hardware

- [Supermicro SYS-6016T-URF with X8DTU-F mobo](http://www.supermicro.com/products/system/1U/6016/SYS-6016T-URF.cfm)
- Power-A&B - UL24-3#24

### vm0.iad.rg.net Disk Configuration
```
vm0.iad.rg.net:/root# tw_cli info c0

Unit  UnitType  Status         %RCmpl  %V/I/M  Stripe  Size(GB)  Cache  AVrfy
------------------------------------------------------------------------------
u0    RAID-5    OK             -       -       256K    8381.87   RiW    ON

VPort Status         Unit Size      Type  Phy Encl-Slot    Model
------------------------------------------------------------------------------
p0    OK             u0   3.63 TB   SATA  0   -            WDC WD4003FRYZ-01F0
p1    OK             u0   3.63 TB   SATA  1   -            WDC WD4003FRYZ-01F0
p2    OK             u0   3.63 TB   SATA  2   -            WDC WD4003FRYZ-01F0
p3    OK             u0   2.73 TB   SATA  3   -            HITACHI HUA723030AL
```

Four drive bays seem to be numbered 0-3 left to right

### vm0.iad.rg.net Disk Drive Serial Numbers

From `sudo smartctl -a -d 3ware,$i /dev/twl0`

| Unit | Model                   | Serial          |                      |
| ---- | ----------------------- | --------------- | -------------------- |
| 0    | WD4003FRYZ-01F0DB0      | VBHVEUTF        | new as of 2023.05.17 |
| 1    | WD4003FRYZ-01F0DB0      | V1JVGGHG 	   |                      |
| 2    | WD4003FRYZ-01F0DB0      | V1KW63UG        | new as of 2023.08.09 |
| 3    | HITACHI HUA723030ALA640 | YVHPV0LA        |                      |

* 2023.05.17 replaced p0 K7G9TG6L with VBHVEUTF
* 2022.05.18 replaced p1 WDC WD3000FYYZ-01UL serial WD-WCC130121922
* 2023.08.09 replaced p2 WD3000FYYZ-01UL1B0  WD-WCC130095709


## vm2.iad.rg.net Hardware

* Dell R630  Gly2w52  express code 36155548982
* iDRAC8, no KVM :(
* iDRAC tools - [racadm tools for DRAC8 download the latest here](https://dl.dell.com/FOLDER07423496M/1/DellEMC-iDRACTools-Web-LX-10.1.0.0-4566_A00.tar.gz).  use `racadm getsysinfo`
* [Link for how to download in the future](https://www.dell.com/support/kbdoc/en-us/000177791/poweredge-how-to-gather-an-idrac-log-using-racadm#1)
* [Documentation for racadm](https://dl.dell.com/Manuals/all-products/esuprt_software/esuprt_remote_ent_sys_mgm[…]ssis-mgmt-cntrllr-v1.25-pwedge-vrtx_reference%20guide_en-us.pdf)
* Part number from Dell for iDRAC8 license is 385-BBHP
* [How to import and export a license with iDRAC7 or iDRAC8](https://www.dell.com/support/kbdoc/en-th/000145345/poweredge-how-to-manage-an-idrac-license-via-the-web-interface)
* 3ware Inc 9750 Controller

### vm2.iad Disk Drives

`for i in a b c d; do echo $i; smartctl -a /dev/sd$i | egrep '^(Device Model|Serial)' | cut -c 19-60; done`

| LUN  | Serial          | Model               | Size |
| ---- | --------------- | ------------------- | ---- |
|  a   | S6PNNS0T602439V | Samsung SSD 870 EVO | 2TB  |
|  b   | S6PNNS0T602496T | Samsung SSD 870 EVO | 2TB  |
|  c   | S6PNNS0T604993A | Samsung SSD 870 EVO | 2TB  |
|  d   | S6PNNS0T604995Z | Samsung SSD 870 EVO | 2TB  |

## r1.iad.rg.net

* Dell R630 6TL9MN2 Express Service Code: 14849934302
* 2 x Xeon E5-2640 v4 2.4GHz 10 Cores each
* 64G RAM
* PERC H730
* BRCM 10G/GbE 2+2P 57800 - 2xCopper 2xSFP
* iDRAC8

### r1.iad NICs

| NIC                     | MAC               |
| ----------------------- | ----------------- |
| IPMI			  | 58:8A:5A:EE:CA:D2 |
| Integrated NIC 1 Port 1 | B8:2A:72:E0:5E:EF |
| Integrated NIC 1 Port 2 | B8:2A:72:E0:5E:F1 |
| Integrated NIC 1 Port 3 | B8:2A:72:E0:5E:F3 |
| Integrated NIC 1 Port 4 | B8:2A:72:E0:5E:F5 |

### r1.iad Disk Drives

`for i in a b; do echo $i; smartctl -a /dev/sd$i | egrep '^(Device Model|Serial)' | cut -c 19-60; done`

| LUN  | Serial          | Model                     | Size  |
| ---- | --------------- | ------------------------- | ----- |
|  0   | S7BWNJ0W650863P | Samsung SSD 870 EVO 500GB | 500G  |
|  1   | S7BWNJ0W685314L | Samsung SSD 870 EVO 500GB | 500G  |


## PDUs

```
BayTech RPC is accessed via serial from o0.iad.rg.net as pwr0/1
You will face RPC> prompt.  Type
  CONFIG
  ON x
  OFF x
  REBOOT x
```

### pwr0.iad.rg.net
```
1)...r1.iad-left
2)...unused
3)...vm1.iad.rg.net
4)...vm2.iad.rg.net
5)...sw0.iad.rg.net
6)...vm0.iad.rg.net
```

### pwr1.iad.rg.net
```
1)...r1.iad-right
2)...vm2.iad.rg.net
3)...unused
4)...unused
5)...vm0.iad.rg.net
6)...o0.iad
```

---

## vm1.iad.rg.net Hardware  DECOMMISSIONED

 **[SuperMicro AS-1022G-URF 2RU Chassis](http://www.supermicro.com/Aplus/system/1U/1022/AS-1022G-URF.cfm)**

- [H8DGU-F Motherboard](http://www.supermicro.com/Aplus/motherboard/Opteron6000/SR56x0/H8DGU-F.cfm)
- [Two 12-core AMD Opteron 6344 Abu Dhabi 2.6GHz](http://products.amd.com/en-gb/OpteronCPUDetail.aspx?id=819&f1=&f2=&f3=Yes&f4=&f5=&f6=&f7=&f8=&f9=&f10=&f11=&)
- [Crucial 128G 8 x 16GB 240-Pin DDR3 SDRAM ECC Registered DDR3 1600 (PC3 12800) Server Memory](http://www.crucial.com/usa/en/CT16G3ERSLD4160B?)
- [LSI MegaRAID SATA/SAS 9260-4i 6Gb/s PCI-Express 2.0](http://www.lsi.com/products/raid-controllers/pages/megaraid-sas-9260-4i.aspx)
- [Four Western Digital RE WD3000FYYZ 3TB 7200 RPM 64MB Cache SA T A 6.0Gb/s 3.5" Enterprise Internal Hard Drives](http://wdc.com/en/products/catalog/)

## vm1.iad.rg.net Disk Drives

From `megacli -PDList -aALL | egrep 'Coerced|Inquiry'`

| LUN  | Serial             | Model              | Size     |
| ---- | ------------------ | ------------------ | -------- |
| 0    | WD-WMC130D9JJJZWDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
| 1    | WD-WMC130D1CT76WDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
| 2    | WD-WMC130D2MZFVWDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
| 3    | WD-WMC130D2MZFVWDC | WD3000FYYZ-01UL1B2 | 2.728 TB |

### SprintLink

* sl-mst50-ash2, ge-0/0/9 is wired to 204/4/29 with translates to
Equinix panel name DC4:01:041210: CP:0204:137587 Ports 27/28. Equinix
made the XC between our CFA in our cage and PSG's CFA in their
cage. There in no MMR involved in the path.
2024.05.30 Jeffrey Kerrick <jkerrick@cogentco.com>

* sl-mst50-ash2, ge-0/0/9, (To PSG peer (AS3927) CCOI: PEER PRIVATE GIGE
^psg-3927-ash2^)
2024.05.30 from BC,

* port 17-18 in the Ashburn cage 1490
* A-Side Patch Panel/Module/Port: PP:0103:25916||9
* Z-Side Customer and Cage Number: SPRINT DC2::01490:SPRINT
* Z-Side Cabinet Number: 0102
* Carrier Circuit ID(if applicable): Randy Bush
* Z-Side Patch Panel/Module/Port: PP:0102:605||17
* Cable ID: 792604  should be used to reference that patch cable

## r1.iad.rg.net  Juniper MX80 from IETF DECOMISSIONED 2024.09.12
```
randy@r1.iad> show chassis hardware
Hardware inventory:
Item             Version  Part number  Serial number     Description
Chassis                                E4642             MX80
Midplane         REV 06   711-031594   YP5258            MX80
PEM 0            Rev 04   740-028288   UH01164           AC Power Entry Module
PEM 1            Rev 04   740-028288   WF04755           AC Power Entry Module
Routing Engine            BUILTIN      BUILTIN           Routing Engine
TFEB 0                    BUILTIN      BUILTIN           Forwarding Engine Processor
  QXM 0          REV 05   711-028408   YL0286            MPC QXM
FPC 0                     BUILTIN      BUILTIN           MPC BUILTIN
  MIC 0                   BUILTIN      BUILTIN           4x 10GE XFP
    PIC 0                 BUILTIN      BUILTIN           4x 10GE XFP
FPC 1                     BUILTIN      BUILTIN           MPC BUILTIN
  MIC 0          REV 22   750-028392   YJ7317            3D 20x 1GE(LAN) SFP
    PIC 0                 BUILTIN      BUILTIN           10x 1GE(LAN) SFP
      Xcvr 0     REV 01   740-011614   PJ717AP           SFP-LX10
      Xcvr 1     REV 01   740-031850   G1908083802       SFP-LX10
    PIC 1                 BUILTIN      BUILTIN           10x 1GE(LAN) SFP
Fan Tray                                                 Fan Tray
```

---

2024.09.12