rgnet-wiki/pages/AshburnPoP.md

417 lines
No EOL
18 KiB
Markdown

# Ashburn DC2 PoP
```
Sandbox, cage 2020, rack 102
c/o Equinix DC2
21715 Filigree Ct
Ashburn, VA 20147
noc@equinix.com (or ask ERC support@equinix.com folk to escalate to
primary on-call NSE)
+1 888 892 0607 equinix 24x7
CURRENT CONTACTS LIST: (2024.07.02)
Muhammad Waqas Bin Tariq <mwaqas@equinix.com>
Tarkesh Patel <tpatel@equinix.com>
```
## PoP Diagram
![221028.ashburn.jpg](../pics/221028.ashburn.jpg)
## To Do
* connect route views transit
## Circuits
### Cogent
A-side
IBX: DC2
Cage: 2020
Patch Panel: PP:0103:25916
Ports: 11/12 (these were new ports)
* Cogent
* GigabitEthernet0/2/1/8.rcr22.iad01
* description CUST-W GIGE ^RGnet LLC^ ID:3-001717104 PT:3-001717104
* AS 174
* ipv4 address 38.88.248.236/31
* ipv6 address 2001:550:2:1::22/127
* RGnet/PSGnet
* r1.iad-eno1
* AS 3927
* ipv4 address 38.88.248.237/31
* ipv6 address 2001:550:2:1::23/127
### o0.iad
* o0 IP into Equinix Management Network
* port 20 of Louie's 3Com switch in the next cabinet over
* o0.iad.rg.net: 206.223.132.86/26
* gateway: 206.223.132.65
### Route Views
* Circuit ID 20438058 in cage 2020 is Route Views to IX
## Equipment
* sw0 is a Cisco WS-C3750G-24PS
* o0 is a Cisco 2621 (MPC860) processor (revision 0x102) w/ 61440K/4096K
* r0 is a Juniper MX240 for the moment on loan from warren
* r1 is a Dell 630 running FRR
* Equinix Power Strip aka Leviton
* [photo from 2020.02.18](https://photos.app.goo.gl/aTaqAXH1C14CNbbG8)
### vm1.iad.rg.net proxmox
Service Tag: 7WCXDH2<br>
Dell R630<br>
2x 10-Core 2.4 GHz Intel E5-2640V4<br>
256GB DDR4 Memory<br>
H730 Mini RAID controller<br>
4 Gigabit RJ45 network ports<br>
2 10Gb SFP+<br>
iDRAC Enterprise
| Unit | Model | Serial | |
| ---- | ----------------------- | --------------- | -------------------- |
| 0 | Samsung SSD 870 EVO 4TB | S758NX0X504317Z | new as of 2025.07.08 |
| 1 | Samsung SSD 870 EVO 4TB | S758NX0X505056R | new as of 2025.07.08 |
| 2 | Samsung SSD 870 EVO 4TB | S758NX0X504319J | new as of 2025.07.08 |
| 3 | Samsung SSD 870 EVO 4TB | S758NX0X504324X | new as of 2025.07.08 |
## Rack Physical and Wiring
| hostname | switch | oob | oobname | pwr | RU | |
| :-------------------- | ------------- | ----- | ------- | --------| ---- | ------------------------- |
| r1.iad.rg.net | s0.5 | o0.36 | r1 | 0.1 1.1 | ???? | Dell 630/FRR |
| r0.iad.rg.net | s0.21 s0.12 | o0.33 | r0 | equinix | 7-8 | Juniper MX240 (warren) |
| fiber patch panel | | | | | 5-6 | (equinix) |
| vm0.iad.rg.net | s0.02 s0.14 | o0.XX | vm0 | 0.6 | 3 | SuperMicro SYS-6016T-URF |
| o0.iad.rg.net | s0.01/02 | vm2.usb | | 1.6 | | Cisco 2621 (MPC860) |
| sw0.iad.rg.net | | o0.37 | s0 | 0.5 | | Cisco WS-C3750G-24PS |
| vm1.iad.rg.net | s0.06 | o0.38 | srv0 | 0.3 | | SuperMicro AS-1022G-URF |
| pwr0.iad.rg.net | | o0.41 | pwr0 | equinix | | BayTech RPC |
| pwr1.iad.rg.net | | o0.43 | pwr1 | equinix | | BayTech RPC |
| vm2.iad.rg.net | s0.07 sw0.13 | o0.35 | vm2 | 0.4 1.2 | | Dell R630 GLY2W52 |
## Removed
| hostname | switch | oob | oobname | pwr | RU | |
| :-------------------- | ------------- | ----- | ------- | ------------- | ---- | ------------------------- |
| cypress.shrubbery.net | s0.03 & s0.13 | o0.35 | cypress | 0.4 | | removed 2022.08.28 |
| akkht.hactrn.net Eth0 | s0.11 | o0.11 | sra | 0.1 | 2 | removed 2022.08.28 |
| akkht.hactrn.net DRAC | s0.12 | | | | 2 | removed 2022.08.28 |
| r1.iad.rg.net | s0.23 | o0.34 | r1 | equinix | | Cisco 7206-G1 |
| emu.machshav.com | s0.08 | o0.40 | emu | 0.2 | | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
| emu-2.machshav.com | s0.09/10 | | | | | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
## Ethernet Ports
| hostname | main ether | ipmi | drbd |
| :--------------- | ---------- | ----- | ------- |
| vm0.iad.rg.net | sw0.02 | sw0.14 | sw0.15 |
| vm1.iad.rg.net | sw0.06 | --- | sw0.16 |
| vm2.iad.rg.net | sw0.07 | sw0.13 | sw0.17 |
| hostname | main ether | ipmi |
| :--------------- | ---------- | ----- |
| r0 .iad.rg.net | sw0.25 | sw0.12 |
| r1 .iad.rg.net | sw0.05 | sw0.3 |
### Hosts on vm0/2.iad.rg.net / 198.180.150.8/10
```
vm0.iad.rg.net:/root# ./do-stat
Node DTotal DFree MTotal MNode MFree Pinst Sinst
vm0.iad.rg.net 8.2T 7.3T 78.6G 35.4G 67.9G 5 9
vm2.iad.rg.net 3.6T 2.2T 188.8G 62.6G 160.7G 9 5
Instance Primary_node Secondary_Nodes Disk/0 Memory CPUs
bbgp.rg.net vm0.iad.rg.net vm2.iad.rg.net 32.0G 2.0G 1
bbt2.rg.net vm0.iad.rg.net vm2.iad.rg.net 64.0G 4.0G 1
bbte.rg.net vm2.iad.rg.net vm0.iad.rg.net 64.0G 4.0G 4
bozanicfamily.com vm2.iad.rg.net vm0.iad.rg.net 34.0G 1.0G 1
khatovar.hactrn.net vm0.iad.rg.net vm2.iad.rg.net 250.0G 4.0G 1
m2.machshav.com vm2.iad.rg.net vm0.iad.rg.net 125.0G 8.0G 1
netsrv.iad.rg.net vm0.iad.rg.net vm2.iad.rg.net 32.0G 2.0G 1
ns1.machshav.com vm2.iad.rg.net vm0.iad.rg.net 32.0G 2.0G 1
pfs0.iad.rg.net vm2.iad.rg.net vm0.iad.rg.net 8.0G 512M 1
pfs.iad.rg.net vm2.iad.rg.net vm0.iad.rg.net 8.0G 1.0G 1
rgnet.anycast.censurfridns.dk vm2.iad.rg.net vm0.iad.rg.net 50.0G 6.0G 2
srv0.iad.rg.net vm2.iad.rg.net vm0.iad.rg.net 64.0G 2.0G 1
tor0.iad.rg.net vm2.iad.rg.net vm0.iad.rg.net 32.0G 12.0G 1
usbeacon2.iibex.auckland.ac.nz vm0.iad.rg.net vm2.iad.rg.net 36.0G 1.0G 1
```
| Hostname | IP Address | Owner and Email |
| :----------------------------- | -------------- | ------------------------- |
| bbgp.rg.net | 198.180.150.15 | Randy Bush &lt;randy@psg.com&gt; |
| bbt2.rg.net | 198.180.150.61 | Cristel Pelsser &lt;cristel.pelsser@uclouvain.be&gt;
| bbte.rg.net | 198.180.150.60 | Cristel Pelsser &lt;cristel.pelsser@uclouvain.be&gt; |
| bozanicfamily.com | 198.180.150.5 | Randy Bush &lt;randy@psg.com&gt; |
| khatovar.hactrn.net | 198.180.150.30 | Rob Austein &lt;sra@hactrn.net&gt; |
| m2.macshav.com | 198.180.150.45 | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
| netsrv.iad.rg.net | 198.180.150.13 | Randy Bush &lt;randy@psg.com&gt; |
| ns1.machshav.com | 198.180.150.41 | Steven M Bellovin &lt;smb@cs.columbia.edu&gt; |
| pfs0.iad.rg.net | 198.180.150.3 | Randy Bush &lt;randy@psg.com&gt; |
| pfs.iad.rg.net | 198.180.150.6 | Randy Bush &lt;randy@psg.com&gt; |
| rgnet.anycast.censurfridns.dk | 198.180.150.12 | Phil Regnauld &lt;pr@x0.dk&gt; |
| srv0.iad.rg.net | 198.180.150.1 | Randy Bush &lt;randy@psg.com&gt; |
| tor0.iad.rg.net | 198.180.150.9 | Randy Bush &lt;randy@psg.com&gt; |
| usbeacon2.iibex.auckland.ac.nz | 198.180.150.52 | Etuate Cocker &lt;ecoc005@aucklanduni.ac.nz&gt; |
## vm0.iad.rg.net Hardware
- [Supermicro SYS-6016T-URF with X8DTU-F mobo](http://www.supermicro.com/products/system/1U/6016/SYS-6016T-URF.cfm)
- Power-A&B - UL24-3#24
### vm0.iad.rg.net Disk Configuration
```
vm0.iad.rg.net:/root# tw_cli info c0
Unit UnitType Status %RCmpl %V/I/M Stripe Size(GB) Cache AVrfy
------------------------------------------------------------------------------
u0 RAID-5 OK - - 256K 8381.87 RiW ON
VPort Status Unit Size Type Phy Encl-Slot Model
------------------------------------------------------------------------------
p0 OK u0 3.63 TB SATA 0 - WDC WD4003FRYZ-01F0
p1 OK u0 3.63 TB SATA 1 - WDC WD4003FRYZ-01F0
p2 OK u0 3.63 TB SATA 2 - WDC WD4003FRYZ-01F0
p3 OK u0 2.73 TB SATA 3 - HITACHI HUA723030AL
```
Four drive bays seem to be numbered 0-3 left to right
From `for i in 0 1 2 3; do smartctl -a -d 3ware,$i /dev/twl0 | grep Serial; done`
| Unit | Model | Serial | |
| ---- | ----------------------- | --------------- | -------------------- |
| 0 | WD4003FRYZ-01F0DB0 | VBHVEUTF | new as of 2023.05.17 |
| 1 | WD4003FRYZ-01F0DB0 | V1JVGGHG | |
| 2 | WD4003FRYZ-01F0DB0 | V1KW63UG | new as of 2023.08.09 |
| 3 | HITACHI HUA723030ALA640 | YVHPV0LA | |
* 2023.05.17 replaced p0 K7G9TG6L with VBHVEUTF
* 2022.05.18 replaced p1 WDC WD3000FYYZ-01UL serial WD-WCC130121922
* 2023.08.09 replaced p2 WD3000FYYZ-01UL1B0 WD-WCC130095709
## vm1.iad.rg.net proxmox
Service Tag: 7WCXDH2<br>
Dell R630<br>
2x 10-Core 2.4 GHz Intel E5-2640V4<br>
256GB DDR4 Memory<br>
H730 Mini RAID controller<br>
4 Gigabit RJ45 network ports<br>
2 10Gb SFP+<br>
iDRAC Enterprise
## vm1.iad.rg.net Disk Configuration
| Unit | Model | Serial | |
| ---- | ----------------------- | --------------- | -------------------- |
| 0 | Samsung SSD 870 EVO 4TB | S758NX0X504317Z | new as of 2025.07.08 |
| 1 | Samsung SSD 870 EVO 4TB | S758NX0X505056R | new as of 2025.07.08 |
| 2 | Samsung SSD 870 EVO 4TB | S758NX0X504319J | new as of 2025.07.08 |
| 3 | Samsung SSD 870 EVO 4TB | S758NX0X504324X | new as of 2025.07.08 |
## vm2.iad.rg.net Hardware
Dell R630 Tag: GLY2W52 Express Code: 36155548982<br>
Dual Intel(R) Xeon(R) CPU E5-2697 v3 @ 2.60GHz<br>
192GB RAM 12x16GB DDR4<br>
BRCM GbE 4P 5720-t rNDC<br>
iDRAC8<br>
iDRAC tools - [racadm tools for DRAC8 download the latest here](https://dl.dell.com/FOLDER07423496M/1/DellEMC-iDRACTools-Web-LX-10.1.0.0-4566_A00.tar.gz). use `racadm getsysinfo`<br>
[Link for how to download in the future](https://www.dell.com/support/kbdoc/en-us/000177791/poweredge-how-to-gather-an-idrac-log-using-racadm#1)<br>
[Documentation for racadm](https://dl.dell.com/Manuals/all-products/esuprt_software/esuprt_remote_ent_sys_mgm[…]ssis-mgmt-cntrllr-v1.25-pwedge-vrtx_reference%20guide_en-us.pdf)<br>
Part number from Dell for iDRAC8 license is 385-BBHP<br>
[How to import and export a license with iDRAC7 or iDRAC8](https://www.dell.com/support/kbdoc/en-th/000145345/poweredge-how-to-manage-an-idrac-license-via-the-web-interface)<br>
3ware Inc 9750 Controller<br>
## vm2.iad Disk Drives
`for i in a b c d; do echo $i; smartctl -a /dev/sd$i | egrep '^(Device Model|Serial)' | cut -c 19-60; done`
| LUN | Serial | Model | Size |
| ---- | --------------- | ------------------- | ---- |
| a | S6PNNS0T602439V | Samsung SSD 870 EVO | 2TB |
| b | S6PNNS0T602496T | Samsung SSD 870 EVO | 2TB |
| c | S6PNNS0T604993A | Samsung SSD 870 EVO | 2TB |
| d | S6PNNS0T604995Z | Samsung SSD 870 EVO | 2TB |
## r0.iad.rg.net FRR
Service Tag: 6TKCMN2<br>
Dell R630<br>
2x 10-Core 2.4 GHz Intel E5-2640V4<br>
64GB DDR4 Memory<br>
H730 Mini RAID controller<br>
4 Gigabit RJ45 network ports<br>
2 10Gb SFP+<br>
iDRAC Enterprise
### r1.iad Disk Drives
| Unit | Model | Serial | |
| ---- | ------------------------ | --------------- | -------------------- |
| 0 | Samsung SSD 870 EVO 500G | S6PWNU0Y300444D | new as of 2025.07.08 |
| 1 | Samsung SSD 870 EVO 500G | S6PWNU0Y300637D | new as of 2025.07.08 |
## r1.iad.rg.net
* Dell R630 6TL9MN2 Express Service Code: 14849934302
* 2 x Xeon E5-2640 v4 2.4GHz 10 Cores each
* 64G RAM
* PERC H730
* BRCM 10G/GbE 2+2P 57800 - 2xCopper 2xSFP
* iDRAC8
### r1.iad NICs
| NIC | MAC |
| ----------------------- | ----------------- |
| IPMI | 58:8A:5A:EE:CA:D2 |
| Integrated NIC 1 Port 1 | B8:2A:72:E0:5E:EF |
| Integrated NIC 1 Port 2 | B8:2A:72:E0:5E:F1 |
| Integrated NIC 1 Port 3 | B8:2A:72:E0:5E:F3 |
| Integrated NIC 1 Port 4 | B8:2A:72:E0:5E:F5 |
### r1.iad Disk Drives
`for i in a b; do echo $i; smartctl -a /dev/sd$i | egrep '^(Device Model|Serial)' | cut -c 19-60; done`
| LUN | Serial | Model | Size |
| ---- | --------------- | ------------------------- | ----- |
| 0 | S7BWNJ0W650863P | Samsung SSD 870 EVO 500GB | 500G |
| 1 | S7BWNJ0W685314L | Samsung SSD 870 EVO 500GB | 500G |
## PDUs
```
BayTech RPC is accessed via serial from o0.iad.rg.net as pwr0/1
You will face RPC> prompt. Type
CONFIG
ON x
OFF x
REBOOT x
```
### pwr0.iad.rg.net
```
1)...r1.iad-left
2)...unused
3)...vm1.iad.rg.net
4)...vm2.iad.rg.net
5)...sw0.iad.rg.net
6)...vm0.iad.rg.net
```
### pwr1.iad.rg.net
```
1)...r1.iad-right
2)...vm2.iad.rg.net
3)...unused
4)...unused
5)...vm0.iad.rg.net
6)...o0.iad
```
---
## vm1.iad.rg.net Hardware DECOMMISSIONED
**[SuperMicro AS-1022G-URF 2RU Chassis](http://www.supermicro.com/Aplus/system/1U/1022/AS-1022G-URF.cfm)**
- [H8DGU-F Motherboard](http://www.supermicro.com/Aplus/motherboard/Opteron6000/SR56x0/H8DGU-F.cfm)
- [Two 12-core AMD Opteron 6344 Abu Dhabi 2.6GHz](http://products.amd.com/en-gb/OpteronCPUDetail.aspx?id=819&f1=&f2=&f3=Yes&f4=&f5=&f6=&f7=&f8=&f9=&f10=&f11=&)
- [Crucial 128G 8 x 16GB 240-Pin DDR3 SDRAM ECC Registered DDR3 1600 (PC3 12800) Server Memory](http://www.crucial.com/usa/en/CT16G3ERSLD4160B?)
- [LSI MegaRAID SATA/SAS 9260-4i 6Gb/s PCI-Express 2.0](http://www.lsi.com/products/raid-controllers/pages/megaraid-sas-9260-4i.aspx)
- [Four Western Digital RE WD3000FYYZ 3TB 7200 RPM 64MB Cache SA T A 6.0Gb/s 3.5" Enterprise Internal Hard Drives](http://wdc.com/en/products/catalog/)
## vm1.iad.rg.net Disk Drives
From `megacli -PDList -aALL | egrep 'Coerced|Inquiry'`
| LUN | Serial | Model | Size |
| ---- | ------------------ | ------------------ | -------- |
| 0 | WD-WMC130D9JJJZWDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
| 1 | WD-WMC130D1CT76WDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
| 2 | WD-WMC130D2MZFVWDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
| 3 | WD-WMC130D2MZFVWDC | WD3000FYYZ-01UL1B2 | 2.728 TB |
### SprintLink
* sl-mst50-ash2, ge-0/0/9 is wired to 204/4/29 with translates to
Equinix panel name DC4:01:041210: CP:0204:137587 Ports 27/28. Equinix
made the XC between our CFA in our cage and PSG's CFA in their
cage. There in no MMR involved in the path.
2024.05.30 Jeffrey Kerrick <jkerrick@cogentco.com>
* sl-mst50-ash2, ge-0/0/9, (To PSG peer (AS3927) CCOI: PEER PRIVATE GIGE
^psg-3927-ash2^)
2024.05.30 from BC,
* port 17-18 in the Ashburn cage 1490
* A-Side Patch Panel/Module/Port: PP:0103:25916||9
* Z-Side Customer and Cage Number: SPRINT DC2::01490:SPRINT
* Z-Side Cabinet Number: 0102
* Carrier Circuit ID(if applicable): Randy Bush
* Z-Side Patch Panel/Module/Port: PP:0102:605||17
* Cable ID: 792604 should be used to reference that patch cable
## r1.iad.rg.net Juniper MX80 from IETF DECOMISSIONED 2024.09.12
```
randy@r1.iad> show chassis hardware
Hardware inventory:
Item Version Part number Serial number Description
Chassis E4642 MX80
Midplane REV 06 711-031594 YP5258 MX80
PEM 0 Rev 04 740-028288 UH01164 AC Power Entry Module
PEM 1 Rev 04 740-028288 WF04755 AC Power Entry Module
Routing Engine BUILTIN BUILTIN Routing Engine
TFEB 0 BUILTIN BUILTIN Forwarding Engine Processor
QXM 0 REV 05 711-028408 YL0286 MPC QXM
FPC 0 BUILTIN BUILTIN MPC BUILTIN
MIC 0 BUILTIN BUILTIN 4x 10GE XFP
PIC 0 BUILTIN BUILTIN 4x 10GE XFP
FPC 1 BUILTIN BUILTIN MPC BUILTIN
MIC 0 REV 22 750-028392 YJ7317 3D 20x 1GE(LAN) SFP
PIC 0 BUILTIN BUILTIN 10x 1GE(LAN) SFP
Xcvr 0 REV 01 740-011614 PJ717AP SFP-LX10
Xcvr 1 REV 01 740-031850 G1908083802 SFP-LX10
PIC 1 BUILTIN BUILTIN 10x 1GE(LAN) SFP
Fan Tray Fan Tray
```
## r0.iad.rg.net Juniper MX240 from warren Decommissioned 2025.****
```
randy@r0.iad> show chassis hardware
Hardware inventory:
Item Version Part number Serial number Description
Chassis JN11544AFAFC MX240
Midplane REV 07 760-021404 ABAA3443 MX240 Backplane
FPM Board REV 03 760-021392 ABBA1738 Front Panel Display
PEM 0 Rev 01 740-022697 QCS0931C044 PS 1.2-1.7kW; 100-240V AC in
PEM 2 Rev 03 740-022697 QCS1243C071 PS 1.2-1.7kW; 100-240V AC in
Routing Engine 0 REV 07 740-015113 9009006841 RE-S-1300
CB 0 REV 05 710-021523 ABBA1993 MX SCB
FPC 2 REV 16 750-022765 XM0320 DPCE 20x 1GE + 2x 10GE R
CPU REV 03 710-022351 XM4341 DPC PMB
PIC 0 BUILTIN BUILTIN 10x 1GE(LAN)
Xcvr 0 REV 01 740-011613 PFF29VR SFP-SX
Xcvr 9 REV 02 740-011613 PGP5559 SFP-SX
PIC 1 BUILTIN BUILTIN 10x 1GE(LAN)
PIC 2 BUILTIN BUILTIN 1x 10GE(LAN/WAN)
PIC 3 BUILTIN BUILTIN 1x 10GE(LAN/WAN)
Fan Tray 0 REV 01 710-021113 XB1539 MX240 Fan Tray
```
---
2025.07.22