From e2bea5f3ac9abc6b9e1df57665df3d5eb8516def Mon Sep 17 00:00:00 2001 From: Randy Bush Date: Sat, 4 Jul 2020 15:04:05 -0700 Subject: [PATCH] fixed mess --- pages/ForkLift.md | 739 +++++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 738 insertions(+), 1 deletion(-) diff --git a/pages/ForkLift.md b/pages/ForkLift.md index efa989d..8b6de3d 100644 --- a/pages/ForkLift.md +++ b/pages/ForkLift.md @@ -2,4 +2,741 @@ With much help from [https://nsrc.org/workshops/2014/sanog23-virtualization/raw-attachment/wiki/Agenda/ex-ganeti-install.htm](https://nsrc.org/workshops/2014/sanog23-virtualization/raw-attachment/wiki/Agenda/ex-ganeti-install.htm). -And [And https://nsrc.org/workshops/2014/sanog23-virtualization/wiki/Agenda](https://nsrc.org/workshops/2014/sanog23-virtualization/wiki/Agenda) is also helpful. \ No newline at end of file +And [And https://nsrc.org/workshops/2014/sanog23-virtualization/wiki/Agenda](https://nsrc.org/workshops/2014/sanog23-virtualization/wiki/Agenda) is also helpful. + +------ + +First, record disk and memory allocation for each VM, configured size, not utilization. + +| Hostname | RAM | Disk | MAC | MD5 | +| :--------------------------- | ---- | ----- | ----------------- | -------------------------------- | +| adrilankha.hactrn.net | 4G | 200G | 00:0c:29:be:72:5b | f4566ff7105e84dabcb3f6cd2ff40ab0 | +| archive.psg.com | 1G | 100G | 00:0c:29:6e:06:f4 | 69b5cc1318707977b08ff8d7767af816 | +| hiroshima.bogus.com | 4G | 250G | 00:0c:29:75:01:b7 | 3a5f2130a23679962526a9ec5f90e8a8 | +| linear.algebras.org | 1G | 100G | 00:0c:29:b7:6a:60 | 11548e21ef24236b599cdb64878c37ac | +| nagasaki.bogus.com | 4G | 256G | 00:0c:29:6b:64:e3 | 3f4b06082516e89a8e7dcb5e6bb072a7 | +| okui.psg.com | 1G | 100G | 00:0c:29:89:e3:60 | aabd3b496a131e8f516a3c541a04a78f | +| r1.securerouting.org | 2G | 100G | 00:0c:29:46:0e:b6 | a108b9201bf853868f9c462513af3c20 | +| rip1.psg.com | 2G | 36G | 00:0c:29:60:fe:bb | ce7da43bbcc25ed2b45a4458aaaf943c | +| turing.worldpowersystems.com | 2G | 256G* | 00:0c:29:b7:21:6e | 03dce3e51df1d3e2fe880fbd852cf9e5 | +| zoe.dns.gh | 4G | 200G | 00:0c:29:9e:36:a2 | 86c24decf3c0a46aa830586d0df2ca74 | +| zzyzx.sigpipe.org | 2G | 100G | 00:0c:29:bf:79:86 | 7eef30eb2de95e5d38d491b78df0c9cb | + +## Users Hack Configuration Aspects Which Will Change + +Disk and Network Interface naming may change from the ESXI guest environment to the Ganeti/KVM environment. Owners of gusts should make config changes just before shutting down their machines. Thus, when they come back up in the new environment they will boot usefully. + +### Linux Guests Should Need No Modification + +Linux Guests should be able to find their disks as UUIDs and mount as /dev/sdaN. And Ethernet seems to be a pretty constant eth0. + +### FreeBSD Guests May Need Modification + +Do not do this. There seems to be a hack around it, see below. + +FreeBSD guests seem to use /dev/ada for the disk drives + +``` +root@fbsd0:~ # more /etc/fstab +# Device Mountpoint FStype Options Dump Pass# +/dev/ada0p2 / ufs rw 1 1 +/dev/ada0p3 none swap sw 0 0 +``` + +FreeBSD drives on ESXI seem to be /dev/da. So users will have to change their /etc/fstab just before the fork-lift. s/da/ada/g + +The FreeBSD Ethernet interface seems to be em0 on ESXI and on KVM + +``` +root@fbsd0:~ # ifconfig +em0: flags=8843 metric 0 mtu 1500 + options=209b + ether 52:54:00:ad:71:03 + inet 198.180.150.10 netmask 0xffffff00 broadcast 198.180.150.255 + inet6 fe80::5054:ff:fead:7103%em0 prefixlen 64 scopeid 0x2 + nd6 options=29 + media: Ethernet autoselect (1000baseT ) + status: active +``` + +As ESXI and KVM seem to be the same, it should require no change. + +## Copy VMs to an NFS Mounted Filesystem + +Create a /data/nfs directory on raid1.psg.com and NFS export it to vm0.sea using hacks/advice from: + +- [Exporting NFS from FreeBSD ](http://myitnotes.info/doku.php?id=en:jobs:freebsd_zfs_nfs_for_vmware) +- [A really disgusting and unsafe hack to disable syncs to speed up NFS writes ](https://www.ateamsystems.com/tech-blog/solved-performance-issues-with-freebsd-zfs-backed-esxi-storage-over-nfs/) + +Mount raid1.psg.com:/data/nfs on vm0.sea.rg.net as an NFS datastore. + +Stop and power off all guest VMs on vm0.sea.rg.net. + +Record the md5 checksum of each and every guest VM .vmdk file. + +Use VMware vSphere Client on my laptop to move each guest VM from vm0.sea.rg.net:datastore1 to the NFS datastore. + +Take the md5 checksum of each and every .vmdk file on the NFS datastore and compare to that of the original from vm0.sea.rg.net:datastore1. + +It is now safe to destroy and rebuild vm0.sea.rg.net + +## Build a Debian/Ganeti System on vm0.sea.rg.net + +Boot into Adaptec BIOS and configure the four drives as one RAID5. The hack to get an INSert key on the MacBook? is Windows, Accessories, Access, Keyboard + +### Install Debian + +- Boot Debian CD/ISO +- Choose Install +- Choose English, UK (so you can get UCT) +- Choose American English +- Name the host +- Choose root password +- Choose user name and password +- Partition + - Choose Manual Partitioning + - Select the drive + - Create new empty partition table + - Select Free Space + - Create new partition, primary, 1GB, begining, bios + - Done + - Select Free Space + - Create new partition, primary, 256MGB, begining, /boot, ext4, bootable + - Done + - Select Free Space again + - Create a new partition + - Accept whatever size is shown (the rest of the disk) + - Primary, physical volume for LVM + - Done +- Configure LVM + - Configure LVM accepting write changes to disks + - Create volume group + - Volume group name: ganeti + - Devices for the new volume group: select only the LVM partition + - Create Logical Volume: on ganeti, root, 8G + - Create Logical Volume: on ganeti, swap, 16G + - Create Logical Volume: on ganeti, var, 8G + - Edit the Logical Volumes to be ext4 /, swap, and ext4 /var + - Finish partitioning and write changes +- Finish partitioning and write changes to disk + +- Be sure it will not boot CD-ROM, and Reboot from the installed system + +## Finish Debian Installation + +Clean up from CDROM sources + +``` +vi /etc/apt/sources.list +``` + +and delete the two CDROM entries at the top + +Install homey things (it's not a computer without emacs:) + +``` +apt-get update +apt-get upgrade +apt-get install emacs23-nox +apt-get install rsync +apt-get install gcc +apt-get install bridge-utils vlan +apt-get install sudo +apt-get install unbound +apt-get install tw_cli *********** +usermod -G sudo -a randy +``` + +Fix hostname + +``` +echo vm0.sea.rg.net > /etc/hostname +hostname `cat /etc/hostname` +``` + +Fix /etc/unbound/unbound.conf + +``` + access-control: 127.0.0.0/8 allow + access-control: 147.28.0.0/16 allow + access-control: 198.180.150.0/24 allow + access-control: 198.180.152.0/24 allow + access-control: 0.0.0.0/0 refuse + access-control: ::1 allow + access-control: ::ffff:127.0.0.1 allow + access-control: 2001:418:1::0/48 allow + access-control: 2001:418:3807::0/48 allow + access-control: 2001:418:8006::0/48 allow + access-control: ::0/0 refuse +``` + +[Install Unattended Upgrading](http://www.howtoforge.com/how-to-configure-automatic-updates-on-debian-squeeze) + +## Debian Ganeti Specific Configuration + +Edit /etc/hosts to have the real address of the host, e.g. + +``` +127.0.0.1 localhost +147.28.0.3 vm0.sea.rg.net vm0 +147.28.0.100 gnt0.sea.rg.net +``` + +### Fix /etc/network/interfaces + +Make eth0 hang off of whatever your bridge will be called + +``` +# The loopback network interface +auto lo +iface lo inet loopback + +# Management interface +auto eth0 +iface eth0 inet manual + +auto br-lan +iface br-lan inet static + address 147.28.0.3 + netmask 255.255.255.0 + gateway 147.28.0.1 + bridge_ports eth0 + bridge_stp off + bridge_fd 0 + bridge_maxwait 0 + +# VLAN 100 +auto eth0.100 +iface eth0.100 inet manual + +auto br-rep +iface br-rep inet static + address 147.28.0.100 + netmask 255.255.255.0 + bridge_ports eth0.100 + bridge_stp off + bridge_fd 0 + bridge_maxwait 0 + +auto eth0.255 +iface eth0.255 inet manual + +# VLAN 255 +auto br-svc +iface br-svc inet manual + bridge_ports eth0.255 + bridge_stp off + bridge_fd 0 + bridge_maxwait 0 +``` + +Check /etc.resolv.comf + +In theory, this looks like + +``` + -------------+-------------- + | + br-lan + | this host + +---------+---------+ + | eth0 | + | | + |eth0.255 eth0.100| + +--+-----------+----+ + | | + br-svc br-rep + | | + VMs --------+ +------> to other ganeti hosts +``` + +## Install Ganeti + +Set up to get Ganeti from backports + +``` +cat > /etc/apt/sources.list.d/wheezy-backports.list +deb http://cdn.debian.net/debian/ wheezy-backports main +``` + +And then install it + +``` +apt-get update +apt-get install ganeti/wheezy-backports +``` + +Fix up drbd + +``` +echo "options drbd minor_count=128 usermode_helper=/bin/true" > /etc/modprobe.d/drbd.conf +rmmod drbd # ignore any error +modprobe drbd +``` + +### Initialize and Build Ganeti Cluster + +``` +gnt-cluster init \ + --master-netdev=br-lan \ + --enabled-hypervisors=kvm \ + -H kvm:kernel_path="",initrd_path="" \ + -N link=br-lan \ + --vg-name=ganeti \ + gnt0.sea.rg.net +``` + +If it barfs, try + +``` +gnt-cluster destroy --yes-do-it +``` + +then re-run gnt-cluster init ... + +If you get into gnutls problems check apt-get upgrade and dist-upgrade + +### Check That CLuster is Happy + +Fix VNC passwording + +``` +echo '4titude' > /etc/ganeti/vnc-cluster-password +gnt-cluster modify -H kvm:vnc_password_file=/etc/ganeti/vnc-cluster-password +``` + +Test that the cluster was built happily + +``` +gnt-cluster verify +``` + +If you get + +``` +Fri Mar 14 05:20:55 2014 - ERROR: node deb64.psg.com: volume ganeti/root is unknown +Fri Mar 14 05:20:55 2014 - ERROR: node deb64.psg.com: volume ganeti/swap is unknown +Fri Mar 14 05:20:55 2014 - ERROR: node deb64.psg.com: volume ganeti/var is unknown +``` + +That's OK. To make it go away + +``` +gnt-cluster modify --reserved-lvs=ganeti/root,ganeti/swap,ganeti/var +``` + +## Load the ESXI Images + +Make a LV for the ESXI images + +``` +lvcreate --size 2TB --name nfs-data ganeti +mkfs.ext4 /dev/ganeti/nfs-data +mkdir /nfs-data +mount /dev/ganeti/nfs-data /nfs-data +``` + +Copy over the data from raid1. rsync and scp are compute bound. nfs and ftp may be the best choices + +### Install Ganeti Instance Management + +Install ganeti-instance-image + +``` +wget https://code.osuosl.org/attachments/download/2169/ganeti-instance-image_0.5.1-1_all.debcd +dpkg -i ganeti-instance-image_0.5.1-1_all.deb +``` + +Install qemu utilities (though they likely came in with other installs) + +``` +apt-get install qemu-utils +``` + +And force latest version of qemu-image + +``` +apt-get install qemu-utils/wheezy-backports +``` + +Aside: if you also want ganeti-instance-debootstrap then version 0.14 is now in wheezy-backports. You don't need to install from source. You'll only want ganeti-instance-debootstrap to create images from scratch where it installs Debian or a Debian-related OS automatically. + +### Create the Guest VM Instances + +For each VM, run the following: + +``` +#!/bin/sh + +# makeVM diskGB ramGB nameFQDN + +DISK=$1 +RAM=$2 +NAME=$3 +NODE=vm0.sea.rg.net + +gnt-instance add \ + -t plain \ + -o image+default \ + -s ${DISK}G \ + -B minmem=${RAM}G,maxmem=$((${RAM}*2))G \ + -n $NODE \ + -H kvm:vnc_bind_address=0.0.0.0 \ + --no-install \ + --no-start \ + --no-ip-check \ + --no-name-check \ + ${NAME} +``` + +This produces + +``` +vm0.sea.rg.net:/root# ./do-add 200 4 +Tue Apr 22 23:15:35 2014 * disk 0, size 200.0G +Tue Apr 22 23:15:35 2014 * creating instance disks... +Tue Apr 22 23:15:38 2014 adding instance to cluster config +Tue Apr 22 23:15:38 2014 - INFO: Waiting for instance to sync disks +Tue Apr 22 23:15:39 2014 - INFO: Instance 's disks are in sync +``` + +If it is a FreeBSD VM, also do + +``` +gnt-instance modify -H disk_type=scsi +``` + +so that da devices still work at boot. + +Get the UUIDs of all VMs, and fill out the table. + +``` +gnt-instance list -o name,disk.uuid/0 +``` + +### Get the Stored VM VMDK Files from Backup + +As root + +``` +mkdir -p /store/esxi-vms +rsync -vPaHxRSz raid1.psg.com:/data/nfs/ /store/esxi-vms +``` + +Again, compare the MD5 checksums of the vmdk files with that of the the originals. + +### Convert the ESXI Images to Ganeti Guest Images + +``` +gnt-instance info --all | egrep 'Instance name|on primary' +``` + +Will show the primary device for each ganeti VM + +``` + on primary: /dev/xenvg/95d2bb8f-063f-498d-b98a-9c03acea991f.disk0 (252:2) +``` + +which we use as the output UUID + +Check the type of image we have + +``` +qemu-img info +``` + +### If it is a Flat Raw Image + +For -flat.vmdk files, you should be able to + +``` +dd bs=4096k if= of=/dev/ganeti/ +``` + +### If it is a Real VMDK + +For -s001.vmdk files, then you should be able, for each VMDK + +``` +qemu-img convert -f vmdk -O raw +``` + +## Try the VMs! + +You can use the built in console or come over VNC 9over ssh, of course). + +Start the image + +``` +gnt instance start +``` + +And come im over the text console or VNC + +### Direct Text Console + +``` +gnt-instance console +``` + +### Over VNC for Graphics + +``` +gnt-instance list -o +network_port +``` + +To get + +``` +Instance Hypervisor OS Primary_node Status Memory Network_port +minibsd-test kvm image+default deb64.psg.com running 256M 11001 +``` + +Then run a VNC to the base system port number in that report e.g. 11001, e.g. (notice port 11001) + +``` +ssh -N -L 5900:127.0.0.1:11001 vm0.sea.rg.net +``` + +And get ready to start your VNC session (in this case, I would be using Chicken of the VNC to VNC display localhost:0, aka localhost port 5900). + +To give each user a different password, do it at the instance level: + +``` +echo 'wombat' >/etc/ganeti/vnc-password- +gnt-instance modify -H vnc_password_file=/etc/ganeti/vnc-password- foobar +``` + +Or make a directory /etc/ganeti/passwords and stash them there. + +## If FreeBSD Does Not Mount Root + +If the system boots but does did not mount the root filesystem, and leaves you at the mountroot prompt. It seems as if FreeBSD + +> /dev/da0p2 + +may become + +> /dev/vtbd0p2 + +If you do the mountroot to + +``` +ufs:/dev/vtbd0p2 +``` + +the root mounts and the system comes up. + +sra reminds us that it is good idea to do an fsck of / at single user, before enabling write to the / filesystem. + +Of course, the filesystem will be image dependent. + +## Optionally Convert plain to drbd + +For each instance + +``` +$ gnt-instance stop +$ gnt-instance modify \ + -t drbd \ + --no-wait-for-sync \ + +$ gnt-instance start +``` + +------ + +## The ESXI Images as of 2014.04.18 + +``` +/vmfs/volumes/4d794907-845289f0-6305-003048d66e3b # ls -lh * +ISOs: +-rw------- 1 root root 690.6M Apr 16 2011 FreeBSD-8.2-RELEASE-amd64-disc1.iso +-rw------- 1 root root 612.1M Mar 8 2012 FreeBSD-9.0-RELEASE-amd64-disc1.iso +-rw------- 1 root root 684.2M Apr 20 2011 ubuntu-10.04.2-server-amd64.iso + +Patches: +-rw------- 1 root root 202.1M Mar 10 2011 ESXi410-201010001.zip +-rw------- 1 root root 85.7M Mar 10 2011 ESXi410-201011001.zip +-rw------- 1 root root 205.0M Jul 19 2011 ESXi410-201104001.zip +-rw------- 1 root root 205.8M Jul 19 2011 update-from-esxi4.1-4.1_update01.zip + +Zoe 147.28.0.23: +-rw------- 1 root root 4.0G Aug 20 2012 Zoe 147.28.0.23-cc6d5f9f.vswp +-rw------- 1 root root 200.0G Apr 19 00:58 Zoe 147.28.0.23-flat.vmdk +-rw------- 1 root root 8.5k Mar 7 02:28 Zoe 147.28.0.23.nvram +-rw------- 1 root root 504 Jul 7 2011 Zoe 147.28.0.23.vmdk +-rw-r--r-- 1 root root 0 Jul 7 2011 Zoe 147.28.0.23.vmsd +-rwxr-xr-x 1 root root 2.8k Feb 21 2012 Zoe 147.28.0.23.vmx +-rw-r--r-- 1 root root 270 Mar 8 2012 Zoe 147.28.0.23.vmxf +-rw-r--r-- 1 root root 45.7k Feb 21 2012 vmware-10.log +-rw-r--r-- 1 root root 46.6k Feb 21 2012 vmware-11.log +-rw-r--r-- 1 root root 56.5k Feb 21 2012 vmware-12.log +-rw-r--r-- 1 root root 45.3k Aug 18 2012 vmware-13.log +-rw-r--r-- 1 root root 71.4k Feb 20 2012 vmware-8.log +-rw-r--r-- 1 root root 45.6k Feb 20 2012 vmware-9.log +-rw-r--r-- 1 root root 45.5k Feb 12 03:05 vmware.log + +adrilankha.hactrn.net: +-rw------- 1 root root 4.0G Aug 20 2012 adrilankha.hactrn.net-597d4fbe.vswp +-rw------- 1 root root 256.0G Apr 19 00:58 adrilankha.hactrn.net-flat.vmdk +-rw------- 1 root root 8.5k Apr 19 00:40 adrilankha.hactrn.net.nvram +-rw------- 1 root root 484 Jul 16 2011 adrilankha.hactrn.net.vmdk +-rw-r--r-- 1 root root 0 Jul 16 2011 adrilankha.hactrn.net.vmsd +-rwxr-xr-x 1 root root 2.9k May 16 2012 adrilankha.hactrn.net.vmx +-rw-r--r-- 1 root root 276 Mar 16 18:11 adrilankha.hactrn.net.vmxf +-rw-r--r-- 1 root root 44.0k Jul 16 2011 vmware-1.log +-rw-r--r-- 1 root root 70.7k Jul 17 2011 vmware-2.log +-rw-r--r-- 1 root root 322.9k May 16 2012 vmware-3.log +-rw-r--r-- 1 root root 121.1k Aug 8 2012 vmware-4.log +-rw-r--r-- 1 root root 55.4k Aug 20 2012 vmware-5.log +-rw-r--r-- 1 root root 548.3k Apr 8 05:11 vmware.log + +apnicrpki.rand.apnic.net: +-rw------- 1 root root 1.0G Apr 10 2013 apnicrpki.rand.apnic.net-c157c72e.vswp +-rw-r--r-- 1 root root 6.7G Apr 19 00:58 apnicrpki.rand.apnic.net-s001.vmdk +-rw------- 1 root root 8.5k Mar 19 03:20 apnicrpki.rand.apnic.net.nvram +-rw------- 1 root root 717 Mar 11 2011 apnicrpki.rand.apnic.net.vmdk +-rw-r--r-- 1 root root 0 Mar 11 2011 apnicrpki.rand.apnic.net.vmsd +-rwxr-xr-x 1 root root 2.7k Mar 11 2011 apnicrpki.rand.apnic.net.vmx +-rw-r--r-- 1 root root 279 Mar 11 2011 apnicrpki.rand.apnic.net.vmxf +-rw-r--r-- 1 root root 99.1k Apr 17 2011 vmware-1.log +-rw-r--r-- 1 root root 61.0k Apr 30 2011 vmware-2.log +-rw-r--r-- 1 root root 83.6k Jul 15 2011 vmware-3.log +-rw-r--r-- 1 root root 60.9k Aug 1 2011 vmware-4.log +-rw-r--r-- 1 root root 164.1k Aug 18 2012 vmware-5.log +-rw-r--r-- 1 root root 68.2k Aug 20 2012 vmware-6.log +-rw-r--r-- 1 root root 152.1k Apr 16 13:32 vmware.log + +archive.psg.com: +-rw------- 1 root root 1.0G Apr 8 2013 archive.psg.com-7275f553.vswp +-rw------- 1 root root 100.0G Apr 19 00:57 archive.psg.com-flat.vmdk +-rw------- 1 root root 8.5k Apr 19 00:46 archive.psg.com.nvram +-rw------- 1 root root 478 Jun 26 2011 archive.psg.com.vmdk +-rw-r--r-- 1 root root 0 Jun 26 2011 archive.psg.com.vmsd +-rwxr-xr-x 1 root root 2.7k Jun 26 2011 archive.psg.com.vmx +-rw-r--r-- 1 root root 270 Jun 26 2011 archive.psg.com.vmxf +-rw-r--r-- 1 root root 119.6k Jun 27 2011 vmware-1.log +-rw-r--r-- 1 root root 44.3k Jul 15 2011 vmware-2.log +-rw-r--r-- 1 root root 184.6k Jan 23 2012 vmware-3.log +-rw-r--r-- 1 root root 48.0k Aug 20 2012 vmware-4.log +-rw-r--r-- 1 root root 70.5k Apr 8 08:16 vmware.log + +hiroshima.bogus.com: +-rw------- 1 root root 4.0G Aug 20 2012 hiroshima.bogus.com-e1c80ccb.vswp +-rw------- 1 root root 250.0G Apr 19 00:58 hiroshima.bogus.com-flat.vmdk +-rw------- 1 root root 8.5k Apr 16 08:31 hiroshima.bogus.com.nvram +-rw------- 1 root root 482 Mar 18 2011 hiroshima.bogus.com.vmdk +-rw-r--r-- 1 root root 0 Mar 18 2011 hiroshima.bogus.com.vmsd +-rwxr-xr-x 1 root root 3.0k Aug 1 2011 hiroshima.bogus.com.vmx +-rw-r--r-- 1 root root 274 Aug 1 2011 hiroshima.bogus.com.vmxf +-rw-r--r-- 1 root root 160.4k Jul 2 2011 vmware-2.log +-rw-r--r-- 1 root root 266.3k Jul 4 2011 vmware-3.log +-rw-r--r-- 1 root root 119.5k Jul 15 2011 vmware-4.log +-rw-r--r-- 1 root root 106.6k Aug 1 2011 vmware-5.log +-rw-r--r-- 1 root root 47.5k Aug 1 2011 vmware-6.log +-rw-r--r-- 1 root root 47.0k Aug 18 2012 vmware-7.log +-rw-r--r-- 1 root root 45.8k Apr 17 10:44 vmware.log + +linear.algebras.org: +-rw------- 1 root root 1.0G Mar 8 2013 linear.algebras.org-3e70db4c.vswp +-rw------- 1 root root 100.0G Apr 19 00:56 linear.algebras.org-flat.vmdk +-rw------- 1 root root 8.5k Mar 8 2012 linear.algebras.org.nvram +-rw------- 1 root root 482 Mar 8 2012 linear.algebras.org.vmdk +-rw-r--r-- 1 root root 0 Mar 8 2012 linear.algebras.org.vmsd +-rwxr-xr-x 1 root root 2.9k Mar 8 2012 linear.algebras.org.vmx +-rw-r--r-- 1 root root 274 Mar 8 2012 linear.algebras.org.vmxf +-rw-r--r-- 1 root root 57.7k Mar 8 2012 vmware-1.log +-rw-r--r-- 1 root root 60.5k Aug 20 2012 vmware-2.log +-rw-r--r-- 1 root root 95.8k Jan 15 04:00 vmware.log + +nagasaki.bogus.com: +-rw------- 1 root root 2.0G Mar 15 07:21 nagasaki.bogus.com-8a19c006.vswp +-rw------- 1 root root 256.0G Apr 19 00:58 nagasaki.bogus.com-flat.vmdk +-rw------- 1 root root 8.5k Apr 19 00:55 nagasaki.bogus.com.nvram +-rw------- 1 root root 504 Mar 21 2011 nagasaki.bogus.com.vmdk +-rw-r--r-- 1 root root 0 Mar 18 2011 nagasaki.bogus.com.vmsd +-rwxr-xr-x 1 root root 3.3k Mar 15 07:21 nagasaki.bogus.com.vmx +-rw-r--r-- 1 root root 273 Mar 15 07:21 nagasaki.bogus.com.vmxf +-rw-r--r-- 1 root root 113.6k Apr 28 2011 vmware-15.log +-rw-r--r-- 1 root root 85.3k Jul 2 2011 vmware-16.log +-rw-r--r-- 1 root root 54.0k Jul 15 2011 vmware-17.log +-rw-r--r-- 1 root root 54.6k Aug 1 2011 vmware-18.log +-rw-r--r-- 1 root root 57.5k Aug 18 2012 vmware-19.log +-rw-r--r-- 1 root root 130.7k Mar 15 07:19 vmware-20.log +-rw-r--r-- 1 root root 47.2k Mar 15 07:32 vmware.log + +okui.psg.com: +-rw------- 1 root root 1.0G Apr 10 2013 okui.psg.com-22fd1f29.vswp +-rw------- 1 root root 100.0G Apr 19 00:57 okui.psg.com-flat.vmdk +-rw------- 1 root root 8.5k Apr 19 00:36 okui.psg.com.nvram +-rw------- 1 root root 475 Mar 8 2012 okui.psg.com.vmdk +-rw-r--r-- 1 root root 0 Mar 8 2012 okui.psg.com.vmsd +-rwxr-xr-x 1 root root 2.7k Mar 8 2012 okui.psg.com.vmx +-rw-r--r-- 1 root root 267 Mar 8 2012 okui.psg.com.vmxf +-rw-r--r-- 1 root root 55.2k Mar 8 2012 vmware-1.log +-rw-r--r-- 1 root root 59.9k Aug 20 2012 vmware-2.log +-rw-r--r-- 1 root root 270.2k Mar 18 00:36 vmware.log + +r1.securerouting.org: +-rw------- 1 root root 2.0G Apr 10 2013 r1.securerouting.org-66616b62.vswp +-rw------- 1 root root 100.0G Apr 19 00:58 r1.securerouting.org-flat.vmdk +-rw------- 1 root root 8.5k Mar 13 02:28 r1.securerouting.org.nvram +-rw------- 1 root root 483 Jun 14 2011 r1.securerouting.org.vmdk +-rw-r--r-- 1 root root 0 Jun 14 2011 r1.securerouting.org.vmsd +-rwxr-xr-x 1 root root 2.8k Oct 28 2011 r1.securerouting.org.vmx +-rw-r--r-- 1 root root 275 Jun 14 2011 r1.securerouting.org.vmxf +-rw-r--r-- 1 root root 129.9k Jul 10 2011 vmware-1.log +-rw-r--r-- 1 root root 55.6k Jul 15 2011 vmware-2.log +-rw-r--r-- 1 root root 132.2k Oct 28 2011 vmware-3.log +-rw-r--r-- 1 root root 303.8k Jun 15 2012 vmware-4.log +-rw-r--r-- 1 root root 59.0k Aug 18 2012 vmware-5.log +-rw-r--r-- 1 root root 254.3k Mar 13 02:29 vmware.log + +rip1.psg.com: +-rw------- 1 root root 2.0G Apr 9 2013 rip1.psg.com-1bb03eed.vswp +-rw------- 1 root root 36.0G Apr 19 00:58 rip1.psg.com-flat.vmdk +-rw------- 1 root root 8.5k Apr 19 00:32 rip1.psg.com.nvram +-rw------- 1 root root 505 Mar 11 2011 rip1.psg.com.vmdk +-rw-r--r-- 1 root root 0 Mar 11 2011 rip1.psg.com.vmsd +-rwxr-xr-x 1 root root 2.7k Mar 18 2011 rip1.psg.com.vmx +-rw-r--r-- 1 root root 267 Mar 18 2011 rip1.psg.com.vmxf +-rw-r--r-- 1 root root 125.3k Apr 14 2011 vmware-4.log +-rw-r--r-- 1 root root 44.4k Apr 18 2011 vmware-5.log +-rw-r--r-- 1 root root 44.3k Apr 30 2011 vmware-6.log +-rw-r--r-- 1 root root 44.2k Jul 15 2011 vmware-7.log +-rw-r--r-- 1 root root 125.9k Jan 24 2012 vmware-8.log +-rw-r--r-- 1 root root 47.5k Aug 20 2012 vmware-9.log +-rw-r--r-- 1 root root 57.7k Nov 27 2012 vmware.log + +turing.wps.com: +-rw------- 1 root root 2.0G Apr 10 2013 turing.wps.com-2cfaf03a.vswp +-rw------- 1 root root 100.0G Apr 19 00:58 turing.wps.com-flat.vmdk +-rw------- 1 root root 8.5k Apr 19 00:55 turing.wps.com.nvram +-rw------- 1 root root 477 Apr 20 2011 turing.wps.com.vmdk +-rw-r--r-- 1 root root 0 Apr 20 2011 turing.wps.com.vmsd +-rwxr-xr-x 1 root root 2.7k Apr 20 2011 turing.wps.com.vmx +-rw-r--r-- 1 root root 269 Apr 20 2011 turing.wps.com.vmxf +-rw-r--r-- 1 root root 154.1k Apr 29 2011 vmware-1.log +-rw-r--r-- 1 root root 396.1k May 26 2011 vmware-2.log +-rw-r--r-- 1 root root 56.1k Jul 15 2011 vmware-3.log +-rw-r--r-- 1 root root 59.2k Feb 28 2012 vmware-4.log +-rw-r--r-- 1 root root 56.8k Feb 28 2012 vmware-5.log +-rw-r--r-- 1 root root 58.6k Aug 18 2012 vmware-6.log +-rw-r--r-- 1 root root 58.7k Dec 1 10:42 vmware.log + +zzyzx.sigpipe.org: +-rw-r--r-- 1 root root 77.5k Jun 13 2011 vmware-1.log +-rw-r--r-- 1 root root 133.0k Jun 13 2011 vmware-2.log +-rw-r--r-- 1 root root 56.1k Jul 15 2011 vmware-3.log +-rw-r--r-- 1 root root 55.6k Aug 1 2011 vmware-4.log +-rw-r--r-- 1 root root 58.9k Aug 18 2012 vmware-5.log +-rw-r--r-- 1 root root 145.3k Jan 2 18:49 vmware.log +-rw------- 1 root root 2.0G Oct 24 2012 zzyzx.sigpipe.org-45c519e0.vswp +-rw------- 1 root root 100.0G Apr 19 00:58 zzyzx.sigpipe.org-flat.vmdk +-rw------- 1 root root 8.5k Apr 19 00:57 zzyzx.sigpipe.org.nvram +-rw------- 1 root root 480 Jun 13 2011 zzyzx.sigpipe.org.vmdk +-rw-r--r-- 1 root root 0 Jun 13 2011 zzyzx.sigpipe.org.vmsd +-rwxr-xr-x 1 root root 2.8k Jun 13 2011 zzyzx.sigpipe.org.vmx +-rw-r--r-- 1 root root 272 Jun 13 2011 zzyzx.sigpipe.org.vmxf +```