Category: Work

April 20, 2016

The 28 Year Old Rookie

Twice the last two weeks I’ve made the big rookie mistake of train-riding. I’m currently seated on the wrong side of the train, so I either get a delightful glare from the monitor or a face full of sun. By the time I realized (about five seconds) all the correct seats were already gone.

I ended up getting a reasonable amount accomplished today. Nutanix is one staged patch away from being ready, and we have a migration plan ready for tomorrow morning. I’m working on some of those carrots that are viable now, like a new backup target for some hosted web servers. Joining a Linux machine to an AD domain is easier than ever in CentOS 7, and I left off at a good point. Tomorrow I’ll have logons restricted to a security group and sudo restricted to a different one.

I spent my lunch break remoted home, organizing my storage, moving files around to more logical locations, cleaning up names with Filebot, and generally setting this new array up for success. I also downloaded some 250 games between Steam and Origin, and boy am I happy we’re not doing data caps on residential internet yet because that was about a terabyte of data right there.

I’m going to be really happy to have the system back in a usable state. This has been quite the homework project but it was a lot of fun, too. I’m happy I’m going to be able to game again tonight. I’ve got an odd juxtaposition of game styles I want to play. I want to keep playing FIFA 15, I’ve really been enjoying it. But I also want to play something very difficult like an XCOM or Dark Souls. The thing is, they are difficult through entirely different mechanisms. XCOM uses a … (More) “The 28 Year Old Rookie”

April 20, 2016

It’s like 802.1p for your innards.

So I have titles again now, I ran through my countdown (or countup, I suppose) of ten days. No nicotine and I’m over that mental hurdle now of ten days. Truth be told, everything after that jittery first day was easy. I threw away all my remaining gear over the weekend. At this point I’m ready to enter that “I used to” phase of my life and be more selective, if only a little, about what’s coming into my body.

The hard drive saga appears to be laid to rest. The final topology is 4x5TB drives in a RAID 10, with the 128GB SSD still to be swapped out for a larger model. Those replace 2x3TB in a RAID 1 and 2x1TB in a RAID 0. So my usable space has doubled, but it’s all resilient storage. I took one of the 3TB drives and put it in one of the enclosures that the 5TB drives came in, and connected it to the PC over USB 3.0. With write caching enabled, it’s fast enough to be the data store for Steam, even NBA 2K16 didn’t see a change in load times and it’s probably the biggest game I have in terms of shit to load. I took the 1TB drives and fed them to the PowerEdge server, to bring me up to 8x1TB drives which I’m reconfiguring to an 8-drive RAID 10. That leaves one 3TB drive that I’m unsure what to do with. All my Steam and Origin games fit fine on one 3TB drive. And these drives have a 94% failure rate? Nothing important’s going on it, anyway. I’ll think it over.

We also bought a Keurig and a water filter/dispenser deal over the weekend. I didn’t grasp how much I disliked our tap water until we got … (More) “It’s like 802.1p for your innards.”

April 15, 2016


The one day since I started this job that I don’t bring a jacket and it rains. Heh.

Lots of planning on this Read-Only Friday left me with no time for a weekly review. Gotta take care of that now so it doesn’t pile up.… (More) “146/240”

April 15, 2016


So we actually decided “drink more” had some merit. I’m pretty sure I still smell like Texas Roadhouse, but it was a bit of necessary food and booze therapy.

There’s something highly important about a big, sincere laugh. There’s some sort of biochemical thing happening that is needed to re-center yourself. I think so, anyway. And this is not connected to the overly-sappy “Live, Laugh, Love” thing that’s overdone by people that “hate drama.”

Despite a hangover, I feel better than I did the day before, like a clock has been reset, a deadline pushed back just a little bit. It leaves me feeling like I’ll be more able to enjoy Friday and the weekend rather than stagger into it gasping for air.

Nonetheless, I should’ve hydrated a bit better. Oof.

I’ve been feeling like I should switch up my projects on the train, like I should get back into web development. Honestly though, there’s not much I really feel like doing right now. I think it might be more of a general purpose skill improvement I want, to be a better professional. I do have some new books to finish, and the Surface is powerful enough to virtualize a test lab. I have videos to watch, I have a lot of options. I think it might be a desire to not have some skills go stale for lack of use. Web development would be up there, C# and PowerShell are a duo I need to spend more time committing to memory.

If you don’t mind, I’m going to read for a little bit.… (More) “137/240”

April 14, 2016


It felt like a day for action. No reason not to get stuff done today. Turns out, we spent the day waiting on Nutanix to hit us with a fix for our license. They finally delivered 5 minutes before 5:00.

It turned into a day of meetings and planning. Not really what I was going for, but so it goes.

I did take the 9:00 train in to work because last night was one of the most historic nights in NBA history, saying goodbye to an all-timer and closing out a season for the ages. Sports historians will look back on the Warriors offense and conclude that Steph Curry facilitated a style of play as much as any one player has ever done so, outside of Shaq and Wilt.

I spent the morning ride collating and organizing data from a couple of surveys I did at the start of the season. Over/unders for wins and aggregated power rankings. Plenty of people will say the Bulls had the most disappointing season this year, but by the numbers, it’s the Pelicans by a huge margin. They ended up 17.5 games below their Vegas projection. The overachiever was, of course, Portland, at 17.5 games above their projection. And let’s be honest, they have the Clippers in the first round and I wouldn’t laugh you out of the room for saying Portland has a chance to win that series. C.J. McCollum has been a revelation, Damian Lillard is in the conversation for 3rd team All NBA, and the whole team is generally punching above their weight. Just the same, I really liked the makeup of last year’s team, it seemed like such a good blend of people with Batum, Lopez, Matthews, Lillard and Aldridge.

The Spurs ended up with the least lauded 67-win season … (More) “122/240”

April 13, 2016


Imagine my surprise when the Dell guy said he wouldn’t be back tomorrow.

Apparently, when Dell’s project manager told us that he’d be available for three days, it was mostly for if something went absolutely wrong like a show-stopping hardware failure.

Imagine my relief when I don’t need the Dell guy here tomorrow because we’re done.

We got three machines migrated over with vMotion and could’ve snuck in a 4th before the end of the day. I was hoping for one.

I will say, Nutanix and Dell made this really painless, if slightly vague on some particulars. Like, you can’t mix deduplication and compression on a storage container. It’s one or the other. We’re taking dedupe because we work with data that’s largely already compressed, and we run a lot of the same OS. We also ran into a snag with their license server not being able to validate our purchase, which locks us out of RF3 redundancy (RF3 being something like RAID 60 as far as I can tell). It’ll get fixed in a day or so and then we’ll be able to start building a timeline for moving production machines. And the hot vMotion we were hoping for won’t happen because of a CPU architecture mismatch, so it’s gotta be cold. Which is fine, that’s some comp time for later anyway.

I’m like 85% of the way done with a very important slide deck. It needs a few more slides and some decisions answered, and now that we are out of the planning phase and into the doing phase I think we’re going to have a better understanding of our wants versus reality.

Some weeks fly by and some crawl. To get “over the hump” of this particular week feels like an accomplishment. It’s not often you deploy … (More) “98/240”

April 12, 2016


We got Nutanix racked and stacked, powered up, networked, and updating. It’s also the most I’ve walked since I started here by 40% over the next highest day according to my Fitbit. It didn’t seem like that much in the moment, but by 3:30 I was feeling it. It’s about 5 miles of walking, all between two adjacent buildings.

So, a number of things to be thankful for. All the gear is working well. The Dell tech, so far, has been quite good and works well with us. I bought lunch for the team and that went over quite well. No dead drives out of 38 to get started.

Good chance that tomorrow we’ll be out of the setup phase and ready to vMotion some test machines, and seeing if we’ll be able to use Nutanix’s in-built backup utility. The details we got initially aren’t promising on that front, and we may need to spring for Veeam B&R. If we have a VM living on the cluster tomorrow I’ll consider us well ahead of schedule.

I can already tell this week is going to fly by.

I had to put in a change request for a new Software Restriction Policy. The last SRPs I had to deploy were to block CryptoWall. This one is to block Windows 10. Despite a Group Policy named “Do not upgrade to latest versions of Windows”, a registry key named “DisableGWX” (Get Windows X), and a registry key named “DisableOSUpgrades,” I’m still somehow not being clear enough to Microsoft, because new updates are pushing the GWX app anyway.

Our users can’t perform the upgrade themselves anyway, they lack local admin rights to do so. But it still nags the user and basically asks them why their sysadmins are horrible security-haters.

It’s hard to believe that … (More) “74/240”

April 12, 2016


I strongly considered another 45 minutes of sleep this morning, which would’ve left me driving up to work instead of relaxing on the train. I don’t know where this responsible side of me came from but it’s a rather welcome addition.

I only just now found out that the Surface Pro 3 has a default scaling of 150%, when I set that to 100% the blog is tiny as fuck. I think I’ll work on that for the rest of the trip up. I’m going to let this new theme ride for a while and see what I think of it.

I would be more internet-productive if there was any mobile signal out here. I feel like it’s more correct to blame the USB modem here than Verizon, because my phone has signal for 90% of the ride whereas the modem has signal for…maybe 20%. It’s disappointing to say the least. It’s also free, so I can’t complain too loudly.

Nutanix begins about four hours from now. I’ve gotta figure out how Dell is going to get all the gear from my office to the datacenter. Hopefully we can jack a rolling cart or two or three from somewhere.

I have a couple of “soft skills” pieces I’ve been meaning to write for and /r/sysadmin, including one about GTD. I think I’m going to hold off until I finish reading Time Management for System Administrators and see what can be adapted there. I’m a couple chapters in and it seems to be rather heavily inspired by GTD. But, maybe there’ll be something good in here just the same.

The other piece is on the new file server infrastructure, which I might see if CSO Magazine is interested in since this is being built with security in mind first.… (More) “63/240”

April 11, 2016


I really dislike this business of moving offices in the middle of the biggest server implementation in the last five years. Neither us nor the people in the room we’re headed to want to do this right now.

I did manage to snag a pretty sweet 30″ monitor along the way, but I can’t get the full resolution out of it without an adapter. This irritates the piss out of me. The monitor is DVI-D Dual Link. The docking station is also pinned out for DVI-D Dual Link. However, it actually runs as single link, halving the throughput and leaving me with 1/4 of the maximum resolution, so Lenovo could save a quarter on a dock they sell for 300 fucking dollars. This leaves me to have to buy an active DVI-to-DisplayPort adapter for like $125. That’s some shit.

I was pleasantly surprised that I went all day without even the 0mg juice. I might go through a fair amount of chewing gum at this rate, though. Might have to figure out how to buy Doublemint in bulk. Did you notice they stopped the fat packs of gum? Everything’s these slim packs of 15 now, and I swear to god there’s less gum to a stick now, it’s either thinner or smaller, maybe both. I double up on the gum, I’m not a part of your system.

I tuned in to DI today for the first time in ages. They’ve grown up so much, it’s incredible. They also have a lot, and I mean a lot, of advertisements. Pandora seems to have hit on the appropriate price to go ad-free and the number and duration of ads to endure if you’re not a paid subscriber. DI is 40% more, and the ads per hour time is probably six times … (More) “50/240”

April 8, 2016

Transmission Level: Pitino

Yes, a few things got done here and there today, but overall today went beyond mailing it in, towards something like faxing it in. Never really felt 100%, and there just wasn’t much terribly important going on today anyway. Read-only Friday is especially sacred when you’re shorthanded.

We’re moving offices, by all accounts. Going down two floors, getting the entire ops team in one place is a plus, and it puts us right by a little side-door to get in and out quickly. What I don’t get is that this went from concept to “get your shit and get out” in two days. State government is agonizingly slow in so many other ways, why the rush here? I will be more than mildly inconvenienced here; I have a half-dozen servers and some 10GbE switches in my office to be deployed next week. I’m going to try and stall so they only have to get moved once.

Nutanix is about 12 business hours away from reality. I know the team has been fighting for a hyperconverged solution well before I got here, but it’s going to be crazy to finally have it all come together. I hope my systems guy doesn’t think I’m micromanaging by wanting to be in the datacenter when this goes live. Won’t get another chance at a game-changing deployment for five years, I want to be right in the middle of it.

I don’t know if it’s just from lack of sleep but I’ve had this tic in my eye for days. I’m gonna see if I can catch a half hour nap.… (More) “Transmission Level: Pitino”