MagAO-X 2024B Day 20: Sunny Side Up

Today, the night crew from telescope removal day attempted to get back on to a day schedule, which is always so much harder than it sounds. Additionally, we bid farewell to Laird and Jialin! Before he left, Laird gave his stamp of approval towards the state of the instrument after Eden was able to successfully close the loop after we got all the cabling straightened out. Great job everyone who contributed to the DM re-cabling in the clean room, it was perfect the first time…! (I think it was Eden, Katie, Parker, and Jialin)

After all of the major parts of MagAO-X passed initial testing, it was time for me and Parker to shine with some much-needed plumbing maintenance for our computers in the electronics rack.

The frustrating thing that keeps happening is that some variety of slime mold or bacteria keeps accumulating in and around the heatsinks in the CPUs and GPUs and causing embolisms to form in the glycol tubing network after some months of operation. Until we get a permanent handle on this phenomenon, we have to back flush the various components that are most affected. To do this right, we removed the glycol filter and found it pretty caked with that nasty slime mold stuff, which required cleaning to avoid causing a straight up clog if/when we dislodged bigger pieces during the flush procedure.

We report that the plumbing maintenance was a success and saw at least one very large clot get dislodged from one of RTC’s GPUs (oddly satisfying). We cleaned the filter again, for good measure, and confirmed the system was performing as expected. Hopefully we’re good until the next run!

Meanwhile our Leiden colleagues were living it up in the glamorous LATAM lounge at SCL. Sebastiaan looking more less healed and photogenic as ever after a restful night of sleep at the apartments at El Pino.

As is the tradition, we couldn’t miss tonight’s sunset, but in front of the cleanroom this time. ‘Cause at night, the sun in retreat, made the skyline look like crooked teeth.

Bonus Content

There isn’t a whole lot of technical stuff going on these days with the observing run over and the rest of us just counting down the hours until our departure. There has been a lot of discussion about lucid dreaming and dreaming in general this run so I thought I’d share one of my recent dreams from a couple nights ago. This was undoubtedly inspired by Joseph’s fun trip down midway through the run to go see the penguins where he brought up some groceries to resupply our dwindling Snack Stack. Among these items, was the biggest, most beautiful bottle of Benedictino I’ve seen in a long time. For those who are out of the loop, we recently got our most precious bottles of fizzy water (Benedictino) replaced by a generic brand of agua con gas for sustainability, as these new bottles are reuseable and hold a lot more drink. This is obviously an admirable move, I mean, think of all the Benedictino bottles at the bottom of the ocean, but still, it’s not the same, man. And we’ve really been missing this brand of fizzy water.

The dream went something like this:

I was just finishing up dinner at the lodge and on my way to bringing my tray back to the dish pit, when something in the reach-in cooler where the soda bottles are kept caught my eye and hit me like those first rays of sunlight hitting your face after emerging from a dark cave. There was absolutely nothing in this fridge *except* a freakishly large bottle of unopened Benedictino fizzy water. And lucid me decided it was about to be all mine.

The light inside the fridge glowed a ghostly white and blanked out everything else around me, and the Benedictino sparkled as if it were a holy deity sitting before me. Every one of my heartbeats pounded through my body like the distant firing of 19th-century cannons as I twisted off the cap and watched it fall from my nerveless fingers silently into the dark abyss. I grabbed the bottle like an ancient artifact and, with trembling hands, slowly raised it to my lips where I was met with the intoxicating aroma of atomized carbonic acid. Tilting my head back, the fizzy water began its descent into my stomach in a raging whirlpool as the bottle began to rapidly shed its weight. Closing my eyes, a spotlight shone onto me as my mind thundered with horns sounding victory and the cheering of an invisible crowd. Lowering my head back down, I was met with the gaze of an enormous condor perched on the outdoor patio, a cheese empanada clutched in one talon and bottle of orange Fanta in the other, and saw the reflection of the Chilean flag in its predatory eyes. It nodded in approval and with a screech, flew off toward the Magellan telescopes guided by the light of the setting November sun. I looked down to the previously full gallon-sized bottle of Benedictino to find it entirely empty. 10/10 dream.

Song of the Day

MagAO-X 2024B Day 12: Manqui Moon

It’s time to finally call off the searches everyone. Tie up your bloodhounds, turn off those spotlights, and park your helicopters. That’s right, the mountain’s most infamous instrument has been located after eons of searching high and low.

There were fears that MagAO’s near-IR camera, Clio, had been sentenced to the boneyard to peacefully decay as the many instruments before it. However, despite being undoubtedly still weary from her travels, Alycia generously gave the students a nice tour of the DuPont telescope (a.k.a., the 100″) just down the road from the Magellans where they found our Clio and drew collective sighs of relief from all who were around during the golden MagAO days.

Day break, too much light for sleepy eyes

And here it is! The Great Clio! Ready to be born again on another 6.5-meter telescope…!

A special thanks to Prof. Ewan Douglas of Steward Obseratory’s UASAL who was a critical part of Clio’s rediscovery. No need to be humble, Ewan.

Yeah, man. So, after the tour, some of the group decided to make use of some extra time before dinner to prepare for the MagAO-X telescope removal. This Chilean iron is extra dense, I’ll you what. But this dry air will make you soft, so we push on.

Thanks, Elena for serenading us during our workout. Those high notes absolutely helped us push out a couple more reps!

After dinner, Laird, Alycia, and received a nice tour from the LLAMAS team who showed us how the instrument was mounted and talked a little bit about how it all the various systems and mounting fixtures work. 1700 kgs of pure instrumental awesomeness.

The underside of the LLAMAS instrument showing the complicated, but organized network of glycol tubes responsible for the temperature management of the cameras. They use a glycol concentration of 25%, and claim that the glycol should never need to be changed. They also allegedly add a biofilm inhibitor of some sort. Maybe we should try that out?

Some of us got heartier meals for our night lunches than others. Parker’s Pro Tip of the Day is write “extra everything, times ten” on the comment section of your night lunch form to get the homie hookup from the kitchen.

A major milestone in MagAO-X’s career as an extreme AO instrument, Sebastiaan et al. have successfully implemented wavefront sensing and control using a neural network on-sky…! We’ve been learned, people.

In other engineering news, Jared and Eden and I got a 5kHz LOWFS loop locked on one of Sebastiaan’s target for some kick-ass vibration control. Whatcha know ’bout jitter?

Ok, there was actually a lot more that went on tonight, such as Team Jaylycia getting some pro-level data on an edge-on disk. Again, testing the altitude limits of the telescope and the instrument. And probably even more to report on, but we’re pretty…

In a daydream until darkness falls

…sleepy. However, I’ve got one more moment to highlight, as it was the sweetest gesture and gift I’ve received as a direct result of being peanutted. Yeah, somehow peanuts got into my tuna + rice tonight (it was literally just some rice and tuna/shrimp in a white cream sauce) and I took a nasty hit to my health bar. However, one Zyrtec and a bunch of crackers and soda helped me recover enough HP to make it through the rest of the night. Because of this experience, Johnson “The Hook” Johnson crocheted me a “J” protection charm to wear to commemorate my survival. Thanks, man. I owe you some milk.

Song of the Day

I’ve been really into this song during this run. This one really deserves a listen, not only because you all need to see that Warren’s long lost twin brother is a guitar virtuoso, but this guy also pairs one of my favorite music genres (percussive fingerstyle guitar) with a killer voice. Some lyrics found in the body of the post above.

MagAO-X 2024B Day 2: Smooth Sailing

So far, Laird and Sebastiaan have been doing an excellent job directing the in-person crew and we’ve made great progress towards the many tasks that needed to be done before the start of the big move on Wednesday.

Here, we see a lot of the team watching and learning during Tuesday morning’s initial alignment procedures as we prepare to install all the fancy new Lyot and focal plane masks brought down from Tucson.

The first optomechanical task of the day was to install the special masks for the new self-coherent camera. Check out the pinhole on the very upper edge of the mask when held up to Eden’s computer screen! That little pinhole, we’ve since learned, is the key for fancy new speckle-nulling strategies, like Coherent Differential Imaging. Sebastiaan’s and Parker’s faces says it all

… and after a bit of alignment work from the team, the mask is aligned!

Here is the result: there are fringes on the camsci images indicating that light from the pinhole is interfering with the light that transmits through the Lyot stop. Neat! If I were a quasistatic speckle I’d sure be sweating right now.

We broke for lunch and afterwards, it was time to finish up other miscellaneous tasks such as some interior cable organization, reconfiguring the power pathways for the Zaber stages, and squashing some LED lights inside the instrument.

We were initially just assigned the Suzuki for Clay observers “Lil Red” for our daily needs but we quickly realized that our transportation needs weren’t being met. After an email or two, we got permission to use one of the Suzuki Jimnys a.k.a. one of the super cool, white Jurassic Park-looking cars. Score!

One of the smaller tasks of the day was installing a small cable tray inside MagAO-X to help tidy up some of the pico motor cabling we had installed last month during the engineering run. These plastic trays required some slight modifications, which required a trip to the machine shop in the ASB. It’s not often any of us find our way in here, so it was cool to see…!

We had some time after dinner to enjoy the fading of the evening sunlight. some of us drove, some walked, and one of us ran.

From the Rocky Theme Song. We were attempting to do some vizzy spotting on the north slope of the telescope summit with P. Johnson who suddenly looked like he saw a ghost after looking at his phone. We asked what was wrong since this caught all of our attention and he, with a slight mumble of “Jared wants me…!”, ran off into the setting sun. So, when you’re checking out the telescope summit and you get a Slack message from Jared saying it’s time to Zoom, you best start zooming son.


Trying hard now
It’s so hard now
Trying hard now

Getting strong now
Won’t be long now
Getting strong now

Gonna fly now
Flying high now
Gonna fly, fly, fly…

I think we spent at least a couple of minutes talking to a Parker-shaped cloud before we realized what happened. Dude is fast, man.

These summer sunsets are great. Hasta mañana.

Song of the Day

MagAO-X Engineering Run 2024B Day 4: Well, it wasn’t lupus

Today is still ongoing, as I write this blog post at 1 am. I’m currently holed up in the library at the ASB writing my butt off for this 51 Peg proposal. It’s basically like 12-16 pages of highly polished material that they’re requesting for the application, so it’s a lot of work. To keep my morale up, Warren made sure I could read all about our avian brethren that live in the Argentinian region of South America by finding this in one of the many bookcases.

Lunch today consisted of some interesting Chilean-Japanese fusion. I grabbed the “pastel de choclo” which is like a shepherd’s pie, but with a corn topping instead of mashed potatoes. They also had vegetable tempura. This tourno of chefs is killing it, man.

After lunch we returned to our regular duties. However, before dinner we stumbled on an annular eclipse, so we had to go out and check it out. Apparently totality is happening directly over Easter Island, which honestly sounds like a religious experience. Well we here at LCO we ended up getting something like a 30% eclipse. Better than nothing…!

In MagAO-X engineering news…

We got a chance to admire the fruits of our alignment labors last night. A PSF comparison between camsci1 and camllowfs. We want these to look similar, indicating good alignment. So it’s looking good!

Stay hydrated, eat your green vegetables, and align optics. Do those everyday, and you’ll be alright.

We had trouble measuring some optics. Inches were too fractional we couldn’t find any metric calipers. We present a new unit of measurement for the lab: a micromaggie, which is 6.75e-7 inches or like 2 microns or something. Much more useful and reliable.

ICC2 has been sick. In fact, this morning we awoke to it looking almost terminally ill. It wouldn’t boot to the OS and just kept getting stuck at the BIOS, despite working relatively fine the day before. Although it was having trouble recognizing hard drives before it got super sick, usually a reset was enough to fix everything.

Luckily, we got our best doctors on the case (Jared and Joseph). Despite the confusing symptoms and near-death experience, ICC2 managed to make a full recovery once Jared and Joseph found the right treatment for the ailment. I’ve been watching old episodes on House M.D. lately, so I’ve almost been picturing the legendary Dr. House and Wilson themselves working on ICC2.

I think it would’ve made for a great episode! Maybe you’d all like to know- it wasn’t lupus that was making ICC2 sick. Although, it’s *never* lupus…

Song of the Day

I was going to pick Massive Attack’s “Teardrop”, initially released in 1998 because of the House M.D. analogy. But I’m pretty tired. And I think everyone else is too especially after a couple back-to-back 16 hour shifts. So maybe Brain Stew by Green Day better captures the mood here.

Initially released in 1995.

MagAO-X Engineering Run 2024B Day 0: A Hero’s Journey to LCO

Let me tell you about our trip.

Jared and I were scheduled to leave on Thurs. 09/27, however our Tucson flight was delayed to the point where we would have missed our ATL-SCL connection, so we got the opportunity to rebook. Whether or not this was due to Hurricane Helene, we’re not sure. Because ATL-SCL on 09/27 left on time, more or less, despite being closer in time to peak hurricane’ing. Our original TUS-ATL flight arrived about 3 minutes before the plane to Santiago left the runway, so all in all, it was the right move to rebook.

Because we rebooked, the revised departure date was the next day, Friday 09/28. By about 9a on Friday, the flight was already delayed by 20 minutes (we thought: “here we go again”), but thankfully the delayed departure time didn’t change again…. all the way until the VP landed in TUS which (we painfully learned) shuts down the whole airport for half an hour. This new delay was coupled by the plane being overweight as well because of the unseasonably hot tarmac temperatures this late into September. So, the poor souls on standby who got onto the plane had to be escorted right back off to bring the curb weight of the plane down. After all that, we departed TUS *finally* at around 2:10p, a final delay of about 1hr 20mins. We were set to arrive at ATL by 8:15p EST at Terminal B. Our ATL–SCL flight was set to depart right at 8:55p, from Terminal… E….

This is NOT Air Force Two, but it was close to the airport, so, possibly related.
Cue the Mario star powerup music
Y’all ever see “Yes Man” with Jim Carrey? Maybe the group that practices running photography was onto something, this is pretty fun.

We ended up making it with mere seconds to Gate E14, but Delta misjudged our dedication (and ability to sprint) and automatically rebooked us to fly to Santiago the next day while we were still en route to ATL. After a few tense minutes, however, the gate agents were able to get us back on our original flight and thankfully they didn’t close the door on us as it was definitely after 8:40p by this point. After taking our seat, we left the ground a few minutes after 8:55p.

We landed at SCL without incident but about ten minutes past 7a local time. Normally not such a big deal, but because we had gotten rebooked initially, our new flight out SCL–LSC was at 9a on the dot. The line to get through customs was, of course, super long. We finally got through at 7:55a. Boarding began at 8a, so, more running…!

SCL has also moved the security checkpoint to near the LATAM check-in desks. Again, normally not such a big deal, but Jared was never given a boarding pass when we deplaned out flight from ATL, so he had to get one reprinted before we could get through security. It was 8:34a.

Boarding doors close at 8:45! and the B gates were, no joke, like a third of a mile from the security check point.

We. Just. Made it…!

After taking the transport up from La Serena (and sleeping for most of it), we were just in time for lunch and were greeted by some familiar views.

Truth be told, after all the delays and setbacks and just plain bad luck, I never thought we’d make it this far.

Bonus Content

For today’s Bonus Content we were greeted by a ravenous goaty parade at sunset…! This made for many, many small “landmines” when walking down later that evening in the dark. Make sure you wipe your shoes extra good before entering your room during goat season.

Blog Rule

Short trip, simple rule. The blog writer must pick the Song of the Day from the assigned decade below:

Day 0: 1950s
Day 1: 1960s
Day 2: 1970s
Day 3: 1980s
Day 4: 1990s
Day 5: 2000s
Day 6: 2010s
Day 7(?): 2020s

Song of the Day

The song of the day is Frank Sinatra’s “Come Fly with Me”, originally released in 1958.